Preslav Nakov - The Web as a Training Set Part 3
Download as PPTX, PDF1 like415 views
The document discusses the future advancements in semantics and machine translation, emphasizing the need for a revolution in semantics to move beyond superficial statistics and better understand multi-word expressions and semantic relations. It highlights the significant past revolutions in machine translation, pointing to the potential for a new revolution driven by deep neural networks. The text also raises concerns about the implications of artificial intelligence and its potential threats to humanity.
![5
Semantics: Revolution is Needed?
• If we want the dream come true, we should
– not rely on superficial statistics alone
– need to get to the meaning of text
• A revolution in semantics is needed
– looking at words is not enough
– we need better models for
• multi-word expressions (~70% of terminology)
• semantic relations (meaning is in the links!)
• The revolution will be supported by
– Web-scale corpora
– linguistic knowledge
“Moving Lexical Semantics
from Alchemy to Science”
Discussion on [Corpora-List]
• This is what Chomsky has
done with syntax.
• Should we expect the same
for lexical semantics?](https://image.slidesharecdn.com/nakovtalkdsspart3-150906162649-lva1-app6891/85/Preslav-Nakov-The-Web-as-a-Training-Set-Part-3-5-320.jpg)
Preslav Nakov - The Web as a Training Set Part 3
- 1. The Future
- 2. 2 The Big Dream (once again) Dave Bowman: “Open the pod bay doors, HAL” HAL 9000: “I’m sorry Dave. I’m afraid I can’t do that.”
- 3. 3 Two Important Directions We Touched • Semantics • Machine Translation Critical for the overall advancement of the field Practical, within the reach of current technology
- 4. 4 Two Important Directions We Touched •Semantics • Machine Translation
- 5. 5 Semantics: Revolution is Needed? • If we want the dream come true, we should – not rely on superficial statistics alone – need to get to the meaning of text • A revolution in semantics is needed – looking at words is not enough – we need better models for • multi-word expressions (~70% of terminology) • semantic relations (meaning is in the links!) • The revolution will be supported by – Web-scale corpora – linguistic knowledge “Moving Lexical Semantics from Alchemy to Science” Discussion on [Corpora-List] • This is what Chomsky has done with syntax. • Should we expect the same for lexical semantics?
- 6. 6 NAACL’2015: Accept/Reject by Area 0 10 20 30 40 50 60 70 80 90 100 Semantics NLP for Web and Social Media and Social… Machine Translation Information Extraction and Question Answering Tagging and Chunking and Syntax and Parsing Machine Learning for NLP Generation and Summarization Language Resources and Evaluation Text Categorization and Topic Models Sentiment Analysis and Opinion Mining Phonology and Morphology and Word… Spoken Language Processing Discourse and Pragmatics NLP-enabled Technology Linguistic and Psycholinguistic Aspects of CL Dialogue and Interactive Systems Information Retrieval Language and Vision Semantics has emerged from a marginal to a dominant position.
- 7. 7 Two Important Directions We Have Touched • Semantics •Machine Translation
- 8. 8 Machine Translation: Revolution? • Revolution? – Two great revolutions so far • 1993: statistical word-based translation • 2003: statistical phrase-based translation
- 9. 9 Machine Translation: Revolution? • Revolution? – Two great revolutions so far • 1993: statistical word-based translation • 2003: statistical phrase-based translation – Overdue for the next revolution? • 2013: ??? – Syntactic translation? – Semantic translation? SOURCE TARGET words words syntax syntax semantics semantics interlingua phrases phrases
- 10. 10 Machine Translation: Revolution? • Revolution? – Two great revolutions so far • 1993: statistical word-based translation • 2003: statistical phrase-based translation – Overdue for the next revolution? • 2014: revolution in progress? Deep neural networks – the new revolution: • Speech recognition • Machine translation • Semantics BUT can they: - scale to the Web? - model linguistic structure - handle MWEs - use linguistic knowledge
- 11. 11 The Future? Three words: Web, semantics, linguistics and deep neural networks?
- 29. 29 The Future is Now? • Books - Algorithm by Philip Parker, Insead o 1,000,000+ books generated o 100,000+ being sold at Amazon • Robo journalism - tons of articles generated today - by 2025, can cover 90% • What is next - Fake reviews? - Computers mining text written by other computers? - From Computational to Computer Linguistics? - …
- 31. 31 Hiroshima & Nagasaki • 26/07/1945: Potsdam declaration was an ultimatum to Japan: capitulate or face “prompt and utter destruction” • Japan’s prime minister Kantaro Suzuki at a press-conference: “No comment. We keep discussing.” • He used the word mokusatsu, which can mean (a) no comment, or (b) we reject. • 10 days later…
- 32. 32 The Future? Will the next nuclear war start because of a computer translation?
- 33. 33 Moore’s Law: in 10 years… Can NNs scale?
- 34. 34 In 17 years: More Robots than Humans!
- 35. 35 Maybe you do not believe it...
- 36. 36
- 37. 37 Artificial Intelligence as a Threat “The development of full artificial intelligence could spell the end of the human race.” Stephen Hawking “I am in the camp that is concerned about super intelligence. ...and don't understand why some people are not concerned..” Bill Gates “I think we should be very careful about artificial intelligence. If I had to guess at what our biggest existential threat is, it’s probably that.” Elon Musk (donated $10 million to Future of Life Institute)
- 39. 39 The Future?
- 40. 40 The Future?
- 41. 41