Language and AI: Hacking Humanity's Greatest Invention
Download as PPTX, PDF0 likes437 views
The document discusses the evolution of language, its impact on human development, and the advancements in artificial intelligence related to language processing. It outlines historical events such as human migrations and the extinction of several human species, highlighting language as a key factor in human survival and growth. Additionally, it reviews the progression of machine translation and deep learning technologies from the mid-20th century to recent developments in AI language models like GPT-2.
Language and AI: Hacking Humanity's Greatest Invention
- 1. Language and AI: Hacking Humanity’s Greatest Invention Steve Omohundro, Ph.D. Chief Scientist, AIBrain http://googleresearch.blogspot.com/2015/06/inceptionism-going-deeper-into-neural.html
- 2. We Almost Went Extinct https://www.flickr.com/photos/breenjones/6226950967/
- 3. 70,000 Years Ago: Just 5,000 of Us https://www.npr.org/sections/krulwich/2012/10/22/163397584/how-human-beings-almost-vanished-from-earth-in-70-000-b-c https://www.flickr.com/photos/carsten_tb/35287549266/
- 4. 27 Other Species of Human Went Extinct https://www.amazon.com/Last-Ape-Standing-Seven-Million-Year-Survived-ebook/dp/B009K4YLU2/ref=sr_1_1 https://www.flickr.com/photos/gianfrancogoria/3766258280/
- 7. Language Emerges Bottom-Up, https://www.flickr.com/photos/dkit/3659315187/ But Creates Rules, Grammars, and Logics that Appear to be Top-Down https://www.amazon.com/Evolution-Everything-How-Ideas-Emerge-ebook/dp/B00U1T9OSO/ref=sr_1_1
- 10. Teaching Rules Top-Down Doesn’t Work Well https://www.amazon.com/Comprehensive-Grammar-English-Language-General/dp/0582517346/ref=pd_sbs_14_1/139-0790829-4747552
- 11. 1954: First Machine Translation System – Georgetown-IBM https://en.wikipedia.org/wiki/Georgetown%E2%80%93IBM_experiment
- 12. Recursive Translation: English->Russian->English https://www.flickr.com/photos/hyshqa/2443564617/ "Out of sight, out of mind" -> "Blind Idiot" https://tvtropes.org/pmwiki/pmwiki.php/Main/BlindIdiotTranslation
- 13. https://www.flickr.com/photos/hyshqa/2443564617/ “The spirit is willing but the flesh is weak” -> https://www.snopes.com/fact-check/quality-is-the-first-occupation/ “The vodka is strong but the meat is rotten”
- 14. 1984: CYC Project 35 Years, Hundreds of People, 1.5 million terms in the Ontology http://www.cyc.com/kb/
- 15. 1990’s: Ngram Statistical Translation http://michaelnielsen.org/blog/introduction-to-statistical-machine-translation/ “Rather than argue about whether this algorithm is better than that algorithm, all you have to do is get ten times more training data. And now all of a sudden, the worst algorithm … is performing better than the best algorithm on less training data. Worry about the data first before you worry about the algorithm.” — Peter Norvig, Director of Research at Google
- 16. 2009: Deep Learning Successes https://en.wikipedia.org/wiki/Deep_learning 2009 Speech Recognition TIMIT: Cortana, Skype, Google Now, Siri, Baidu, Nuance, etc. 2012 Image Recognition ImageNet 2012 Drug Discovery Merck Challenge 2013 Natural Language Sentiment 2014 Image Captioning 2014 Natural Language Translation 2015 Atari Video Games DeepMind
- 17. 2018: ELMo, BERT, and GPT-2 https://allennlp.org/elmo Great Open Source Trained Language Models to Build on: June 2018: AllenNLP ELMo November 2018: Google BERT February 2019: OpenAI GPT-2 https://github.com/google-research/bert https://github.com/openai/gpt-2
- 18. AIBrain: Augmented Intelligence https://aibrain.com/ Augmented Learning Augmented Memory Augmented Emotional Intelligence Augmented Social Media Augmented Gamification Augmented Sports Learning Augmented Psychological Growth
- 19. Let the Hacking Begin! https://spiritualmusclehead.files.wordpress.com/2014/11/justice.jpg