Helping Computers Find Meaning they Lost in Translation
Download as PPTX, PDF2 likes428 views
The document discusses the challenges and methodologies behind machine translation and human interaction in language processing, as presented by Katie Kuksenok, a PhD student in computer science at the University of Washington. It explores concepts such as interactive machine translation, human computation, and the importance of data-driven approaches to improve translation accuracy. The document emphasizes the collaboration between humans and machines to enhance understanding in translation tasks.
![Human Computation
source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía.
initial Saw a vixen the hungry crow been in the fig tree, and asked you why did.
reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did.
reorder [a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did.
retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did.
retype A vixen {saw} the hungry crow been in the fig tree, and asked you why did.](https://image.slidesharecdn.com/20120308engage-150826212743-lva1-app6891/85/Helping-Computers-Find-Meaning-they-Lost-in-Translation-38-320.jpg)
![Human Computation
source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía.
initial Saw a vixen the hungry crow been in the fig tree, and asked you why did.
reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did.
reorder [a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did.
retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did.
retype A vixen {saw} the hungry crow been in the fig tree, and asked you why did.
delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did.
delete A vixen saw the hungry crow in the fig tree, and asked [you] why did.
replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did.](https://image.slidesharecdn.com/20120308engage-150826212743-lva1-app6891/85/Helping-Computers-Find-Meaning-they-Lost-in-Translation-39-320.jpg)
![Human Computation
source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía.
initial Saw a vixen the hungry crow been in the fig tree, and asked you why did.
reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did.
reorder [a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did.
retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did.
retype A vixen {saw} the hungry crow been in the fig tree, and asked you why did.
delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did.
delete A vixen saw the hungry crow in the fig tree, and asked [you] why did.
replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did.
retype A vixen saw the hungry crow in the fig tree, and asked {why} was he doing did.
reorder A vixen saw the hungry crow in the fig tree, and asked why [he] was [he] doing did.
retype A vixen saw the hungry crow in the fig tree, and asked why he was {there} did.
delete A vixen saw the hungry crow in the fig tree, and asked why he was there [did].
final A vixen saw the hungry crow in the fig tree, and asked why he was there.](https://image.slidesharecdn.com/20120308engage-150826212743-lva1-app6891/85/Helping-Computers-Find-Meaning-they-Lost-in-Translation-40-320.jpg)
![Human Computation
source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía.
initial Saw a vixen the hungry crow been in the fig tree, and asked you why did.
reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did.
[a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did.
retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did.
A vixen {saw} the hungry crow been in the fig tree, and asked you why did.
delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did.
A vixen saw the hungry crow in the fig tree, and asked [you] why did.
replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did.
retype A vixen saw the hungry crow in the fig tree, and asked {why} was he doing did.
reorder A vixen saw the hungry crow in the fig tree, and asked why [he] was [he] doing did.
retype A vixen saw the hungry crow in the fig tree, and asked why he was {there} did.
delete A vixen saw the hungry crow in the fig tree, and asked why he was there [did].
final A vixen saw the hungry crow in the fig tree, and asked why he was there.
x 100](https://image.slidesharecdn.com/20120308engage-150826212743-lva1-app6891/85/Helping-Computers-Find-Meaning-they-Lost-in-Translation-41-320.jpg)
![Human Computation
x 100…
= Human Insight as Data
source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía.
initial Saw a vixen the hungry crow been in the fig tree, and asked you why did.
reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did.
[a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did.
retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did.
A vixen {saw} the hungry crow been in the fig tree, and asked you why did.
delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did.
A vixen saw the hungry crow in the fig tree, and asked [you] why did.
replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did.
retype A vixen saw the hungry crow in the fig tree, and asked {why} was he doing did.
reorder A vixen saw the hungry crow in the fig tree, and asked why [he] was [he] doing did.
retype A vixen saw the hungry crow in the fig tree, and asked why he was {there} did.
delete A vixen saw the hungry crow in the fig tree, and asked why he was there [did].
final A vixen saw the hungry crow in the fig tree, and asked why he was there.](https://image.slidesharecdn.com/20120308engage-150826212743-lva1-app6891/85/Helping-Computers-Find-Meaning-they-Lost-in-Translation-42-320.jpg)
![Human Computation + Translation
How can we
capture the
editing process ?
source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía.
initial Saw a vixen the hungry crow been in the fig tree, and asked you why did.
reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did.
[a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did.
retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did.
A vixen {saw} the hungry crow been in the fig tree, and asked you why did.
delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did.
A vixen saw the hungry crow in the fig tree, and asked [you] why did.
replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did.
retype A vixen saw the hungry crow in the fig tree, and asked {why} was he doing did.
reorder A vixen saw the hungry crow in the fig tree, and asked why [he] was [he] doing did.
retype A vixen saw the hungry crow in the fig tree, and asked why he was {there} did.
delete A vixen saw the hungry crow in the fig tree, and asked why he was there [did].
final A vixen saw the hungry crow in the fig tree, and asked why he was there.](https://image.slidesharecdn.com/20120308engage-150826212743-lva1-app6891/85/Helping-Computers-Find-Meaning-they-Lost-in-Translation-45-320.jpg)
Helping Computers Find Meaning they Lost in Translation
- 1. Helping Computers Find Meaning They Lost in Translation Katie Kuksenok UW Science Now! University of Washington March 8, 2012
- 2. Hi! I’m Katie! Computer Science and Engineering PhD student How people interact with computers Richness of written language
- 8. Machine Translation ----------------- ----------------- ----------------- ----------------- ----------------- --------- translation Source language Target language
- 9. Machine Translation + Interaction ----------------- ----------------- ----------------- ----------------- ----------------- --------- translation reading Source language Target language
- 10. Machine Translation + Interaction ----------------- ----------------- ----------------- ----------------- ----------------- --------- editing translation reading Source language Target language
- 11. Machine Translation + Interaction ----------------- ----------------- ----------------- ----------------- ----------------- --------- editing translation reading Source language Target language
- 14. Artificial Intelligence …where to begin? What would a person do? How can we describe that to a computer?
- 16. Did it work?
- 17. Did it work? The spirit is willing, but the flesh is weak
- 18. Did it work? The spirit is willing, but the flesh is weak (Russian)
- 19. Did it work? The spirit is willing, but the flesh is weak The vodka is good, but the meat is rotten (Russian)
- 21. Rosetta Stone ?
- 22. Translate this: Source farok crrrok hihok yorok clok kantok yurp Target ____ ____ _____ _____ ____ ______ ___
- 23. Translate this: Source farok crrrok hihok yorok clok kantok yurp Target ____ ____ _____ _____ ____ ______ ___ Source wiwok farok izok stok Target sus clientes estan enfadados Source lalok farok ororok lalok sprok izok enemok Target los clientes y los asociados son enemigos Based on 2 parallel pairs:
- 24. Source wiwok farok izok stok Target sus clientes estan enfadados Source lalok farok ororok lalok sprok izok enemok Target los clientes y los asociados son enemigos Translate this: Source farok crrrok hihok yorok clok kantok yurp Target ____ ____ _____ _____ ____ ______ ___ Based on 2 parallel pairs:
- 25. Source wiwok farok izok stok Target sus clientes estan enfadados Source lalok farok ororok lalok sprok izok enemok Target los clientes y los asociados son enemigos Translate this: Source farok crrrok hihok yorok clok kantok yurp Target ____ ____ _____ _____ ____ ______ ___ Based on 2 parallel pairs:
- 26. Source wiwok farok izok stok Target sus clientes estan enfadados Source lalok farok ororok lalok sprok izok enemok Target los clientes y los asociados son enemigos Translate this: Source farok crrrok hihok yorok clok kantok yurp Target ____ ____ _____ _____ ____ ______ ___ Based on 2 parallel pairs: clientes
- 27. Machine Learning Statistics + Data = Surprisingly Good Results More Data + Better Data = Better Results
- 28. DATA
- 29. Statistical Machine Translation state of the art
- 30. 1954 1966 1991 2012
- 32. How do people learn different languages? By Instruction? By Example?
- 33. By Failing
- 37. Human Computation source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía. initial Saw a vixen the hungry crow been in the fig tree, and asked you why did.
- 38. Human Computation source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía. initial Saw a vixen the hungry crow been in the fig tree, and asked you why did. reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did. reorder [a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did. retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did. retype A vixen {saw} the hungry crow been in the fig tree, and asked you why did.
- 39. Human Computation source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía. initial Saw a vixen the hungry crow been in the fig tree, and asked you why did. reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did. reorder [a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did. retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did. retype A vixen {saw} the hungry crow been in the fig tree, and asked you why did. delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did. delete A vixen saw the hungry crow in the fig tree, and asked [you] why did. replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did.
- 40. Human Computation source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía. initial Saw a vixen the hungry crow been in the fig tree, and asked you why did. reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did. reorder [a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did. retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did. retype A vixen {saw} the hungry crow been in the fig tree, and asked you why did. delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did. delete A vixen saw the hungry crow in the fig tree, and asked [you] why did. replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did. retype A vixen saw the hungry crow in the fig tree, and asked {why} was he doing did. reorder A vixen saw the hungry crow in the fig tree, and asked why [he] was [he] doing did. retype A vixen saw the hungry crow in the fig tree, and asked why he was {there} did. delete A vixen saw the hungry crow in the fig tree, and asked why he was there [did]. final A vixen saw the hungry crow in the fig tree, and asked why he was there.
- 41. Human Computation source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía. initial Saw a vixen the hungry crow been in the fig tree, and asked you why did. reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did. [a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did. retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did. A vixen {saw} the hungry crow been in the fig tree, and asked you why did. delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did. A vixen saw the hungry crow in the fig tree, and asked [you] why did. replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did. retype A vixen saw the hungry crow in the fig tree, and asked {why} was he doing did. reorder A vixen saw the hungry crow in the fig tree, and asked why [he] was [he] doing did. retype A vixen saw the hungry crow in the fig tree, and asked why he was {there} did. delete A vixen saw the hungry crow in the fig tree, and asked why he was there [did]. final A vixen saw the hungry crow in the fig tree, and asked why he was there. x 100
- 42. Human Computation x 100… = Human Insight as Data source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía. initial Saw a vixen the hungry crow been in the fig tree, and asked you why did. reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did. [a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did. retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did. A vixen {saw} the hungry crow been in the fig tree, and asked you why did. delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did. A vixen saw the hungry crow in the fig tree, and asked [you] why did. replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did. retype A vixen saw the hungry crow in the fig tree, and asked {why} was he doing did. reorder A vixen saw the hungry crow in the fig tree, and asked why [he] was [he] doing did. retype A vixen saw the hungry crow in the fig tree, and asked why he was {there} did. delete A vixen saw the hungry crow in the fig tree, and asked why he was there [did]. final A vixen saw the hungry crow in the fig tree, and asked why he was there.
- 43. DATA
- 44. DATA Human Insight as Data
- 45. Human Computation + Translation How can we capture the editing process ? source Vio una zorra al hambriento cuervo eternizado en la higuera, y le preguntó qué hacía. initial Saw a vixen the hungry crow been in the fig tree, and asked you why did. reorder [vixen] Saw a [vixen] he hungry crow been in the fig tree, and asked you why did. [a] vixen Saw [a] the hungry crow been in the fig tree, and asked you why did. retype {A} vixen Saw the hungry crow been in the fig tree, and asked you why did. A vixen {saw} the hungry crow been in the fig tree, and asked you why did. delete A vixen saw the hungry crow [been] in the fig tree, and asked you why did. A vixen saw the hungry crow in the fig tree, and asked [you] why did. replace A vixen saw the hungry crow in the fig tree, and asked [what was he doing] did. retype A vixen saw the hungry crow in the fig tree, and asked {why} was he doing did. reorder A vixen saw the hungry crow in the fig tree, and asked why [he] was [he] doing did. retype A vixen saw the hungry crow in the fig tree, and asked why he was {there} did. delete A vixen saw the hungry crow in the fig tree, and asked why he was there [did]. final A vixen saw the hungry crow in the fig tree, and asked why he was there.
- 46. Interaction Drag and drop to reorder Dropdowns with suggestions
- 47. Interaction Drag and drop to reorder vs Dropdowns with suggestions Free type
- 49. Many Hypotheses Interaction Suggested Alternative Translations
- 52. NoviceExpert Caitra (2010) Interaction + Translation Translator expertise
- 53. NoviceExpert Caitra (2010) TransType (2000) Interaction + Translation Translator expertise
- 54. NoviceExpert Google Translate Caitra (2010) TransType (2000) Interaction + Translation Translator expertise Google translate
- 55. data powers better systems NoviceExpert Google Translate Caitra (2010) Active Crowd Translation (2010) TransType (2000) Interaction + Translation Translator expertise
- 56. data powers better systems collaboration + discussion NoviceExpert Google Translate MonoTrans (2011)Caitra (2010) Active Crowd Translation (2010) TransType (2000) Interaction + Translation Translator expertise
- 58. Beyond Human Computation Munteanu, Baecker, and Penn, CHI 2008
- 60. Interactive Machine Translation What if people interact with translation? How can a computer learn from that? How powerful is this approach?
- 61. Production: www.paperhand.org | Photos: mlight.typepad.com
- 62. A Sea of Information Production: www.paperhand.org | Photos: mlight.typepad.com
- 63. A City Obsessed with More and Newer Production: www.paperhand.org | Photos: mlight.typepad.com
- 64. An Insatiable, Hungry Monster Production: www.paperhand.org | Photos: mlight.typepad.com
- 66. An Insatiable, Hungry Monster Production: www.paperhand.org | Photos: mlight.typepad.com
- 67. An Insatiable, Hungry Monster Access? Production: www.paperhand.org | Photos: mlight.typepad.com
- 68. Effective Access Production: www.paperhand.org | Photos: mlight.typepad.com
- 70. Thanks to: • Mentors – James Fogarty (UW) – Srinivas Bangalore (AT&T) – Luke Zettlemoyer (UW) – Dan Weld (UW) – Charlotte P. Lee (UW) – Jen Mankoff (CMU) • And many more – Study Participants – Colleagues – You! • Supporting Organizations – National Science Foundation – AT&T Labs – Microsoft Research – Google – University Book Store – Engage: The Science Speaker Series – University of Washington – Pacific Science Center – Town Hall Seattle – Microsoft
- 71. Thank You! Questions? Contact: kuksenok@cs.uw.edu Links, Citations, etc: students.washington.edu/kuksenok/engage
Editor's Notes
- #14: <when>
- #15: AI Problem -> spam -> for translation “So how would a person figure out how to translate between languages?”
- #22: Jean-François Champollion
- #23: Kevin Knight
- #24: Kevin Knight
- #25: Kevin Knight
- #26: Kevin Knight
- #27: Kevin Knight
- #45: http://stylescorner.com/wp-content/uploads/2011/11/Lemon-Skin-Care-Natural-Recipes1.jpg
- #62: Last summer I saw a play I see technology as incredibly empowering. Providing access to this vast sea of infromation to me means providing the freedom to decide what to believe, and the
- #64: aMALgam
- #66: CONTROVERSIAL – transformation – continuing process we’re all experiencing
- #70: As more people get connected from other countries and cultures, more content is produced online. There is a lot of effort right now by people in computer science and engineering to make technology more available throughout the world, to give as many people as possible access to information online and a platform for producing their own content. And as that happens, we should expect more colors on this map, not less.