Breaking Language Barriers with AI - Web Summit 2018

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Breaking Language Barriers with AI
WebSummit Lisbon – November 2018
Boaz Ziniman
Technical Evangelist, Amazon Web Service
@ziniman
boaz.ziniman.aws
ziniman

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Natural language processing (NLP)
• Automatic Speech Recognition (ASR)
• Natural Language Understanding (NLU)
• Text to Speech
• Translation
1970 1980 1990 2000 2010 2020
HUMAN ACCURACY
50% 55%
60% 62%
70%
95%
Source: MindMeld

Common Language Use Cases
Information Bots
Education
Accessibility
Knowledge Management
Voice of Customer
Applications
Customer Service/
Call Centers
Enterprise
Digital Assistant
Semantic Search
Captioning Workflows
LocalizationPersonalization

AI Services

Amazon Polly
Deep Learning-based text-to-speech service

“Today in Seattle, WA
it’s 11°F”
Amazon Polly: Text In, Life-like Speech Out
52 voices across 25 languages
“Today in Seattle Washington
it’s 11 degrees Fahrenheit”

“Today in Mumbai,
India it’s 32°C”
“Today in Mumbai, India it’s 32
degrees Celcius”

“Esta é a minha 2ª
visita ao WebSummit
Lisboa”
“Esta é a minha
segunda visita ao
WebSummit Lisboa”

A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
• “Today in Seattle, WA, it’s 11°F”

2. Intelligible and Easy to Understand

3. Add Semantic Meaning to Text

https://www.w3.org/TR/speech-synthesis/
<speak>
The spelling of my name is
<prosody rate='x-slow'>
<say-as interpret-as="characters">Boaz</say-as>
</prosody>
</speak>

3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“
<say-as interpret-as="telephone">

Voice Modification: Vocal Tract Length
<speak>
This is Brian without any voice modifications.
<amazon:effect vocal-tract-length="+15%"> Imagine now that I got bigger… </amazon:effect>
<amazon:effect vocal-tract-length="+25%"> Suppose that I got even bigger still… </amazon:effect>
Now let's go back and hear the effect when I go in the opposite direction.
<amazon:effect vocal-tract-length="-15%"> Can you tell that I'm getting smaller? </amazon:effect>
<amazon:effect vocal-tract-length="-25%"> Now I'm even smaller than before. </amazon:effect>
</speak>

“This is a new technology that can give users
more choice and better accessibility to our
content, so we wanted to create an
experiment to dive deeper into the user
experience. After a month, we’ll take what
we’ve learned about how users engage with
this feature to develop our first iteration of a
product with Amazon Polly.“
Joseph Price, Product Manager
The Washington Post
https://www.washingtonpost.com/pr/wp/201
7/06/09/the-washington-post-to-start-
experimenting-with-audio-articles-using-
amazon-polly

Navigation

AI Radio Announcer
• FM Wakayama: Japanese radio station
• Amazon Polly Japanese voices are used for
regularly scheduled broadcasts throughout
the week
• Emergency broadcast during 12/09 Typhoon

Polly API example
aws polly synthesize-speech
--output-format mp3 --voice-id Matthew --text-type ssml
--text '<speak>
<amazon:auto-breaths>
<prosody rate="x-slow" pitch="low">Here is my little secret.</prosody>
<amazon:breath duration="long" volume="x-loud"/>
<amazon:effect name="whispered">
<prosody rate="x-slow">
<prosody pitch="x-low">I</prosody>
killed Mufasa!
</prosody>
</amazon:effect>
</amazon:auto-breaths>
</speak>'
mufasa.mp3

Amazon Transcribe
Automatic speech recognition service

“Hello, this is Allan
speaking”

Support for
telephony
audio
Timestamp
generation
Intelligent
punctuation
and formatting
Recognize
multiple
speakers
Custom
vocabulary
Multiple
languages

ringDNA
RingDNA is an end-to-end communications
platform for sales teams.
Hundreds of enterprise organizations use
RingDNA to increase productivity, engage in
smarter sales conversations, gain predictive
sales insights and improve their win rate.
Speech to Text
"A critical component of RingDNA’s Conversation
AI requires best of breed speech-to-text to deliver
transcriptions of every phone call. RingDNA is
excited about Amazon Transcribe since it provides
high-quality speech recognition at scale, helping
us to better transcribe every call to text"
Howard Brown, CEO & Founder, RingDNA https://www.youtube.com/watch?v=1ZJ_f1bDdog

Amazon Translate
Neural Machine Translation Service

“Hello, what’s up? Do
you want to go see a
movie tonight?”
Amazon Translate
Natural and fluent language translation
"Olá, quer ir ver um filme
hoje à noite?"

Automatic translation
Real-time
translation
Powered by Deep
Learning
12 Language pairs
(more to come)
Language detection

Translate API example
boazz: ~$ aws translate translate-text
--text "Hello, what’s up? Do you want to go see a movie tonight?"
--source-language-code auto --target-language-code pt
{
"TargetLanguageCode": "pt",
"TranslatedText": "Olá, quer ir ver um filme hoje à noite?",
"SourceLanguageCode": "en"
}

import boto3
translate = boto3.client("translate")
lang_flag_pairs = [("fr", "!"), ("de", """),
("es", "#"), ("pt", "$"),
("zh", "%"), ("ar", "&"),
("ja", "'"), ("ru", "("),
("it", ")"), ("zh-TW", "*"),
("tr", "+"), ("cs", ",")]
for lang, flag in lang_flag_pairs:
print(flag)
print(translate.translate_text(
Text="Hello, World",
SourceLanguageCode="en",
TargetLanguageCode=lang
)['TranslatedText'])

!
Bonjour, Monde
"
Hallo, Welt
#
Hola, Mundo
$
Olá, Mundo
%
&
‫ﻣ‬‫ﺮ‬‫ﺣ‬‫ﺒ‬‫ﺎ‬،‫ا‬‫ﻟ‬‫ﻌ‬‫ﺎ‬‫ﻟ‬‫ﻢ‬
'
(
Привет, Мир
)
Ciao, Mondo
*
,
+
Merhaba, Dünya.
,
Ahoj, světe.
https://github.com/ziniman/aws-translate-demo

Hotels.com
Machine Translation
At Hotels.com, we are committed to offering all of our customers the most
relevant and up to date information about their destination. To achieve that,
we operate 90 localized websites in 41 languages. We have more than 25M
customer reviews and more are coming in every day, making a great candidate
for machine translation. Having evaluated Amazon Translate and several other
solutions, we believe that Amazon Translate presents a quick, efficient and
most importantly, accurate solution.
Matt Fryer, VP and Chief Data Science Officer, Hotels.com

Demo - https://translate.boaz.cloud/
https://github.com/ziniman/aws-translate-demo

Amazon Comprehend
Natural Language Processing

Fully managed natural language processing
Discover valuable insights from text
Entities
Key Phrases
Language
Sentiment

Topic modeling
STORM
WORLD SERIES
AUSTRALIASTOCK
MARKET
WASHINGTON
HEALTH
CRISIS
MACHINE
LEARNING
LIBRARY OF
NEWS ARTICLES *

Run Amazon Comprehend on S3 Bucket
import boto3
import json
s3 = boto3.resource('s3’)
bucket_name = ‘my_bucket’
region_name = ‘us-east-1’
bucket = s3.Bucket(bucket_name)
comprehend = boto3.client(service_name='comprehend', region_name=region)
for obj in bucket.objects.all():
body = obj.get()['Body'].read()
text = body
sentiment_response = comprehend.detect_sentiment(Text=text, LanguageCode='en’)
print(json.dumps(sentiment_response, sort_keys=True, indent=4))

Demo
https://github.com/ziniman/aws-comprehend-demo

Amazon Lex
Conversational Interfaces

Advent of conversational interactions
2nd gen:
Pointers & sliders
3nd gen:
Conversational
interfaces
1st gen:
Punch cards & memory
registers

Lex Use Case: Digital Assistant to Book a Hotel
Book hotel
NYC
“Book a hotel in
NYC”
Automatic speech
recognition
Hotel booking
New York City
Natural language
understanding
Intent/slot
model
UtterancesHotel booking
City New York City
Check in November 30
Check out December 2
“Your hotel is booked for
November 30.”
Amazon Polly
Confirmation: “Your hotel is
booked for November 30.”
“Can I go ahead
with the booking?”
a
in

Amazon Lex use cases
Informational Bots
Chatbots for everyday consumer requests
Application Bots
Build powerful interfaces to mobile applications
• News updates
• Weather information
• Game scores …
• Book tickets
• Order food
• Manage bank accounts …
Enterprise Productivity Bots
Streamline enterprise work activities and improve efficiencies
• Check sales numbers
• Marketing performance
• Inventory status …
Internet of Things (IoT) Bots
Enable conversational interfaces for device interactions
• Wearables
• Appliances
• Auto …

Connect Demo
+1-979-335-5593
+1-979-335-5593
Next session for Boaz Ziniman is…

Babel fish
"The Babel fish is small, yellow, leech-like - and probably the oddest thing in the universe. It
feeds on brain wave energy, absorbing all unconscious frequencies and then excreting
telepathically a matrix formed from the conscious frequencies and nerve signals picked up
from the speech centres of the brain, the practical upshot of which is that if you stick one in
your ear, you can instantly understand anything said to you in any form of language: the
speech you hear decodes the brain wave matrix."
The Hitchhiker's Guide to the Galaxy, Douglas Adams

Build your own Babel fish
Person Speaks in
English
Transcribe voice to text in
English
Translate text to
Spanish
Speak in
Spanish

Babel Chat
chat.boaz.cloud

Babel Chat
chat.boaz.cloud
{
"room":"/",
"message":{
"user":"Boaz",
"text":"I'm doing great",
"timestamp":1540978160578
},
"clientId":"07958771059731382"
}

?

AWS DEVELOPER WORKSHOP SCHEDULE
10:00AM
An Introduction to AWS for
Developers
11:00AM
AI & Machine Learning at Amazon
12:00PM
Breaking Language Barriers with AI
1:00PM
Deep Learning Demystified, A
(Mostly) Effortless Introduction
2:00PM
Machine Learning at the Edge: An
Introduction to AI/ML Options on
Mobile Devices
3:00PM
How to Avoid Common Mistakes at Scale
4:00PM
How to Build Multi-Region
Applications in the Cloud
Wednesday, November 7

AWS DEVELOPER WORKSHOP SCHEDULE
10:00AM
An Introduction to AWS for
Developers
11:00AM
Serve Your Customers with AI from
Cloud
12:00PM
Chaos Engineering: Why Breaking
Things Should be Practiced
1:00PM
From Data Collection to Actionable
Insights in 60 Seconds
2:00PM
How to Process Transactions like a
Boss!
3:00PM
IoT – From Cloud to Edge & Back Again
4:00PM
Exploring Ad-Based Monetization
Opportunities for Modern Web &
Mobile Apps
Thursday, November 8

Did We Scan Your Badge?
Remember to opt-in to AWS
communications and you will receive a
post-event email with a link to:
• AWS Developer Workshop Slides
• $200 in AWS Credits

Thank you!
Boaz Ziniman
Technical Evangelist, Amazon Web Service
Give me feedback – Talk to my Bot
m.me/boaz.ziniman.aws
@ziniman
boaz.ziniman.aws

Breaking Language Barriers with AI - Web Summit 2018

More Related Content

Similar to Breaking Language Barriers with AI - Web Summit 2018 (10)

More from Boaz Ziniman (20)

Recently uploaded (20)

Breaking Language Barriers with AI - Web Summit 2018