Voice is the New Keyboard - Voice Interfaces in 2018 and Beyond
- 1. Voice is the newkeyboard:Voice interfaces in 2018and beyond Keanan Koppenhaver CTO, Alpha Particle keanan@alphaparticle.com AlphaParticle @kkoppenhaver
- 4. Future: “50% of allsearcheswillbevoice searches by2020” - Comscore keanan@alphaparticle.com AlphaParticle @kkoppenhaver
- 8. keanan@alphaparticle.com AlphaParticle @kkoppenhaver Astoryin 3 Parts PostContent -> Audio Bring the post content to connected devices Taking itfurther with custom functionality
- 9. Part1 | Post Content->Audio keanan@alphaparticle.com AlphaParticle @kkoppenhaver
- 10. keanan@alphaparticle.com AlphaParticle @kkoppenhaver AWS Polly forwordpress ByAWS Labs,WP Engine
- 11. Whatisamazon polly? keanan@alphaparticle.com AlphaParticle @kkoppenhaver Automated audio player for published postcontent Feed to turn posts into podcasts
- 12. Whatisamazon polly? keanan@alphaparticle.com AlphaParticle @kkoppenhaver Deep Learning “WE live in Chicago” vs “We’re Live in chicago” Dozens ofvoices and languages Free for up to 5M characters per month onAWS Free plan
- 14. Part2 | PostContent -> Devices keanan@alphaparticle.com AlphaParticle @kkoppenhaver
- 15. Connected devices can have skills keanan@alphaparticle.com AlphaParticle @kkoppenhaver HelpsAmazonAlexaand Google home perform more diverse tasks Backed byeither a template (using existing infra) or customapi endpoints (usingyour infra)
- 16. Skill-> Intent-> function -> Response keanan@alphaparticle.com AlphaParticle @kkoppenhaver
- 17. Whatcan backupa function? keanan@alphaparticle.com AlphaParticle @kkoppenhaver Skilltemplate AWS Lambda Firebase Customapi endpoints
- 18. Skilltemplate: Flash briefing keanan@alphaparticle.com AlphaParticle @kkoppenhaver “HEyalexa, what’s in the news?" “JustaddWater…er, feed” Audio feed or text feed, updated Hourly/Daily/ Weekly This makes itvery easy to getaskillupand running…ifyou do news
- 20. What ifyou don’tdo news? keanan@alphaparticle.com AlphaParticle @kkoppenhaver
- 21. You canwrite custom skills Yourself* keanan@alphaparticle.com AlphaParticle @kkoppenhaver *With someJavaor Python Knowledge anda bunch of time spentreading documentation
- 26. Part 3 | None of theabove keanan@alphaparticle.com AlphaParticle @kkoppenhaver
- 27. Custom google home skill keanan@alphaparticle.com AlphaParticle @kkoppenhaver CustomWPand WC RESTapi endpoints Google -> Firebase Functions -> RESTAPI -> Firebase -> Google Home Some code to parse here…butyouasked for it
- 28. Whatdoes google do? keanan@alphaparticle.com AlphaParticle @kkoppenhaver Create skilland set up intents (What’s on sale, Whatare the hours?) Pass everything (once parsed) to firebase functions
- 29. Whatdoes Firebase do? keanan@alphaparticle.com AlphaParticle @kkoppenhaver Decideswhatwe’re trying to do Passes intent,along with anyparameters to endpoints (WC/WP)
- 33. Whatdoes Firebase do? keanan@alphaparticle.com AlphaParticle @kkoppenhaver Waits for data Builds thevoice response For google home
- 34. Help google speak keanan@alphaparticle.com AlphaParticle @kkoppenhaver Can return text or can return speech synthesis markup language (Ssml) SSMLcan helpwith awkward cadence or bad interpretation (numbers, tone, etc) Response is spoken out to the user
- 36. <speak> Step 1, takeadeep breath. <break time="200ms"/> Step 2, exhale. Step 3, take adeep breathagain. <breakstrength="weak"/> Step 4, exhale. </speak> keanan@alphaparticle.com AlphaParticle @kkoppenhaver
- 37. <speak> Iwantto tellyouasecret. <amazon:effectname="whispered">Iam notareal human.</amazon:effect>. Canyou believe it? </speak> keanan@alphaparticle.com AlphaParticle @kkoppenhaver
- 39. (Final) Demo HeyGoogle, OpenAcmeWidgetCatalog HeyGoogle askacmewidgetcatalogwhat are the store hours Heygoogle askacmewidgetcatalogwhat’s on sale keanan@alphaparticle.com AlphaParticle @kkoppenhaver