Meet Jessie
‘Inventory assistant’
google actions
Stephen Samuel
Why Jessie?
Google actions developed to manage users grocery inventory
Sam
Bob
Google actions developed to manage users grocery inventory
Google actions developed to manage users grocery inventory
NodeJS
webhook
MongoDB
collection (mLab)
api.ai
intent vs action
Heroku
host server
Remove items
from the
collection
Send the list to
Keep/ Express
Assist first time
user
Adding item to
the collection
Google home
voice activated speaker
Google assistant
A conversation between you and Google that
helps you get more done in your world.
Actions on Google
How developers can
extend the assistant
“Jessie, what do I have in my inventory?”
There are no items added to our inventory,
can we add now?
Intent of user
Action to be performed
“Sure, I have sugar 5kg”
added sugar 5kg to the inventory
Intent of user
Action to be performed
“Jessie,
Should I shop today, how is my inventory looking?”
you have the necessary items at home for
this week.
Intent of user
Action to be performed
High level
• Demo
Uncle Bob
Conversation action
Map user’s intent with an action and
routes to the fulfillment backend
service
Receives the action and parameters
from api.ai. Process request and
generate the dialog output
stores/ retrieves
from the mongoDB
collection
fulfillment/ web hook
What is happening here?
Google actions developed to manage users grocery inventory
Google actions developed to manage users grocery inventory
Send the list to
Keep/ Express
Train the Bot
ML
talk to
RaspberryPi
Alexa
Compatible
Automate
home
Next on our list!
firebase
backend
Learnings
• Technology:
• NodeJS/ Express framework, mongoDB, REST api/ Web hook
• api.ai / SSML/ Heroku deploy
• Keep it simple: One chat one list.
• Create less commands
• as you can./add and /remove are the only actions that let you manipulate the list
• Let the bot learn itself
Hey Google, Why don't you ask it yourself?
Alexa, ask pi to check the temperature
outside. I’m feeling hot in here!
Make them talk together!
Oh Good! Seriously!!
Will not talk to pi until he apologies for what
happened yesterday!
Make them talk together!
10011101001

More Related Content

PPTX
EC-CUBE Plugin meetup 2nd
PPTX
Automating SharePoint on premises tasks with PowerShell
PDF
Actions On Google - How? Why?
PDF
Building Conversational Experiences with Actions on Google
PDF
Google Assistant Revolution
PDF
Building conversational experiences with Actions on Google
PDF
Building Conversational Experiences for Google Assistant
PDF
Google Assistant - Why? How?
EC-CUBE Plugin meetup 2nd
Automating SharePoint on premises tasks with PowerShell
Actions On Google - How? Why?
Building Conversational Experiences with Actions on Google
Google Assistant Revolution
Building conversational experiences with Actions on Google
Building Conversational Experiences for Google Assistant
Google Assistant - Why? How?

Similar to Google actions developed to manage users grocery inventory (20)

PDF
Actions On Google - GDD Europe 2017
PDF
Aiy project, el día que le hablé a una caja
PDF
Google Assistant Actions – Codelab and Hackathon - 2018.06.06
PDF
Building your actions for Google Assistant
PDF
Building for google assistant
PDF
Esplorando Google Assistant e Dialogflow
PDF
Engage user with actions
PDF
Construindo projetos para o Google Assistant - I/O 2019 Recap São Paulo
PDF
Building Conversational Experiences with Actions on Google
PDF
Incubeta Ignite: The Age of Assistance
PPTX
Action on Google
PPTX
Google Assistant
PDF
Google Home and Google Assistant Workshop: Build your own serverless Action o...
PDF
The Voice Interface Revolution
PDF
Google assistant basics
PDF
Naomi Makofsky - Connecting with your customer via conversation
PDF
Final getting started with google actions
PPTX
Hey hubballi! - Talk on "Actions on Google" #DevFestHubali
PDF
Workflow monitoring presentation
PDF
Your First Assistant App with DialogFlow + Firebase
Actions On Google - GDD Europe 2017
Aiy project, el día que le hablé a una caja
Google Assistant Actions – Codelab and Hackathon - 2018.06.06
Building your actions for Google Assistant
Building for google assistant
Esplorando Google Assistant e Dialogflow
Engage user with actions
Construindo projetos para o Google Assistant - I/O 2019 Recap São Paulo
Building Conversational Experiences with Actions on Google
Incubeta Ignite: The Age of Assistance
Action on Google
Google Assistant
Google Home and Google Assistant Workshop: Build your own serverless Action o...
The Voice Interface Revolution
Google assistant basics
Naomi Makofsky - Connecting with your customer via conversation
Final getting started with google actions
Hey hubballi! - Talk on "Actions on Google" #DevFestHubali
Workflow monitoring presentation
Your First Assistant App with DialogFlow + Firebase
Ad

Recently uploaded (20)

PPTX
Configure Apache Mutual Authentication
PDF
Two-dimensional Klein-Gordon and Sine-Gordon numerical solutions based on dee...
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
DOCX
search engine optimization ppt fir known well about this
PDF
NewMind AI Weekly Chronicles – August ’25 Week III
PDF
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
PPTX
Modernising the Digital Integration Hub
PPTX
Custom Battery Pack Design Considerations for Performance and Safety
PDF
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
PDF
Developing a website for English-speaking practice to English as a foreign la...
PPTX
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
PDF
OpenACC and Open Hackathons Monthly Highlights July 2025
PDF
sbt 2.0: go big (Scala Days 2025 edition)
PDF
A review of recent deep learning applications in wood surface defect identifi...
PPTX
2018-HIPAA-Renewal-Training for executives
PPTX
Benefits of Physical activity for teenagers.pptx
PDF
Credit Without Borders: AI and Financial Inclusion in Bangladesh
PDF
The influence of sentiment analysis in enhancing early warning system model f...
PDF
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Configure Apache Mutual Authentication
Two-dimensional Klein-Gordon and Sine-Gordon numerical solutions based on dee...
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
search engine optimization ppt fir known well about this
NewMind AI Weekly Chronicles – August ’25 Week III
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
Modernising the Digital Integration Hub
Custom Battery Pack Design Considerations for Performance and Safety
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
Developing a website for English-speaking practice to English as a foreign la...
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
OpenACC and Open Hackathons Monthly Highlights July 2025
sbt 2.0: go big (Scala Days 2025 edition)
A review of recent deep learning applications in wood surface defect identifi...
2018-HIPAA-Renewal-Training for executives
Benefits of Physical activity for teenagers.pptx
Credit Without Borders: AI and Financial Inclusion in Bangladesh
The influence of sentiment analysis in enhancing early warning system model f...
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Ad

Google actions developed to manage users grocery inventory

  • 7. NodeJS webhook MongoDB collection (mLab) api.ai intent vs action Heroku host server Remove items from the collection Send the list to Keep/ Express Assist first time user Adding item to the collection
  • 8. Google home voice activated speaker Google assistant A conversation between you and Google that helps you get more done in your world. Actions on Google How developers can extend the assistant
  • 9. “Jessie, what do I have in my inventory?” There are no items added to our inventory, can we add now? Intent of user Action to be performed
  • 10. “Sure, I have sugar 5kg” added sugar 5kg to the inventory Intent of user Action to be performed
  • 11. “Jessie, Should I shop today, how is my inventory looking?” you have the necessary items at home for this week. Intent of user Action to be performed
  • 14. Uncle Bob Conversation action Map user’s intent with an action and routes to the fulfillment backend service Receives the action and parameters from api.ai. Process request and generate the dialog output stores/ retrieves from the mongoDB collection fulfillment/ web hook What is happening here?
  • 17. Send the list to Keep/ Express Train the Bot ML talk to RaspberryPi Alexa Compatible Automate home Next on our list! firebase backend
  • 18. Learnings • Technology: • NodeJS/ Express framework, mongoDB, REST api/ Web hook • api.ai / SSML/ Heroku deploy • Keep it simple: One chat one list. • Create less commands • as you can./add and /remove are the only actions that let you manipulate the list • Let the bot learn itself
  • 19. Hey Google, Why don't you ask it yourself? Alexa, ask pi to check the temperature outside. I’m feeling hot in here! Make them talk together!
  • 20. Oh Good! Seriously!! Will not talk to pi until he apologies for what happened yesterday! Make them talk together! 10011101001