1
aOS Moscow
9/7/2019
Bots and Language
understanding
Rick Van Rousselt
Your
picture
◦ THANKS TO OUR SPONSORS
2
Web
Sharesoft
Platinum
Silver
Diamond
Chatbots have
been around for a
long time!
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
Once in a Decade Opportunity
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
Basics
1
2 3
Shared Reference
Gärdenfors (2014)
Language begins with
the naming of items in
the world
A concept is shared between
persons and a word is used to
name that concept
Language is more then just
words
perception concept action
Our brains link shared concepts to personal emotions and
experiences
• If somebody says “rabbit then we think about linked experiences
• Between each other we understand each other because we share the
same experiences
We negotiate about language and meaning while we are having the
conversation
Coordination
of meaning
Coordination of experience
Instruction
Break
Break
Confirmation
Confirmation
We negotiate about language and meaning while we are having the
conversation
A fishing rod is
a stick with a
string and a
hook
You can catch a fish with a
fishing rod
Get me some fish
Break
Break
Confirmation
Confirmation
Maxim of Quantity: Say only what is not implied.
Yes: “Bring me the block.”
No: “Bring me the block by transporting it to my
location.”
Conversations have their own rules
Grice's Maxims
Conversations have their own rules
Maxim of Quality: Say only things that are true.
Yes: “I hate carrying blocks.”
No: “I love carrying blocks, especially when they
are covered in fire ants.”
Grice's Maxims
Conversations have their own rules
Maxim of Relevance: Say only things that matter.
Yes: “Bring me the block.”
No: “Bring me the block and birds sing.”
Grice's Maxims
Conversations have their own rules
Maxim of Manner: Speak in a way that can be easily
understood.
Yes: “Bring me the block.”
No: “Use personal physical force to levitate the block and
transport it to me.”
Grice's Maxims
The way you say it… is equally important
• You know. I don’t. [So don’t ask me.]
• You know I don’t. [You know that I don’t.]
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
With great
power comes great responsibility
Not: Should I build a bot
But
What is the outcome I want for users of my
product or service?
What is the business outcome you want to drive?
- Customer retention
- Customer service
- Ex: helping a user until a live person is
available
Is a
conversation
al chatbot
the best
medium for
your
outcome?
 Vacation booking site?
 Recipe's site?
Does your idea try to replace tasks that people
love doing?
- Ex: Plan a trip
Is the cost for using your
chatbot-powered product or
service less than the perceived
value?
 Ex: Shopping list
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
Start easy
The current state of chatbots
Purposeless mimicry agents
Purposeless mimicry agents
- Psychologist from the ’60s
- Illusion of conversations
- Lot’s of data and deep learning
- Nowadays used mainly for automatic
translations
Recurrent neural network encoding the phrase “How are you?” The result is the vector h3.
Intention-based agents
Intention-based agents
- Present
- Language translated to commands
- Alexa, Siri, Cortana
- Natural Language Processing (NLP)
Intents
 Task or action a user wants to perform => verbs
 Ex: What's the weather like in Moscow?
Entities
 Information relevant to the intent => Nouns
 Ex: What's the weather like in Moscow?
Conversational agents
Conversation Agents
- Future
- Multi-turn conversations
- Dialog manager
Bot Facts
Fact #1:
Users love
buttons
When given the choice of
rich controls, text and voice,
user will choose:
UI Controls first
Text second
Voice third, only if options
above aren’t possible (e.g.
Driving a car)
Fact #2: Users never say things the way you expect
As you model your NLP, make sure you’re being realistic
Fact #3: Search
can do
wonders for
bots
• QnAMaker.ai:
• Super low friction way of creating a Q&A
bot
• Built in web and document crawler: Parses
data and builds the QnA easily
• Not great for too many records
• Not great for deep level customization of
the experience
• Azure Search:
• Can work with millions of records like a
breeze
• Works with different document formats
and data sources
• Takes more effort to prepare/code/fine-
tune
Fact #4: Not all bots need to
have conversations
• Sometimes buttons do everything you need.
• Avoid the engineer’s urge to complicate simple things
• Your business requirement is NOT to
pass the Turing Test: It is to solve your
user’s problem!
11.11.2017
Q&A Maker Demo
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
New botbuilder
tools
Chatdown
• Transcript generator to generate mock transcripts
• Helps non-devs to understand the flow
• Helps define a “Happy Path”
Manage bot resources
• MsBot: Create a .bot file that links up different
services together
• LuisGen: Generate Typescript and C# classes
from a Luis export
• Luis + QnAMaker : manage LUIS.AI and QnA
Maker
• Dispatch: integrate multiple LUIS Apps and
QnA Services
Conversational Commerce
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
Brands need to seriously consider:
How will customers talk to our
brand? And, who are they talking
to?
Aiden Livingston
aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt
Marketers craft brand narratives, creative
writers plot a storyline, and copywriters make
micro-copy magical.
Conversation designers are a hybrid of all
three.
Rick Van Rousselt
CTO Advantive Belgium
Office Apps and Services MVP
BIWUG Board Member
Email : rick.van.rousselt@advantive.be
rickvanrousselt
https://www.rickvanrousselt.com
jobs@advantive.be

More Related Content

PDF
Content Marketing World - Top Tweets
PDF
Digital Heroes - User Experience & Micro Copy
PDF
Getting ready for voice
PDF
Fun With Words: A Toolkit for Designing Great Content, First
KEY
So You've Got a Software Idea...Now What?
KEY
It's Not Just About Code
PPTX
Build a Chatbot with IBM Watson - No Coding Required
PDF
TheTin x SXSW 2017
Content Marketing World - Top Tweets
Digital Heroes - User Experience & Micro Copy
Getting ready for voice
Fun With Words: A Toolkit for Designing Great Content, First
So You've Got a Software Idea...Now What?
It's Not Just About Code
Build a Chatbot with IBM Watson - No Coding Required
TheTin x SXSW 2017

Similar to aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt (20)

PDF
Big Design 2018 - Chatbots & Chatboxes
PDF
Tools and Resources for Transition from Libraries to Wider Community Use Cent...
PDF
How to Talk About Your Open Source Project So People Get It
PPTX
PDF
Brain Dating at Dreamforce
PDF
Beginners chatbotai workshopdbb_bitfusion
PDF
The rise of th enterprise chatbot
PDF
Best Practices for Designing High-Fidelity Voice Experiences
PDF
Conversational experience by Systango
PDF
Getting Started With User-Centered Content by Emileigh Barnes & Kate Garklavs...
PDF
An introduction to content design
PDF
Content Design for the Conversational UI - Design + Content Conference 2019
PDF
Hitting Your Mark - Content Strategy & Optimization
PDF
Workshop: Chatbot in a box - Introduction to conversation design and conducti...
PDF
Unleashing the Power of GPT & LLM: A Holland & Barrett Exploration
PDF
27_07_Landing Pages_Gilles de Clerck_EIA Porto 2022.pdf
PDF
Webinar - Design thinking 101 - 2018-07-24
PPTX
Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...
PDF
Tackling New Challenges in a Virtual Focused Community
PPTX
WebSG - UX @ SMU 11/11/10
Big Design 2018 - Chatbots & Chatboxes
Tools and Resources for Transition from Libraries to Wider Community Use Cent...
How to Talk About Your Open Source Project So People Get It
Brain Dating at Dreamforce
Beginners chatbotai workshopdbb_bitfusion
The rise of th enterprise chatbot
Best Practices for Designing High-Fidelity Voice Experiences
Conversational experience by Systango
Getting Started With User-Centered Content by Emileigh Barnes & Kate Garklavs...
An introduction to content design
Content Design for the Conversational UI - Design + Content Conference 2019
Hitting Your Mark - Content Strategy & Optimization
Workshop: Chatbot in a box - Introduction to conversation design and conducti...
Unleashing the Power of GPT & LLM: A Holland & Barrett Exploration
27_07_Landing Pages_Gilles de Clerck_EIA Porto 2022.pdf
Webinar - Design thinking 101 - 2018-07-24
Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...
Tackling New Challenges in a Virtual Focused Community
WebSG - UX @ SMU 11/11/10
Ad

More from aOS Community (20)

PPTX
Commencer le IaaS sur Azure - aOS Tahiti 03-03-2020
PPTX
Migrer vers O365. Quelles stragtégies? - aOS Tahiti 03-03-2020
PPTX
Passer des macro Excel à la power plateform - aOS Tahiti 03-03-2020
PDF
Serverless avec azure functions - aOS Tahiti 03-03-2020
PPTX
Passer des macro Excel à la power plateform - aOS Nouméa 28-02-2020
PDF
MS ignite : les nouveautés autour des content services et projet cortex - aOS...
PDF
Cybersecurité dans M365 - aOS Noumea 28-02-2020
PDF
Introduction a Power Automate - aOS Nouméa 28-02-2020
PDF
aOS Monaco 2019 - S3 - Présentation Varonis - Cloud Data Protection - Benjami...
PDF
aOS Monaco 2019 - S2 - Présentation ARKADIN - TEAMS Adoption - Laurent Pilo
PDF
aOS Monaco 2019 - C1 - Sécuriser sa messagerie sur Office 365 - Hakim Taoussi...
PDF
aOS Monaco 2019 - B7 - I Developed a SPFx solution, what to do next and how t...
PDF
aOS Monaco 2019 - B6 - Mister Governance and Doctor Teams - Jean-François Ber...
PDF
aOS Monaco 2019 - B5 - The good, the bad and the unexpected - a BOT story - K...
PDF
aOS Monaco 2019 - B4 - Three must have workflows with Microsoft Flow - Vlad C...
PDF
aOS Monaco 2019 - B3 - Create purchase request in PowerApps - Robi Voncina
PDF
aOS Monaco 2019 - B2 - Intégrer la Power Platform avec SharePoint - Patrick G...
PDF
aOS Monaco 2019 - B1 - Construire son infrastructure sur Azure un jeu d'enfan...
PDF
aOS Monaco 2019 - A7 - Sécurisez votre SI et vos services Office 365 partie 2...
PDF
aOS Monaco 2019 - A6 - Sécurisez votre SI et vos services Office 365 partie 1...
Commencer le IaaS sur Azure - aOS Tahiti 03-03-2020
Migrer vers O365. Quelles stragtégies? - aOS Tahiti 03-03-2020
Passer des macro Excel à la power plateform - aOS Tahiti 03-03-2020
Serverless avec azure functions - aOS Tahiti 03-03-2020
Passer des macro Excel à la power plateform - aOS Nouméa 28-02-2020
MS ignite : les nouveautés autour des content services et projet cortex - aOS...
Cybersecurité dans M365 - aOS Noumea 28-02-2020
Introduction a Power Automate - aOS Nouméa 28-02-2020
aOS Monaco 2019 - S3 - Présentation Varonis - Cloud Data Protection - Benjami...
aOS Monaco 2019 - S2 - Présentation ARKADIN - TEAMS Adoption - Laurent Pilo
aOS Monaco 2019 - C1 - Sécuriser sa messagerie sur Office 365 - Hakim Taoussi...
aOS Monaco 2019 - B7 - I Developed a SPFx solution, what to do next and how t...
aOS Monaco 2019 - B6 - Mister Governance and Doctor Teams - Jean-François Ber...
aOS Monaco 2019 - B5 - The good, the bad and the unexpected - a BOT story - K...
aOS Monaco 2019 - B4 - Three must have workflows with Microsoft Flow - Vlad C...
aOS Monaco 2019 - B3 - Create purchase request in PowerApps - Robi Voncina
aOS Monaco 2019 - B2 - Intégrer la Power Platform avec SharePoint - Patrick G...
aOS Monaco 2019 - B1 - Construire son infrastructure sur Azure un jeu d'enfan...
aOS Monaco 2019 - A7 - Sécurisez votre SI et vos services Office 365 partie 2...
aOS Monaco 2019 - A6 - Sécurisez votre SI et vos services Office 365 partie 1...
Ad

Recently uploaded (20)

PPTX
Benefits of Physical activity for teenagers.pptx
PDF
Abstractive summarization using multilingual text-to-text transfer transforme...
PDF
Consumable AI The What, Why & How for Small Teams.pdf
PPTX
The various Industrial Revolutions .pptx
PDF
Credit Without Borders: AI and Financial Inclusion in Bangladesh
PPTX
Chapter 5: Probability Theory and Statistics
PDF
NewMind AI Weekly Chronicles – August ’25 Week III
PPT
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
PDF
A review of recent deep learning applications in wood surface defect identifi...
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PPTX
Microsoft Excel 365/2024 Beginner's training
PPTX
Custom Battery Pack Design Considerations for Performance and Safety
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
PDF
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
PPTX
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
PPTX
2018-HIPAA-Renewal-Training for executives
PDF
A proposed approach for plagiarism detection in Myanmar Unicode text
PPTX
Modernising the Digital Integration Hub
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
CloudStack 4.21: First Look Webinar slides
Benefits of Physical activity for teenagers.pptx
Abstractive summarization using multilingual text-to-text transfer transforme...
Consumable AI The What, Why & How for Small Teams.pdf
The various Industrial Revolutions .pptx
Credit Without Borders: AI and Financial Inclusion in Bangladesh
Chapter 5: Probability Theory and Statistics
NewMind AI Weekly Chronicles – August ’25 Week III
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
A review of recent deep learning applications in wood surface defect identifi...
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
Microsoft Excel 365/2024 Beginner's training
Custom Battery Pack Design Considerations for Performance and Safety
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
2018-HIPAA-Renewal-Training for executives
A proposed approach for plagiarism detection in Myanmar Unicode text
Modernising the Digital Integration Hub
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
CloudStack 4.21: First Look Webinar slides

aOS Moscow - E1 - Bots and language understanding - Rick van Rousselt

  • 1. 1 aOS Moscow 9/7/2019 Bots and Language understanding Rick Van Rousselt Your picture
  • 2. ◦ THANKS TO OUR SPONSORS 2 Web Sharesoft Platinum Silver Diamond
  • 3. Chatbots have been around for a long time!
  • 8. Once in a Decade Opportunity
  • 27. Language begins with the naming of items in the world A concept is shared between persons and a word is used to name that concept
  • 28. Language is more then just words
  • 29. perception concept action Our brains link shared concepts to personal emotions and experiences • If somebody says “rabbit then we think about linked experiences • Between each other we understand each other because we share the same experiences
  • 30. We negotiate about language and meaning while we are having the conversation Coordination of meaning Coordination of experience Instruction Break Break Confirmation Confirmation
  • 31. We negotiate about language and meaning while we are having the conversation A fishing rod is a stick with a string and a hook You can catch a fish with a fishing rod Get me some fish Break Break Confirmation Confirmation
  • 32. Maxim of Quantity: Say only what is not implied. Yes: “Bring me the block.” No: “Bring me the block by transporting it to my location.” Conversations have their own rules Grice's Maxims
  • 33. Conversations have their own rules Maxim of Quality: Say only things that are true. Yes: “I hate carrying blocks.” No: “I love carrying blocks, especially when they are covered in fire ants.” Grice's Maxims
  • 34. Conversations have their own rules Maxim of Relevance: Say only things that matter. Yes: “Bring me the block.” No: “Bring me the block and birds sing.” Grice's Maxims
  • 35. Conversations have their own rules Maxim of Manner: Speak in a way that can be easily understood. Yes: “Bring me the block.” No: “Use personal physical force to levitate the block and transport it to me.” Grice's Maxims
  • 36. The way you say it… is equally important • You know. I don’t. [So don’t ask me.] • You know I don’t. [You know that I don’t.]
  • 39. With great power comes great responsibility
  • 40. Not: Should I build a bot But What is the outcome I want for users of my product or service?
  • 41. What is the business outcome you want to drive? - Customer retention - Customer service - Ex: helping a user until a live person is available
  • 42. Is a conversation al chatbot the best medium for your outcome?  Vacation booking site?  Recipe's site?
  • 43. Does your idea try to replace tasks that people love doing? - Ex: Plan a trip
  • 44. Is the cost for using your chatbot-powered product or service less than the perceived value?  Ex: Shopping list
  • 47. The current state of chatbots
  • 49. Purposeless mimicry agents - Psychologist from the ’60s - Illusion of conversations - Lot’s of data and deep learning - Nowadays used mainly for automatic translations
  • 50. Recurrent neural network encoding the phrase “How are you?” The result is the vector h3.
  • 52. Intention-based agents - Present - Language translated to commands - Alexa, Siri, Cortana - Natural Language Processing (NLP)
  • 53. Intents  Task or action a user wants to perform => verbs  Ex: What's the weather like in Moscow?
  • 54. Entities  Information relevant to the intent => Nouns  Ex: What's the weather like in Moscow?
  • 56. Conversation Agents - Future - Multi-turn conversations - Dialog manager
  • 58. Fact #1: Users love buttons When given the choice of rich controls, text and voice, user will choose: UI Controls first Text second Voice third, only if options above aren’t possible (e.g. Driving a car)
  • 59. Fact #2: Users never say things the way you expect As you model your NLP, make sure you’re being realistic
  • 60. Fact #3: Search can do wonders for bots • QnAMaker.ai: • Super low friction way of creating a Q&A bot • Built in web and document crawler: Parses data and builds the QnA easily • Not great for too many records • Not great for deep level customization of the experience • Azure Search: • Can work with millions of records like a breeze • Works with different document formats and data sources • Takes more effort to prepare/code/fine- tune
  • 61. Fact #4: Not all bots need to have conversations • Sometimes buttons do everything you need. • Avoid the engineer’s urge to complicate simple things • Your business requirement is NOT to pass the Turing Test: It is to solve your user’s problem!
  • 66. Chatdown • Transcript generator to generate mock transcripts • Helps non-devs to understand the flow • Helps define a “Happy Path”
  • 67. Manage bot resources • MsBot: Create a .bot file that links up different services together • LuisGen: Generate Typescript and C# classes from a Luis export • Luis + QnAMaker : manage LUIS.AI and QnA Maker • Dispatch: integrate multiple LUIS Apps and QnA Services
  • 70. Brands need to seriously consider: How will customers talk to our brand? And, who are they talking to? Aiden Livingston
  • 72. Marketers craft brand narratives, creative writers plot a storyline, and copywriters make micro-copy magical. Conversation designers are a hybrid of all three.
  • 73. Rick Van Rousselt CTO Advantive Belgium Office Apps and Services MVP BIWUG Board Member Email : rick.van.rousselt@advantive.be rickvanrousselt https://www.rickvanrousselt.com jobs@advantive.be