SlideShare a Scribd company logo
Clever data: building a chatbot from your database
Clever data: Building a chatbot
from your database
Luis Beltrán
Luis Beltrán
• Microsoft MVP in AI & Developer Technologies
• Researcher at Tomás Bata University in Zlín, Czech
Republic.
• Professor at Tecnológico Nacional de México in
Celaya, Mexico.
@darkicebeam
luis@luisbeltran.mx
Agenda
• Chatbots Introduction
• Microsoft Bot Framework
• Adding your data into your bot
• Demo
Chatbots Introduction
Clever data: building a chatbot from your database
Chatbots:
• Conversational bots.
• Background tasks.
• Availability 24/7/365.
• AI-powered. A bot detects users’
intentions and is capable of
combining millions of data
from different sources.
Pattern: Knowledge Base Bots
Fuzzy Searching
Filtering to guide a conversation
Generating search queries from natural language
Pattern: Handoff to Human
Every company deals with this:
First
triage/data
collection
Simple and
repetitive
solutions
If it is simple and repetitive, it can
be coded. Bots can accelerate it
Thank you for providing all this information. I
have John with me now who will take from here
and help you out
Hello, this is John. I understand your computer
won’t power on. Let’s take a look at some
service options
I’ve tried these steps, my computer still won’t turn on
Sounds lovely, thank you
I suggest us to request a hardware service. We can have one
of our service engineers look at your computer
Note to operator: It sounds like the user will need hardware
replacement, what next step should I take?
Apologize to
user
Suggest
hardware
service
Let me type
Bot to human
hand-off:
Complete or
supervised
Microsoft Bot Framework
Goals
• Start Simple. Add Complexity. No dead-ends.
• Bot adapts to the user, based on context
• Composable and intelligent controls to manage complexity
Bot Controls
LUIS
Query over database via
Azure Search
Form
Filling
QnA
C#
Customer’s
Business Logic
& DataBot Connector
Cortana Direct Line
What?
• Tools for building REST Web Sites
• Services to enrich
• Mechanisms for receive events
• Data to debug and analyze
Why?
• Implements standard protocols
• Modeling conversations is hard. Tools help!
• UI across multiple canvases is hard. Cards rock!
• Language Understanding is hard
• Common and well understood patterns
What is Microsoft Bot Framework?
An x-ray of a typical bot
Bot web service
Your bot code
Entity
Extraction
Speech
Vision/Face
Natural
Language
Translation
+ Microsoft Cognitive Services
Search
Emotion
Knowledge
API
…
Message input <> output
State Management
Bot Connector Service
Conversation Canvas/Channels
……
…
Other services, APIs,
Databases, Azure Machine
Learning, Azure Search,
etc…
Bot Builder SDK
Web Chat
Direct Line…
Email
Facebook
GroupMe
Kik
Skype
Slack
Telegram
Twilio (SMS)
Bot Builder SDK
Your bot code goes here
Bot Connector Messages
Your bot
{
"type": "Message",
"id": "68YrxgtB53Y",
"conversationId": "DphPaFQrDuZDKyCez4AFGcT4vy5aQDje1lLGIjB8v18MFtb",
"language": "en",
"text": "You can say "/order" to order!",
"attachments": [ ],
"from": {
"name": "+12065551212",
"channelId": "sms",
"address": "+12065551212",
"id": "Ro52hKN287",
"isBot": false
},
"channelData": { SMS data here },
"botUserData": { your data here },
...
}
Bot
Connector
Bot Builder
SDK
Template
Your Bot LUIS
Publish to
Azure
Connect to
users
Add dialog
smarts
Bot Builder SDK Template
LUIS (Language Understanding Intelligent
Service)
Trains utterances (examples) into a REST API
Maps utterances to intents (verbs) and extracts entities
“I want to find
news about flight
delays”
{
“entities”: [
{
“entity”: “flight delays”,
“type”: “Topic”
}
],
“intents”: [
{
“intent”: “FindNews”,
“score”: 0.99853384
},
{
“intent”: “None”,
“score”: 0.07289317
},
{
“intent”: “ReadNews”,
“score”: 0.0167122427
},
{
“intent”: “ShareNews”,
“score”: 1.0919299E-06
}
]
}
Publish to Azure
Connect to users
Add Dialog Smarts with Adaptive Cards
Notification Microsoft Teams Skype Android iOS
Adding your data into your bot
Database (SQL Server, Azure SQL, Oracle, …)
Access to your database (REST API, GraphQL, …)
Bot project – Understand user messages (1)
LUIS – Intents, Entities and Utterances
LUIS – Intents, Entities and Utterances
Bot project – Send user messages to LUIS (2)
Bot project - Translate user messages into
API calls (3)
Bot project - Translate user messages into
API calls (4)
Profit!
Demo
https://github.com/icebeam7/SQLSaturdayPragueMobileBot
https://github.com/icebeam7/SQLSaturdayPragueBot
https://github.com/icebeam7/SQLSaturdayPragueWebApi
Bot Scenarios
• Q & A
• Helpdesk
• Product selection
• Task automation
• Monitoring
• Expert Systems
Call to Action
• Microsoft Bot Framework https://dev.botframework.com/
• Azure Cognitive Services https://microsoft.com/cognitive
• Bot Builder http://github.com/Microsoft/botbuilder
• LUIS https://luis.ai
• Docs https://aka.ms/azure/bots/overview/docs
Clever data: building a chatbot from your database
Luis Beltrán
Tomás Bata University in Zlín
Tecnológico Nacional de México en Celaya
luis@luisbeltran.mx luisbeltran.mx @darkicebeam
Thank you for your attention!
Let’s connect! ☺
icebeam darkicebeam luisantoniobeltran
icebeam7 about.me/luis-beltran
Clever data: building a chatbot from your database

More Related Content

PPT
KohaCon11: Integrating Koha with RFID system
PPTX
Internet and its working (manu)
PPTX
Wi fi presentation
PPTX
Clever data building a chatbot from your database
PPTX
Clever data building a chatbot from your database
PPTX
Build a mobile chatbot with Xamarin
PPTX
virtual-2021-data.sql_.saturday.la-Building database interactions with users ...
PDF
Bot design AIsatPN 2018
KohaCon11: Integrating Koha with RFID system
Internet and its working (manu)
Wi fi presentation
Clever data building a chatbot from your database
Clever data building a chatbot from your database
Build a mobile chatbot with Xamarin
virtual-2021-data.sql_.saturday.la-Building database interactions with users ...
Bot design AIsatPN 2018

Similar to Clever data: building a chatbot from your database (20)

PDF
Lessons learned from building a commercial bot development platform
PPTX
Build intelligent chatbot with bot framework
PDF
Everything you need to know about chatbots
PPSX
Introduction to Microsoft Bot Framework
PPTX
Mat Velloso - Bots in the real world
PPTX
Building A Conversational Bot Using Bot Framework and Microsoft
PPTX
SharePoint Fest DC 2019 - Bot Framework and Microsoft Graph - Join The Revolu...
PPTX
SharePoint Saturday Warsaw - Conversational AI applications in Microsoft Teams
PPTX
Chatbot Technology
PPTX
Microsoft Bots and Cognitive Services
PDF
Bots are the New Apps: Building with the Bot Framework & Language Understanding
PPTX
Microsoft bot framework in azure
PPTX
AI Machine vs Human
PPTX
Human vs Bot: Giocare a Sasso-Carta-Forbici - Matteo Valoriani, Antimo Musone...
PDF
Chatbotmeetup15062017
PPTX
Leveling up your bot with language intelligence!
PPTX
‘You talking to me?’ — Bringing MT to the world of chatbots
PPTX
chatbotppt-2-221230190622-6b7k0e717.pptx
PPTX
Dynamics 365 Saturday Amsterdam 02/2018 - Dynamics 365 and chatbots
PPTX
chatbotppt-2-221230190622-6b70e7171.pptx
Lessons learned from building a commercial bot development platform
Build intelligent chatbot with bot framework
Everything you need to know about chatbots
Introduction to Microsoft Bot Framework
Mat Velloso - Bots in the real world
Building A Conversational Bot Using Bot Framework and Microsoft
SharePoint Fest DC 2019 - Bot Framework and Microsoft Graph - Join The Revolu...
SharePoint Saturday Warsaw - Conversational AI applications in Microsoft Teams
Chatbot Technology
Microsoft Bots and Cognitive Services
Bots are the New Apps: Building with the Bot Framework & Language Understanding
Microsoft bot framework in azure
AI Machine vs Human
Human vs Bot: Giocare a Sasso-Carta-Forbici - Matteo Valoriani, Antimo Musone...
Chatbotmeetup15062017
Leveling up your bot with language intelligence!
‘You talking to me?’ — Bringing MT to the world of chatbots
chatbotppt-2-221230190622-6b7k0e717.pptx
Dynamics 365 Saturday Amsterdam 02/2018 - Dynamics 365 and chatbots
chatbotppt-2-221230190622-6b70e7171.pptx
Ad

More from Luis Beltran (20)

PPTX
AI for Accessibility.pptx
PPTX
NET Conf Bhubaneswar - Migrating your Xamarin.Forms app to .NET MAUI.pptx
PPTX
03 GlobalAIBootcamp2020Lisboa-Rock, Paper, Scissors.pptx
PPTX
BI LATAM Summit 2022 - Creación de soluciones de automatización serverless-...
PDF
CEIAAIT - Fundamentos y Aplicaciones de Deep Learning.pdf
PPTX
Computo en la Nube con Azure - AI Gaming Panama.pptx
PPTX
5StarsConf - Serverless Machine Learning con Azure Functions y ML.NET .pptx
PPTX
ACW - Azure Speaker Recognition Biometria de Voz.pptx
PPTX
UNICABA - Azure Machine Learning.pptx
PPTX
Azure Talks Bolivia - Aumente la confiabilidad de su negocio con Azure Anomal...
PPTX
Latino NET - Integrando WhatsApp en nuestras apps .NET con Twilio.pptx
PPTX
NOVA - Enriquecimiento de IA con Azure Cognitive Search.pptx
PPTX
Netcoreconf 2021 Realidad mixta en apps móviles con Azure Spatial Anchors y ...
PPTX
ATG Puebla - El cementerio de Microsoft.pptx
PPTX
Data-Saturday-10-Sofia-2021 Azure Video Indexer- Advanced data extraction fro...
PPTX
Azure Community Conference - Image Recognition in WhatsApp chatbot with Azure...
PPTX
Real NET Docs Show - Serverless Machine Learning v3.pptx
PPTX
Sesion 5 - Eficiencia del Rendimiento - Well Architected Backstage Tour.pptx
PPTX
XamarinExpertDay - Creating PDF files in mobile apps with PdfSharpCore and Mi...
PPTX
Latam Space Week - Clasificación de rocas espaciales por medio de IA.pptx
AI for Accessibility.pptx
NET Conf Bhubaneswar - Migrating your Xamarin.Forms app to .NET MAUI.pptx
03 GlobalAIBootcamp2020Lisboa-Rock, Paper, Scissors.pptx
BI LATAM Summit 2022 - Creación de soluciones de automatización serverless-...
CEIAAIT - Fundamentos y Aplicaciones de Deep Learning.pdf
Computo en la Nube con Azure - AI Gaming Panama.pptx
5StarsConf - Serverless Machine Learning con Azure Functions y ML.NET .pptx
ACW - Azure Speaker Recognition Biometria de Voz.pptx
UNICABA - Azure Machine Learning.pptx
Azure Talks Bolivia - Aumente la confiabilidad de su negocio con Azure Anomal...
Latino NET - Integrando WhatsApp en nuestras apps .NET con Twilio.pptx
NOVA - Enriquecimiento de IA con Azure Cognitive Search.pptx
Netcoreconf 2021 Realidad mixta en apps móviles con Azure Spatial Anchors y ...
ATG Puebla - El cementerio de Microsoft.pptx
Data-Saturday-10-Sofia-2021 Azure Video Indexer- Advanced data extraction fro...
Azure Community Conference - Image Recognition in WhatsApp chatbot with Azure...
Real NET Docs Show - Serverless Machine Learning v3.pptx
Sesion 5 - Eficiencia del Rendimiento - Well Architected Backstage Tour.pptx
XamarinExpertDay - Creating PDF files in mobile apps with PdfSharpCore and Mi...
Latam Space Week - Clasificación de rocas espaciales por medio de IA.pptx
Ad

Recently uploaded (20)

PDF
Encapsulation_ Review paper, used for researhc scholars
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Electronic commerce courselecture one. Pdf
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
Big Data Technologies - Introduction.pptx
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
Cloud computing and distributed systems.
PDF
cuic standard and advanced reporting.pdf
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Encapsulation theory and applications.pdf
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Unlocking AI with Model Context Protocol (MCP)
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Encapsulation_ Review paper, used for researhc scholars
The AUB Centre for AI in Media Proposal.docx
Per capita expenditure prediction using model stacking based on satellite ima...
Electronic commerce courselecture one. Pdf
Understanding_Digital_Forensics_Presentation.pptx
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Big Data Technologies - Introduction.pptx
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Chapter 3 Spatial Domain Image Processing.pdf
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Cloud computing and distributed systems.
cuic standard and advanced reporting.pdf
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Encapsulation theory and applications.pdf
Programs and apps: productivity, graphics, security and other tools
Reach Out and Touch Someone: Haptics and Empathic Computing
Unlocking AI with Model Context Protocol (MCP)
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy

Clever data: building a chatbot from your database

  • 2. Clever data: Building a chatbot from your database Luis Beltrán
  • 3. Luis Beltrán • Microsoft MVP in AI & Developer Technologies • Researcher at Tomás Bata University in Zlín, Czech Republic. • Professor at Tecnológico Nacional de México in Celaya, Mexico. @darkicebeam luis@luisbeltran.mx
  • 4. Agenda • Chatbots Introduction • Microsoft Bot Framework • Adding your data into your bot • Demo
  • 7. Chatbots: • Conversational bots. • Background tasks. • Availability 24/7/365. • AI-powered. A bot detects users’ intentions and is capable of combining millions of data from different sources.
  • 8. Pattern: Knowledge Base Bots Fuzzy Searching Filtering to guide a conversation Generating search queries from natural language
  • 9. Pattern: Handoff to Human Every company deals with this:
  • 10. First triage/data collection Simple and repetitive solutions If it is simple and repetitive, it can be coded. Bots can accelerate it
  • 11. Thank you for providing all this information. I have John with me now who will take from here and help you out Hello, this is John. I understand your computer won’t power on. Let’s take a look at some service options I’ve tried these steps, my computer still won’t turn on Sounds lovely, thank you I suggest us to request a hardware service. We can have one of our service engineers look at your computer Note to operator: It sounds like the user will need hardware replacement, what next step should I take? Apologize to user Suggest hardware service Let me type Bot to human hand-off: Complete or supervised
  • 13. Goals • Start Simple. Add Complexity. No dead-ends. • Bot adapts to the user, based on context • Composable and intelligent controls to manage complexity Bot Controls LUIS Query over database via Azure Search Form Filling QnA C# Customer’s Business Logic & DataBot Connector Cortana Direct Line What? • Tools for building REST Web Sites • Services to enrich • Mechanisms for receive events • Data to debug and analyze Why? • Implements standard protocols • Modeling conversations is hard. Tools help! • UI across multiple canvases is hard. Cards rock! • Language Understanding is hard • Common and well understood patterns What is Microsoft Bot Framework?
  • 14. An x-ray of a typical bot Bot web service Your bot code Entity Extraction Speech Vision/Face Natural Language Translation + Microsoft Cognitive Services Search Emotion Knowledge API … Message input <> output State Management Bot Connector Service Conversation Canvas/Channels …… … Other services, APIs, Databases, Azure Machine Learning, Azure Search, etc… Bot Builder SDK Web Chat Direct Line… Email Facebook GroupMe Kik Skype Slack Telegram Twilio (SMS) Bot Builder SDK Your bot code goes here
  • 15. Bot Connector Messages Your bot { "type": "Message", "id": "68YrxgtB53Y", "conversationId": "DphPaFQrDuZDKyCez4AFGcT4vy5aQDje1lLGIjB8v18MFtb", "language": "en", "text": "You can say "/order" to order!", "attachments": [ ], "from": { "name": "+12065551212", "channelId": "sms", "address": "+12065551212", "id": "Ro52hKN287", "isBot": false }, "channelData": { SMS data here }, "botUserData": { your data here }, ... } Bot Connector
  • 16. Bot Builder SDK Template Your Bot LUIS Publish to Azure Connect to users Add dialog smarts
  • 17. Bot Builder SDK Template
  • 18. LUIS (Language Understanding Intelligent Service) Trains utterances (examples) into a REST API Maps utterances to intents (verbs) and extracts entities
  • 19. “I want to find news about flight delays” { “entities”: [ { “entity”: “flight delays”, “type”: “Topic” } ], “intents”: [ { “intent”: “FindNews”, “score”: 0.99853384 }, { “intent”: “None”, “score”: 0.07289317 }, { “intent”: “ReadNews”, “score”: 0.0167122427 }, { “intent”: “ShareNews”, “score”: 1.0919299E-06 } ] }
  • 22. Add Dialog Smarts with Adaptive Cards Notification Microsoft Teams Skype Android iOS
  • 23. Adding your data into your bot
  • 24. Database (SQL Server, Azure SQL, Oracle, …)
  • 25. Access to your database (REST API, GraphQL, …)
  • 26. Bot project – Understand user messages (1)
  • 27. LUIS – Intents, Entities and Utterances
  • 28. LUIS – Intents, Entities and Utterances
  • 29. Bot project – Send user messages to LUIS (2)
  • 30. Bot project - Translate user messages into API calls (3)
  • 31. Bot project - Translate user messages into API calls (4)
  • 33. Demo
  • 35. Bot Scenarios • Q & A • Helpdesk • Product selection • Task automation • Monitoring • Expert Systems
  • 36. Call to Action • Microsoft Bot Framework https://dev.botframework.com/ • Azure Cognitive Services https://microsoft.com/cognitive • Bot Builder http://github.com/Microsoft/botbuilder • LUIS https://luis.ai • Docs https://aka.ms/azure/bots/overview/docs
  • 38. Luis Beltrán Tomás Bata University in Zlín Tecnológico Nacional de México en Celaya luis@luisbeltran.mx luisbeltran.mx @darkicebeam Thank you for your attention! Let’s connect! ☺ icebeam darkicebeam luisantoniobeltran icebeam7 about.me/luis-beltran