Bot & AI - A Bot for Productivity

Bot & AI
Marvin Heng, Microsoft MVP

https://www.techconnect.io
@hmheng
“To him,
turning innovative ideas into
reality is great excitement and
achievement.”
Microsoft MVP | Tech + AI Enthusiast
Marvin Heng

A chatbot is an artificial intelligence (AI) software that
can simulate a conversation (or a chat) with a user in
natural language.

Why Do I Need a Bot?
A chatbot is said to bring the following benefits
Be Pioneer
Chatbot is highly intelligent solution that
allows human-like interaction.
And it is 24/7 throughout the year.
Improve Satisfaction
User/Customers satisfaction is proven to
be improved by implementing bot into
your businesses.
Boost Productivity
By integrating bot into your productivity
apps, it is highly possible to automate a
lot of processes.

Conversations
Notification-Only Bots
Sending and Receiving Files (Preview)
DEMO
Bots in Microsoft Teams

Conversations
Series of messages sent between your bot and one or more users. Conversations are in one of
the following scopes:
Teams
Also called channel conversations,
visible to all members of the channel.
Personal
Conversations between bots and a
single user.
Group chat
Chat between a bot and two or more
users.
(In developer preview – Sep 2018)

Bot Events in Microsoft Teams
Activity objects are used to pass information back and forth between bot and channel (or user).
Activities can represent Events, denoted by ActivityType == ‘conversationUpdate’
Team Member Events
teamMemberAdded
teamMemberRemoved
Payload object contains
added/removed members
*Adding bot fires this event
Channel Events
channelCreated
channelRenamed
channelDeleted
ChannelData object reflects
current state
Reactions
reactionsAdded
reactionsRemoved
replyToId contains the ID of the
specific message
Team Events
teamRenamed
ChannelData object reflects
current state

Teams Context
Your bot can access additional context about the team or chat, such as user profile. This information
can be used to enrich your bot's functionality and provide a more personalized experience.
Members in conversation
var mbrs = await connector.Conversations
.GetConversationMembersAsync(
message.Conversation.Id
);
foreach (var mbr in mbrs.AsTeamsChannelAccounts())
{
[...]
}
Channels in Team
ConversationList channels =
client
.GetTeamsConnectorClient()
.Teams
.FetchChannelList(
activity.GetChannelData<TeamsChannelData>()
.Team.Id
);

Proactive Messaging
A proactive message is an activity sent by a bot to start a conversation
Start Personal conversation
Must have user’s information cached
• From team roster
• From previous interaction with user
• From conversationUpdate events
Use the CreateOrGetDirectConversation method
Start Channel conversation
Must have channel information cached
• From previous interaction in channel
• From conversationUpdate events
To create conversation:
• Create ConnectorClient with service Uri
• Call connector.Conversations.CreateConversationAsync,
passing channel account for bot
• Set Conversation property of new message
• Call connector.Conversations.SendToConversationAsync

Activity Feed
Optionally send personal chat messages into the
feed as preview cards summarizing your app's
activity.
Construct the message such that choosing the card
navigates the user straight to the message or object
that triggered the notification, such as an entity in a
tab.
Must include Text and Summary properties

Notification only bots
Bots can update the activity feed
If the sole purpose of the bot is to deliver notifications,
consider a notification only bot.
• Users cannot message your notification-only bot
• Users cannot @mention the bot
bots node
isNotificationOnly property
"bots": [
{
"botId": "[MicrosoftAppId]",
"scopes": [
"personal",
"team"
],
"isNotificationOnly": true,
}
]

Send and Receive file
Sending and receiving files through a bot can be accomplished via two different APIs
Microsoft Graph API
Obtain access to OneDrive folder (user or group drive)
Get reference to file
Post message to conversation with card attachment
Microsoft Teams API
Personal context (1:1) only
Enable files in manifest
Teams client provides a file picker experience
Teams client will store file in OneDriveCreate and then post
activity with metadata, including content URL
Bot must download and handle file as appropriate

Enable send and receive
Teams client will handle file selection and
storage
Handles scenario User -> Bot
bots node
supportsFiles property
"bots": [
{
"scopes": [
"personal",
"team"
],
"supportsFiles": true,
}
]

Demo
Sending and Receiving files

Events and Queries
Responding to User Requests
Message Extensions in App Manifest
Demo
Messaging Extensions

Events and Queries
Activity payload
Type is invoke
Name identifies type of event
composeExtension/query
composeExtension/querySettingUrl
composeExtension/setting
Sent to registered bot endpoint
Teams Connector NuGet package provides
detection methods and data models

Events and Queries
Query events
Query data sent to bot
Activity.GetComposeExtensionQueryData()
• Verify commandId and parameters
• Use parameter value to query your service
Respond with attachment layout of “List”

Events and Queries
Settings events
If canUpdateConfiguration is true, Teams
will send Settings events in response to
user action
onQuerySettingsUrl
• Sent when “Settings” clicked
• Return Url of settings page
• Teams will render page
onSettingsUpdate
• Sent when settings page is closed
• Storage of settings is developer
responsibility

Service must respond within 5 seconds.
Response is not an activity sent via the Bot Framework.
Response is an HTTP Response:
• HTTP Status of 200
• Content type application/json
• Response body must contain a valid composeExtension object.

composeExtension node
Associated with a registered application
Personal and Team scopes
Define command UI and parameter
Multiple extensions
Your extension shown along
with all others added to Teams
"composeExtensions": [
{
"scopes": [
"team"
],
"canUpdateConfiguration": true,
"commands": [
{
"id": "searchCmd",
"description": "Search Bot Channels",
"title": "Bot Channels",
"initialRun": false,
"parameters": [
{
"name": "searchText",
"description": "Enter your search text",
"title": "Search Text“
}
]
}
]
}
]

Using Cards in Bots
Using Cards in Messaging Extensions
Adaptive Cards support in Microsoft Teams
DEMO
Using Cards in Microsoft Teams

Using Cards in Bots
Adaptive Card
A customizable card that can contain any
combination of text, speech, images,
buttons, and input fields.
Supported in Teams, Outlook, Windows,
etc.
Hero
Largest card
Best used for articles, long descriptions or
scenarios where your image is telling most of
the story
Receipt
A card that enables a bot to provide a receipt
to the user. It typically contains the list of items
to include on the receipt, tax and total
information, and other text.

Respond with attachment layout of “List”
Format each query result as a card
Do not include actions

Microsoft Teams supports three action types for Adaptive cards:
• Action.OpenUrl
• Action.Submit
• Action.ShowCard
Actions other than these are not supported

Demo
Adaptive Cards in Microsoft Teams

Summary
Conversations
Notification-Only Bots
Sending and Receiving Files (Preview)
Events and Queries
Using Cards in Bots

Content References
OfficeDev – Bot, Messaging Extensions
and Cards by Microsoft

Bot & AI - A Bot for Productivity

More Related Content

Similar to Bot & AI - A Bot for Productivity (20)

More from Marvin Heng (20)

Recently uploaded (20)

Bot & AI - A Bot for Productivity