Microsoft Teams Development - Conversational AI
Download as PPTX, PDF1 like287 views
The document discusses using conversational AI with Microsoft Teams to improve workplace communication and collaboration. It highlights some of the challenges with current communication methods and how Teams integrates tools like chat, meetings, calls and Office 365 apps. It also describes capabilities for building bots, commands and actions with Teams to help users complete tasks through natural language. Finally, it provides examples of how conversational AI could be used to build virtual assistants and modernize company FAQs.
Microsoft Teams Development - Conversational AI
- 1. Partner: Veranstalter: SharePoint konferenz Microsoft Teams Development – Conversational AI in Kombination mit dem Hub für Teamwork
- 2. ABOUT US THOMAS GÖLLES MICROSOFT MVP (O365) SOLVION https://thomy.tech @thomyg Head of Modern Workplace Solutions Graz, Austria STEPHAN BISSER MICROSOFT MVP (AI) SOLVION https://www.cloudguy.pro @cloudguy_pro Technical Lead Graz, Austria
- 4. Despite technological advancements, efficient communication in the workplace remains challenging for most Average percentage of each day a knowledge worker spends managing email* 28% Percentage of managers who say they are missing important information, daily, due to information overload* 59% Percentage of time avg knowledge worker spends, each day, tracking down information* 20% *Microsoft-sponsored Gartner research report, 2017
- 5. Microsoft Teams Communicate through chat, meetings & calls Collaborate with deeply integrated Office 365 apps Integrate the tools you need using apps, processes, and workflows Work with confidence enterprise level security, compliance, and manageability
- 6. Evolve how your people work, with the tools they need Organization-based applications Partner applications Office 365 applications Departmental tools Employee resources Support & info Processes & workflow Ready to use Custom apps Vertical solutions RetailHealthcare BankingManufacturing
- 7. Microsoft graph Power your apps using Graph. Automate teamwork and add richness using data from M365 Build and manage for your organization Enterprise developers Upload to your organization’s app catalog Bots and connectors Notify and help users get tasks via natural language Commands and actions Trigger commands to kick off workflows or search content ISVs Publish to AppSource and make your app available in the Teams app store Build richer apps that allow users to take action, complete tasks and workflows, and collaborate with greater efficiency Recap of the Teams platform Tabs Surface rich content within Teams Reach across devices IT admins Robust tools to manage apps in your organization Publish and reach Teams users
- 8. Building Teams apps Today
- 9. Manifest
- 10. The App Package
- 11. Teams App Studio
- 13. • Enable users to complete tasks while in the flow of their work • Minimize switching by surfacing apps contextually • Collect inputs through rich modal forms Commands and actions in Teams Messaging extension Command box Compose box Task module to collect user input or surface richer information
- 14. • Enrich link sharing with custom previews • Register for domains to get link shared events • Add actions to preview to make link sharing more productive Smart link unfurling Available in dev preview
- 15. Collecting input from the user
- 16. • Tabs can access device capabilities such as camera and microphone • Deep link from your tab to messages and other content in Teams Making your tab more native
- 17. • Apps can utilize SSO for simplified login experience for the user • Powered by Azure Active Directory Authentication Coming soon
- 18. • Apps can utilize SSO for simplified login experience for the user • Use this across tabs, bots or messaging extensions Authentication
- 19. • Improvements to for team lifecycle automation • Application permissions for installing or upgrading apps • Creating teams using templates • Support email and deep link to a channel • APIs are now available for GCC High and DoD customers! • Sending and reading messages in your organization • Read 1:1 and group chat messages • Post replies to messages • Manage shifts for firstline workers • New APIs for creating, listing, and updating shifts • Connect Shifts app to external scheduling services Automate teamwork via Graph
- 20. Graph can automate team lifecycles Create a team Add members and owners Configure team settings Add channelsInstall apps Add tabs Archive or delete the team when the time comes
- 21. • Increase the reach of your bot by bringing it to 1:1, group chat, and meeting chats • Track 1:1 discussions between manager & direct report • Create a quick poll with options for the next follow-up meeting Bring bots anywhere Available in dev preview
- 23. What is Conversational AI?
- 24. Conversational AI • A new user interface paradigm • Exposes software services through conversational interface • In apps, browser and on IoT devices • Pro-active capabilities (Virtual Assistant etc.) • Bots Conversational AI is a subfield of artificial intelligence focused on producing natural and seamless conversations between humans and computers
- 25. Modernizing the company FAQ Company info Departmental knowledge Troubleshooting/support
- 26. Microsoft Bot Framework Users Direct Line Mail Bing kik Facebook Messenger Web Chat 3rd Party 3rd Slack GroupMe CortanaMicrosoft Teams Telegram Twilio (SMS) SkypeOffice 365 Channels * still in preview Conversational AI Platform Bot Builder SDKs C# .NET SDK Java SDK*JavaScript SDK Python SDK* Cognitive ServicesVision Speech Search Language Knowledge Patterns & ConceptsRecognizers CardsMiddlewareState Dialogs Web App Bot Bot Channels Registration Bot Service Types HostingMicrosoft Azure On-premises Other Cloud Service Providers
- 27. Point of Interest Mail Automotive Custom Hospitality Conversation Skills (Customisable) APIs Productivity 1st/3rd Party Directory Tasks Calendar AI Capabilities Language Understanding Speech Vision QnA Knowledge Sources Manuals (PDF) Data Sources General Knowledge 3rd Party Assistants IoT Edge Devices Type Speak Tap User Input Adaptive Cards Channels Azure Bot Services Virtual Assistant Your Brand Your Personality Dialogs Language Model Virtual Assistant Your brand, your assistant
- 28. Conversational mechanisms • Text, with optional media attachments • Input prompts • Suggested actions: Buttons, numbered items in a list, etc. • Rich cards, rendered as a list or carousel • Images, buttons, audio, animations, video, user sign-in, etc. • Hero Cards • Audio Cards • Animation Cards • Thumbnail Cards • Receipt Cards • Sign In Cards • Video Cards • Adaptive Cards
- 29. Yes No Maybe
- 30. Adaptive Cards Native rendering on any platform Automatically adapt to the Host UX Low cost, targeted at the long tail Purely declarative, no code
- 31. Demo – Walkthtrough 0 Code Teams Bot Creation
- 34. Danke für die Aufmerksamkeit!
- 35. @thomyg @cloudguy_pro Microsoft Teams Development – Conversational AI in Kombination mit dem Hub für Teamwork SharePoint Konferenz 2019
Editor's Notes
- #5: 4
- #9: So, what does it take to build a Teams app today? Let’s start with some basics.
- #10: The manifest is where the app is defined. It’s the manifest that provides not just the app metadata, but also all of the components and hooks that make up its functionality. It’s where the tabs, bots and more are all referenced.
- #11: For an app in teams, the manifest and the app icons are combined into a single zip file: the app package.
- #12: The manifest is an easily-edited JSON file, but just like how developers sometimes prefer an IDE to help with the tedious parts of development and configuration, Teams developers have Teams App Studio to help with app setup. You can use it as a complete app as shown here, or as a bot which uses your responses to build the app.
- #13: Ok, so now you’ve seen the basics of building Teams apps, let’s dive into the features that are new or coming to the platform
- #16: 15
- #21: Here’s an example of what you might automate with the Graph for that incident response example. <click through each one> You can automate everything from the team creation through to adding members, tables, apps, and channels, and then automatically dispose or archive the team when the work is done.
- #30: 29
- #31: Microsoft Build 2017