Measuring Microsoft 365 Copilot and Gen AI Success
Session | Measuring Microsoft 365 Copilot and Gen AI Success with Viva Insights and Purview Presenter | Nikki Chapple 2 x MVP and Principal Cloud Architect at CloudWay Event | European Collaboration Conference 2025 Format | In person Germany Date | 28 May 2025 š Measuring Copilot and Gen AI Success with Viva Insights and Purview Presented by Nikki Chapple ā Microsoft 365 MVP & Principal Cloud Architect, CloudWay How do you measure the successāand manage the risksāof Microsoft 365 Copilot and Generative AI (Gen AI)? In this ECS 2025 session, Microsoft MVP and Principal Cloud Architect Nikki Chapple explores how to go beyond basic usage metrics to gain full-spectrum visibility into AI adoption, business impact, user sentiment, and data security. šÆ Key Topics Covered: Microsoft 365 Copilot usage and adoption metrics Viva Insights Copilot Analytics and Dashboard Microsoft Purview Data Security Posture Management (DSPM) for AI Measuring AI readiness, impact, and sentiment Identifying and mitigating risks from third-party Gen AI tools Shadow IT, oversharing, and compliance risks Microsoft 365 Admin Center reports and Copilot Readiness Power BI-based Copilot Business Impact Report (Preview) š Why AI Measurement Matters: Without meaningful measurement, organizations risk operating in the darkāunable to prove ROI, identify friction points, or detect compliance violations. Nikki presents a unified framework combining quantitative metrics, qualitative insights, and risk monitoring to help organizations: Prove ROI on AI investments Drive responsible adoption Protect sensitive data Ensure compliance and governance š Tools and Reports Highlighted: Microsoft 365 Admin Center: Copilot Overview, Usage, Readiness, Agents, Chat, and Adoption Score Viva Insights Copilot Dashboard: Readiness, Adoption, Impact, Sentiment Copilot Business Impact Report: Power BI integration for business outcome mapping Microsoft Purview DSPM for AI: Discover and govern Copilot and third-party Gen AI usage š Security and Compliance Insights: Learn how to detect unsanctioned Gen AI tools like ChatGPT, Gemini, and Claude, track oversharing, and apply eDLP and Insider Risk Management (IRM) policies. Understand how to use Microsoft Purviewāeven without E5 Complianceāto monitor Copilot usage and protect sensitive data. š Who Should Watch: This session is ideal for IT leaders, security professionals, compliance officers, and Microsoft 365 admins looking to: Maximize the value of Microsoft Copilot Build a secure, measurable AI strategy Align AI usage with business goals and compliance requirements š Read the blog https://nikkichapple.com/measuring-copilot-gen-ai/
Measuring Microsoft 365 Copilot and Gen AI Success
- 1. ECS 2025 Measuring Copilot and Gen AI Success with Viva Insights and Purview Nikki Chapple | MVP Principal Cloud Architect | CloudWay
- 2. Premium Partner Premium Sponsor Diamond Sponsor Platinum Sponsor Gold Sponsor Silver Sponsor Technology Partner Bronze Sponsor Startup Silver Startup Bronze Startup Sponsor
- 3. Survey results question 1 Is your organization currently using Microsoft 365 Copilot?
- 4. Survey results question 2: Are you reporting on your Microsoft 365 and Gen AI usage?
- 6. Business Rewards versus Security Risks of Gen AI
- 12. Reporting in the Microsoft 365 Admin center
- 13. M365 Admin Center - Copilot Overview
- 14. Copilot Overview
- 15. M365 Admin Center - Usage reports
- 17. Microsoft 365 Copilot Readiness
- 19. Microsoft 365 Copilot Usage
- 20. Microsoft 365 Copilot Agents
- 21. Microsoft 365 Copilot Chat (non M365 Copilot users)
- 22. M365 Admin Center - Adoption Score
- 23. M365 Admin Center - Adoption Score Copilot
- 27. 1: Copilot Analytics by Viva Insights
- 30. The Copilot Dashboard (Part of Viva Insights and found in the Teams client )
- 44. But wait there is more User sentiment in the Copilot Dashboard
- 50. And there is even more Copilot Business Impact Report (Preview) Advanced reporting with Power BI
- 53. 2: Gen AI activity using Purview Data Security Posture Management for AI
- 54. DSPM for AI Out of the box Copilot experiences reports
- 55. Prerequisites Audit enabled Copilot licenses assigned Configuration None Optional Sensitivity labels RBAC Global reader or Security reader ā view DSPM for AI Copilot experiences reports
- 58. If you use sensitivity labels
- 60. All users are āno riskā as IRM polices are not configured
- 67. Problem: We do not see 3rd Party Gen AI Activity
- 68. āŖof users bring their own AI tools 78%
- 69. DSPM for AI 3rd party Gen AI Reports (E5 Compliance)
- 70. Prerequisites Audit enabled Devices onboarded Purview Extension deployed Licensing E5 Compliance Copilot licenses not required Configuration eDLP Polices IRM policies (optional) RBAC Compliance Admin ā configure policies Security reader ā view IRM ā view Risky user info 3rd party Gen AI usage reports
- 74. Track risky behaviours Uses IRM (E5 Compliance)
- 78. Track Agents
- 82. Summary
- 85. Purview Viva Insights M365 Admin reports ā¢ Discover ā¢ Data security controls ā¢ Risk management ā¢ 3rd party Gen AI apps ā¢ Behaviours ā¢ Segmentation ā¢ Qualitative ā¢ KPIs ā¢ Quantitative ā¢ Readiness ā¢ Usage ā¢ Adoption Comprehensive Copilot Reporting
- 86. Using the Microsoft reporting addresses
- 87. THANK YOU, YOU ARE AWESOME PLEASE RATE THIS SESSION IN THE MOBILE APP. Nikki Chapple Contact Me ā