Becoma an Ace in Analytics
- 1. Become an Ace in Analytics
- 2. Speaker Intro Tim De Keukelaere Freelance Consultant Tim.De.Keukelaere@IT-Essence.be @Tim_DK http://be.linkedin.com/in/timdekeukelaere/ http://www.dekeukelaere.com Timdk_itpro Ken Goossens Sr. Program Manager Ken.Goossens@microsoft.com @Goosken https://be.linkedin.com/in/kengoossens-ems/ http://mc2mc.be N/A
- 3. Agenda • Desktop Analytics (DA) • Office 365 ProPlus Upgrade Readiness • User Experience Analytics (UXA)
- 6. Transforming Deployment strategies Leveraging Telemetry to general meaningful insights Providing transparency of known issues Validating critical assets
- 7. Data Flow
- 8. Set up diagnostic data Select your Windows Diagnostic data level • Basic is all you need for upgrade assessments • Limit Enhanced adds app usage and health data (Will fallback to basic for 1709 and lower, CDO for Windows 7 and 8.1) With 1803 DeviceName is no longer sent with diagnostic data • Allow Device Name in diagnostic data: Enabled
- 13. What’s new in Desktop Analytics? On-demand data refresh Readiness insights for LOB apps Phased deployment integration ISO certification Better pilot representation Data migration from Windows Analytics Additional Compatibility Insights Auto marking modern apps and system components
- 14. Improvements to App Confidence Engine Framework Dependency (.NET, VC++, Silverlight) OS Version Violations Driver Dependency UI Access 16-bit binaries Non-DPI awareness UAC Violations VB6 Dependency Java Dependency Analytics Data Ready for Windows + MS Known Issues Framework Dependency (.NET, VC++, Silverlight) OS Version Violations Driver Dependency UI Access 16-bit binaries Non-DPI awareness UAC Violations VB6 Dependency Java Dependency Analytics Data Ready for Windows + MS Known Issues Risk Assessment with Possible Remediations Low Medium High
- 16. Roadmap Efficient asset classification and validation Reduce latency for device changes Additional health insights Increasing upgrade confidence Intune reporting and integration Support environments with multiple hierarchy
- 18. Configuration Manager 1910 allows IT admins to assess device readiness to deploy Office ProPlus with confidence Office readiness reports show which devices are ready to deploy Recommendations identify the minimum set of pilot devices Remediation and health reports address issues impacting roll-out Typically ~80% of devices are ready based on worldwide or internal adoption of add-ins and (optional) macro assessment Pilot coverage recommendations & health reporting Validate & Remediate Report
- 23. Evaluating Office Readiness Prerequisites – make sure hardware inventory collection is enabled and the Office classes are included Data will begin to be populated in the dashboard once the summarization tasks and other calculations are complete You can see at a glance which devices are ready to upgrade based on their inventory
- 25. Background
- 26. Eliminate boot/sign-in delays due to legacy hardware, misconfigured policies, or 3rd party agents Reduce support ticket volumes by fixing common support issues before customers call help-desk For the best user experience A dashboard tying this all together Startup performance Remediation scripting Recommended software Experience score Purpose
- 27. Helps IT improve user productivity and reduce support costs Administered from the Microsoft Endpoint Manager portal Doesn’t require co-management Initial feature set in limited preview: Startup perf – eliminate long boot times Proactive remediations – fix support issues before end-users notice the problem Recommended software – for the best user experience In a nutshell …
- 28. IT has limited visibility into end-user experience Most IT departments rely on support to identify end-user problems End- user Tier 1 support Tier 2 Tier 3 Product group most issues minutes to resolve hours to resolve days to resolve weeks/months to resolve not reported
- 29. A better way… Proactive end-user experience optimization integrated into EMM tools Provide IT with an end-user experience “score” and recommendations Monitor Pro-active remediation • Perf • Reliability • User SAT • … Report • User experience score • RecommendationsAnalytics and Remediation logic built into SCCM/Intune Customer value: Save $$$ • Improved end user productivity (better perf/reliability/…) • Reduced support costs (fixes applied before getting to tier1/2/…) Config changes MSFT value: Increased adoption • Increase value of our enterprise offering • Incent customers to get current (sw + hw) and modern (less 3rd party bloatware) HW procurement standards changes
- 30. Target personas 1. IT pro: Proactive support. Fix issues before they get to reactive support (tier 1/2/3) 2. IT pro: Endpoint management. Ensure config changes don’t cause UX regressions 3. End user. A small % of proactive remediations may require end-user action 4. Reactive support persona. The data will also power reactive support experiences (tier 1/2/3)
- 31. Device Service ConfigMgr Gateway Service Architecture: Data Flow
- 36. Manage Overview Properties Search (Ctrl+/) Dashboard Dashboard Reports > User experience analytics - Proactive remediations My custom script Proactive remediations Delete Monitor Device status 10000 5000 1000 500 200 100 50 # Devices NO ISSUE 32 ISSUE FOUND 32 FAILED 42 Detection status trend 11/1/2017 11/7/2017 11/14/2017 11/21/2017 11/30/2017 Duplicate Detection status NO ISSUE 31 FAILED 4 ISSUE FOUND 17 PENDING 2 7/23/19 12:43PM Remediation status ISSUE FIXED 10 RECURRED 4 NOT RUN 2 FAILED 1 7/23/19 12:43PM 7/23/19 12:43PM
- 37. Roadmap OS reliability App health Productivity score Additional remediation Anomaly detection Service now integration impact of security features on perf right-size hardware reports
- 41. Thanks to our sponsors!
Editor's Notes
- #9: CDO – Commercial Data Opt-in
- #14: Windows Analytics retired 31/01/2020 - https://support.microsoft.com/en-us/help/4521815/windows-analytics-retirement Data migration no longer available as of 03/02/2020 How long do I have to migrate my data? Windows Analytics Upgrade Readiness solution is being retired on January 31st, 2020. After retirement, based on the Log Analytics workspace retention policy, data will go away over time. Customers that want to keep the data need to migrate or export before that occurs. Source: https://docs.microsoft.com/en-us/configmgr/desktop-analytics/faq#existing-windows-analytics-customers Manage inputs for any app at a global level or per deployment plan. In the Desktop Analytics portal, in the Manage menu, select Assets. Then select Apps. Use the Type and Category columns to manage these app categories: For store apps, filter Type as Modern For system apps, filter Category as Background process or Windows component Source: https://docs.microsoft.com/en-us/configmgr/desktop-analytics/about-assets
- #15: There are several sources that Desktop Analytics uses to generate the assessment rating for applications: Microsoft known issues Ready for Windows catalog Advanced insights More Info: https://docs.microsoft.com/en-us/configmgr/desktop-analytics/compat-assessment
- #29: Ken: But that’s a poor signal, since: It is slow; and many issues are caused by IT configuration changes, so need faster feedback loop It’s expensive; better to move remediation to the left, though proactive insights Most issues go unreported; end-users suffer in silence, don’t get known fixes End-users don’t know how to optimize their experience, so their complaints should not be the basis of what to optimize
- #31: Note: the first two personas use the same data, but in a different way. If an app crashes 60% of the time before an end-point config change, and “only” 50% after, the end-point management persona has a green light, but the proactive support persona wants additional action
- #32: Main take-aways: SCCM connector is “cloud attached” (just requires connection to an Intune tenant, not co-managed devices) Data flows through our existing enterprise pipelines (no reliance on Windows diagnostic data) Data is available via MS-Graph
- #39: “Startup performance is often affected by 3rd party agents. We are putting the finishing touches on insights to show you which apps and services are impacting your startup time” “We’re leaving out specific names so as not to call out particular ISVs, but when you run this in your tenant, you will know”
- #40: “The value report provides a quick summary of the benefits you have obtained, in the last month, from optimizing the user experience (compared to your baseline)”
- #41: “Named filters allow you to see your experience score on a subset of your devices”