Metrics That Matter: How to Measure Digital Transformation Success
1 like690 views
The document presents a framework for measuring digital transformation success, emphasizing the importance of context in metrics, continuous agile journey adjustments, and ecosystem metrics such as lead time and team velocity. It offers actionable tips like extending views to post-deployment and addressing bottlenecks to improve alignment with business objectives. The ultimate goal is to achieve better value delivery and operational efficiency through effective use of the digital.ai value stream platform.
Metrics That Matter: How to Measure Digital Transformation Success
- 1. | © Digital.ai.2020© Digital.ai.2020 Metrics that Matter How to Measure Digital Transformation Success
- 2. | © Digital.ai.20202 Metrics that Matter How to Measure Digital Transformation Success Andreas Prins VP of Product Strategy XebiaLabs – Now Digital.ai Amy Johnston Director of Product Marketing XebiaLabs – Now Digital.ai
- 3. | © Digital.ai.20203 The foundation of the Digital.ai Value Stream Platform Enterprise Agile Planning & Collaborative Development Release Orchestration & Deployment Automation In-Application Protection & Threat Analytics Mobile App & Cross-Browser Testing AI-Powered IT Business Analytics
- 4. | © Digital.ai.20204 What we’ll talk about today •Putting metrics in context •Focusing on what matters •Four tips to get you started
- 5. | © Digital.ai.2020 Putting metrics in context 5
- 6. | © Digital.ai.20206 Metrics provide more value in context Agile Journey Atmosphere Ecosystem Live Environment
- 7. | © Digital.ai.2020 Agile Journey 7
- 8. | © Digital.ai.20208 The Agile Journey requires continuous planning, observation and adjustment (1/3) Discover where to go with your digital transformation and Agile Journey. This can be done through explorer maps. • http://www.ideetotit.nl/uncategorized/explorer-maps-krachtig-instrument-strategie-naar-executie/ Open source available at: http://ryxz.nl
- 9. | © Digital.ai.20209 The Agile Journey requires continuous planning, observation and adjustment (2/3) Using a visual instrument such as an Obeya will drive the right conversations to lead an entire company, give a clear understanding of the current state, and allow adjustment when needed.
- 10. | © Digital.ai.202010 The Agile Journey requires continuous planning, observation and adjustment (3/3) Using a visual instrument such as a team board will drive the conversations in daily team meetings, give a clear understanding of the current state, and allow adjustment when needed. The discovery of the metrics that matter to your team is a never- ending process of adjustment and improvements
- 13. | © Digital.ai.202013 The importance of psychological safety Source: https://rework.withgoogle.com/blog/five-keys-to-a-successful-google-team
- 14. | © Digital.ai.202014 The Smell-O-Meter
- 16. | © Digital.ai.2020 Examples of ecosystem metrics • Lead time • Story points • Team velocity • Sprint burndown • Broken builds • Automated test failure rate • Manual test failure rate • Cycle time • Deployment frequency • Deployment duration • Deployment failure rate • Defect escape ratio • Field incidents • Customer tickets 16
- 17. | © Digital.ai.202017 Focus on breaking down silos
- 18. | © Digital.ai.2020 Examples of ecosystem metrics • Lead time • Story points • Team velocity • Sprint burndown • Broken builds • Automated test failure rate • Manual test failure rate • Cycle time • Deployment frequency • Deployment duration • Deployment failure rate • Defect escape ratio • Field incidents • Customer tickets 18
- 19. | © Digital.ai.202019 Invest in automation at every point
- 20. | © Digital.ai.2020 Examples of ecosystem metrics • Lead time • Story points • Team velocity • Sprint burndown • Broken builds • Automated test failure rate • Manual test failure rate • Cycle time • Deployment frequency • Deployment duration • Deployment failure rate • Defect escape ratio • Field incidents • Customer tickets 20
- 21. | © Digital.ai.2020 Live Environment 21
- 22. | © Digital.ai.202022 Decide what really matters
- 23. | © Digital.ai.202023 Observe applications in the real world
- 24. | © Digital.ai.202024 Imagine a team’s journey... Agile Journey Atmosphere Ecosystem Live Environment
- 25. | © Digital.ai.2020 Focus on what matters 25
- 26. | © Digital.ai.202026 Before you start, understand where you want to go Use “impact mapping for business outcomes” as a technique to determine the goals to achieve.
- 27. | © Digital.ai.202027 Using data from outputs to measure outcomes
- 29. | © Digital.ai.2020 Four Tips to Get You Started 29
- 30. | © Digital.ai.2020 Four tips to get you started 1. Extend your view to post-deployment 2. Discuss the success of an initiative with your business partner 3. Take bottlenecks seriously 4. Exercise: Map IT activities to your company objectives 30
- 31. | © Digital.ai.202031 Extend your view to post-deployment Digital.ai continuumDigital.ai versionone Digital.ai release Digital.ai deployDigital.ai app protect Strategic Theme Epic/Capability/ Features/Story Story DeployRelease Protect Digital.ai releaseDigital.ai versionone Measure Pivot or Persevere Continuous Operational Telemetry Motley Bank Mortgage App Digital.ai continuumDigital.ai versionone Digital.ai release Digital.ai deployDigital.ai app protect Strategic Theme Epic/Capability/ Features/Story Story DeployRelease Protect Digital.ai releaseDigital.ai versionone Measure Pivot or Persevere Digital.ai continuumDigital.ai versionone Digital.ai release Digital.ai deployDigital.ai app protect Strategic Theme Epic/Capability/ Features/Story Story DeployRelease Protect Digital.ai releaseDigital.ai versionone Measure Pivot or Persevere Continuous Vulnerability Telemetry Development Value Stream Iterations Customer Fulfilment Process
- 32. | © Digital.ai.202032 Discuss the success of an initiative with your business partner • Every discipline involved in the definition and creation of an initiative has its own view • Clear articulation and established connections between practices allow value flow in your organization Lens Value Capture Value Creation Value delivery CEO of the Enterprise Serving our customers with a new product Strategy statement Rollout of new product offering Line of business Roadmap and portofolio changes Well articulated epics Set of customer facing features, measures of business performance Product Manager Customer investigation, prototypes Well defined Features New version of software in prod Team Stories, architecture diagrams Tens of stories marked as done Artifact Engineer Line of code, test defenitions Code commit Merge to master Digital.ai Planning allows you to cascade and structure your initiatives
- 33. | © Digital.ai.202033 Spend time with your teams discovering bottlenecks Bottlenecks have many appearances: • Backlog laziness • Agenda craziness • Pipeline haziness • Delivery bumpiness
- 34. | © Digital.ai.202034 Exercise: Map IT activities to your company objectives Impact Outcome MappingExplorer Maps Improvement starts with alignment and adjustment to a shared direction! Open source available at: http://ryxz.nl
- 36. | © Digital.ai.2020 • Dashboards • Security / Compliance • Automated Audits • Value Stream Metrics • Predictive Analytics (AI/ML) DEPLOYMENT AUTOMATION DigitalTransformation with the Digital.aiValue Stream Platform Business Value Stream ENTERPRISE AGILE PLANNING strategies portfolios epics features A P P P R O T E C T Common Data Model Business Outcomes Concept work item …… I N - A P P S E C U R I T Y SECURITY MONITORING AND INTELLIGENCE (AI/ML) RELEASE ORCHESTRATION Development Value Stream
- 37. | © Digital.ai.2020 Questions? Follow us on Twitter @digitalaisw 37