SlideShare a Scribd company logo
Measuring for Accountability
                   Al Goerner
                   Agile Edge - UK


                         30 April 2008
Metrics for Many Purposes

     Keep metrics diagnostic
     and constructive!                                       Expectation                     Business
                                                                                             Analysts
                                                             Management
          Where are we?                                                            Project Sponsor
                                                                                   & Stakeholders
          Are we on track?
          Are in trouble? Why?
          What can we improve?
                                                                                   Direction and
      “Tell me how you will measure me,                          Project Manager
                                                                                   Risk/Issue
      and I will tell you how I will behave.”   Motivation
                                 - Goldratt                                        Management


     Punitive metrics
     are self-defeating!                                      Development
                                                                 Team
                                                                       Test Team

#2
Agile Metric Objectives … Distilled

     Outcomes-Oriented
        Measures value delivered to the customer, not effort consumed.
     Motivated
        Intended to address relevant questions, not random speculations.
     Organic
        Based on readily available data – from your current processes.
     Diagnostic
        Helps determine what is going wrong and what to do about it.
     Pattern-based
        Founded on regular, reasonable, teachable patterns



#3
Metrics
                               Iteration-level    Release-level               Portfolio-level                    Enterprise
                                  (day-to-day)    (iteration-to-iteration)   (relse-to-relse, prod-to-prod)   (qtr-to-qtr, year-to-year)
                                Pacing & Flow    Progress & Fitness Value & Opportunity                       Agility & Vitality



   Executive & Line                                                                                                                        Metrics are
    Management
Using Resources Effectively!                                                                                                                NOT Evil!


 LoB Product Owner                                                                                                                           If You do
      & Mgmt.
  Build the Right Thing!                                                                                                                    them Right,
                                                                                                                                            Metrics are
                                                                                                                                              Practical
 Development Team                                                             Start w/ Basics
                                                                                                                                           Self-Defense!
  Build the Thing Right!                                                      Then, Build Up




                       If You Don’t Measure It, You Don’t Understand It.

  4
Essential Release-level
    Project Mgmt. Questions
     Essential Progress Questions
         Is this release on-time?
         Is this release healthy?
     Essential Quality Questions
         Is this release likely to be fit-for-release when it is
         ready-for-release?
         Is this project (in general) and this release (in
         particular) effectively satisfying our customer’s
         needs?
     Ultimate Diagnostic Question
         What can be done to get this project back on-track?

#5
Release Progress
         120.0
                                                                                                    112

         110.0

         100.0                                                                             94


                90.0

                80.0                                                              75

                                                                      68
                70.0
Units of Work




                                                               65
                                                   63

                60.0
                                         52
                                                                                           50        51
                               47                              47     48          48
                50.0                               46
                       43                43
                               40
                       38
                40.0
                                                   42                                                            33
                       40                40
                       37      38        37                    37                                    38                 29
                               36                  36                                      36
                30.0                                           33     34                                                        24
                                                                      30          31
                                                                                           27        28                                   20
                                                                                  26
                20.0                                                                                                                               15
                                                                                                                                                        11
                10.0            6                 5.25         5.75   4.75       5.25     4.75                                                                 6
                       3                 2.5                                                        3.75
                       0        0         0         0           0      0          0         0        0                                                                  1

                 0.0            3                   3          3.5    3.5         4
                       1                 1.5                                               0.5       0
                       1        2         3        4            5      6          7         8        9           10     11      12       13        14   15    16       17       18       19
                                                                                                          Iteration #

                            Ideal Burndown Cone - Low                       Ideal Burndown Cone - High                  All-Categories Scope Elements        Value-Categories Scope Elements

                            Planned Cumulative Scope Expansion              Planned Value Scope Expansion               All-Categories Work Remaining        Value-Categories Work Remaining
#6
                            All-Categories Weighted Velocity                Value-Categories Weighted Velocity          Projected Burndown
Workqueue/Backlog Breakout
                120




                100

                                                                                                                                                4


                80
                                                                                                                                   2            22

                                                                                                                                  13
Units of Work




                                                                                                                                                10
                60                                                                                                  6              8
                                                                                                     2              3                           6
                                                                                    2                2                             5
                                                                     2                               4              5
                                                                     4              4
                                                   1                                                                              14            14
                                                                                   12               13              13
                40                                                  12
                                                   12
                                  12
                      12



                20                                                                                                                              37
                                                                    34             35               35              35            36
                                                   31
                      26          28




                      1           2                3                 4             5                 6              7              8            9
                                                                               Iteration #

                      Feature    Feature                Requirements     Committed           Technical   Special (Level-2)   Risk/Issue Mgmt.
  #7                  Requests   Change Requests        Clarifications   Defect Repairs      Debt        Tests               Tasks
60                                                                                                                               120.0%
                     117%




50       100%        100%            100%         100%            100%            100%                                           100.0%

                                     93%                                                       94%
                                                                                                                         92%
                                                                                               89%           88%

40                                                                                                                       80%     80.0%
                                                                                                             78%


         67%

30                                                     Value Scope                                                               60.0%




20                                                                                                                               40.0%

                                                                              Level-1 Accepted
                                                                                                             28.9%       29.5%
                                                  26.6%           27.2%           27.7%        27.7%
                                     24.9%                                                                               12
         22.0%       23.1%
10                                                                                                                               20.0%
                                                                              Level-2 Accepted
                                                                                                             6           12%
                                                                                               10%           10%
                                                  9%              9%              8%
                                                  2
                                     2%                                                        1
0        0%
         0           0%
                     0               0                            0               0                                              0.0%
     1           2               3            4               5               6            7             8           9

                     Value Scope                       Level-1 Accepted                   Level-2 Accepted
                     Outstanding Technical Debt        Feature Churn                      Requirements Churn
#8                   Planning Stability                Regression Stability
Metrics
                               Iteration-level    Release-level               Portfolio-level                    Enterprise
                                  (day-to-day)    (iteration-to-iteration)   (relse-to-relse, prod-to-prod)   (qtr-to-qtr, year-to-year)
                                Pacing & Flow    Progress & Fitness Value & Opportunity                       Agility & Vitality



   Executive & Line                                                                                                                        Metrics are
    Management
Using Resources Effectively!                                                                                                                NOT Evil!


 LoB Product Owner                                                                                                                           If You do
      & Mgmt.
  Build the Right Thing!                                                                                                                    them Right,
                                                                                                                                            Metrics are
                                                                                                                                              Practical
 Development Team                                                             Start w/ Basics
                                                                                                                                           Self-Defense!
  Build the Thing Right!                                                      Then, Build Up




                       If You Don’t Measure It, You Don’t Understand It.

  9
Management & Line-of-Business
Dashboard Tiles
      Support at-a-glance
      summary with drill-through.
      Same 4 essential questions,
      at a higher level, plus …
             “How much do I have to worry
             about this project?” – Risk
             “Are we burning budget at a
             sustainable rate?” – Costs
             “Does this project still make
             good business sense?” – Margin
             or ROI
             “Does this project support further
             business or other initiatives
             within the company?” –
             Opportunity or Program Goals
#10   Dell Agile Summit
      January 24, 2007
10                                                     Feature 4, 5.00



                         9


                         8                                                      Feature 3, 5.39



                         7            Feature 2, 3.16



                         6
      Severity of Risk




                         5                                                                                 Chg. Request 1, 10.30



                         4                                    Feature 1, 6.71



                         3
                                                                            Which risks really *need*
                         2
                                                                            to be addressed *now*?

                         1             Chg. Request 2, 9.06



                         0
                              0   1        2            3         4         5       6          7   8   9      10
                                                            Probability of Occurence of Risk
#11
Three Things to Do Now…
Thank you for attending!



                         Questions???


     Contacts:

                             Al Goerner                          Jonathan Cook
             Principal Emterprise Consultant   Business Development, United Kingdom
                    al.goerner@valtech.com               jonathan.cooke@valtech.com
                           +01 214 724 7240                           +44 7748638031

More Related Content

PPTX
Zambia team lfys analysis
PDF
Evaluating Touch Gesture Usability
PPTX
Agile Metrics, Value, and Softwre
PDF
Agile metrics
PPTX
Making Cornwall Agile
PDF
Seeing what matters using the right vision to manage transition - Alan Shalloway
PDF
Metrics As A Learn And Change Agent
PDF
SwissQ Agile Trends & Benchmarks 2012 (Englisch)
Zambia team lfys analysis
Evaluating Touch Gesture Usability
Agile Metrics, Value, and Softwre
Agile metrics
Making Cornwall Agile
Seeing what matters using the right vision to manage transition - Alan Shalloway
Metrics As A Learn And Change Agent
SwissQ Agile Trends & Benchmarks 2012 (Englisch)

Similar to Agile Measurement and metrics for Accountability (20)

PDF
Agile Developers Create Their Own Identity
PDF
Requirements & scope
PPTX
Agile Workshop: Agile Metrics
PDF
2012 CIO Perspectives: From Operations to the Executive Suite
PDF
9. fri 1045 1130 griffin - starting the sustainable analytic journey
PDF
Lean Thinking on Business Analysis
PDF
Enterprise Cloud Development and Agile Transformation Strategy - China 2012
PDF
Agile Developers Create Their Own Identity[1]
PDF
Agile & Business Analysis: A Successful Combination
PDF
Warranty Management: 3 questions ; 1 answered, 2 to go
PDF
Teleconferencia 2 q10
PDF
Scope International
PDF
Check Point Brochure 5 Governance Sprints 2012[1]
PDF
Lessons from the Cornish Software Mines
PDF
Measuring the Results of your Agile Adoption
PPTX
NFP Strategic Initiatives Process 2012
PPTX
Gregs BI Presentation
PPTX
A Brief Introduction to the SCRUM Agile Methodology
PDF
Essentials Of Succession Planning
PDF
Improving corporate management performance english version__osvaldo
Agile Developers Create Their Own Identity
Requirements & scope
Agile Workshop: Agile Metrics
2012 CIO Perspectives: From Operations to the Executive Suite
9. fri 1045 1130 griffin - starting the sustainable analytic journey
Lean Thinking on Business Analysis
Enterprise Cloud Development and Agile Transformation Strategy - China 2012
Agile Developers Create Their Own Identity[1]
Agile & Business Analysis: A Successful Combination
Warranty Management: 3 questions ; 1 answered, 2 to go
Teleconferencia 2 q10
Scope International
Check Point Brochure 5 Governance Sprints 2012[1]
Lessons from the Cornish Software Mines
Measuring the Results of your Agile Adoption
NFP Strategic Initiatives Process 2012
Gregs BI Presentation
A Brief Introduction to the SCRUM Agile Methodology
Essentials Of Succession Planning
Improving corporate management performance english version__osvaldo
Ad

More from Valtech UK (20)

PDF
Get to know your users using Lean UX
PDF
The Art of Visualising Software - Simon Brown
PDF
Get to know your users
PPTX
LeanUX and Agile in the Public Sector
PPTX
Transforming nhs choices using agile and lean ux agile manc
PDF
Digital Inclusion in the Public Sector
PDF
Presentation compressed
PDF
The Mobile Landscape - Do you really need an app?
PDF
Modern Digital Design: The power of Responsive Design
PDF
White Paper: "Designing Around People"
PDF
Simplifying Facebook: Designing Around People
PDF
The mobile landscape - Do you really need an app?
PDF
An Introduction to Responsive Design
PDF
Customer case - IC companys
PDF
Part 1: "Making Agile Work" Webinar Series: Inception
PDF
Experience Report: FLIGHTGLOBAL.COM
PDF
Agile UX integration
PDF
Agile in highly regulated environments
PDF
Using CFD, SPC and Kanban on UK GOV IT projects
PDF
Adapting agile to the entreprise
Get to know your users using Lean UX
The Art of Visualising Software - Simon Brown
Get to know your users
LeanUX and Agile in the Public Sector
Transforming nhs choices using agile and lean ux agile manc
Digital Inclusion in the Public Sector
Presentation compressed
The Mobile Landscape - Do you really need an app?
Modern Digital Design: The power of Responsive Design
White Paper: "Designing Around People"
Simplifying Facebook: Designing Around People
The mobile landscape - Do you really need an app?
An Introduction to Responsive Design
Customer case - IC companys
Part 1: "Making Agile Work" Webinar Series: Inception
Experience Report: FLIGHTGLOBAL.COM
Agile UX integration
Agile in highly regulated environments
Using CFD, SPC and Kanban on UK GOV IT projects
Adapting agile to the entreprise
Ad

Recently uploaded (20)

PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Encapsulation theory and applications.pdf
PDF
Modernizing your data center with Dell and AMD
PDF
Approach and Philosophy of On baking technology
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Electronic commerce courselecture one. Pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
KodekX | Application Modernization Development
PDF
Empathic Computing: Creating Shared Understanding
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPTX
A Presentation on Artificial Intelligence
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
Reach Out and Touch Someone: Haptics and Empathic Computing
Encapsulation_ Review paper, used for researhc scholars
Dropbox Q2 2025 Financial Results & Investor Presentation
Encapsulation theory and applications.pdf
Modernizing your data center with Dell and AMD
Approach and Philosophy of On baking technology
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Understanding_Digital_Forensics_Presentation.pptx
Mobile App Security Testing_ A Comprehensive Guide.pdf
The Rise and Fall of 3GPP – Time for a Sabbatical?
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Electronic commerce courselecture one. Pdf
Unlocking AI with Model Context Protocol (MCP)
KodekX | Application Modernization Development
Empathic Computing: Creating Shared Understanding
Digital-Transformation-Roadmap-for-Companies.pptx
A Presentation on Artificial Intelligence

Agile Measurement and metrics for Accountability

  • 1. Measuring for Accountability Al Goerner Agile Edge - UK 30 April 2008
  • 2. Metrics for Many Purposes Keep metrics diagnostic and constructive! Expectation Business Analysts Management Where are we? Project Sponsor & Stakeholders Are we on track? Are in trouble? Why? What can we improve? Direction and “Tell me how you will measure me, Project Manager Risk/Issue and I will tell you how I will behave.” Motivation - Goldratt Management Punitive metrics are self-defeating! Development Team Test Team #2
  • 3. Agile Metric Objectives … Distilled Outcomes-Oriented Measures value delivered to the customer, not effort consumed. Motivated Intended to address relevant questions, not random speculations. Organic Based on readily available data – from your current processes. Diagnostic Helps determine what is going wrong and what to do about it. Pattern-based Founded on regular, reasonable, teachable patterns #3
  • 4. Metrics Iteration-level Release-level Portfolio-level Enterprise (day-to-day) (iteration-to-iteration) (relse-to-relse, prod-to-prod) (qtr-to-qtr, year-to-year) Pacing & Flow Progress & Fitness Value & Opportunity Agility & Vitality Executive & Line Metrics are Management Using Resources Effectively! NOT Evil! LoB Product Owner If You do & Mgmt. Build the Right Thing! them Right, Metrics are Practical Development Team Start w/ Basics Self-Defense! Build the Thing Right! Then, Build Up If You Don’t Measure It, You Don’t Understand It. 4
  • 5. Essential Release-level Project Mgmt. Questions Essential Progress Questions Is this release on-time? Is this release healthy? Essential Quality Questions Is this release likely to be fit-for-release when it is ready-for-release? Is this project (in general) and this release (in particular) effectively satisfying our customer’s needs? Ultimate Diagnostic Question What can be done to get this project back on-track? #5
  • 6. Release Progress 120.0 112 110.0 100.0 94 90.0 80.0 75 68 70.0 Units of Work 65 63 60.0 52 50 51 47 47 48 48 50.0 46 43 43 40 38 40.0 42 33 40 40 37 38 37 37 38 29 36 36 36 30.0 33 34 24 30 31 27 28 20 26 20.0 15 11 10.0 6 5.25 5.75 4.75 5.25 4.75 6 3 2.5 3.75 0 0 0 0 0 0 0 0 0 1 0.0 3 3 3.5 3.5 4 1 1.5 0.5 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 Iteration # Ideal Burndown Cone - Low Ideal Burndown Cone - High All-Categories Scope Elements Value-Categories Scope Elements Planned Cumulative Scope Expansion Planned Value Scope Expansion All-Categories Work Remaining Value-Categories Work Remaining #6 All-Categories Weighted Velocity Value-Categories Weighted Velocity Projected Burndown
  • 7. Workqueue/Backlog Breakout 120 100 4 80 2 22 13 Units of Work 10 60 6 8 2 3 6 2 2 5 2 4 5 4 4 1 14 14 12 13 13 40 12 12 12 12 20 37 34 35 35 35 36 31 26 28 1 2 3 4 5 6 7 8 9 Iteration # Feature Feature Requirements Committed Technical Special (Level-2) Risk/Issue Mgmt. #7 Requests Change Requests Clarifications Defect Repairs Debt Tests Tasks
  • 8. 60 120.0% 117% 50 100% 100% 100% 100% 100% 100% 100.0% 93% 94% 92% 89% 88% 40 80% 80.0% 78% 67% 30 Value Scope 60.0% 20 40.0% Level-1 Accepted 28.9% 29.5% 26.6% 27.2% 27.7% 27.7% 24.9% 12 22.0% 23.1% 10 20.0% Level-2 Accepted 6 12% 10% 10% 9% 9% 8% 2 2% 1 0 0% 0 0% 0 0 0 0 0.0% 1 2 3 4 5 6 7 8 9 Value Scope Level-1 Accepted Level-2 Accepted Outstanding Technical Debt Feature Churn Requirements Churn #8 Planning Stability Regression Stability
  • 9. Metrics Iteration-level Release-level Portfolio-level Enterprise (day-to-day) (iteration-to-iteration) (relse-to-relse, prod-to-prod) (qtr-to-qtr, year-to-year) Pacing & Flow Progress & Fitness Value & Opportunity Agility & Vitality Executive & Line Metrics are Management Using Resources Effectively! NOT Evil! LoB Product Owner If You do & Mgmt. Build the Right Thing! them Right, Metrics are Practical Development Team Start w/ Basics Self-Defense! Build the Thing Right! Then, Build Up If You Don’t Measure It, You Don’t Understand It. 9
  • 10. Management & Line-of-Business Dashboard Tiles Support at-a-glance summary with drill-through. Same 4 essential questions, at a higher level, plus … “How much do I have to worry about this project?” – Risk “Are we burning budget at a sustainable rate?” – Costs “Does this project still make good business sense?” – Margin or ROI “Does this project support further business or other initiatives within the company?” – Opportunity or Program Goals #10 Dell Agile Summit January 24, 2007
  • 11. 10 Feature 4, 5.00 9 8 Feature 3, 5.39 7 Feature 2, 3.16 6 Severity of Risk 5 Chg. Request 1, 10.30 4 Feature 1, 6.71 3 Which risks really *need* 2 to be addressed *now*? 1 Chg. Request 2, 9.06 0 0 1 2 3 4 5 6 7 8 9 10 Probability of Occurence of Risk #11
  • 12. Three Things to Do Now…
  • 13. Thank you for attending! Questions??? Contacts: Al Goerner Jonathan Cook Principal Emterprise Consultant Business Development, United Kingdom al.goerner@valtech.com jonathan.cooke@valtech.com +01 214 724 7240 +44 7748638031