SlideShare a Scribd company logo
Benchmarking Execution Performance and Earned Value
                EVM World 2012 Conference

   //
// Brad Arterbury, PMP

 ◦    About Me
        ◦   MBA, Texas State University
        ◦   Current member of PMI
        ◦   Wide-ranging business expertise
 ◦    Role
        ◦   Currently lead business development
            efforts:
                ◦    Information Technology
                ◦    Aerospace and Defense
                ◦    Government

 June 5, 2012   //   2
// About Acumen

 ◦    Project management software company

 ◦    Insight into PM challenges and use of
      analytics to overcome them

 ◦    Core concepts
        ◦   Project success requires a sound plan
        ◦   Forecast accuracy requires risk
            consideration

 June 5, 2012   //   3
// Benchmarking Defined




 ◦    To measure according to specified
      standards in order to compare with and
      improve one’s own product

 June 5, 2012   //   4
// Benefits of Benchmarking

 ◦    Context given to project analysis and
      scoring

 ◦    Internal and external starting point

 ◦    Portfolio tracking



 June 5, 2012   //   5
// Three Types of Benchmarking
 ◦    Intra-project Benchmarking
        ◦   Compare ribbons or time phases within the same
            project against one another

 ◦    Inter-project Benchmarking
        ◦   Compare a single project against prior snapshots of
            the same plan or similar past projects

 ◦    Cloud Benchmarking
        ◦   Compare a single project against a database of
            thousands of like projects

 June 5, 2012   //   6
// Metric Requirements
 ◦    What are metrics?
        ◦   Measurable, actionable criteria

 ◦    Schedule, Cost, Risk
        ◦   Both quality and performance

 ◦    Industry Standards
        ◦   Earned Value Management
        ◦   DCMA 14-Point Assessment
        ◦   GAO 10 Best Practices


 June 5, 2012   //   7
// DCMA 14-Point Assessment

 ◦    A precursor to EVM analysis

 ◦    Metrics look at schedule quality primarily

 ◦    Provides some schedule performance
      feedback absent of cost data



 June 5, 2012   //   8
// Fuse Schedule Index

 ◦    Nine different schedule checks combined
      with their proven thresholds

 ◦    Individually calculated and weighted
      before compilation

 ◦    For example, Logic Density should be
      between 2 and 4
 June 5, 2012   //   9
// Tracking Execution Performance

 ◦    Percent Complete
        ◦   Doesn’t account for effort or resources


 ◦    Baseline Compliance
        ◦   Performance for start/finish by time phase


 ◦    Earned Schedule


 June 5, 2012   //   10
// Importance of Earned Value

 ◦    Metrics for performance analysis of cost
      and schedule in one system

 ◦    Proven predictor of project success

 ◦    Established methodology for government
      contracts


 June 5, 2012   //   11
// Benchmarking EVM
 ◦    In planning and execution, useful to
      benchmark EVM metrics

 ◦    Provides context
        ‒   Validates baseline
        ‒   Calibrates performance

 ◦    Benchmark against internal past and
      external past in parallel or vs. a rollup of
      thousands of projects

 June 5, 2012   //   12
// Metric Analysis for Intra-Project
  Benchmarking

  ◦    Group data into ribbons by a common attribute

  ◦    Group data into time phases

  ◦    Apply customizable metrics for true project
       insight




  June 5, 2012   //   13
// Intra-Project Benchmarking

//   ◦    SV                  //   ◦   CV
     ◦    SPI                      ◦   CPI




     June 5, 2012   //   14
// Inter-Project Benchmarking

 ◦    Understand variance on the same project
      over time

 ◦    Ensure integrity of baselines
        ◦   Especially useful when applying EVM


 ◦    Insight into differences of similar projects


 June 5, 2012   //   15
// Forensic Analysis

 ◦     Differences from baseline to status
       updates
         ◦   Calendar
         ◦   Milestones
         ◦   Critical path


 ◦     Find causes of delay and cost overruns
       that are affecting execution performance

  June 5, 2012   //   16
// Cloud Benchmarking

 ◦    Global Project database

 ◦    Access through Acumen Fuse

 ◦    Targeted benchmarking using
      standardized scoring



 June 5, 2012   //   17
// Scoring

// Fuse Schedule Index™    // Fuse Logic Index™




  June 5, 2012   //   18
// Probability of Success




  June 5, 2012   //   19
// Planning = Execution Success
                                        1
 Probability of On-Time Completion




                                      0.9

                                      0.8

                                      0.7

                                      0.6

                                      0.5

                                      0.4

                                      0.3

                                      0.2

                                      0.1

                                        0
                                            0%           10%    20%   30%      40%   50%   60%     70%   80%   90%   100%

                                                                            Fuse Schedule Index™



                                     June 5, 2012   //     20
// Benchmarking Summary

 ◦    Tools for comparing project quality and
      performance

 ◦    Compare EV metrics, 14-Point Assessment
      metrics, GAO Scheduling Best
      Practices, and other metrics by project

 ◦    Schedule and Logic Quality in Acumen
      Cloud Benchmarking

 June 5, 2012   //   21
// Questions?




     //
// More Information

 ◦    White papers: www.projectacumen.com

 ◦    Software trial: www.projectacumen.com/trial

 ◦    Twitter: @projectacumen

 ◦    E-mail: info@projectacumen.com



 June 5, 2012   //   23

More Related Content

PDF
Developing Standards for Enterprise Schedule Quality
PDF
Simplifiying cost and schedule risk analysis with acumen risk
PPSX
Schedule Risk Analysis
PDF
How Traditional Risk Reporting Has Let Us Down
PDF
The Value of a Standard Schedule Quality Index
PDF
Applying the checklist manifesto for project management success
PDF
Project Management Control Systems
DOCX
Risk Management Guidance
Developing Standards for Enterprise Schedule Quality
Simplifiying cost and schedule risk analysis with acumen risk
Schedule Risk Analysis
How Traditional Risk Reporting Has Let Us Down
The Value of a Standard Schedule Quality Index
Applying the checklist manifesto for project management success
Project Management Control Systems
Risk Management Guidance

What's hot (20)

PDF
Fuse Customer Perspectives: Oil & Gas / Energy
PDF
The 5 Immutable principles of project management
PDF
Managing risk with deliverables planning
PDF
Project Success Assessment
DOCX
Managing Risk as Opportunity
PDF
Deliverables based planning handbook
DOCX
Increasing the probability of program success
PDF
Acumen Fuse Metrics & Descriptions Guide
PPTX
From WBS to Integrated Master Schedule
PDF
Methods and tools_of_success_driven_project_management
PDF
Event based scheduling brown bag
PDF
IMP / IMS Step by Step
PDF
Risk Management
PDF
Notional cam interview questions (update)
PDF
Assessing Enterprise Project Risk
XLS
Risk Analysis Workbook
PDF
Project risk management
PDF
Risk Modeling and Analysis (Mitigating the Planning Fallacy)
PDF
Risk Management Processes (v2)
Fuse Customer Perspectives: Oil & Gas / Energy
The 5 Immutable principles of project management
Managing risk with deliverables planning
Project Success Assessment
Managing Risk as Opportunity
Deliverables based planning handbook
Increasing the probability of program success
Acumen Fuse Metrics & Descriptions Guide
From WBS to Integrated Master Schedule
Methods and tools_of_success_driven_project_management
Event based scheduling brown bag
IMP / IMS Step by Step
Risk Management
Notional cam interview questions (update)
Assessing Enterprise Project Risk
Risk Analysis Workbook
Project risk management
Risk Modeling and Analysis (Mitigating the Planning Fallacy)
Risk Management Processes (v2)
Ad

Viewers also liked (15)

PDF
Does Better Scheduling Drive Execution Success?
PDF
Intelligent Project Acceleration: An Introduction to Acumen 360
PPTX
Acumen & ARES: Simplified Cost & Schedule Integration
PDF
Advanced Project Analysis and Project Benchmarking with Acumen Cloud™
PDF
Consideraciones en la determinación de contingencia de plazo
PDF
Alcance del proyecto
PDF
Schedule analysis what could possibly go wrong - Oracle Primavera Collaborat...
PPTX
#NoEstimates project planning using Monte Carlo simulation
PPT
Monte Carlo Schedule Risk Analysis
PPTX
Schedule Risk Analysis (SRA) by Pedram Daneshmand 14-Jan-2011
PPTX
Applying Monte Carlo Simulation to Microsoft Project Schedules
PDF
Monte Carlo Simulation for project estimates v1.0
PPTX
Improving Forecasts with Monte Carlo Simulations
Does Better Scheduling Drive Execution Success?
Intelligent Project Acceleration: An Introduction to Acumen 360
Acumen & ARES: Simplified Cost & Schedule Integration
Advanced Project Analysis and Project Benchmarking with Acumen Cloud™
Consideraciones en la determinación de contingencia de plazo
Alcance del proyecto
Schedule analysis what could possibly go wrong - Oracle Primavera Collaborat...
#NoEstimates project planning using Monte Carlo simulation
Monte Carlo Schedule Risk Analysis
Schedule Risk Analysis (SRA) by Pedram Daneshmand 14-Jan-2011
Applying Monte Carlo Simulation to Microsoft Project Schedules
Monte Carlo Simulation for project estimates v1.0
Improving Forecasts with Monte Carlo Simulations
Ad

Similar to Benchmarking Execution Performance and Earned Value (20)

PDF
Benchmarking Project Schedules
PDF
Fuse Customer Perspectives Webinar: Project Compliance
PPTX
Fuse Customer Perspectives Webinar: EPC
PDF
Advanced Project Analysis: An Introduction to Fuse 3.0
PDF
Successfully Integrating Agile and Earned Value
PDF
Integrating Risk With Earned Value
PDF
Measuring the Results of your Agile Adoption
PDF
Acumen Fuse & Customer Case Study
PDF
Meet or Exceed Schedule Expectations through Intelligent Acceleration
PDF
Applying Global Benchmarking To Fm And Service Alan Masterton Aug 08
PDF
Effectively managing project performance reporting
PDF
Using Dashboards to Monitor Project Performance - Is there a Practical Approach?
PPT
Balanced scorecard for effective project selection process
PDF
Hr Transformation Overview
PDF
Performance Management With Rational Insight - Karthi D
PDF
New Zealand Premiere! A first look at Rational Insight
DOCX
Quality metrics in project management
PPTX
PDF
Enterprise Project Management
PPT
Esoaug r12 whats_new_projects_hcm(1)
Benchmarking Project Schedules
Fuse Customer Perspectives Webinar: Project Compliance
Fuse Customer Perspectives Webinar: EPC
Advanced Project Analysis: An Introduction to Fuse 3.0
Successfully Integrating Agile and Earned Value
Integrating Risk With Earned Value
Measuring the Results of your Agile Adoption
Acumen Fuse & Customer Case Study
Meet or Exceed Schedule Expectations through Intelligent Acceleration
Applying Global Benchmarking To Fm And Service Alan Masterton Aug 08
Effectively managing project performance reporting
Using Dashboards to Monitor Project Performance - Is there a Practical Approach?
Balanced scorecard for effective project selection process
Hr Transformation Overview
Performance Management With Rational Insight - Karthi D
New Zealand Premiere! A first look at Rational Insight
Quality metrics in project management
Enterprise Project Management
Esoaug r12 whats_new_projects_hcm(1)

More from Acumen (17)

PDF
Acumen Fuse World Tour 2012
PDF
Dr. McNatty Webinar: An Introduction to Acumen 360
PDF
PMICOS Webinar: Building a Sound Schedule in an Enterprise Environment
PDF
Smarter Project Analysis and Improved Project Performance
PDF
Meeting Project Schedule Compliance Standards
PDF
2011 Acumen Annual Summit Keynote
PDF
Calgary Breakfast Seminar: Predict and Influence Project Success
PDF
Successful Dispute Resolution
PDF
Achieving the Unachievable: Aligning a Project with Stakeholder Expectations
PDF
Acumen Risk Workshops Overview
PDF
Acumen Fuse Independent Review
PDF
Fuse Information Sheet
PDF
Improved Schedule Risk Analysis through Metric Assessment
PDF
Why Scheduling Mustn't Be Allowed to Become an Extinct Science
PDF
Project Simplification through Metric Analysis
PDF
Measuring Risk Exposure through Risk Range Certainty
PDF
The Art and Science Behind Successful Risk Workshops
Acumen Fuse World Tour 2012
Dr. McNatty Webinar: An Introduction to Acumen 360
PMICOS Webinar: Building a Sound Schedule in an Enterprise Environment
Smarter Project Analysis and Improved Project Performance
Meeting Project Schedule Compliance Standards
2011 Acumen Annual Summit Keynote
Calgary Breakfast Seminar: Predict and Influence Project Success
Successful Dispute Resolution
Achieving the Unachievable: Aligning a Project with Stakeholder Expectations
Acumen Risk Workshops Overview
Acumen Fuse Independent Review
Fuse Information Sheet
Improved Schedule Risk Analysis through Metric Assessment
Why Scheduling Mustn't Be Allowed to Become an Extinct Science
Project Simplification through Metric Analysis
Measuring Risk Exposure through Risk Range Certainty
The Art and Science Behind Successful Risk Workshops

Recently uploaded (20)

PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
KodekX | Application Modernization Development
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Electronic commerce courselecture one. Pdf
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Machine learning based COVID-19 study performance prediction
PDF
Approach and Philosophy of On baking technology
PDF
cuic standard and advanced reporting.pdf
PPTX
Cloud computing and distributed systems.
PPT
Teaching material agriculture food technology
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Per capita expenditure prediction using model stacking based on satellite ima...
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Network Security Unit 5.pdf for BCA BBA.
KodekX | Application Modernization Development
The Rise and Fall of 3GPP – Time for a Sabbatical?
Electronic commerce courselecture one. Pdf
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Advanced methodologies resolving dimensionality complications for autism neur...
Building Integrated photovoltaic BIPV_UPV.pdf
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Encapsulation_ Review paper, used for researhc scholars
Mobile App Security Testing_ A Comprehensive Guide.pdf
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Machine learning based COVID-19 study performance prediction
Approach and Philosophy of On baking technology
cuic standard and advanced reporting.pdf
Cloud computing and distributed systems.
Teaching material agriculture food technology

Benchmarking Execution Performance and Earned Value

  • 1. Benchmarking Execution Performance and Earned Value EVM World 2012 Conference //
  • 2. // Brad Arterbury, PMP ◦ About Me ◦ MBA, Texas State University ◦ Current member of PMI ◦ Wide-ranging business expertise ◦ Role ◦ Currently lead business development efforts: ◦ Information Technology ◦ Aerospace and Defense ◦ Government June 5, 2012 // 2
  • 3. // About Acumen ◦ Project management software company ◦ Insight into PM challenges and use of analytics to overcome them ◦ Core concepts ◦ Project success requires a sound plan ◦ Forecast accuracy requires risk consideration June 5, 2012 // 3
  • 4. // Benchmarking Defined ◦ To measure according to specified standards in order to compare with and improve one’s own product June 5, 2012 // 4
  • 5. // Benefits of Benchmarking ◦ Context given to project analysis and scoring ◦ Internal and external starting point ◦ Portfolio tracking June 5, 2012 // 5
  • 6. // Three Types of Benchmarking ◦ Intra-project Benchmarking ◦ Compare ribbons or time phases within the same project against one another ◦ Inter-project Benchmarking ◦ Compare a single project against prior snapshots of the same plan or similar past projects ◦ Cloud Benchmarking ◦ Compare a single project against a database of thousands of like projects June 5, 2012 // 6
  • 7. // Metric Requirements ◦ What are metrics? ◦ Measurable, actionable criteria ◦ Schedule, Cost, Risk ◦ Both quality and performance ◦ Industry Standards ◦ Earned Value Management ◦ DCMA 14-Point Assessment ◦ GAO 10 Best Practices June 5, 2012 // 7
  • 8. // DCMA 14-Point Assessment ◦ A precursor to EVM analysis ◦ Metrics look at schedule quality primarily ◦ Provides some schedule performance feedback absent of cost data June 5, 2012 // 8
  • 9. // Fuse Schedule Index ◦ Nine different schedule checks combined with their proven thresholds ◦ Individually calculated and weighted before compilation ◦ For example, Logic Density should be between 2 and 4 June 5, 2012 // 9
  • 10. // Tracking Execution Performance ◦ Percent Complete ◦ Doesn’t account for effort or resources ◦ Baseline Compliance ◦ Performance for start/finish by time phase ◦ Earned Schedule June 5, 2012 // 10
  • 11. // Importance of Earned Value ◦ Metrics for performance analysis of cost and schedule in one system ◦ Proven predictor of project success ◦ Established methodology for government contracts June 5, 2012 // 11
  • 12. // Benchmarking EVM ◦ In planning and execution, useful to benchmark EVM metrics ◦ Provides context ‒ Validates baseline ‒ Calibrates performance ◦ Benchmark against internal past and external past in parallel or vs. a rollup of thousands of projects June 5, 2012 // 12
  • 13. // Metric Analysis for Intra-Project Benchmarking ◦ Group data into ribbons by a common attribute ◦ Group data into time phases ◦ Apply customizable metrics for true project insight June 5, 2012 // 13
  • 14. // Intra-Project Benchmarking // ◦ SV // ◦ CV ◦ SPI ◦ CPI June 5, 2012 // 14
  • 15. // Inter-Project Benchmarking ◦ Understand variance on the same project over time ◦ Ensure integrity of baselines ◦ Especially useful when applying EVM ◦ Insight into differences of similar projects June 5, 2012 // 15
  • 16. // Forensic Analysis ◦ Differences from baseline to status updates ◦ Calendar ◦ Milestones ◦ Critical path ◦ Find causes of delay and cost overruns that are affecting execution performance June 5, 2012 // 16
  • 17. // Cloud Benchmarking ◦ Global Project database ◦ Access through Acumen Fuse ◦ Targeted benchmarking using standardized scoring June 5, 2012 // 17
  • 18. // Scoring // Fuse Schedule Index™ // Fuse Logic Index™ June 5, 2012 // 18
  • 19. // Probability of Success June 5, 2012 // 19
  • 20. // Planning = Execution Success 1 Probability of On-Time Completion 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Fuse Schedule Index™ June 5, 2012 // 20
  • 21. // Benchmarking Summary ◦ Tools for comparing project quality and performance ◦ Compare EV metrics, 14-Point Assessment metrics, GAO Scheduling Best Practices, and other metrics by project ◦ Schedule and Logic Quality in Acumen Cloud Benchmarking June 5, 2012 // 21
  • 23. // More Information ◦ White papers: www.projectacumen.com ◦ Software trial: www.projectacumen.com/trial ◦ Twitter: @projectacumen ◦ E-mail: info@projectacumen.com June 5, 2012 // 23