SlideShare a Scribd company logo
Resolving Key Cost Management
Pitfalls for Agile Development
Daniel Saroff
Vice President, Consulting
IDC
dsaroff@idc.com
+1.508.935.4462
2
© IDC |
IDC | Technology Research,Advisory, and Consulting
Global provider of market intelligence, insights, and data for nearly 60 years
• Digitally-Capable
Infrastructure
• Leadership &
Governance Strategies
• Data, AI & Intelligence
• The Trusted & Secure
Enterprise
• Systems of Experience:
Customers & Employees
• Metrics & KPIs
• Innovation & Cost
Management
Future IT
Industry Transformation
• Executive Peer-to-Peer
Connections
• Brand Management
Services
• Executive Coaching and
Leadership
Development
• Custom Development
Services
• Women in IT Coaching &
Development Programs
• CIO Board Readiness
Advisory Services
Use Case
Centric Innovation
• Securing &
Documenting Cost Mgt
Effectiveness
• IT Deal Benchmarking
• Tech Evaluation, RFP
Support & Vendor
Selection
• Innovative technology
acquisition
• Audit Review and
Defense
• Contract Language
Vendor Sourcing
& Management
Robotics
5G & Mobile
Big Data /
Analytics
Blockchain
Cloud
AR/VR
IoT
CyberSecurity
& Digital Trust
3D Printing
AI
Oil & Gas
Utilities Mining
Manufacturing Retail
Hospitality
& Dining
Health
Life Sciences
Financial
Services
Insurance
Government
Smart Cities
Education
• Agile Improvement
• Benchmarking
• Cloud Cost Management
• Cloud Readiness
• IT Service & Vendor Cost
Management
• Maturity Assessment
• Optimization
• Sourcing
• Strategy Assessment
• Staffing Assessment
IDC Metri
Consulting
3
© IDC |
You can’t manage*, what you can’t measure
*This include costs
4
© IDC |
For agile development, to understand:
• The measurement challenge
• Predictability, cost accountability, control, and visibility
• Managing budgets
• Increase delivery speed and product quality
• Assessing agile team performance
Goals
5
© IDC |
Software is costly
• Software cost - US$542b / year
• COTS – US$234b
• Custom/bespoke – US$132.2b
• Middleware – US$141b
• Average cost overrun
• 30%
Hasn’t improved with shift to Agile
from Waterfall. Why?
6
© IDC |
The promise and reality of agile
Promise
• Higher quality
• Minimum viable product
• Risk reduction
• Speed
• Transparency
• Predictability
• Lower costs
• Flexibility
• Customer satisfaction
Reality
• Cost blackhole
• Variable quality
• Difficult to manage
• Challenges in visibility
• Predictability challenges
• Qualitative metrics
• Challenge to compare across
teams or projects
7
© IDC |
Challenges organizations experience
Challenges in Monitoring and Reporting the
Performance
Q. Which of the following challenges, if any, is your organization
facing with respect to monitoring and reporting the
performance of your software development and DevOps
teams?*
*IDC survey
8
© IDC |
Agile does work
~3x ~1/2
9
© IDC |
What drives development cost
Complexity Duration Effort Efficiency Productivity
Delay Quality Change Turn-over Reliability
Over / Under
Estimation
Resourcing Stability Security Maintenance
…makes estimation seem hard
10
© IDC |
Realistic estimation is key for cost estimation
Optimism
Additional
Costs
Low Realistic High
100%
0%
Pessimism
Human
Judgement
11
© IDC |
Blame it on story points
• Story points are qualitative / subjective measures of effort
• Teams estimate the effort an item requires compared to a reference story
• Useful for development teams. Challenging for cost estimation and benchmarking
• People find it difficult to estimate absolute things, but can easily estimate relatives
• Story points measure effort not size. Effort is variable
Cost estimation requires a consistent measure
12
© IDC |
Loss of value over time – burning money
Sprint 1
Sprints 2…N
MVP
Production
90%
70%
50% 20%
13
© IDC |
Enough of the problem…
…let’s get to the answer!
14
© IDC |
Source: Galorath
15
© IDC |
Function Point Analysis (FPA)* measures application functionality delivery.
• International standards (e.g., OMG, CISQ, Nesma, IFPUG, COSMIC)
• Standardized, weighted criteria that measures functional size
• Normalized
• Derives the Function Point Index (size and complexity of the software)
• Can be applied across teams and projects and between companies
• Quantitative
• Doesn’t impact the work-flow of agile
• Counting can be automated (and can be computed manually)
*Allan Albrecht, 1979, “Measuring Application Development Productivity”
16
© IDC |
Function points – the details
• Function Points measure standardized output
• Enhanced Function Points (EFP) quantifies functionality added or changed
• Automated Function Points (AFP) is FPA and EFP count automated by tools
• Manual Function Points (mFPA) is manually FP counting
The Simple Formulae
• Productivity = Hours per EFP
• Cost Efficiency = Costs per EFP
• Speed = EFP per month or sprint
• Project Quality = Defects per EFP
The Simple Formulae
• Hours = Team bandwidth
• Cost = Salaries, technology, tooling
• Speed = Productivity over time
• Defects = Poor coding or CVEs
17
© IDC |
Software cost estimation maturity model
Source: Galorath
Agile Model
Qualitative
Function Pts.
Quantitative
Cost Estimate = Backlog or Requirements x Cost
Cost Forecasting = (Backlog – Productivity) x Cost
18
© IDC |
Measuring to improve and benchmark
Team Metrics Product Metrics
High Performing Team
Industry Average
Low Performing Team
-80%
-60%
-40%
-20%
0%
20%
40%
60%
80%
100%
19
© IDC |
Usage
Team
Benchmark
Speed
20
© IDC |
Usage
• Multiple
development teams
• Anecdotally, some
better than others
• Benchmark
performance and
compare with FPA
• Identify high
performers, assess
success drivers
• Share practices from
high performing
teams to others
21
© IDC |
Usage
• Low productivity
• Updates slow
• Security/CVE issues
• FPA identifies
refactoring churn
(low maintainability /
robustness)
• Understanding this,
you can focus on
refactoring and
improving
maintainability and
changeability
• Better productivity,
faster time to value,
better costs mgt
22
© IDC |
Benefits
Management Benefits Team Benefits
Consistent reporting Faster development
Visibility Improved requirements management
Comparability Proper resourcing
Predictability Predictability
Cost forecasting Reduced stress
Cost management Focus
Project cost estimation Improved quality
Business benefit analysis Doesn’t impact the agile methodology
23
© IDC |
• Because these metrics are based on an international standard (EFP),
they can be used to benchmark teams and against industry metrics
• Following trends for each team is feasible allowing for course
corrections and targets to address performance
• Additionally, these metrics may be included in third-party contracts to
ensure supplier performance. This promotes suppliers to employ better
developers to meet the quality metrics of the contract
Benefits

More Related Content

PPTX
Automotive Software Cost Estimation - The UCE Approach - Emmanuel Mary
PPTX
The COSMIC battle between David and Goliath - Paul Hussein
PPTX
CEBoK for Software Past Present Future - Megan Jones
PDF
Principios operativos ágiles - Modelo Operativo Ágil
PPTX
How to Pitch an App at a Hackathon
PPTX
RTE Presentation
PDF
EA Intensive Course "Building Enterprise Architecture" by mr.danairat
PPS
Understanding and Applying The Open Group Architecture Framework (TOGAF)
Automotive Software Cost Estimation - The UCE Approach - Emmanuel Mary
The COSMIC battle between David and Goliath - Paul Hussein
CEBoK for Software Past Present Future - Megan Jones
Principios operativos ágiles - Modelo Operativo Ágil
How to Pitch an App at a Hackathon
RTE Presentation
EA Intensive Course "Building Enterprise Architecture" by mr.danairat
Understanding and Applying The Open Group Architecture Framework (TOGAF)

What's hot (20)

PDF
Lean Enterprise Transformation: The Journey Inside Large Organizations, Sonja...
PDF
Milky Way Webinar February 2023.pdf
PPTX
Practical Enterprise Architecture in Medium-size Corporation using TOGAF
PDF
Agilidad Empresarial y SAFe
PPTX
Kanban
PDF
Managing software projects & teams effectively
PPTX
What is a planning increment?
PPT
Kanban 101 - 3 - Kanban Essentials
PPTX
Introduction to Recipes for Agile Governance in the Enterprise (RAGE)
PDF
DevOps - Transforming the Traditional SDLC
PDF
Agile IT Operatinos - Getting to Daily Releases
PPTX
Value stream management is essential for dev ops v4
PDF
Agile Software Development
PPTX
What is Kanban in Agile?
PDF
The Agile Adoption Roadmap (Keynote by Tim Abbott)
PPTX
Best pratices reliability & scalability on Azure
PDF
Introduction to Scaled Agile Framework SAFe
PDF
Implement cobit in your organization
PDF
Project Cost & Schedule Integration Lessons Learnt
PDF
Agile Mindset Workshop
Lean Enterprise Transformation: The Journey Inside Large Organizations, Sonja...
Milky Way Webinar February 2023.pdf
Practical Enterprise Architecture in Medium-size Corporation using TOGAF
Agilidad Empresarial y SAFe
Kanban
Managing software projects & teams effectively
What is a planning increment?
Kanban 101 - 3 - Kanban Essentials
Introduction to Recipes for Agile Governance in the Enterprise (RAGE)
DevOps - Transforming the Traditional SDLC
Agile IT Operatinos - Getting to Daily Releases
Value stream management is essential for dev ops v4
Agile Software Development
What is Kanban in Agile?
The Agile Adoption Roadmap (Keynote by Tim Abbott)
Best pratices reliability & scalability on Azure
Introduction to Scaled Agile Framework SAFe
Implement cobit in your organization
Project Cost & Schedule Integration Lessons Learnt
Agile Mindset Workshop
Ad

Similar to Resolving Cost Management and Key Pitfalls of Agile Software Development - Daniel Saroff (20)

PDF
Nesma event June '23 - How to use objective metrics as a basis for agile cost...
PDF
Are Function Points Still Relevant?
PDF
Are Function Points Still Relevant?
PDF
How should we estimates agile projects (CAST)
PDF
The fact that your poject is agile is not (necessarily) a cost driver arlen...
PDF
8. how nesma can quick start your software estimate frank vogelezang
PDF
Measuring the Results of your Agile Adoption
PDF
Agile Gurugram 2023 I Metrics and Business Agility - Dinker Charak
PDF
Agile teams get a grip - martijn groenewegen
PDF
David Rico Business Value Agile Methods19 Feb 14
PDF
Project control and process instrumentation
PPTX
VFQ Metrics that Matter
PPTX
Agile and Its Impact on Productivity
PPTX
View from the Executive Suite, MN-PMI May 2014
PDF
Bridging the gap rob de munnik - dutch tax office
PPTX
Lean Metrics: Driving and Measuring Change
PDF
Agile Team Performance Measurement webinar
PPTX
Lean Agile Metrics And KPIs
PPTX
Agile metrics - Agile KC Meeting 9/26/13
PDF
Agile Metrics In Action Measuring And Enhancing The Performance Of Agile Team...
Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Are Function Points Still Relevant?
Are Function Points Still Relevant?
How should we estimates agile projects (CAST)
The fact that your poject is agile is not (necessarily) a cost driver arlen...
8. how nesma can quick start your software estimate frank vogelezang
Measuring the Results of your Agile Adoption
Agile Gurugram 2023 I Metrics and Business Agility - Dinker Charak
Agile teams get a grip - martijn groenewegen
David Rico Business Value Agile Methods19 Feb 14
Project control and process instrumentation
VFQ Metrics that Matter
Agile and Its Impact on Productivity
View from the Executive Suite, MN-PMI May 2014
Bridging the gap rob de munnik - dutch tax office
Lean Metrics: Driving and Measuring Change
Agile Team Performance Measurement webinar
Lean Agile Metrics And KPIs
Agile metrics - Agile KC Meeting 9/26/13
Agile Metrics In Action Measuring And Enhancing The Performance Of Agile Team...
Ad

More from Nesma (20)

PDF
Viktor Clerc - Presentatie Nesma over NPR5333.pdf
PDF
Harold van Heeringen - Nesma FP in Cost Estimation.pdf
PDF
Frank Vogelezang - EFS presentation 6-6-2024.pdf
PDF
Eric van der Vliet - ICEAA SW - Status.pdf
PDF
The Use of Functional Size in the Industry.pdf
PDF
2024-04 - Nesma webinar - Benchmarking.pdf
PDF
Software Cost Estimation webinar January 2024.pdf
PDF
Nesma event June '23 - NEN Practice Guideline - NPR.pdf
PDF
Nesma event June '23 - Easy Function Sizing - Introduction.pdf
PPTX
Succesful Estimating - It's how you tell the story - Amritpal Singh Agar
PPTX
(Increasing) Predictability of large Government ICT Projects - Koos Veefkind
PPTX
Agile Development and Agile Cost Estimation - A return to basic principles - ...
PPTX
Project Succes is a Choice - Joop Schefferlie
PDF
Afrekenen met functiepunten
PDF
Software sizing as an essential measure past present and future - Dan Galorat...
PDF
A benchmark based approach to determine language verbosity - Hans Kuijpers - ...
PDF
Software sizing the cornerstone for iceaa's scebok - Carol Dekkers
PDF
Size matters a lot rick collins - technomics
PDF
Software estimation challenge diederik wortman - metri
PDF
Estimation of a micro services based estimation application bhawna thakur -...
Viktor Clerc - Presentatie Nesma over NPR5333.pdf
Harold van Heeringen - Nesma FP in Cost Estimation.pdf
Frank Vogelezang - EFS presentation 6-6-2024.pdf
Eric van der Vliet - ICEAA SW - Status.pdf
The Use of Functional Size in the Industry.pdf
2024-04 - Nesma webinar - Benchmarking.pdf
Software Cost Estimation webinar January 2024.pdf
Nesma event June '23 - NEN Practice Guideline - NPR.pdf
Nesma event June '23 - Easy Function Sizing - Introduction.pdf
Succesful Estimating - It's how you tell the story - Amritpal Singh Agar
(Increasing) Predictability of large Government ICT Projects - Koos Veefkind
Agile Development and Agile Cost Estimation - A return to basic principles - ...
Project Succes is a Choice - Joop Schefferlie
Afrekenen met functiepunten
Software sizing as an essential measure past present and future - Dan Galorat...
A benchmark based approach to determine language verbosity - Hans Kuijpers - ...
Software sizing the cornerstone for iceaa's scebok - Carol Dekkers
Size matters a lot rick collins - technomics
Software estimation challenge diederik wortman - metri
Estimation of a micro services based estimation application bhawna thakur -...

Recently uploaded (20)

PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Encapsulation theory and applications.pdf
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
cuic standard and advanced reporting.pdf
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Approach and Philosophy of On baking technology
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
Cloud computing and distributed systems.
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
Spectroscopy.pptx food analysis technology
Mobile App Security Testing_ A Comprehensive Guide.pdf
Encapsulation theory and applications.pdf
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
NewMind AI Weekly Chronicles - August'25 Week I
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Building Integrated photovoltaic BIPV_UPV.pdf
MIND Revenue Release Quarter 2 2025 Press Release
Reach Out and Touch Someone: Haptics and Empathic Computing
cuic standard and advanced reporting.pdf
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Approach and Philosophy of On baking technology
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Cloud computing and distributed systems.
Chapter 3 Spatial Domain Image Processing.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Spectroscopy.pptx food analysis technology

Resolving Cost Management and Key Pitfalls of Agile Software Development - Daniel Saroff

  • 1. Resolving Key Cost Management Pitfalls for Agile Development Daniel Saroff Vice President, Consulting IDC dsaroff@idc.com +1.508.935.4462
  • 2. 2 © IDC | IDC | Technology Research,Advisory, and Consulting Global provider of market intelligence, insights, and data for nearly 60 years • Digitally-Capable Infrastructure • Leadership & Governance Strategies • Data, AI & Intelligence • The Trusted & Secure Enterprise • Systems of Experience: Customers & Employees • Metrics & KPIs • Innovation & Cost Management Future IT Industry Transformation • Executive Peer-to-Peer Connections • Brand Management Services • Executive Coaching and Leadership Development • Custom Development Services • Women in IT Coaching & Development Programs • CIO Board Readiness Advisory Services Use Case Centric Innovation • Securing & Documenting Cost Mgt Effectiveness • IT Deal Benchmarking • Tech Evaluation, RFP Support & Vendor Selection • Innovative technology acquisition • Audit Review and Defense • Contract Language Vendor Sourcing & Management Robotics 5G & Mobile Big Data / Analytics Blockchain Cloud AR/VR IoT CyberSecurity & Digital Trust 3D Printing AI Oil & Gas Utilities Mining Manufacturing Retail Hospitality & Dining Health Life Sciences Financial Services Insurance Government Smart Cities Education • Agile Improvement • Benchmarking • Cloud Cost Management • Cloud Readiness • IT Service & Vendor Cost Management • Maturity Assessment • Optimization • Sourcing • Strategy Assessment • Staffing Assessment IDC Metri Consulting
  • 3. 3 © IDC | You can’t manage*, what you can’t measure *This include costs
  • 4. 4 © IDC | For agile development, to understand: • The measurement challenge • Predictability, cost accountability, control, and visibility • Managing budgets • Increase delivery speed and product quality • Assessing agile team performance Goals
  • 5. 5 © IDC | Software is costly • Software cost - US$542b / year • COTS – US$234b • Custom/bespoke – US$132.2b • Middleware – US$141b • Average cost overrun • 30% Hasn’t improved with shift to Agile from Waterfall. Why?
  • 6. 6 © IDC | The promise and reality of agile Promise • Higher quality • Minimum viable product • Risk reduction • Speed • Transparency • Predictability • Lower costs • Flexibility • Customer satisfaction Reality • Cost blackhole • Variable quality • Difficult to manage • Challenges in visibility • Predictability challenges • Qualitative metrics • Challenge to compare across teams or projects
  • 7. 7 © IDC | Challenges organizations experience Challenges in Monitoring and Reporting the Performance Q. Which of the following challenges, if any, is your organization facing with respect to monitoring and reporting the performance of your software development and DevOps teams?* *IDC survey
  • 8. 8 © IDC | Agile does work ~3x ~1/2
  • 9. 9 © IDC | What drives development cost Complexity Duration Effort Efficiency Productivity Delay Quality Change Turn-over Reliability Over / Under Estimation Resourcing Stability Security Maintenance …makes estimation seem hard
  • 10. 10 © IDC | Realistic estimation is key for cost estimation Optimism Additional Costs Low Realistic High 100% 0% Pessimism Human Judgement
  • 11. 11 © IDC | Blame it on story points • Story points are qualitative / subjective measures of effort • Teams estimate the effort an item requires compared to a reference story • Useful for development teams. Challenging for cost estimation and benchmarking • People find it difficult to estimate absolute things, but can easily estimate relatives • Story points measure effort not size. Effort is variable Cost estimation requires a consistent measure
  • 12. 12 © IDC | Loss of value over time – burning money Sprint 1 Sprints 2…N MVP Production 90% 70% 50% 20%
  • 13. 13 © IDC | Enough of the problem… …let’s get to the answer!
  • 15. 15 © IDC | Function Point Analysis (FPA)* measures application functionality delivery. • International standards (e.g., OMG, CISQ, Nesma, IFPUG, COSMIC) • Standardized, weighted criteria that measures functional size • Normalized • Derives the Function Point Index (size and complexity of the software) • Can be applied across teams and projects and between companies • Quantitative • Doesn’t impact the work-flow of agile • Counting can be automated (and can be computed manually) *Allan Albrecht, 1979, “Measuring Application Development Productivity”
  • 16. 16 © IDC | Function points – the details • Function Points measure standardized output • Enhanced Function Points (EFP) quantifies functionality added or changed • Automated Function Points (AFP) is FPA and EFP count automated by tools • Manual Function Points (mFPA) is manually FP counting The Simple Formulae • Productivity = Hours per EFP • Cost Efficiency = Costs per EFP • Speed = EFP per month or sprint • Project Quality = Defects per EFP The Simple Formulae • Hours = Team bandwidth • Cost = Salaries, technology, tooling • Speed = Productivity over time • Defects = Poor coding or CVEs
  • 17. 17 © IDC | Software cost estimation maturity model Source: Galorath Agile Model Qualitative Function Pts. Quantitative Cost Estimate = Backlog or Requirements x Cost Cost Forecasting = (Backlog – Productivity) x Cost
  • 18. 18 © IDC | Measuring to improve and benchmark Team Metrics Product Metrics High Performing Team Industry Average Low Performing Team -80% -60% -40% -20% 0% 20% 40% 60% 80% 100%
  • 20. 20 © IDC | Usage • Multiple development teams • Anecdotally, some better than others • Benchmark performance and compare with FPA • Identify high performers, assess success drivers • Share practices from high performing teams to others
  • 21. 21 © IDC | Usage • Low productivity • Updates slow • Security/CVE issues • FPA identifies refactoring churn (low maintainability / robustness) • Understanding this, you can focus on refactoring and improving maintainability and changeability • Better productivity, faster time to value, better costs mgt
  • 22. 22 © IDC | Benefits Management Benefits Team Benefits Consistent reporting Faster development Visibility Improved requirements management Comparability Proper resourcing Predictability Predictability Cost forecasting Reduced stress Cost management Focus Project cost estimation Improved quality Business benefit analysis Doesn’t impact the agile methodology
  • 23. 23 © IDC | • Because these metrics are based on an international standard (EFP), they can be used to benchmark teams and against industry metrics • Following trends for each team is feasible allowing for course corrections and targets to address performance • Additionally, these metrics may be included in third-party contracts to ensure supplier performance. This promotes suppliers to employ better developers to meet the quality metrics of the contract Benefits