SlideShare a Scribd company logo
To Estimate or Not to Estimate,
Is that the Question?
#leanagileUS @mattphilipLeanAgileUS Conference, 27 Feb 2017
Hofstadter’s Law
“It always takes longer than you
expect, even when you take into
account Hofstadter’s Law.”
#leanagileUS @mattphilip
Parkinson’s Law
“Work expands so as to fill the
time available for its completion."
#leanagileUS @mattphilip
”Poor Estimation Skills”
#leanagileUS @mattphilip
The Spectrum of Estimating
Never
Estimate
Anything
Always
Estimate
Everything
Question purpose of estimating
Include all sources of variation
Focus on characterizing work
Probabilistic forecast
Use delivery data
Less effort spent
Estimation culture
Consider effort only
Deterministic forecast
Use intuition
Heavy effort involved
Tasks in hours
#leanagileUS @mattphilip
What NoEstimates is not saying
• You are evil if you estimate
• All estimates are totally useless
• Stop doing your successful estimating practice
• Stop having the conversations to understand/analyze/break down work
• Work items must be the same size
• You must place your full faith and confidence in Monte Carlo forecasts
#leanagileUS @mattphilip
What NoEstimates is saying
• Know why you are estimating
• Discover for yourself how good you are at estimating (measure)
• Keep doing the things that help you understand the work
• Upfront estimates need to be held loosely
#leanagileUS @mattphilip
NoEstimates, Manifesto Style
… We have come to value:
Probabilistic over Deterministic
Delivery time over Development time
MVP scope over Full scope
Data over Intuition*
Reducing sources of variation over Improving estimating
That is, while there is value in the items on the right, we value the items on the left more.
*Neil Killick uses “empiricism over guesswork”
#leanagileUS @mattphilip
Sources of Variation
#leanagileUS @mattphilip
Do You Assume Correlation?
Is the initial sizing a good predictor for when you can get your stuff?
In our case, the surprising truth was ”no.”
-- Mattias Skarin, Real-World Kanban
#leanagileUS @mattphilip
What’s Going On?
Low process efficiency (typically 5-15% in
software delivery) means that even if we
nailed the effort estimates … we would be
accurately predicting 5-15% of elapsed
delivery time!
-- Troy Magennis
#leanagileUS @mattphilip
Other Sources of Variation
Often system factors account for more of the elapsed delivery time than different
story sizes.
-- Troy Magennis
#leanagileUS @mattphilip
Sources of Variation
#leanagileUS @mattphilip
How many can you name?
Sources of Variation
#leanagileUS @mattphilip
• WIP
• Technology/domain/product
• Team composition
• User, client and client representative
• Multitasking/focus factor
• Market and competitors
• System dependencies
• Team dependencies
• Specialization
• Waiting for availability
• Rework
• Steps/handoffs (50%*50%*50%...)
• Stages in team development (Tuckman)
• Selection policy
• Essential complication (How hard a problem
is on its own)
• Accidental complication (“How much we
suck at our jobs” -Rainsberger)
First, Know Where You Are
#leanagileUS @mattphilip
Keogh’s “Scale of Ignorance”
1. Just about everyone in the world has done this.
2. Lots of people have done this, including someone on our team.
3. Someone in our company has done this, or we have access to expertise.
4. Someone in the world did this, but not in our organization (and probably at a
competitor).
5. Nobody in the world has ever done this before.
#leanagileUS @mattphilip
What Can You Do About Variation?
#leanagileUS @mattphilip
How many remedies
can you name?
What You Can Do About Variation
• Lower WIP
• ConWIP/System WIP
• Five Focusing Steps
• Blocker clustering
• Reduce workflow stages
• Explicit policies
• Cost of Delay scheduling, sequencing and selection
#leanagileUS @mattphilip
Lean-Kanban
What You Can Do About Variation
• “Agile 101” (simple, decoupled design; thin vertical slices; pairing)
• Identify/make visible/measure dependencies
• Collaborate/Share work (Dimitar Bakardzhiev)
• Spike and stabilize (Dan North)
• Reduce accidental complexity (Liz Keogh)
#leanagileUS @mattphilip
Team
Why?
“Business” Considerations
#leanagileUS @mattphilip
NoEstimates and the Business
• Determine what actions would be different based on the estimate
• Customer-based fitness criteria
• Budgeting: Team run rate
• Focus conversation on value, not cost
• MVP and product ownership
• Create probabilistic forecast ASAP (as soon as you have data) – together!
• Service-Delivery Reviews
• Teams: Keep teams together, dedicated (reduces context-switching, Tuckman stages)
#leanagileUS @mattphilip
To Estimate or Not to Estimate?
Never
Estimate
Anything
Always
Estimate
Everything
Question purpose of estimating
Include all sources of variation
Focus on characterizing work
Probabilistic forecast
Use delivery data
Less effort spent
Estimation culture
Consider effort only
Deterministic forecast
Use intuition
Heavy effort involved
Tasks in hours
#leanagileUS @mattphilip
A better question:
What can you do to maximize value and
reduce risk in planning and delivery?
#leanagileUS @mattphilip
• noestimatesbook.com (Vasco Duarte)
• focusedobjective.com (Troy Magennis)
• actionableagile.com (Dan Vacanti)
• infoq.com/articles/noestimates-monte-carlo
(Dimitar Bakardzhiev)
• priceonomics.com/why-are-projects-always-
behind-schedule/
• scrumandkanban.co.uk/estimation-meets-
cynefin/
• ronjeffries.com
• lizkeogh.com
• neilkillick.com
• zuill.us
• mattphilip.wordpress.com/tag/noestimates
References and More Info
#leanagileUS @mattphilip

More Related Content

PDF
2017 Music City Agile Conference: NoEstimates Workshop
PDF
De-Risky Business: Techniques for Mitigating and Managing Risk
PDF
The Service-Delivery Review: The Missing Agile Feedback Loop
PDF
Getting Fit(ness Criteria)
PDF
Flow From Blockers: How to Use Blocker Clustering to Improve Predictability, ...
PDF
To Estimate or Not to Estimate, Is that the Question? (2017 Better Software C...
PDF
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
PDF
The Service-Delivery Review: The Missing Agile Feedback Loop [2017 Lean Kanba...
2017 Music City Agile Conference: NoEstimates Workshop
De-Risky Business: Techniques for Mitigating and Managing Risk
The Service-Delivery Review: The Missing Agile Feedback Loop
Getting Fit(ness Criteria)
Flow From Blockers: How to Use Blocker Clustering to Improve Predictability, ...
To Estimate or Not to Estimate, Is that the Question? (2017 Better Software C...
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
The Service-Delivery Review: The Missing Agile Feedback Loop [2017 Lean Kanba...

What's hot (20)

PDF
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
PDF
The Service-Delivery Review: The Missing Agile Feedback Loop [Lean Kanban Nor...
PDF
The Service Delivery Review: The Missing Agile Feedback Loop
PDF
Kanban Cadences for Santa
PDF
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
PPTX
Views You Can Use - How to Maximize and Measure Video's Impact throughout the...
PDF
What's Measured Improves: Metrics that matter
PDF
Metrics that Matter
PPTX
Data Lakes in Real Life: Analyzing Analysts to Improve Process Efficiency, Su...
PPTX
Data Lakes in Real Life. Superweek 2019
PDF
DevOps Traction - Continuous Lifecycle 2016 London
PDF
Selling DevOps To Non-Technical Management
PDF
How to Work with Software Engineers (strtupboost 10/18/18)
PDF
Creating a Culture of Continuous Improvement at Avvo
PPTX
Energy Surveys, Inc. Customer Journey
PDF
Robert and Anne Sabourin: Gauging Software Health
PPTX
Customer Obsession at Scale
PDF
Documentation triage WTD 2018
PPTX
Streamlining Automation Scripts and Test Data Management
PPTX
Software Testing Metrics with qTest Insights - QASymphony Webinar
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
The Service-Delivery Review: The Missing Agile Feedback Loop [Lean Kanban Nor...
The Service Delivery Review: The Missing Agile Feedback Loop
Kanban Cadences for Santa
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Views You Can Use - How to Maximize and Measure Video's Impact throughout the...
What's Measured Improves: Metrics that matter
Metrics that Matter
Data Lakes in Real Life: Analyzing Analysts to Improve Process Efficiency, Su...
Data Lakes in Real Life. Superweek 2019
DevOps Traction - Continuous Lifecycle 2016 London
Selling DevOps To Non-Technical Management
How to Work with Software Engineers (strtupboost 10/18/18)
Creating a Culture of Continuous Improvement at Avvo
Energy Surveys, Inc. Customer Journey
Robert and Anne Sabourin: Gauging Software Health
Customer Obsession at Scale
Documentation triage WTD 2018
Streamlining Automation Scripts and Test Data Management
Software Testing Metrics with qTest Insights - QASymphony Webinar
Ad

Viewers also liked (19)

PDF
Kanban Iceberg, Lean Kanban North America 2015 conference
PPTX
How (and why) to Identify Opportunities for Growth!
PPTX
Workshop zo los je zorgverzekeringsschulden op!
PDF
Customs Clearance Documents
PDF
LUẬT SƯ OLIVER MASSMANN PHÁT BIỂU TRƯỚC CÁC ĐẠI BIỂU QUỐC HỘI VIỆT NAM VỀ HIỆ...
PPSX
RETHINKING THE WAY WE THINK
PPSX
RETHINKING GLOBAL POVERTY (Part Two)
PPTX
The 10 Commandments of Digital Marketing
PPTX
制作会社の視点で見る デザイナーのキャリアパスとスキル
PDF
事業成長にコミットするエンジニア組織への道のり
PDF
International wastwater systems company overview
PDF
Vietnam - Casino and Gambling - Market Report
PPSX
CREATIVE WORK
PDF
The Infinite Dial 2017
PDF
VIETNAM CASINO BUSINESS BREAKING NEWS - THE LAW IS ISSUED – VIETNAMESE CAN G...
PDF
Daft Punk SEO
PPTX
Marine salvage services offered worldwide-E MAIL marinegedrosia@gmail.com
PDF
جوامع الدعاء من اعداد و جمع توفيق بن سعيد الصايغ
PPSX
RETHINKING WHO WE ARE, WHY WE LIVE
Kanban Iceberg, Lean Kanban North America 2015 conference
How (and why) to Identify Opportunities for Growth!
Workshop zo los je zorgverzekeringsschulden op!
Customs Clearance Documents
LUẬT SƯ OLIVER MASSMANN PHÁT BIỂU TRƯỚC CÁC ĐẠI BIỂU QUỐC HỘI VIỆT NAM VỀ HIỆ...
RETHINKING THE WAY WE THINK
RETHINKING GLOBAL POVERTY (Part Two)
The 10 Commandments of Digital Marketing
制作会社の視点で見る デザイナーのキャリアパスとスキル
事業成長にコミットするエンジニア組織への道のり
International wastwater systems company overview
Vietnam - Casino and Gambling - Market Report
CREATIVE WORK
The Infinite Dial 2017
VIETNAM CASINO BUSINESS BREAKING NEWS - THE LAW IS ISSUED – VIETNAMESE CAN G...
Daft Punk SEO
Marine salvage services offered worldwide-E MAIL marinegedrosia@gmail.com
جوامع الدعاء من اعداد و جمع توفيق بن سعيد الصايغ
RETHINKING WHO WE ARE, WHY WE LIVE
Ad

Similar to To Estimate or Not to Estimate, Is that the Question? LeanAgileUS 2017 (20)

PDF
To Estimate or Not to Estimate, is that the Question?
PDF
Product strategy in a customer centric company at LeanKit
PDF
Introduction to Lean UX
PDF
Introduction to Lean Startup & Lean User Experience Design
PDF
Meaningful Metrics for Startups
PDF
Building a culture of testing like lucid
PDF
Lean startup
PDF
Estimation is dead - Tbilisi, by John Coleman 26 April 2024 final.pdf
PPTX
Agile2015 Conference Highlights by Synerzip
PPTX
Writing effective design hypotheses
PPTX
Myths, Lies and Illusions of AB and Split Testing
PPTX
Synerzip AGILE2015 Highlights & Take Aways
PPTX
Synerzip AGILE2015 Top10 Take-Aways
PDF
Beyond the Button: Tests that actually move the needle - Karen Hopper, Razorfish
PPTX
Connecting Analytics to Strategy: Keeping Your Corporate Objective in Sight
PDF
Maksym Vyshnivetskyi: PMO KPIs (UA). Lemberg PMO School 2025
PDF
AB Testing and UX - a love story with numbers and people (by Craig Sullivan a...
PPTX
Product Management in the Era of Data Science
PDF
High-Impact Analytics for Mortals
To Estimate or Not to Estimate, is that the Question?
Product strategy in a customer centric company at LeanKit
Introduction to Lean UX
Introduction to Lean Startup & Lean User Experience Design
Meaningful Metrics for Startups
Building a culture of testing like lucid
Lean startup
Estimation is dead - Tbilisi, by John Coleman 26 April 2024 final.pdf
Agile2015 Conference Highlights by Synerzip
Writing effective design hypotheses
Myths, Lies and Illusions of AB and Split Testing
Synerzip AGILE2015 Highlights & Take Aways
Synerzip AGILE2015 Top10 Take-Aways
Beyond the Button: Tests that actually move the needle - Karen Hopper, Razorfish
Connecting Analytics to Strategy: Keeping Your Corporate Objective in Sight
Maksym Vyshnivetskyi: PMO KPIs (UA). Lemberg PMO School 2025
AB Testing and UX - a love story with numbers and people (by Craig Sullivan a...
Product Management in the Era of Data Science
High-Impact Analytics for Mortals

More from Matthew Philip (17)

PDF
Metrics at Every (Flight) Level
PDF
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
PDF
The 8 Stances of 
a Transformational Leader
PDF
Strategy Deployment: Aligning Action to Vision
PDF
Stop writing stories, start validating working software
PDF
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
PDF
From Andon to Yokoten: Japanese for Agilists
PDF
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
PDF
Leadership at every level [prdc2019]
PDF
No (Lab) Jacket Required [Agile Midwest Conference]
PDF
Leadership at Every Level: Practices for Aligned Autonomy
PDF
Culture add over culture fit [flowcon 2018]
PDF
Leadership at Every Level: Intent-Based Leadership Practices
PDF
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
PDF
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
PDF
The Service-Delivery Review: The Missing Agile Feedback Loop [Lean and Agile ...
PDF
Play soccer, not football: How to foster a whole-team approach by thinking in...
Metrics at Every (Flight) Level
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
The 8 Stances of 
a Transformational Leader
Strategy Deployment: Aligning Action to Vision
Stop writing stories, start validating working software
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
From Andon to Yokoten: Japanese for Agilists
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
Leadership at every level [prdc2019]
No (Lab) Jacket Required [Agile Midwest Conference]
Leadership at Every Level: Practices for Aligned Autonomy
Culture add over culture fit [flowcon 2018]
Leadership at Every Level: Intent-Based Leadership Practices
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
The Service-Delivery Review: The Missing Agile Feedback Loop [Lean and Agile ...
Play soccer, not football: How to foster a whole-team approach by thinking in...

Recently uploaded (20)

PDF
ORGANIZATIONAL communication -concepts and importance._20250806_112132_0000.pdf
PPTX
Human Resource Management | Introduction,Meaning and Definition
PPTX
Consulting on marketing-The needs wants and demands are a very important comp...
PPTX
Five S Training Program - Principles of 5S
PDF
CISSP - Domain 7: Security Operations - InfoSec Institute
PPTX
Chapter One an overview of political economy
PDF
CHAPTER 14 Manageement of Nursing Educational Institutions- planing and orga...
PPTX
Strategic Plan 2023-2024 Presentation.pptx
PPTX
Supervisory Styles and When to Use Them!
PPTX
Effective_communication._(strategy).pptx
PPTX
_ISO_Presentation_ISO 9001 and 45001.pptx
PDF
CISSP Domain 5: Identity and Access Management (IAM)
PPTX
Human Resources management _HR structure
PPTX
Press Release Importance & Structure.pptx
PPTX
Concluding Session_Wrapup-NA May 5 2024-Oct 10 2025 ZS.pptx
PPTX
Project Management Methods PERT-and-CPM.pptx
PPTX
Human resources management -job perception concept
PDF
The-Power-of-Communication (1).pdf......
PDF
CHAPTER 15- Manageement of Nursing Educational Institutions- Staffing and st...
PPTX
MY GOLDEN RULES la regla de oro jhonatan requena
ORGANIZATIONAL communication -concepts and importance._20250806_112132_0000.pdf
Human Resource Management | Introduction,Meaning and Definition
Consulting on marketing-The needs wants and demands are a very important comp...
Five S Training Program - Principles of 5S
CISSP - Domain 7: Security Operations - InfoSec Institute
Chapter One an overview of political economy
CHAPTER 14 Manageement of Nursing Educational Institutions- planing and orga...
Strategic Plan 2023-2024 Presentation.pptx
Supervisory Styles and When to Use Them!
Effective_communication._(strategy).pptx
_ISO_Presentation_ISO 9001 and 45001.pptx
CISSP Domain 5: Identity and Access Management (IAM)
Human Resources management _HR structure
Press Release Importance & Structure.pptx
Concluding Session_Wrapup-NA May 5 2024-Oct 10 2025 ZS.pptx
Project Management Methods PERT-and-CPM.pptx
Human resources management -job perception concept
The-Power-of-Communication (1).pdf......
CHAPTER 15- Manageement of Nursing Educational Institutions- Staffing and st...
MY GOLDEN RULES la regla de oro jhonatan requena

To Estimate or Not to Estimate, Is that the Question? LeanAgileUS 2017

  • 1. To Estimate or Not to Estimate, Is that the Question? #leanagileUS @mattphilipLeanAgileUS Conference, 27 Feb 2017
  • 2. Hofstadter’s Law “It always takes longer than you expect, even when you take into account Hofstadter’s Law.” #leanagileUS @mattphilip
  • 3. Parkinson’s Law “Work expands so as to fill the time available for its completion." #leanagileUS @mattphilip
  • 5. The Spectrum of Estimating Never Estimate Anything Always Estimate Everything Question purpose of estimating Include all sources of variation Focus on characterizing work Probabilistic forecast Use delivery data Less effort spent Estimation culture Consider effort only Deterministic forecast Use intuition Heavy effort involved Tasks in hours #leanagileUS @mattphilip
  • 6. What NoEstimates is not saying • You are evil if you estimate • All estimates are totally useless • Stop doing your successful estimating practice • Stop having the conversations to understand/analyze/break down work • Work items must be the same size • You must place your full faith and confidence in Monte Carlo forecasts #leanagileUS @mattphilip
  • 7. What NoEstimates is saying • Know why you are estimating • Discover for yourself how good you are at estimating (measure) • Keep doing the things that help you understand the work • Upfront estimates need to be held loosely #leanagileUS @mattphilip
  • 8. NoEstimates, Manifesto Style … We have come to value: Probabilistic over Deterministic Delivery time over Development time MVP scope over Full scope Data over Intuition* Reducing sources of variation over Improving estimating That is, while there is value in the items on the right, we value the items on the left more. *Neil Killick uses “empiricism over guesswork” #leanagileUS @mattphilip
  • 10. Do You Assume Correlation? Is the initial sizing a good predictor for when you can get your stuff? In our case, the surprising truth was ”no.” -- Mattias Skarin, Real-World Kanban #leanagileUS @mattphilip
  • 11. What’s Going On? Low process efficiency (typically 5-15% in software delivery) means that even if we nailed the effort estimates … we would be accurately predicting 5-15% of elapsed delivery time! -- Troy Magennis #leanagileUS @mattphilip
  • 12. Other Sources of Variation Often system factors account for more of the elapsed delivery time than different story sizes. -- Troy Magennis #leanagileUS @mattphilip
  • 13. Sources of Variation #leanagileUS @mattphilip How many can you name?
  • 14. Sources of Variation #leanagileUS @mattphilip • WIP • Technology/domain/product • Team composition • User, client and client representative • Multitasking/focus factor • Market and competitors • System dependencies • Team dependencies • Specialization • Waiting for availability • Rework • Steps/handoffs (50%*50%*50%...) • Stages in team development (Tuckman) • Selection policy • Essential complication (How hard a problem is on its own) • Accidental complication (“How much we suck at our jobs” -Rainsberger)
  • 15. First, Know Where You Are #leanagileUS @mattphilip
  • 16. Keogh’s “Scale of Ignorance” 1. Just about everyone in the world has done this. 2. Lots of people have done this, including someone on our team. 3. Someone in our company has done this, or we have access to expertise. 4. Someone in the world did this, but not in our organization (and probably at a competitor). 5. Nobody in the world has ever done this before. #leanagileUS @mattphilip
  • 17. What Can You Do About Variation? #leanagileUS @mattphilip How many remedies can you name?
  • 18. What You Can Do About Variation • Lower WIP • ConWIP/System WIP • Five Focusing Steps • Blocker clustering • Reduce workflow stages • Explicit policies • Cost of Delay scheduling, sequencing and selection #leanagileUS @mattphilip Lean-Kanban
  • 19. What You Can Do About Variation • “Agile 101” (simple, decoupled design; thin vertical slices; pairing) • Identify/make visible/measure dependencies • Collaborate/Share work (Dimitar Bakardzhiev) • Spike and stabilize (Dan North) • Reduce accidental complexity (Liz Keogh) #leanagileUS @mattphilip Team Why?
  • 21. NoEstimates and the Business • Determine what actions would be different based on the estimate • Customer-based fitness criteria • Budgeting: Team run rate • Focus conversation on value, not cost • MVP and product ownership • Create probabilistic forecast ASAP (as soon as you have data) – together! • Service-Delivery Reviews • Teams: Keep teams together, dedicated (reduces context-switching, Tuckman stages) #leanagileUS @mattphilip
  • 22. To Estimate or Not to Estimate? Never Estimate Anything Always Estimate Everything Question purpose of estimating Include all sources of variation Focus on characterizing work Probabilistic forecast Use delivery data Less effort spent Estimation culture Consider effort only Deterministic forecast Use intuition Heavy effort involved Tasks in hours #leanagileUS @mattphilip A better question: What can you do to maximize value and reduce risk in planning and delivery?
  • 24. • noestimatesbook.com (Vasco Duarte) • focusedobjective.com (Troy Magennis) • actionableagile.com (Dan Vacanti) • infoq.com/articles/noestimates-monte-carlo (Dimitar Bakardzhiev) • priceonomics.com/why-are-projects-always- behind-schedule/ • scrumandkanban.co.uk/estimation-meets- cynefin/ • ronjeffries.com • lizkeogh.com • neilkillick.com • zuill.us • mattphilip.wordpress.com/tag/noestimates References and More Info #leanagileUS @mattphilip