SlideShare a Scribd company logo
Prevalence of Spreadsheet ErrorsMBA 236G-01B: Designing Financial Models that WorkHetu Patel5th April, 2010Hetu PatelPrevalence of Spreadsheet Errors1
People tend to underestimate prevalence of errors in spreadsheetsLike in driving, a large majority of all people rate themselves as above average when it comes to spreadsheet skillsBrown and Gould (Brown & Gould, 1987) gave three spreadsheet development tasks to nine highly experienced spreadsheet developers, all made at least one error, and 63% of the spreadsheets overall had errors.Yet, the experts were “very confident” about the correctness of the spreadsheetPeople are reported to have more confidence in large, well formatted spreadsheets, than smaller spreadsheets (regardless of formatting).However, in reality, larger spreadsheets are more prone to errorTo err is human… but, overconfidence just prevents from taking steps to mitigate risk.One source of this overconfidence is lack of testing and thorough review.Hetu PatelPrevalence of Spreadsheet Errors2
Summary of results from separate spreadsheet studies	Summary compiled by Professor Ray Panko, at the University of Hawaii,These numbers seem high, but a conservative estimate of cell error rates is 1%. Assuming this is true for unique formulas, spreadsheets containing from 150 to 350 unique formulae, we find that the probability of an individual spreadsheet containing an error is between 78% and 97%.Evidence from field audits of spreadsheets reveal disturbing error ratesHetu PatelPrevalence of Spreadsheet Errors3
Types of Spreadsheet ErrorsSpreadsheet = Data + Formulas	Therefore, errors in spreadsheet are due to errors in data or errors in formulas…Quantitative Errors (makes the current spreadsheet incorrect)Mechanical errors arise from typing or pointing errors.Logic errors arise from choosing the wrong function or creating the wrong formula.Omission errors arise from misinterpretation of the situation to be modeled.Qualitative Errors (poses threat to make future versions incorrect)Hard-coding numbers into formulasLong formulasPoor physical layoutLack of sufficient documentation.Hetu PatelPrevalence of Spreadsheet Errors4
Proper actions can be taken to mitigate spreadsheet error riskAwareness of common errorsAcknowledging errors is first step to fix themTraining Spreadsheet development is so dispersed and very few do spreadsheet development as their main task. Hence, imparting proper training to all becomes essential.Adopting Best PracticesBest practices must be ingrained and come naturallyAdequate testingAdopt proper testing methods and allocate sufficient time for testing spreadsheet modelsHetu PatelPrevalence of Spreadsheet Errors5
Examples of Some costly spreadsheet errors…Forecast sales of $55 million for planned new computer product. Forgot planned price discount on key components to one supplier. Forecast was $8 million over. It was caught in time to prevent damage.End users shared diskettes containing old data. In one case, a person ordered 30,000 units of a $4 part; but the plan had changed and the company only needed 1,500.A Midwestern firm's estimated taxes were $5,000 off from a correct paper and pencil value. The spreadsheet had an incorrect formula for assessing salvage value.Two spreadsheets with 15,000 cells were used to project the market for CAD equipment. Numbers were rounded off to whole dollars. But the inflation multiplier, which should have been 1.06, became 1. Without inflation, the market was underestimated by $36 million.ReferencesBusiness Week "How Personal Computers Can Trip Up Executives," (2861) September 24, 1984, pp. 94-102 passim.http://www.louisepryor.com/showTopic.do?topic=31http://www.iacis.org/iis/2005_iis/PDFs/Benham_Giullian.pdfhttp://mba.tuck.dartmouth.edu/spreadsheet/product_pubs_files/Errors.pdfhttp://panko.shidler.hawaii.edu/SSR/Mypapers/whatknow.htmHetu PatelPrevalence of Spreadsheet Errors6

More Related Content

PPTX
Identify Root Causes – 5 Whys
PDF
Fishbone and 5 Why webinar 02 11-21
PPT
5-Why Training
PPTX
Measure Phase Roadmap (Level 3) with Matt Hansen at StatStuff
PPTX
Analysis of Behavior & Cognition (ABC) Model with Matt Hansen at StatStuff
PPTX
Qcl 14-v3 [cause-effect diagram]-[parinita dwivedi]_[banasthali university]
PPTX
Cause effect diagram
PPTX
Agile camp 2018 - Team Metrics
Identify Root Causes – 5 Whys
Fishbone and 5 Why webinar 02 11-21
5-Why Training
Measure Phase Roadmap (Level 3) with Matt Hansen at StatStuff
Analysis of Behavior & Cognition (ABC) Model with Matt Hansen at StatStuff
Qcl 14-v3 [cause-effect diagram]-[parinita dwivedi]_[banasthali university]
Cause effect diagram
Agile camp 2018 - Team Metrics

What's hot (20)

PPTX
Building a Problem Statement with Matt Hansen at StatStuff
PPTX
Risk Analysis with Matt Hansen at StatStuff
PPTX
Identify Root Causes – DCP Overview
PPT
Root Cause Analysis
PDF
Automated Decision making with Predictive Applications – Big Data Hamburg
PPTX
Cause and effect diagram
PDF
Automated decision making using Predictive Applications – Big Data Paris
PPT
5 why analysis
PPT
PDF
Automated decision making with predictive applications – Big Data Frankfurt
PPTX
Population vs. Sample Data with Matt Hansen at StatStuff
PPT
Root cause analysis apr 2010
PDF
Root Cause Analysis (RCA) Tools
PDF
Engineering Anti-Patterns @JQueryTO 2014
PPTX
Distributions: Normal with Matt Hansen at StatStuff
PPTX
Distributions: Non-Normal with Matt Hansen at StatStuff
PPTX
Statistics in the age of data science, issues you can not ignore
PPTX
Cause and effect diagram
PDF
12 ways to kill your data science team creativity
PPT
Cause & effect analysis part 2
Building a Problem Statement with Matt Hansen at StatStuff
Risk Analysis with Matt Hansen at StatStuff
Identify Root Causes – DCP Overview
Root Cause Analysis
Automated Decision making with Predictive Applications – Big Data Hamburg
Cause and effect diagram
Automated decision making using Predictive Applications – Big Data Paris
5 why analysis
Automated decision making with predictive applications – Big Data Frankfurt
Population vs. Sample Data with Matt Hansen at StatStuff
Root cause analysis apr 2010
Root Cause Analysis (RCA) Tools
Engineering Anti-Patterns @JQueryTO 2014
Distributions: Normal with Matt Hansen at StatStuff
Distributions: Non-Normal with Matt Hansen at StatStuff
Statistics in the age of data science, issues you can not ignore
Cause and effect diagram
12 ways to kill your data science team creativity
Cause & effect analysis part 2
Ad

Similar to Prevalence Of Spreadsheet Errors (20)

PPTX
Spreadsheet Errors Pc 4 5 10
PPTX
Spreadsheet Errors
PPTX
Spreadsheet Errors
PPT
Spreadsheet Errors
PPTX
Spreadsheet Errors
PPTX
Spreadsheet Errors Mb
PPT
Spreadsheet Errors Swang
PPTX
Spreadsheet Error - A Primer
PPT
Spreadsheet Errors
PPTX
D F M W Spreadsheet Errors John Frerichs
PPTX
Hw1 Spreadsheet Errors
PPTX
art of spreadsheet errors
PPTX
Spreadsheet Errors
PPTX
Spreadsheet Errors
PPTX
Errors In Spreadsheets Are Common
PPTX
Errors In Spreadsheets Are Common
PPTX
Spreadsheet Errors
PPTX
Spreadsheet Errors
PPTX
Spreadsheet Errors
PPTX
Spreadsheet Errors
Spreadsheet Errors Pc 4 5 10
Spreadsheet Errors
Spreadsheet Errors
Spreadsheet Errors
Spreadsheet Errors
Spreadsheet Errors Mb
Spreadsheet Errors Swang
Spreadsheet Error - A Primer
Spreadsheet Errors
D F M W Spreadsheet Errors John Frerichs
Hw1 Spreadsheet Errors
art of spreadsheet errors
Spreadsheet Errors
Spreadsheet Errors
Errors In Spreadsheets Are Common
Errors In Spreadsheets Are Common
Spreadsheet Errors
Spreadsheet Errors
Spreadsheet Errors
Spreadsheet Errors
Ad

Prevalence Of Spreadsheet Errors

  • 1. Prevalence of Spreadsheet ErrorsMBA 236G-01B: Designing Financial Models that WorkHetu Patel5th April, 2010Hetu PatelPrevalence of Spreadsheet Errors1
  • 2. People tend to underestimate prevalence of errors in spreadsheetsLike in driving, a large majority of all people rate themselves as above average when it comes to spreadsheet skillsBrown and Gould (Brown & Gould, 1987) gave three spreadsheet development tasks to nine highly experienced spreadsheet developers, all made at least one error, and 63% of the spreadsheets overall had errors.Yet, the experts were “very confident” about the correctness of the spreadsheetPeople are reported to have more confidence in large, well formatted spreadsheets, than smaller spreadsheets (regardless of formatting).However, in reality, larger spreadsheets are more prone to errorTo err is human… but, overconfidence just prevents from taking steps to mitigate risk.One source of this overconfidence is lack of testing and thorough review.Hetu PatelPrevalence of Spreadsheet Errors2
  • 3. Summary of results from separate spreadsheet studies Summary compiled by Professor Ray Panko, at the University of Hawaii,These numbers seem high, but a conservative estimate of cell error rates is 1%. Assuming this is true for unique formulas, spreadsheets containing from 150 to 350 unique formulae, we find that the probability of an individual spreadsheet containing an error is between 78% and 97%.Evidence from field audits of spreadsheets reveal disturbing error ratesHetu PatelPrevalence of Spreadsheet Errors3
  • 4. Types of Spreadsheet ErrorsSpreadsheet = Data + Formulas Therefore, errors in spreadsheet are due to errors in data or errors in formulas…Quantitative Errors (makes the current spreadsheet incorrect)Mechanical errors arise from typing or pointing errors.Logic errors arise from choosing the wrong function or creating the wrong formula.Omission errors arise from misinterpretation of the situation to be modeled.Qualitative Errors (poses threat to make future versions incorrect)Hard-coding numbers into formulasLong formulasPoor physical layoutLack of sufficient documentation.Hetu PatelPrevalence of Spreadsheet Errors4
  • 5. Proper actions can be taken to mitigate spreadsheet error riskAwareness of common errorsAcknowledging errors is first step to fix themTraining Spreadsheet development is so dispersed and very few do spreadsheet development as their main task. Hence, imparting proper training to all becomes essential.Adopting Best PracticesBest practices must be ingrained and come naturallyAdequate testingAdopt proper testing methods and allocate sufficient time for testing spreadsheet modelsHetu PatelPrevalence of Spreadsheet Errors5
  • 6. Examples of Some costly spreadsheet errors…Forecast sales of $55 million for planned new computer product. Forgot planned price discount on key components to one supplier. Forecast was $8 million over. It was caught in time to prevent damage.End users shared diskettes containing old data. In one case, a person ordered 30,000 units of a $4 part; but the plan had changed and the company only needed 1,500.A Midwestern firm's estimated taxes were $5,000 off from a correct paper and pencil value. The spreadsheet had an incorrect formula for assessing salvage value.Two spreadsheets with 15,000 cells were used to project the market for CAD equipment. Numbers were rounded off to whole dollars. But the inflation multiplier, which should have been 1.06, became 1. Without inflation, the market was underestimated by $36 million.ReferencesBusiness Week "How Personal Computers Can Trip Up Executives," (2861) September 24, 1984, pp. 94-102 passim.http://www.louisepryor.com/showTopic.do?topic=31http://www.iacis.org/iis/2005_iis/PDFs/Benham_Giullian.pdfhttp://mba.tuck.dartmouth.edu/spreadsheet/product_pubs_files/Errors.pdfhttp://panko.shidler.hawaii.edu/SSR/Mypapers/whatknow.htmHetu PatelPrevalence of Spreadsheet Errors6