SlideShare a Scribd company logo
Velocity NY

A Short History of
Performance Engineering
Alexander Podelko
alex.podelko@oracle.com
alexanderpodelko.com/blog
@apodelko

October 14, 2013
1
About Me


I have specialized in performance for the last
16 years



Currently performance testing and
optimization of Hyperion products at Oracle



Board director at CMG http://cmg.org, organization
of performance and capacity professionals
– Conference November 4-8, 2013 in La Jolla, CA

Disclaimer: The views expressed here are my personal views only and do not necessarily represent those of my
current or previous employers. All brands and trademarks mentioned are the property of their owners.
2
There Was [Performance]
Life Even Before Web


Some statements referring to history look
incorrect



Performance engineering history is not well
known
– Not much information readily available



So I decided to share a few bits of
information I know / found
3
The Approach


First mature appearances of still relevant
performance notions
– From what I found
– No discussion about further rich history of each
notion



My subjective choices based on very limited
information

4
Computing Paradigms


Looks like a new wave of performance
engineering starts 10+ years after new
computing paradigm



Mainframes
– Late 50s



Distributed Systems
– Late 70s



Web
– Mid 90s



? – Mobile, Cloud
5
1966: Instrumentation


1966 – SMF (System Management
Facilities) released as part of OS/360
– Still in use

Big

Data ?

Deep

Diagnostics ?
IT

Operations
Analytics ?

6
1968: Response Times


1968 - Robert Miller (IBM) in his "Response
Time in Man-Computer Conversational
Transactions" paper described several
threshold levels of human attention
– Widely cited by many later researchers

7
1974: Monitoring


1974 – RMF (Resource Measurement
Facility) released as part of MVS
– Still in use



1975 – OMEGAMON for MVS by Candle
– Claimed to be the first real-time monitor
– Acquired by IBM in 2004

8
1975: Community


1975 – The Computer Measurement Group
(CMG) was created, holding annual
conferences since
– Coming Performance and Capacity 2013 by CMG
November 4-8 in La Jolla, CA
http://cmg.org/conference/cmg2013/
– Proceedings available to public (1976-2010)
http://cmg.org/proceedings/

9
1977: Performance Analysis
Tool


1977 – BEST/1 was released by BGS Systems,
capacity and performance management tool
– the first commercial package for computer
performance analysis to be based on analytic
models.
BGS

Systems
was acquired by
BMC Software in
1998

10
Late 70s - Distributed
Systems


Distributed Systems
– Client/Server, Three-Tier, N-Tier,
etc.



Less control, less
instrumentation



More need for performance
design and testing
11
1990: Software Performance
Engineering


1990 – Dr. Connie Smith's book
Performance Engineering of Software
Systems was published
– 15 pages of bibliography

"Fix-it-later was once a
viable approach, but it is
now inappropriate and
dangerous"
12
Does It Remind You
Anything?


Fix-it-later was a viable approach in the
1970s, but today the original promises no
longer hold, and fix-it-later is archaic and
dangerous. The original premises were:
– Performance problems are rare.
– Hardware is fast and inexpensive.
– It's too expensive to build responsive software.
– You can tune software later, if necessary.
Performance Engineering of Software Systems, 1990.

13
1991: Load Testing Tools


1991 – LoadRunner was released by
Mercury Interactive
– Acquired by HP in 2006 for $4.5B



Performance expertise moves to
performance testing teams

14
1998 ? – End-User Monitoring


1998 – ETEWatch released by Candle
– Application response time monitor
– End-to-End Watch
– Candle acquired by IBM in 2004, then a part of
Tivioli



Anybody know other EUM/RUM roots?

15
Mid 90s - Web
Most of existing expertise from mainframe
and distributed eras still applicable to back
end
 Books by D. Menasce and V. Almeida (1998,
2000, and 2001)


– Applying existing expertise to Web

16
2007: Web Performance
Optimization


2007 – Steve Souders' book High
Performance Web Sites: Essential
Knowledge for Front-End Engineers was
published



New Web-specific expertise

17
2008: WPO Community


2008 – First Velocity conference

18
Takeaways


Check your facts when you refer to history



A lot was done in the past – not always
necessary to re-invent the wheel



The feeling that we are close to solving
performance problems exists last 40+ years
– Probably will stay with us for a while

19
Questions?
Alexander Podelko
alex.podelko@oracle.com
alexanderpodelko.com/blog
@apodelko

20

More Related Content

PDF
Human vs automatic design in swarm robotics
PPTX
The art of architecture
PPT
Loadrunner presentation
PPT
Performance Testing With Loadrunner
PPTX
Load Runner
PPTX
QSpiders - Introduction to Performance Testing
PPTX
Oslo Schibsted Performance Gathering
PDF
Understanding Microservice Performance
Human vs automatic design in swarm robotics
The art of architecture
Loadrunner presentation
Performance Testing With Loadrunner
Load Runner
QSpiders - Introduction to Performance Testing
Oslo Schibsted Performance Gathering
Understanding Microservice Performance

Viewers also liked (18)

PPT
Web test
PPTX
What is Loadrunner ?
PPTX
How to Get Automatic Analysis for Load Test Results
PPT
Web performance testing
PPT
Analyzing Performance Test Data
PPSX
Performance testing for web applications – techniques, metrics and profiling
PPTX
Performance Test Automation Framework Presentation
PPTX
An Introduction to Performance Testing
PPT
Hp Loadrunner
PDF
E commerce Testing
PDF
Performance Requirement Gathering
PDF
Introduction to Performance testing
PPT
Performance testing using hp load runner
PPT
Advanced Load Runner
PPTX
Introduction to performance testing
PPT
Gathering performance information overview
PDF
How to start performance testing project
PDF
LoadRunner Performance Testing
Web test
What is Loadrunner ?
How to Get Automatic Analysis for Load Test Results
Web performance testing
Analyzing Performance Test Data
Performance testing for web applications – techniques, metrics and profiling
Performance Test Automation Framework Presentation
An Introduction to Performance Testing
Hp Loadrunner
E commerce Testing
Performance Requirement Gathering
Introduction to Performance testing
Performance testing using hp load runner
Advanced Load Runner
Introduction to performance testing
Gathering performance information overview
How to start performance testing project
LoadRunner Performance Testing
Ad

Similar to A Short History of Performance Engineering (20)

PPTX
A Short History of Performance Engineering
PPT
T3 Consortium's Performance Center of Excellence
PDF
PAC 2019 virtual Alexander Podelko
PDF
Performance Engineering State Of The Art And Current Trends 1st Edition Reine...
PPT
Short reference architecture
PDF
BCS APSG Enterprise Systems
PPTX
Software Trends: Past, Present and Future
PDF
Enterprise performance engineering solutions
KEY
What ya gonna do?
 
PDF
IBM’s zEnterprise Really Stretches Its Boundaries — New Windows Are Opened
PPTX
05. performance-concepts
PDF
BCS CCS Enterprise Systems
DOC
Rajesh Kumar Bharathan
PDF
ID114 - Wrestling the Snake: Performance Tuning 101
PDF
Performance Of IT Infrastructure Author Liam Smith
PPT
Performance testing : An Overview
PDF
Adding Value in the Cloud with Performance Test
PDF
performancetestinganoverview-110206071921-phpapp02.pdf
PDF
Load and Performance Testing for J2EE - Testing, monitoring and reporting usi...
PDF
Ron Newman Resume T
A Short History of Performance Engineering
T3 Consortium's Performance Center of Excellence
PAC 2019 virtual Alexander Podelko
Performance Engineering State Of The Art And Current Trends 1st Edition Reine...
Short reference architecture
BCS APSG Enterprise Systems
Software Trends: Past, Present and Future
Enterprise performance engineering solutions
What ya gonna do?
 
IBM’s zEnterprise Really Stretches Its Boundaries — New Windows Are Opened
05. performance-concepts
BCS CCS Enterprise Systems
Rajesh Kumar Bharathan
ID114 - Wrestling the Snake: Performance Tuning 101
Performance Of IT Infrastructure Author Liam Smith
Performance testing : An Overview
Adding Value in the Cloud with Performance Test
performancetestinganoverview-110206071921-phpapp02.pdf
Load and Performance Testing for J2EE - Testing, monitoring and reporting usi...
Ron Newman Resume T
Ad

More from Alexander Podelko (16)

PDF
Continuous Performance Testing: Challenges and Approaches
PPTX
Context-Driven Performance Testing
PPTX
Multiple Dimensions of Load Testing
DOCX
Multiple Dimensions of Load Testing, CMG 2015 paper
PPTX
Reinventing Performance Testing, CMG imPACt 2016 slides
DOCX
Reinventing Performance Testing. CMG imPACt 2016 paper
PDF
Continuous Performance Testing: Myths and Realities
PPTX
Tools of the Trade: Load Testing - Ignite session at WebPerfDays NY 14
PPTX
Load Testing: See a Bigger Picture, ALM Forum, 2014
PPT
Performance testing: respect the difference at swqd14
PDF
Agile Aspects of Performance Testing
PPTX
Performance: See the Whole Picture
PDF
Performance Requirements: CMG'11 slides with notes (pdf)
PPTX
Performance Assurance for Packaged Applications
PPTX
Load Testing: See a Bigger Picture
PPT
Performance Requirements: the Backbone of the Performance Engineering Process
Continuous Performance Testing: Challenges and Approaches
Context-Driven Performance Testing
Multiple Dimensions of Load Testing
Multiple Dimensions of Load Testing, CMG 2015 paper
Reinventing Performance Testing, CMG imPACt 2016 slides
Reinventing Performance Testing. CMG imPACt 2016 paper
Continuous Performance Testing: Myths and Realities
Tools of the Trade: Load Testing - Ignite session at WebPerfDays NY 14
Load Testing: See a Bigger Picture, ALM Forum, 2014
Performance testing: respect the difference at swqd14
Agile Aspects of Performance Testing
Performance: See the Whole Picture
Performance Requirements: CMG'11 slides with notes (pdf)
Performance Assurance for Packaged Applications
Load Testing: See a Bigger Picture
Performance Requirements: the Backbone of the Performance Engineering Process

Recently uploaded (20)

PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Machine learning based COVID-19 study performance prediction
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PPTX
Big Data Technologies - Introduction.pptx
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
Empathic Computing: Creating Shared Understanding
Digital-Transformation-Roadmap-for-Companies.pptx
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Machine learning based COVID-19 study performance prediction
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Network Security Unit 5.pdf for BCA BBA.
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
20250228 LYD VKU AI Blended-Learning.pptx
Dropbox Q2 2025 Financial Results & Investor Presentation
NewMind AI Weekly Chronicles - August'25 Week I
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Review of recent advances in non-invasive hemoglobin estimation
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Chapter 3 Spatial Domain Image Processing.pdf
Big Data Technologies - Introduction.pptx
The Rise and Fall of 3GPP – Time for a Sabbatical?
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
Empathic Computing: Creating Shared Understanding

A Short History of Performance Engineering

  • 1. Velocity NY A Short History of Performance Engineering Alexander Podelko alex.podelko@oracle.com alexanderpodelko.com/blog @apodelko October 14, 2013 1
  • 2. About Me  I have specialized in performance for the last 16 years  Currently performance testing and optimization of Hyperion products at Oracle  Board director at CMG http://cmg.org, organization of performance and capacity professionals – Conference November 4-8, 2013 in La Jolla, CA Disclaimer: The views expressed here are my personal views only and do not necessarily represent those of my current or previous employers. All brands and trademarks mentioned are the property of their owners. 2
  • 3. There Was [Performance] Life Even Before Web  Some statements referring to history look incorrect  Performance engineering history is not well known – Not much information readily available  So I decided to share a few bits of information I know / found 3
  • 4. The Approach  First mature appearances of still relevant performance notions – From what I found – No discussion about further rich history of each notion  My subjective choices based on very limited information 4
  • 5. Computing Paradigms  Looks like a new wave of performance engineering starts 10+ years after new computing paradigm  Mainframes – Late 50s  Distributed Systems – Late 70s  Web – Mid 90s  ? – Mobile, Cloud 5
  • 6. 1966: Instrumentation  1966 – SMF (System Management Facilities) released as part of OS/360 – Still in use Big Data ? Deep Diagnostics ? IT Operations Analytics ? 6
  • 7. 1968: Response Times  1968 - Robert Miller (IBM) in his "Response Time in Man-Computer Conversational Transactions" paper described several threshold levels of human attention – Widely cited by many later researchers 7
  • 8. 1974: Monitoring  1974 – RMF (Resource Measurement Facility) released as part of MVS – Still in use  1975 – OMEGAMON for MVS by Candle – Claimed to be the first real-time monitor – Acquired by IBM in 2004 8
  • 9. 1975: Community  1975 – The Computer Measurement Group (CMG) was created, holding annual conferences since – Coming Performance and Capacity 2013 by CMG November 4-8 in La Jolla, CA http://cmg.org/conference/cmg2013/ – Proceedings available to public (1976-2010) http://cmg.org/proceedings/ 9
  • 10. 1977: Performance Analysis Tool  1977 – BEST/1 was released by BGS Systems, capacity and performance management tool – the first commercial package for computer performance analysis to be based on analytic models. BGS Systems was acquired by BMC Software in 1998 10
  • 11. Late 70s - Distributed Systems  Distributed Systems – Client/Server, Three-Tier, N-Tier, etc.  Less control, less instrumentation  More need for performance design and testing 11
  • 12. 1990: Software Performance Engineering  1990 – Dr. Connie Smith's book Performance Engineering of Software Systems was published – 15 pages of bibliography "Fix-it-later was once a viable approach, but it is now inappropriate and dangerous" 12
  • 13. Does It Remind You Anything?  Fix-it-later was a viable approach in the 1970s, but today the original promises no longer hold, and fix-it-later is archaic and dangerous. The original premises were: – Performance problems are rare. – Hardware is fast and inexpensive. – It's too expensive to build responsive software. – You can tune software later, if necessary. Performance Engineering of Software Systems, 1990. 13
  • 14. 1991: Load Testing Tools  1991 – LoadRunner was released by Mercury Interactive – Acquired by HP in 2006 for $4.5B  Performance expertise moves to performance testing teams 14
  • 15. 1998 ? – End-User Monitoring  1998 – ETEWatch released by Candle – Application response time monitor – End-to-End Watch – Candle acquired by IBM in 2004, then a part of Tivioli  Anybody know other EUM/RUM roots? 15
  • 16. Mid 90s - Web Most of existing expertise from mainframe and distributed eras still applicable to back end  Books by D. Menasce and V. Almeida (1998, 2000, and 2001)  – Applying existing expertise to Web 16
  • 17. 2007: Web Performance Optimization  2007 – Steve Souders' book High Performance Web Sites: Essential Knowledge for Front-End Engineers was published  New Web-specific expertise 17
  • 18. 2008: WPO Community  2008 – First Velocity conference 18
  • 19. Takeaways  Check your facts when you refer to history  A lot was done in the past – not always necessary to re-invent the wheel  The feeling that we are close to solving performance problems exists last 40+ years – Probably will stay with us for a while 19

Editor's Notes

  • #7: http://www.flickr.com/photos/22221172@N00/2627291590
  • #8: http://www.flickr.com/photos/8543480@N06/5565773185
  • #9: http://www.flickr.com/photos/24205142@N00/2370873167/
  • #12: http://www.flickr.com/photos/65615735@N00/4263449886
  • #15: http://www.flickr.com/photos/99112767@N00/420926118/