SlideShare a Scribd company logo
W18
Special Topics
5/1/2013 3:00:00 PM

Reports of the Death of Testing Have
Been Greatly Exaggerated
Presented by:
Ruud Teunissen
Polteq Test Services BV

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Ruud Teunissen
An international test consultant at Polteq Test Services BV, Ruud Teunissen has performed several test
functions in a number of IT projects: tester, test specialist, test consultant, and test manager. Ruud
participated in the development of the structured testing methodology TMap® - Test Management
Approach. Together with Martin Pol and Erik van Veenendaal, Ruud is coauthor of several books on
structured testing, including Software Testing: A Guide to the TMap® Approach.
Reports of the Death of Testing Have
Been Highly Exaggerated
Ruud Teunissen
Polteq Test Services BV
The Netherlands

Reports of the Death of Testing
Have Been Highly Exaggerated
Have you heard? It’s all over the social media. We are the
“last generation of testers.” Testing is dead. No more classical
testing—too much inflexible process. Context driven? That is a
code phrase for do whatever. Agility? Developers do testing,
and testers become developers. DevOps? Development and
operations join forces—and test is not in the picture. And,
companies don’t test anymore—they outsource. Ruud
Teunissen believes we must save the indispensable craft of
testing. Non-functional tests require special skills; new
paradigms like cloud and mobile must be explored and tested;
Enterprise-to-enterprise integration tests become more vital
as systems grow larger and more complex. And who’s going
to do that testing? Testing skills are needed to work
effectively and efficiently in these new contexts. Learn to save
the testing skills within your organization and do what you’ve
always done best—save the day by preventing defects from
going live.
2

1
Let’s have a look at the evolution of testing

Pioneering
Optimizing

Structuur

Unstructured
Undisciplined
Flexible

Specialization
Structured
Disciplined
Inflexible

Structuring
Once

Now

3

Once upon a time testing was pioneering
• Unknown, no buy-in, no budget, no process, no tools
• Fully integrated in the development process
– Generalists, joined effort
– Prototype, exploratory driven
– No dedicated testing staff

• Struggling to get involved
• Not a partner, no influence
• Discussing risks not done
• Only in emergencies
4

2
Because bugs lead to

disasters …

” If debugging is the process
of removing bugs, then
programming must be the
process of putting them in. „

Edsger Dijkstra

3
… we started specializing and structuring
• Structuring the process
• Standardization (Books)
• Defining the test function
– Certification
– Independent

• Functionality and non-functionality
• Test automation
• Test process improvement models
– TPI, TMM, TMMi, TOM, TIM, TSM, …
7

Testing!

• Dedicated (trained) staff
• Recognized as a function
• Test competence center
• Master test planning
• Risk based coverage
• (Early) involvement
• Independent testing

8

4
Testing?

• Becoming a referee
• Process Improvement freaks
• Inflexible
• Metrics mania
• Spreadsheet management
• Complaining and blaming
• Tunnel vision

9

Changing context
Technology push

Efficiency push

10

5
Changing context
Technology push
• Architecture
–
–
–
–

SOA
Virtualization
Web technology
Devices

• Cloud
• SoLoMo
• Integration

11

Changing context
Efficiency push
•
•
•
•
•
•
•

Outsourcing
Package software
Cloud
Agile, Scrum
DevOps
Continuous delivery
Collaboration

12

6
Testing is challenged
Keynote EuroSTAR 2011

Pursuing quality?
(you won’t get there by testing)
James Whittaker
Engineering Director, Google

TestNet (Dutch SIGIST)

Model Driven Development,
the end of the test profession?
Johan den Haan
CTO, Mendix
13

Testing is challenged
xxxxxxxxxxxxxxxxxxxxx

Process = out
Certification = wrong
14

7
Testing is challenged
• Context Driven
– Right solution, practice, coverage, cooperation, skills

Major factor: PEOPLE!

15

Testing is challenged
• Context Driven
–
–
–
–

Right solution, practice, coverage, cooperation, skills
Exploratory
Session based
Rapid

Context driven = less

16

8
Testing is challenged

Tester =

?

17

Testing is challenged

Tester = agilist

18

9
Offshoring, outsourcing

Package software

Cloud computing
19

20

10
• Changing role
• Distributed
– Business/RQMS
– Development
– Operations

21

• Changing role
• Distributed
• Technical
–
–
–
–

Automation
Cloud
SoLoMo
Security

22

11
• Changing role
• Distributed
• Technical
• Programming
– Automation
– Development

23

• Changing role
•
•
•
•

Distributed
Technical
Programming
Social
– Team player
– Communication

24

12
Cooperate
Facilitate
Innovate
Optimize

25

About the speaker
Ruud Teunissen
Polteq Test Services, The Netherlands
ruud.teunissen@polteq.com - http://www.polteq.com
Ruud Teunissen is best described as a passionate software tester.
Throughout his career he has played almost any possible role in
testing (tester, test manager, test trainer, coach, sales, manager,
test consultant, …) in a variety of environments and companies.
Ruud is coauthor of several books on structured testing, including
Software Testing: A Guide to the TMap® Approach. Currently he is
senior test consultant with Polteq Test Services BV and focuses on
test improvement and management in any context. Ruud is
frequently invited to speak at conferences. Within Polteq, Ruud is
responsible for TI4Automation, the approach for successful
implementation and improvement of test automation based on
hands-on experiences and good practices.

26

13

More Related Content

PPTX
Will Robots Replace Testers?
PDF
A Rapid Introduction to Rapid Software Testing
PDF
Agile Testing in the Enterprise 2016
PDF
Agile Testing in the Enterprise
PDF
Rapid Software Testing: Strategy
PDF
New Barriers of Transformation
PPTX
How to do science in a large IT company (ICPC World Finals 2021, Moscow)
PDF
Daryl Elfield - Power to the People - EuroSTAR 2011
Will Robots Replace Testers?
A Rapid Introduction to Rapid Software Testing
Agile Testing in the Enterprise 2016
Agile Testing in the Enterprise
Rapid Software Testing: Strategy
New Barriers of Transformation
How to do science in a large IT company (ICPC World Finals 2021, Moscow)
Daryl Elfield - Power to the People - EuroSTAR 2011

What's hot (20)

PDF
DevOps not a Toolbox
PDF
The Rationale for Continuous Delivery
PDF
Measurement and Metrics for Test Managers
PPTX
State of DevSecOps - DevOpsDays Jakarta 2019
PPTX
DevOps Roadtrip Final Speaking Deck
PPTX
Secure DevOps - Evolution or Revolution?
PDF
Kubernetes is Not Your Platform, It's Just the Foundation @ UK Cloud Infrastr...
PPTX
Extreme programming
PDF
Hs engineering engineering dvc
PPTX
10 Agile Take-Aways for Senior Management
PPTX
State of DevSecOps - DevSecOpsDays 2019
PDF
Cloud Security for Remote Engineering Teams
PDF
Software testing
PPTX
Design process in English
PDF
What We Learned from Three Years of Sciencing the Crap Out of DevOps
PDF
Testing is a team problem
PDF
The Future of DevSecOps
PPTX
Continuous Delivery på riktigt
PDF
The Rationale for Continuous Delivery by Dave Farley
PPTX
SecureWorld: Security is Dead, Rugged DevOps 1f
DevOps not a Toolbox
The Rationale for Continuous Delivery
Measurement and Metrics for Test Managers
State of DevSecOps - DevOpsDays Jakarta 2019
DevOps Roadtrip Final Speaking Deck
Secure DevOps - Evolution or Revolution?
Kubernetes is Not Your Platform, It's Just the Foundation @ UK Cloud Infrastr...
Extreme programming
Hs engineering engineering dvc
10 Agile Take-Aways for Senior Management
State of DevSecOps - DevSecOpsDays 2019
Cloud Security for Remote Engineering Teams
Software testing
Design process in English
What We Learned from Three Years of Sciencing the Crap Out of DevOps
Testing is a team problem
The Future of DevSecOps
Continuous Delivery på riktigt
The Rationale for Continuous Delivery by Dave Farley
SecureWorld: Security is Dead, Rugged DevOps 1f
Ad

Viewers also liked (14)

PDF
Distributed Agile Testing: Yes, You Can
PDF
Creative Techniques for Discovering Test Ideas
PDF
Building Hyperproductive Agile Teams: Leveraging What Science Knows
PDF
Hybrid Security Analysis: Bridging the Gap between Inside-Out and Outside-In
PDF
Seven Deadly Habits of Dysfunctional Software Managers
PDF
Cutting-edge Performance Testing on eCommerce Websites
PDF
Building a Team Backlog: The Power of Retrospectives
PDF
Security Testing for Testing Professionals
PDF
Building Quality In
PDF
The Agile Tester’s Mindset
PDF
Rob Sabourin: On Testing
PDF
The Challenges of BIG Testing: Automation, Virtualization, Outsourcing, and More
PDF
PDF
Team Leadership: Telling Your Testing Stories
Distributed Agile Testing: Yes, You Can
Creative Techniques for Discovering Test Ideas
Building Hyperproductive Agile Teams: Leveraging What Science Knows
Hybrid Security Analysis: Bridging the Gap between Inside-Out and Outside-In
Seven Deadly Habits of Dysfunctional Software Managers
Cutting-edge Performance Testing on eCommerce Websites
Building a Team Backlog: The Power of Retrospectives
Security Testing for Testing Professionals
Building Quality In
The Agile Tester’s Mindset
Rob Sabourin: On Testing
The Challenges of BIG Testing: Automation, Virtualization, Outsourcing, and More
Team Leadership: Telling Your Testing Stories
Ad

Similar to Reports of the Death of Testing Have Been Greatly Exaggerated (20)

PDF
Intelligent Testing Skills Needed for Next Generation Testers
PDF
The Testing Planet Issue 10
PPTX
Agile Testing Days -Trends and future in testing 2017
PDF
Ruud Teunissen - The Awful Truth About Estimation, Have I Been Wrong All Alon...
PPT
Eric Jimmink - The Specialized Testers of the Future
PDF
Paul Gerrard - The Redistribution of Testing – Where to Innovate and What to ...
PDF
Testing and Tester Evolution
PPTX
Software Testing PowerpointPresentation.pptx
PDF
Jon Bach: On Testing
PPTX
New model
PPTX
A New Model For Testing
PPTX
Practitest webinar - When a test manager makes a difference
PDF
[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOps
PPTX
Intelligent Testing Skills Needed in a Digital World
PDF
Der Test Manager ist tot - lang lebe der Test Master
PPT
Ruud Teunissen - Personal Test Improvement - Dealing with the Future
PDF
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
PPTX
Continuous Cycles in Test Automation
PDF
Marlabs test digest Sep 2014
PPTX
Qa focus 2015 2020
Intelligent Testing Skills Needed for Next Generation Testers
The Testing Planet Issue 10
Agile Testing Days -Trends and future in testing 2017
Ruud Teunissen - The Awful Truth About Estimation, Have I Been Wrong All Alon...
Eric Jimmink - The Specialized Testers of the Future
Paul Gerrard - The Redistribution of Testing – Where to Innovate and What to ...
Testing and Tester Evolution
Software Testing PowerpointPresentation.pptx
Jon Bach: On Testing
New model
A New Model For Testing
Practitest webinar - When a test manager makes a difference
[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOps
Intelligent Testing Skills Needed in a Digital World
Der Test Manager ist tot - lang lebe der Test Master
Ruud Teunissen - Personal Test Improvement - Dealing with the Future
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Continuous Cycles in Test Automation
Marlabs test digest Sep 2014
Qa focus 2015 2020

More from TechWell (20)

PDF
Failing and Recovering
PDF
Instill a DevOps Testing Culture in Your Team and Organization
PDF
Test Design for Fully Automated Build Architecture
PDF
System-Level Test Automation: Ensuring a Good Start
PDF
Build Your Mobile App Quality and Test Strategy
PDF
Testing Transformation: The Art and Science for Success
PDF
Implement BDD with Cucumber and SpecFlow
PDF
Develop WebDriver Automated Tests—and Keep Your Sanity
PDF
Ma 15
PDF
Eliminate Cloud Waste with a Holistic DevOps Strategy
PDF
Transform Test Organizations for the New World of DevOps
PDF
The Fourth Constraint in Project Delivery—Leadership
PDF
Resolve the Contradiction of Specialists within Agile Teams
PDF
Pin the Tail on the Metric: A Field-Tested Agile Game
PDF
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
PDF
A Business-First Approach to DevOps Implementation
PDF
Databases in a Continuous Integration/Delivery Process
PDF
Mobile Testing: What—and What Not—to Automate
PDF
Cultural Intelligence: A Key Skill for Success
PDF
Turn the Lights On: A Power Utility Company's Agile Transformation
Failing and Recovering
Instill a DevOps Testing Culture in Your Team and Organization
Test Design for Fully Automated Build Architecture
System-Level Test Automation: Ensuring a Good Start
Build Your Mobile App Quality and Test Strategy
Testing Transformation: The Art and Science for Success
Implement BDD with Cucumber and SpecFlow
Develop WebDriver Automated Tests—and Keep Your Sanity
Ma 15
Eliminate Cloud Waste with a Holistic DevOps Strategy
Transform Test Organizations for the New World of DevOps
The Fourth Constraint in Project Delivery—Leadership
Resolve the Contradiction of Specialists within Agile Teams
Pin the Tail on the Metric: A Field-Tested Agile Game
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
A Business-First Approach to DevOps Implementation
Databases in a Continuous Integration/Delivery Process
Mobile Testing: What—and What Not—to Automate
Cultural Intelligence: A Key Skill for Success
Turn the Lights On: A Power Utility Company's Agile Transformation

Recently uploaded (20)

PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Machine learning based COVID-19 study performance prediction
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PPTX
Big Data Technologies - Introduction.pptx
PPTX
Cloud computing and distributed systems.
PDF
Network Security Unit 5.pdf for BCA BBA.
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Machine learning based COVID-19 study performance prediction
20250228 LYD VKU AI Blended-Learning.pptx
Programs and apps: productivity, graphics, security and other tools
Reach Out and Touch Someone: Haptics and Empathic Computing
Diabetes mellitus diagnosis method based random forest with bat algorithm
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Understanding_Digital_Forensics_Presentation.pptx
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
The Rise and Fall of 3GPP – Time for a Sabbatical?
MIND Revenue Release Quarter 2 2025 Press Release
Dropbox Q2 2025 Financial Results & Investor Presentation
Digital-Transformation-Roadmap-for-Companies.pptx
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Chapter 3 Spatial Domain Image Processing.pdf
NewMind AI Weekly Chronicles - August'25 Week I
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Big Data Technologies - Introduction.pptx
Cloud computing and distributed systems.
Network Security Unit 5.pdf for BCA BBA.

Reports of the Death of Testing Have Been Greatly Exaggerated

  • 1. W18 Special Topics 5/1/2013 3:00:00 PM Reports of the Death of Testing Have Been Greatly Exaggerated Presented by: Ruud Teunissen Polteq Test Services BV Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Ruud Teunissen An international test consultant at Polteq Test Services BV, Ruud Teunissen has performed several test functions in a number of IT projects: tester, test specialist, test consultant, and test manager. Ruud participated in the development of the structured testing methodology TMap® - Test Management Approach. Together with Martin Pol and Erik van Veenendaal, Ruud is coauthor of several books on structured testing, including Software Testing: A Guide to the TMap® Approach.
  • 3. Reports of the Death of Testing Have Been Highly Exaggerated Ruud Teunissen Polteq Test Services BV The Netherlands Reports of the Death of Testing Have Been Highly Exaggerated Have you heard? It’s all over the social media. We are the “last generation of testers.” Testing is dead. No more classical testing—too much inflexible process. Context driven? That is a code phrase for do whatever. Agility? Developers do testing, and testers become developers. DevOps? Development and operations join forces—and test is not in the picture. And, companies don’t test anymore—they outsource. Ruud Teunissen believes we must save the indispensable craft of testing. Non-functional tests require special skills; new paradigms like cloud and mobile must be explored and tested; Enterprise-to-enterprise integration tests become more vital as systems grow larger and more complex. And who’s going to do that testing? Testing skills are needed to work effectively and efficiently in these new contexts. Learn to save the testing skills within your organization and do what you’ve always done best—save the day by preventing defects from going live. 2 1
  • 4. Let’s have a look at the evolution of testing Pioneering Optimizing Structuur Unstructured Undisciplined Flexible Specialization Structured Disciplined Inflexible Structuring Once Now 3 Once upon a time testing was pioneering • Unknown, no buy-in, no budget, no process, no tools • Fully integrated in the development process – Generalists, joined effort – Prototype, exploratory driven – No dedicated testing staff • Struggling to get involved • Not a partner, no influence • Discussing risks not done • Only in emergencies 4 2
  • 5. Because bugs lead to disasters … ” If debugging is the process of removing bugs, then programming must be the process of putting them in. „ Edsger Dijkstra 3
  • 6. … we started specializing and structuring • Structuring the process • Standardization (Books) • Defining the test function – Certification – Independent • Functionality and non-functionality • Test automation • Test process improvement models – TPI, TMM, TMMi, TOM, TIM, TSM, … 7 Testing! • Dedicated (trained) staff • Recognized as a function • Test competence center • Master test planning • Risk based coverage • (Early) involvement • Independent testing 8 4
  • 7. Testing? • Becoming a referee • Process Improvement freaks • Inflexible • Metrics mania • Spreadsheet management • Complaining and blaming • Tunnel vision 9 Changing context Technology push Efficiency push 10 5
  • 8. Changing context Technology push • Architecture – – – – SOA Virtualization Web technology Devices • Cloud • SoLoMo • Integration 11 Changing context Efficiency push • • • • • • • Outsourcing Package software Cloud Agile, Scrum DevOps Continuous delivery Collaboration 12 6
  • 9. Testing is challenged Keynote EuroSTAR 2011 Pursuing quality? (you won’t get there by testing) James Whittaker Engineering Director, Google TestNet (Dutch SIGIST) Model Driven Development, the end of the test profession? Johan den Haan CTO, Mendix 13 Testing is challenged xxxxxxxxxxxxxxxxxxxxx Process = out Certification = wrong 14 7
  • 10. Testing is challenged • Context Driven – Right solution, practice, coverage, cooperation, skills Major factor: PEOPLE! 15 Testing is challenged • Context Driven – – – – Right solution, practice, coverage, cooperation, skills Exploratory Session based Rapid Context driven = less 16 8
  • 11. Testing is challenged Tester = ? 17 Testing is challenged Tester = agilist 18 9
  • 13. • Changing role • Distributed – Business/RQMS – Development – Operations 21 • Changing role • Distributed • Technical – – – – Automation Cloud SoLoMo Security 22 11
  • 14. • Changing role • Distributed • Technical • Programming – Automation – Development 23 • Changing role • • • • Distributed Technical Programming Social – Team player – Communication 24 12
  • 15. Cooperate Facilitate Innovate Optimize 25 About the speaker Ruud Teunissen Polteq Test Services, The Netherlands ruud.teunissen@polteq.com - http://www.polteq.com Ruud Teunissen is best described as a passionate software tester. Throughout his career he has played almost any possible role in testing (tester, test manager, test trainer, coach, sales, manager, test consultant, …) in a variety of environments and companies. Ruud is coauthor of several books on structured testing, including Software Testing: A Guide to the TMap® Approach. Currently he is senior test consultant with Polteq Test Services BV and focuses on test improvement and management in any context. Ruud is frequently invited to speak at conferences. Within Polteq, Ruud is responsible for TI4Automation, the approach for successful implementation and improvement of test automation based on hands-on experiences and good practices. 26 13