SlideShare a Scribd company logo
Quality =! Testing
Testing and Quality:
Correlation does not equal Causation
Theresa Neate | Lead QA, REA Group
11 February 2020
About me
Lead QA @ REA Group
DevOps Girls co-organiser & coach
~20 years of “IT experience”
~8 as Lead QA / Practice Lead
@TheresaNeate @DevOpsGirls
theresaneate.com
@TheresaNeate
2
Tonight
Testing Quality
Building in quality
@TheresaNeate
3
Famous last words
“Our quality is
poor, we need
more testers (or
testing).”
@TheresaNeate
4
Spurious Correlations
@TheresaNeate
5
https://www.tylervigen.com/spurious-correlations
Testing
Testing is inspection
& feedback
(not assurance)
@TheresaNeate
6
Testing is disciplined
https://martinfowler.com/bliki/TestPyramid.html
@TheresaNeate
7
Minimise your manual testing
But make it count
Beware
“Inattentional
Blindness”
@TheresaNeate
Appropriately
involve testing
personnel
8
Testing should be continuous
https://danashby.co.uk/2016/10/19/continuous-testing-in-devops/
@TheresaNeate
9
Quality
“Quality is value to some person”
– Jerry Weinberg
@TheresaNeate
10
Measuring quality
Testing
Static Analysis
Linting
Testability analysis
BDD or TDD
Continuous Integration
Monitoring and Alerting
@TheresaNeate
11
Improving quality
Reacting to the feedback, e.g. postmortems,
bug triages, etc.
@TheresaNeate
“You can’t ‘fix’ people, but you can fix
systems and processes to better support
people making the right choices when
designing and maintaining complex systems.”
– SRE Handbook
12
Building In Quality
@TheresaNeate
Let’s take a proactive look
13
Building In Quality - ideas
@TheresaNeate
Work slicing
14
Building In Quality - ideas
@TheresaNeate
Reducing waste
15
Building In Quality - ideas
@TheresaNeate
Flow
16
Building In Quality - ideas
@TheresaNeate
Just Culture
17
Building In Quality - ideas
@TheresaNeate
Collaboration & visibility:
Pair programming
Pull requests
*-driven-development
Test coverage
Kickoffs
18
Building In Quality - ideas
@TheresaNeate
Systems thinking
19
Moral of the story?
@TheresaNeate
Quality has both a proactive
and reactive approach.
You cannot test in quality.
20
Closing
@TheresaNeate
“Inspection is too late. The
quality, good or bad, is already
in the product.” – Deming
21
References for this talk
@TheresaNeate
Slides: theresaneate.com/content
Blog: theresaneate.com/writing
22
Thank you!
@TheresaNeate

More Related Content

PDF
Testing and Quality: Correlation does not equal Causation
PDF
Agile Testing at Etsy: How and Why It Works
PDF
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
PDF
De-Risky Business: Techniques for Mitigating and Managing Risk
PDF
React introduction
PPTX
Managing Patient Expectations 7 Rules of Success Presented at VCS 2015
PDF
Skyword Platform Tips & Tricks: Content Marketing Made Easier
PDF
Flow From Blockers: How to Use Blocker Clustering to Improve Predictability, ...
Testing and Quality: Correlation does not equal Causation
Agile Testing at Etsy: How and Why It Works
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
De-Risky Business: Techniques for Mitigating and Managing Risk
React introduction
Managing Patient Expectations 7 Rules of Success Presented at VCS 2015
Skyword Platform Tips & Tricks: Content Marketing Made Easier
Flow From Blockers: How to Use Blocker Clustering to Improve Predictability, ...

What's hot (12)

PDF
To Estimate or Not to Estimate, Is that the Question? LeanAgileUS 2017
PDF
Getting Fit(ness Criteria)
PDF
The Service-Delivery Review: The Missing Agile Feedback Loop [2017 Lean Kanba...
PDF
ITIL Practitioner
PDF
The Service-Delivery Review: The Missing Agile Feedback Loop
PPTX
MOA awards jury presentatie
PDF
To Estimate or Not to Estimate, Is that the Question? (2017 Better Software C...
PDF
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
PPTX
Fun in agile
PDF
The Service-Delivery Review: The Missing Agile Feedback Loop [Lean and Agile ...
PDF
2017 Music City Agile Conference: NoEstimates Workshop
PDF
Kanban method: The Practices aren't the Point
To Estimate or Not to Estimate, Is that the Question? LeanAgileUS 2017
Getting Fit(ness Criteria)
The Service-Delivery Review: The Missing Agile Feedback Loop [2017 Lean Kanba...
ITIL Practitioner
The Service-Delivery Review: The Missing Agile Feedback Loop
MOA awards jury presentatie
To Estimate or Not to Estimate, Is that the Question? (2017 Better Software C...
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Fun in agile
The Service-Delivery Review: The Missing Agile Feedback Loop [Lean and Agile ...
2017 Music City Agile Conference: NoEstimates Workshop
Kanban method: The Practices aren't the Point
Ad

Similar to Testing and Quality: Correlation does not equal Causation (20)

PPTX
Agile Testing in Enterprise: Way to transform - SQA Days 2014
PPTX
UNIT-IV 19CS408T - Software Testing Notes
PPTX
Leading with Quality
PPTX
Introduction to software testing and quality assurance
PPTX
hbuyvtyctycrtcfgcfgcijnuinuinunuinuinuinuin
PDF
A business case for a modern QA organization
PDF
We did it!!? There is place for QAs in Agile!!?
PPTX
How to implement quality
PPTX
Introduction to Software Testing Part 2
PPTX
Introduction to Quality Assurance Part 2
PPTX
Introduction to Software Testing - Part 2
PDF
A Rapid Introduction to Rapid Software Testing
PPTX
A Software Testing Intro
PDF
A Rapid Introduction to Rapid Software Testing
PDF
A Rapid Introduction to Rapid Software Testing
PPTX
Fundamentals of testing
PPTX
John Fodeh - Spend Wisely, Test Well
PPTX
AgilNext io Quality Coach
PDF
MoT KL Meetup #3 Presentation
PPTX
Session 02 - Introduction to Quality Assurance / Software Testing
Agile Testing in Enterprise: Way to transform - SQA Days 2014
UNIT-IV 19CS408T - Software Testing Notes
Leading with Quality
Introduction to software testing and quality assurance
hbuyvtyctycrtcfgcfgcijnuinuinunuinuinuinuin
A business case for a modern QA organization
We did it!!? There is place for QAs in Agile!!?
How to implement quality
Introduction to Software Testing Part 2
Introduction to Quality Assurance Part 2
Introduction to Software Testing - Part 2
A Rapid Introduction to Rapid Software Testing
A Software Testing Intro
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
Fundamentals of testing
John Fodeh - Spend Wisely, Test Well
AgilNext io Quality Coach
MoT KL Meetup #3 Presentation
Session 02 - Introduction to Quality Assurance / Software Testing
Ad

More from Theresa Neate (13)

PDF
The UX of DX (Write the Docs 2024) - Theresa Neate.pdf
PDF
Leadership for Intelligent Software Engineering - Agile Australia 2023
PDF
DevSecOps Days Melbourne 2021 - Systems thinking, incidents, and the support ...
PDF
DevOpsGirls at TConf 2019
PDF
DevOps Mythbusting
PDF
What is Developer Experience, and why does it matter?
PDF
Theresa Neate at Dev Ops Girls Feb 2019
PDF
Evolving and remaining relevant as QA - TConf 2018
PDF
Lean QAs : T-shaped QAs in the DevOps world
PDF
How to work in devsecops
PDF
The QA in the DevOps world
PPTX
Agile Testing - LAST Conference 2015
PDF
Agile Testing - First Conference 2015 - Melbourne Australia
The UX of DX (Write the Docs 2024) - Theresa Neate.pdf
Leadership for Intelligent Software Engineering - Agile Australia 2023
DevSecOps Days Melbourne 2021 - Systems thinking, incidents, and the support ...
DevOpsGirls at TConf 2019
DevOps Mythbusting
What is Developer Experience, and why does it matter?
Theresa Neate at Dev Ops Girls Feb 2019
Evolving and remaining relevant as QA - TConf 2018
Lean QAs : T-shaped QAs in the DevOps world
How to work in devsecops
The QA in the DevOps world
Agile Testing - LAST Conference 2015
Agile Testing - First Conference 2015 - Melbourne Australia

Recently uploaded (20)

PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
Machine Learning_overview_presentation.pptx
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PPTX
A Presentation on Artificial Intelligence
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Encapsulation theory and applications.pdf
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Empathic Computing: Creating Shared Understanding
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Chapter 3 Spatial Domain Image Processing.pdf
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Programs and apps: productivity, graphics, security and other tools
Machine Learning_overview_presentation.pptx
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Per capita expenditure prediction using model stacking based on satellite ima...
Spectral efficient network and resource selection model in 5G networks
gpt5_lecture_notes_comprehensive_20250812015547.pdf
A Presentation on Artificial Intelligence
Reach Out and Touch Someone: Haptics and Empathic Computing
Encapsulation theory and applications.pdf
Assigned Numbers - 2025 - Bluetooth® Document
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
“AI and Expert System Decision Support & Business Intelligence Systems”
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Empathic Computing: Creating Shared Understanding
Advanced methodologies resolving dimensionality complications for autism neur...

Testing and Quality: Correlation does not equal Causation