SlideShare a Scribd company logo
Deprogramming the cargo cult of testing
Mike Talks
Datacom
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Who are we?
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
•  RealMe developed
as “classic” V-model
•  18 months between
inception and
delivery
•  6 weeks of system
testing alone
A long time ago …
Being a “classic” V-model
System
Test
UAT
As RealMe matured …
DIA needed to
respond more to
their customers’
needs
Rethinking the model
Going agile …
Where does this
leave testing?
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Take what
you’ve always
done …
The ultimate temptation
This is the Cargo Cult trap
• Project context
changes
• Use same
procedures
• Expect same
result
Waterfall
l Deliver
EVERYthing
l 12 months from
inception
l 6 weeks for
testing
l 7 testers
In a nutshell
Agile
•  Deliver SOMEthing
•  2 weeks from
inception
•  2 weeks for testing
•  2 testers
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
As a test
professional …
How do you
begin the
process of
change?
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Initiate change
By	
  requiring	
  a	
  
change	
  in	
  contract	
  
with	
  your	
  
customer?	
  
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Initiate change
By	
  manda5ng	
  a	
  
new	
  set	
  of	
  test	
  
processes?	
  
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Initiate change
Implemen5ng	
  
change	
  secretly,	
  
hoping	
  no-­‐one	
  
no5ces	
  …	
  
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
How the deprogramming
begins
Looking at the model we had
Requirements
Test
Strategy
Test
Plan
Test
Scripts
Test
Reporting
How can this model go off the
rails?
Derail #1: Lead time
Derail #2: Requirement
change
Derail #3: Reviewing &
Collaboration
Time for introspection
Test Strategy
How do we go about
delivering testing?
Test Plan
What are we going
to test?
Who is going to test?
How long is it going
to take?
Test Script
What testing are we
going to do?
What requirement/
feature are we
testing?
What testing have
we done?
How do new testers
learn/ test on the
system?
Test Reporting
What testing is
complete?
What problems have
there been?
[Defects]
What testing have
we done?
That’s a lot of questions …
What testing is
complete?
What problems
have there
been?
[Defects]
What testing
have we done?
What testing are
we going to do?
What
requirement/
feature are we
testing?
What testing
have we done?
How do new
testers learn/ test
on the system?
What are we
going to test?
Who is going to
test?
How long is it
going to take?
How do we go
about delivering
testing?
Looking at it another way
… as the
questions
they answer
The
deliverables
don’t have
as much
value …
To Make Agile Testing Work
…
Four
fundamental
aims
Aim #1
Deliver
real
change
Aim #2
Processes
lightweight but
address needs
Aim #3
Review
processes
each sprint
Aim #4
Encourage
transparency
between
Datacom & DIA
Use Exploratory Testing?
What testing are we
going to do? What testing have
we done?
Common worries …
There’s always that
one person asking …
How will you
know what to test
without your
scripts?
From Jon & James Bach …
•  “We wanted to be
accountable for our
work”
•  “We wanted to give
status reports that
reflected what we
actually did”
Session Based Test
Management
•  The heart of what
we did.
•  But needed some
customisation
Session Based Test
Management
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
How We Test On RealMe
Warning!
Tailored to fit
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Testing Cycle 1: Planning
Testing Tasks
What are we going
to test?
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Testing Cycle 2:
Expanding Testing Tasks
(pt1)
Boundaries?
Browsers?
Related
areas?
What testing are we
going to do?
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Testing Cycle 2:
Expanding Testing Tasks
(pt2)
Testing Cycle 3: Doing
The Testing (pt1) -
Assignment
What requirement/
feature are we
testing?
Testing Cycle 3: Doing
The Testing (pt2) -
Recording
What testing have
we done?
Testing Cycle 3: Doing
The Testing (pt3) –
Problems!
What problems have
there been?
[Defects]
Testing Cycle 3: Doing
The Testing (pt4) – Peer
review
What testing have
we done?
Testing Cycle 4: Updating
the board
What testing is
complete?
What testing have
we done?
Testing Cycle 5: And right
at the end …
So what’s left?
Who is going to test?
How long is it going
to take?
But what about …
How do new testers
learn/ test on the
system?
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Deliverables?
Mind maps = Plan
Recordings =
Proof of testing
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
Deliverables?
Sprint board =
Progress Report /
Defect Tracking
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
And how’s it
working out?
More engaged
test team Happy customer
Making testing
visible to whole
team
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
We’re
replicating the
success
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
The temptation is still
there
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
The trap is still there …
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
We need to remember…
Individuals and
interactions over
processes and
tools
Copyright © Datacom New Zealand Limited 2013 Wednesday, 9 September 15
But we’re getting there …
Summary #1
Relationships matter!
Summary #2
Focus on needs, not
deliverables
Summary #3
Can what you do be made
more visible?
Mike Lowery
Agile Coach
Nomad 8
Thanks for listening…
Mike Talks
Datacom
Question – Manual
regression
Use of
“character
cards”
personas
Question – Automated
checking with Selenity
Datacom software
•  Uses Selenium
drivers
•  Part of build
checks
•  Delivers less
buggy code to
test env
Thanks for listening…
Mike Talks
Datacom

More Related Content

PDF
Luke Johnstone (Assurity Consulting)
PDF
Process modeling in agile environment alec sharp
PDF
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
PDF
Business Processes Definition
PDF
Alec Sharp Process Traction
PPT
RAPID
PPTX
Making Improvement Standard: Dynamic Agile Practices through Lean Standard Work
PDF
Analyst-to-Synthesist
Luke Johnstone (Assurity Consulting)
Process modeling in agile environment alec sharp
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
Business Processes Definition
Alec Sharp Process Traction
RAPID
Making Improvement Standard: Dynamic Agile Practices through Lean Standard Work
Analyst-to-Synthesist

What's hot (20)

PDF
Portfolio Kanban - Seeing the Big Picture
PPTX
Managers and the land of the lost
PDF
Introduction to Lean Six Sigma in Government
PPTX
Lean IT: PNNL IT's Lean journey starts
PDF
Toyota’s Management System Tools and Behaviours
PPTX
Value-Driven-Delivery
PPTX
PMI-ACP Training Deck
PDF
Seeing the Whole - Creating Lean Supply Chains
PPTX
Agile Auckland agile 101 back to basics
PDF
Building a Business Case for Lean
PDF
Journey toagile published
PDF
WEBINAR: Introduction to Value Stream Mapping
PPTX
Taking Flight: an Approach for Agile Transformation (AgileDC 2013)
PDF
#8 agile governance questions you can and should be asking
PDF
Lean-Agile Business Analysis
PPTX
DOES15 - Paula Thrasher - Three Steps to Change: Lessons from Battling Bureau...
PDF
Lean Healthcare - Streamlining Patient Journeys
PDF
Hanno Jarvet - The Lean Toolkit – Value Stream Mapping and Problem Solving
PDF
Gemba Walks Helping Management to See
PPTX
From Project Manager to Scrum Master
Portfolio Kanban - Seeing the Big Picture
Managers and the land of the lost
Introduction to Lean Six Sigma in Government
Lean IT: PNNL IT's Lean journey starts
Toyota’s Management System Tools and Behaviours
Value-Driven-Delivery
PMI-ACP Training Deck
Seeing the Whole - Creating Lean Supply Chains
Agile Auckland agile 101 back to basics
Building a Business Case for Lean
Journey toagile published
WEBINAR: Introduction to Value Stream Mapping
Taking Flight: an Approach for Agile Transformation (AgileDC 2013)
#8 agile governance questions you can and should be asking
Lean-Agile Business Analysis
DOES15 - Paula Thrasher - Three Steps to Change: Lessons from Battling Bureau...
Lean Healthcare - Streamlining Patient Journeys
Hanno Jarvet - The Lean Toolkit – Value Stream Mapping and Problem Solving
Gemba Walks Helping Management to See
From Project Manager to Scrum Master
Ad

Viewers also liked (20)

PPTX
Lynn Davies (CDHB) & Joe Kearns (Assurity Consulting)
PPTX
Aaron Hodder (Assurity Consulting)
PDF
Paul Flewelling (Fairfax Media)
PPTX
Andrew Nimick (NZME)
PPTX
Henry Lane (Corvecto)
PPTX
Paul Theyers (Assurity Consulting)
PPTX
Edwin Dando (Assurity Consulting)
PPTX
Dave West (Scrum.org)
PPTX
Anthony Marter (Orion Health)
PPTX
Sandy Mamoli (Nomad8)
PPTX
Shane Hastie (SoftEd/Agile Alliance of Auckland)
PPTX
Mike Walls (Revera)
PPTX
Rachel Niven (Niven Consulting)
PPTX
Natalie Kerschner & Victoria White (BNZ)
PPTX
Kirstin Donaldson (Powershop)
PDF
Joshua Kerievsky (Industrial Logic)
PPTX
Robert Chiu (Statistics New Zealand)
PPTX
Suzanne Nottage (CA Technologies Ltd)
PDF
Ahmed Sidky (ICAgile)
PPTX
Dawie Olivier (Westpac)
Lynn Davies (CDHB) & Joe Kearns (Assurity Consulting)
Aaron Hodder (Assurity Consulting)
Paul Flewelling (Fairfax Media)
Andrew Nimick (NZME)
Henry Lane (Corvecto)
Paul Theyers (Assurity Consulting)
Edwin Dando (Assurity Consulting)
Dave West (Scrum.org)
Anthony Marter (Orion Health)
Sandy Mamoli (Nomad8)
Shane Hastie (SoftEd/Agile Alliance of Auckland)
Mike Walls (Revera)
Rachel Niven (Niven Consulting)
Natalie Kerschner & Victoria White (BNZ)
Kirstin Donaldson (Powershop)
Joshua Kerievsky (Industrial Logic)
Robert Chiu (Statistics New Zealand)
Suzanne Nottage (CA Technologies Ltd)
Ahmed Sidky (ICAgile)
Dawie Olivier (Westpac)
Ad

Similar to Mike Talks (Datacom) (20)

PDF
Agile testing practice
PPTX
Is Test Planning a lost art in Agile? by Michelle Williams
PPTX
Introduction to Agile Testing
PPT
Gcs day1
PPT
_VoicePPT_QA_Testing_Training_4_Days_Schedule.ppt
PDF
Methodology: IT test
PDF
AgileTesting_Ver1.0
PPTX
Software testing course - Manual
PPTX
Software Testing interview - Q&A and tips
PDF
Invite the tester to the party
PPTX
Challenges with agile testing process and how to debug and troubleshoot these...
PPTX
Will The Test Leaders Stand Up?
PDF
Manual Testing real time questions .pdf
PDF
Testing in Agile Development
PPT
Agile Testing
PDF
Fundamentals of Software Testing
PPTX
SDLCTesting
PPTX
Software presentation
PPTX
1)Testing-Fundamentals_L_D.pptx
PPTX
Chapter 1 Fundamental of testing ISTQB v4
Agile testing practice
Is Test Planning a lost art in Agile? by Michelle Williams
Introduction to Agile Testing
Gcs day1
_VoicePPT_QA_Testing_Training_4_Days_Schedule.ppt
Methodology: IT test
AgileTesting_Ver1.0
Software testing course - Manual
Software Testing interview - Q&A and tips
Invite the tester to the party
Challenges with agile testing process and how to debug and troubleshoot these...
Will The Test Leaders Stand Up?
Manual Testing real time questions .pdf
Testing in Agile Development
Agile Testing
Fundamentals of Software Testing
SDLCTesting
Software presentation
1)Testing-Fundamentals_L_D.pptx
Chapter 1 Fundamental of testing ISTQB v4

More from AgileNZ Conference (20)

PDF
Automated Agility?! Let's Talk Truly Agile Testing - Adam Howard - AgileNZ 2017
PPTX
The Foundations of Business Agility - Shane Hastie - AgileNZ 2017
PPTX
Breaking Through the Transformation Pain Barrier - Julie Lindenberg & David M...
PDF
Improv-e Your Innovation - Jakob Jurkiewicz - AgileNZ 2017
PDF
Chocolate, Cider & Product Ownership - Penny Goodwin & Chetan Parbhu - AgileN...
PDF
The Art of Dual-track Delivery - Ant Boobier - AgileNZ 2017
PPTX
Becoming Agile: Agile Transitions in Practice - Rashina Hoda - AgileNZ 2017
PDF
Scrumdiddlyumptious & the Killjoys - Mia Horrigan - AgileNZ 2017
PPTX
Build for Speed - Gareth Evans - AgileNZ 2017
PPTX
Inclusive Collaboration – How Our Differences Can Make the Difference - Aaron...
PPTX
Born to Learn - Aurelien Beraud - AgileNZ 2017
PDF
Making the Invisible Visible: Showing WIP & Flow at Portfolio Level in Waterf...
PDF
DevSec Delight with Compliance as Code - Matt Ray - AgileNZ 2017
PDF
Shaking Leads to a Shake Up - Russel Garlick - AgileNZ 2017
PPTX
Making Agile Leadership Work: A Journey From Coach to Manager - Martin Cronj...
PPTX
Agile-ish – How to Build a Culture of Agility - Lynne Cazaly - AgileNZ 2017
PPTX
Modern Agile – What's It Good For? - Jacob Creech - AgileNZ 2017
PPTX
Business Agility: Leadership, Teams & the Work - Jude Horrill - AgileNZ 2017
PPTX
Connecting the Dots: Agile, DevOps, Lean IT - Mike Orzen - AgileNZ 2017
PPTX
Being Agile vs Agile Doing - Luke Hohmann - AgileNZ 2017
Automated Agility?! Let's Talk Truly Agile Testing - Adam Howard - AgileNZ 2017
The Foundations of Business Agility - Shane Hastie - AgileNZ 2017
Breaking Through the Transformation Pain Barrier - Julie Lindenberg & David M...
Improv-e Your Innovation - Jakob Jurkiewicz - AgileNZ 2017
Chocolate, Cider & Product Ownership - Penny Goodwin & Chetan Parbhu - AgileN...
The Art of Dual-track Delivery - Ant Boobier - AgileNZ 2017
Becoming Agile: Agile Transitions in Practice - Rashina Hoda - AgileNZ 2017
Scrumdiddlyumptious & the Killjoys - Mia Horrigan - AgileNZ 2017
Build for Speed - Gareth Evans - AgileNZ 2017
Inclusive Collaboration – How Our Differences Can Make the Difference - Aaron...
Born to Learn - Aurelien Beraud - AgileNZ 2017
Making the Invisible Visible: Showing WIP & Flow at Portfolio Level in Waterf...
DevSec Delight with Compliance as Code - Matt Ray - AgileNZ 2017
Shaking Leads to a Shake Up - Russel Garlick - AgileNZ 2017
Making Agile Leadership Work: A Journey From Coach to Manager - Martin Cronj...
Agile-ish – How to Build a Culture of Agility - Lynne Cazaly - AgileNZ 2017
Modern Agile – What's It Good For? - Jacob Creech - AgileNZ 2017
Business Agility: Leadership, Teams & the Work - Jude Horrill - AgileNZ 2017
Connecting the Dots: Agile, DevOps, Lean IT - Mike Orzen - AgileNZ 2017
Being Agile vs Agile Doing - Luke Hohmann - AgileNZ 2017

Recently uploaded (20)

PPT
340036916-American-Literature-Literary-Period-Overview.ppt
DOCX
Euro SEO Services 1st 3 General Updates.docx
PDF
Unit 1 Cost Accounting - Cost sheet
PDF
Stem Cell Market Report | Trends, Growth & Forecast 2025-2034
PDF
Power and position in leadershipDOC-20250808-WA0011..pdf
PPTX
5 Stages of group development guide.pptx
PPTX
Dragon_Fruit_Cultivation_in Nepal ppt.pptx
PDF
A Brief Introduction About Julia Allison
PDF
Deliverable file - Regulatory guideline analysis.pdf
DOCX
Business Management - unit 1 and 2
PDF
IFRS Notes in your pocket for study all the time
PDF
Chapter 5_Foreign Exchange Market in .pdf
PDF
kom-180-proposal-for-a-directive-amending-directive-2014-45-eu-and-directive-...
PDF
How to Get Funding for Your Trucking Business
PDF
Roadmap Map-digital Banking feature MB,IB,AB
PPTX
job Avenue by vinith.pptxvnbvnvnvbnvbnbmnbmbh
PDF
Laughter Yoga Basic Learning Workshop Manual
PDF
DOC-20250806-WA0002._20250806_112011_0000.pdf
DOCX
unit 1 COST ACCOUNTING AND COST SHEET
PPTX
The Marketing Journey - Tracey Phillips - Marketing Matters 7-2025.pptx
340036916-American-Literature-Literary-Period-Overview.ppt
Euro SEO Services 1st 3 General Updates.docx
Unit 1 Cost Accounting - Cost sheet
Stem Cell Market Report | Trends, Growth & Forecast 2025-2034
Power and position in leadershipDOC-20250808-WA0011..pdf
5 Stages of group development guide.pptx
Dragon_Fruit_Cultivation_in Nepal ppt.pptx
A Brief Introduction About Julia Allison
Deliverable file - Regulatory guideline analysis.pdf
Business Management - unit 1 and 2
IFRS Notes in your pocket for study all the time
Chapter 5_Foreign Exchange Market in .pdf
kom-180-proposal-for-a-directive-amending-directive-2014-45-eu-and-directive-...
How to Get Funding for Your Trucking Business
Roadmap Map-digital Banking feature MB,IB,AB
job Avenue by vinith.pptxvnbvnvnvbnvbnbmnbmbh
Laughter Yoga Basic Learning Workshop Manual
DOC-20250806-WA0002._20250806_112011_0000.pdf
unit 1 COST ACCOUNTING AND COST SHEET
The Marketing Journey - Tracey Phillips - Marketing Matters 7-2025.pptx

Mike Talks (Datacom)