SlideShare a Scribd company logo
MYTHS ABOUT EXPLORATORY
TESTING
Ravneet Kaur
(Lean Agile SAFe Coach)
TESTING IN THE WATERFALL DAYS
TESTING IN THE WATERFALL DAYS
”Back in the old waterfall days, my favorite time
testing was during User Acceptance Testing (UAT)
because the end users embraced Exploratory
Testing without even knowing it.”
WHAT IS EXPLORATORY TESTING?
Exploratory testing is…
Simultaneous…
 Test Execution
 Test Design
 Learning
 Optimization
CASE STUDY – MAKING EXPLORATORY TESTING
THE WAY OF TESTING FOR AGILE TEAMS
EXPLORATORY TESTING IS SAME AS
AD-HOC TESTING (MYTH)
WHAT IS AD-HOC TESTING?
SOME MYTHS ABOUT EXPLORATORY TESTING
EXPLORATORY TESTING
IS
UNPLANNED
EXPLORATORY TESTING
MEANS LACK OF VISIBILITY
AND TRANSPARENCY
EXPLORATORY TESTING
IS NOT A
STRUCTURED APPROACH
EXPLORATORY TESTING
DOESN‘T PROVIDE
COMPLETE COVERAGE
EXPLORATORY TESTING
CAN‘T BE
MANAGED OR MEASURED
EXPLORATORY TESTING
MEANS
NO DOCUMENTATION
Myths about Exploratory Testing - Agile Testing Days
EXPLORATORY TESTING IS UNPLANNED
(MYTH)
EXPLORATORY TESTING AND THE PLANNING MYTH
 What is “Planning"?
 Is Exploratory Testing necessarily unplanned?
 Why might we need to do things that aren't
rigorously planned?
 How do we coordinate and support each other, if not
with a plan?
1. Understanding the Requirements
2. Risk and Impact Analysis
3. Identify Test Objects
4. Test Coverage
5. Distinguish between Good Case and Bad Case Tests
6. Indicate Priority of Test Cases
7. Test Completion
7-STEP PROCESS FOR PREPARATION OF
TESTING SESSION
EXPLORATORY TESTING CAN‘T BE
MANAGED OR MEASURED (MYTH)
HOW TO MEASURE AND MANAGE
EXPLORATORY TESTING?
“How do we get informed on the progress?”
“How progress should be tracked and reported?”
“How will you align with Project Management?”
HOW TO MEASURE AND MANAGE
EXPLORATORY TESTING?
HOW TO MEASURE AND MANAGE
EXPLORATORY TESTING?
EXPLORATORY TESTERS REQUIRE A
DIFFERENT SKILL SET THAN TESTERS
DOING SCRIPTED TESTING (MYTH)
WHAT SKILL SET IS NEEDED BY EXPLORATORY
TESTERS?
This technique requires a specific attitude
and domain knowledge from the tester.
It requires a certain level of maturity, product
insight and discipline of the tester.
You need commitment from management to
hire the correct employees for the job.
SCRIPTED VS EXPLORATORY TESTERS
Myth or Reality
Scripted Testing means high planning, high
predictability and qualitative documentation.
SCRIPTED VS EXPLORATORY TESTERS
Myth or Reality
Scripted Tests, if repeated again and again leads
to no more defects making the software stable.
EXPLORATORY TESTING TAKES MORE
TIME THAN SCRIPTED TESTING (MYTH)
DOES EXPLORATORY TESTING TAKE MORE TIME
THAN SCRIPTED TESTING?
EXPLORATORY TESTING CANNOT BE
APPLIED TO COMPLEX SYSTEMS (MYTH)
IS EXPLORATORY TESTING NOT FOR
COMPLEX SYSTEMS?
EXPLORATORY TESTING DOES NOT TAKE
CARE OF RISK MANAGEMENT (MYTH)
DOES EXPLORATORY TESTING TAKE CARE OF
RISK MANAGEMENT?
The counter action to the risk is not
concrete enough to convince management.
Only informal technique applied for
risk analysis? No FMEA? No Prisma?
How do you handle the risks?
DOES EXPLORATORY TESTING TAKE CARE OF
RISK MANAGEMENT?
1. Risk profiles evolve over time.
2. The earlier you design the tests, the less you
understand the program and its risk profile.
3. The scripted approach means the test stays the same,
even though the risk profile is changing.
DOES EXPLORATORY TESTING TAKE CARE OF
RISK MANAGEMENT?
EXPLORATORY TESTING
IS ONLY FOR AGILE TEAMS (MYTH)
IS EXPLORATORY TESTING ONLY ABOUT AGILE
TEAMS?
INSPECT AND ADAPT
INSANITY: DOING THE
SAME THING OVER
AND OVER AGAIN AND
EXPECTING A
DIFFERENT RESULT
EMPOWER YOUR
TEAM BY ALLOWING
CREATIVITY
LOOK FOR NEW WAYS
OF TESTING
EXPLORATORY TESTING
CAN‘T BE APPLIED TO LARGE TEAMS OR
MULTISITE TEAMS (MYTH)
CAN EXPLORATORY TESTING WORK FOR
LARGE / MULTISITE TEAMS?
If you scale up Exploratory Testing to
large teams and/or multi-site
it may become a problem.
CAN EXPLORATORY TESTING WORK FOR
LARGER TEAMS / MULTISITE TEAMS?
CAN EXPLORATORY TESTING WORK FOR
LARGE TEAMS / MULTISITE TEAMS?
Guidelines for Large / Multisite Teams
 Monitoring of progress (visible to everyone)
 Work Progress is made visible – one dashboard, one agile board
 Early resolution of any communication issue
 Multiple means of communication (E-mail, IM, Screen sharing,
videoconferencing, SMS, telephone)
 Web-based tools
Guidelines for Large / Multisite Teams
 One collaborative workspace: centralized repositories that are
accessible to all team members at any time. This enables easy
report generation and insight into day-to-day work.
 This can include systems for:
 Test executions/results
 Defect tracking
 Templates
 Checklists
 One Sprint management tool
 One document management repository
 One software configuration management environment
 One test management tool
CAN EXPLORATORY TESTING WORK FOR
LARGE TEAMS / MULTISITE TEAMS?
CONCLUSION
EXPLORATORY TESTING
IS NOT ONLY A TESTING TECHNIQUE.
IT‘S A CHANGE IN MINDSET
PUSH-BUTTON
TESTER
MONKEY
TESTER
Myths about Exploratory Testing - Agile Testing Days
Myths about Exploratory Testing - Agile Testing Days
Ravneet Kaur
November 11, 2015
Ravneet Kaur
Certified Scrum Professional (CSP)
Certified SCRUM Master (CSM)
Certified Scrum Product Owner (CSPO)
PMI- Agile Certified Practitioner (PMI-ACP)
LKU Certified Kanban Practitioner (AKP)
SAFe Program Consultant (SPC)
SAFe Agilist (SA)
ISTQB® Certified Tester
ETSI Certified TTCN-3® Expert
OMG Certified UML Professional™
Intel Certified Project Manager
Intel Certified Expert Leader
Lean Agile SAFe Coach
ravneetkj@yahoo.com
0049-176-31043855
Myths about Exploratory Testing - Agile Testing Days

More Related Content

PDF
The Changing Face of Test Management in an Agile World
PPTX
Overcoming The Challenges Faced in Exploratory Testing
PDF
Rapid Software Testing: Reporting
PPTX
Develop your inner tester
PPTX
fundamentals of testing (Fundamental of testing what)
PPTX
State of selenium survey results
PDF
Exploratory Testing: Make It Part of Your Test Strategy
PDF
Rapid Software Testing: Strategy
The Changing Face of Test Management in an Agile World
Overcoming The Challenges Faced in Exploratory Testing
Rapid Software Testing: Reporting
Develop your inner tester
fundamentals of testing (Fundamental of testing what)
State of selenium survey results
Exploratory Testing: Make It Part of Your Test Strategy
Rapid Software Testing: Strategy

What's hot (20)

PDF
Measurement and Metrics for Test Managers
PPTX
"Living up to the promise..." - June 2012
PPTX
The Abolition of Test
PPTX
Fundamental of testing (what is testing)
PPTX
FUNDAMENTALS OF TESTING (Fundamental of testing what)
PDF
A Rapid Introduction to Rapid Software Testing
PDF
Ken Johnston - Big Bugs That Got Away - EuroSTAR 2010
PDF
Effective Testing fo Startups
PPT
Michael Bolton - Heuristics: Solving Problems Rapidly
DOCX
Software testing myths
PPTX
Fundamentals of testing 2
PDF
Test Automation in Agile: A Successful Implementation
PDF
Exploratory Testing - A Whitepaper by RapidValue
PPTX
OmniTestingConf: Taking Test Automation to the Next Level
PPTX
Exploratory testing workshop
PPTX
Imrul: Context Driven Testing
PPTX
Reduce the risk of your mobile development
PPT
Shrini Kulkarni - Software Metrics - So Simple, Yet So Dangerous
PPTX
Applying good context driven testing in an agile context
PDF
Bad metric, bad!
Measurement and Metrics for Test Managers
"Living up to the promise..." - June 2012
The Abolition of Test
Fundamental of testing (what is testing)
FUNDAMENTALS OF TESTING (Fundamental of testing what)
A Rapid Introduction to Rapid Software Testing
Ken Johnston - Big Bugs That Got Away - EuroSTAR 2010
Effective Testing fo Startups
Michael Bolton - Heuristics: Solving Problems Rapidly
Software testing myths
Fundamentals of testing 2
Test Automation in Agile: A Successful Implementation
Exploratory Testing - A Whitepaper by RapidValue
OmniTestingConf: Taking Test Automation to the Next Level
Exploratory testing workshop
Imrul: Context Driven Testing
Reduce the risk of your mobile development
Shrini Kulkarni - Software Metrics - So Simple, Yet So Dangerous
Applying good context driven testing in an agile context
Bad metric, bad!
Ad

Viewers also liked (15)

PDF
mal de amor
PDF
Uu 2003 13
PDF
Akoya play ebrochure
PPTX
agenda digital
PPTX
Project managment software
PPTX
Amanda - Derechos De Autor
DOC
ילנה ברימן -בודקת תוכנה
PDF
Managing Traceability in an Agile, Safety-critical Development Environment
PPTX
How Student Game Designers Design Learning into Games
PPT
Electronic device
PPTX
Zigbee with home automation
PPTX
Sugar yeilding plants
PPTX
8.6. i̇stihdam ve sosyal güvenlik
PPTX
Git for you
PPTX
ppt for primevera
mal de amor
Uu 2003 13
Akoya play ebrochure
agenda digital
Project managment software
Amanda - Derechos De Autor
ילנה ברימן -בודקת תוכנה
Managing Traceability in an Agile, Safety-critical Development Environment
How Student Game Designers Design Learning into Games
Electronic device
Zigbee with home automation
Sugar yeilding plants
8.6. i̇stihdam ve sosyal güvenlik
Git for you
ppt for primevera
Ad

Similar to Myths about Exploratory Testing - Agile Testing Days (20)

PDF
Rapid Software Testing: Strategy
PPTX
Performance Testing – Look Before you Leap
PPT
Test Management introduction
PPTX
Get the Balance Right: Acceptance Test Driven Development, GUI Automation and...
PPT
Test management
PDF
Software Test Automation
PDF
wepik-enhancing-software-testing-efficiency-a-multi-criteria-tool-selection-f...
PPTX
EXTENT-2017: Gap Testing: Combining Diverse Testing Strategies for Fun and Pr...
PPTX
Exploratory testing
PDF
Manoj Kolhe - Testing in Agile Environment
PDF
Exploratory Testing, A Guide Towards Better Test Coverage.pdf
PPTX
Exploratory testing using heuristics
PDF
Paul Gerrard - Advancing Testing Using Axioms - EuroSTAR 2010
PPTX
Advancing Testing Using Axioms
PDF
Tackling software testing challenges in the agile era
PPTX
QA Club Kiev 18 - Test Management and Approaches
PDF
[Paul Holland] Trends in Software Testing
PPTX
Orthogonal array testing course
PPT
PDF
Certified Professional - Exploratory Testing course information v1.01
Rapid Software Testing: Strategy
Performance Testing – Look Before you Leap
Test Management introduction
Get the Balance Right: Acceptance Test Driven Development, GUI Automation and...
Test management
Software Test Automation
wepik-enhancing-software-testing-efficiency-a-multi-criteria-tool-selection-f...
EXTENT-2017: Gap Testing: Combining Diverse Testing Strategies for Fun and Pr...
Exploratory testing
Manoj Kolhe - Testing in Agile Environment
Exploratory Testing, A Guide Towards Better Test Coverage.pdf
Exploratory testing using heuristics
Paul Gerrard - Advancing Testing Using Axioms - EuroSTAR 2010
Advancing Testing Using Axioms
Tackling software testing challenges in the agile era
QA Club Kiev 18 - Test Management and Approaches
[Paul Holland] Trends in Software Testing
Orthogonal array testing course
Certified Professional - Exploratory Testing course information v1.01

Myths about Exploratory Testing - Agile Testing Days

  • 1. MYTHS ABOUT EXPLORATORY TESTING Ravneet Kaur (Lean Agile SAFe Coach)
  • 2. TESTING IN THE WATERFALL DAYS
  • 3. TESTING IN THE WATERFALL DAYS ”Back in the old waterfall days, my favorite time testing was during User Acceptance Testing (UAT) because the end users embraced Exploratory Testing without even knowing it.”
  • 4. WHAT IS EXPLORATORY TESTING? Exploratory testing is… Simultaneous…  Test Execution  Test Design  Learning  Optimization
  • 5. CASE STUDY – MAKING EXPLORATORY TESTING THE WAY OF TESTING FOR AGILE TEAMS
  • 6. EXPLORATORY TESTING IS SAME AS AD-HOC TESTING (MYTH)
  • 7. WHAT IS AD-HOC TESTING?
  • 8. SOME MYTHS ABOUT EXPLORATORY TESTING EXPLORATORY TESTING IS UNPLANNED EXPLORATORY TESTING MEANS LACK OF VISIBILITY AND TRANSPARENCY EXPLORATORY TESTING IS NOT A STRUCTURED APPROACH EXPLORATORY TESTING DOESN‘T PROVIDE COMPLETE COVERAGE EXPLORATORY TESTING CAN‘T BE MANAGED OR MEASURED EXPLORATORY TESTING MEANS NO DOCUMENTATION
  • 10. EXPLORATORY TESTING IS UNPLANNED (MYTH)
  • 11. EXPLORATORY TESTING AND THE PLANNING MYTH  What is “Planning"?  Is Exploratory Testing necessarily unplanned?  Why might we need to do things that aren't rigorously planned?  How do we coordinate and support each other, if not with a plan?
  • 12. 1. Understanding the Requirements 2. Risk and Impact Analysis 3. Identify Test Objects 4. Test Coverage 5. Distinguish between Good Case and Bad Case Tests 6. Indicate Priority of Test Cases 7. Test Completion 7-STEP PROCESS FOR PREPARATION OF TESTING SESSION
  • 13. EXPLORATORY TESTING CAN‘T BE MANAGED OR MEASURED (MYTH)
  • 14. HOW TO MEASURE AND MANAGE EXPLORATORY TESTING? “How do we get informed on the progress?” “How progress should be tracked and reported?” “How will you align with Project Management?”
  • 15. HOW TO MEASURE AND MANAGE EXPLORATORY TESTING?
  • 16. HOW TO MEASURE AND MANAGE EXPLORATORY TESTING?
  • 17. EXPLORATORY TESTERS REQUIRE A DIFFERENT SKILL SET THAN TESTERS DOING SCRIPTED TESTING (MYTH)
  • 18. WHAT SKILL SET IS NEEDED BY EXPLORATORY TESTERS? This technique requires a specific attitude and domain knowledge from the tester. It requires a certain level of maturity, product insight and discipline of the tester. You need commitment from management to hire the correct employees for the job.
  • 19. SCRIPTED VS EXPLORATORY TESTERS Myth or Reality Scripted Testing means high planning, high predictability and qualitative documentation.
  • 20. SCRIPTED VS EXPLORATORY TESTERS Myth or Reality Scripted Tests, if repeated again and again leads to no more defects making the software stable.
  • 21. EXPLORATORY TESTING TAKES MORE TIME THAN SCRIPTED TESTING (MYTH)
  • 22. DOES EXPLORATORY TESTING TAKE MORE TIME THAN SCRIPTED TESTING?
  • 23. EXPLORATORY TESTING CANNOT BE APPLIED TO COMPLEX SYSTEMS (MYTH)
  • 24. IS EXPLORATORY TESTING NOT FOR COMPLEX SYSTEMS?
  • 25. EXPLORATORY TESTING DOES NOT TAKE CARE OF RISK MANAGEMENT (MYTH)
  • 26. DOES EXPLORATORY TESTING TAKE CARE OF RISK MANAGEMENT? The counter action to the risk is not concrete enough to convince management. Only informal technique applied for risk analysis? No FMEA? No Prisma? How do you handle the risks?
  • 27. DOES EXPLORATORY TESTING TAKE CARE OF RISK MANAGEMENT? 1. Risk profiles evolve over time. 2. The earlier you design the tests, the less you understand the program and its risk profile. 3. The scripted approach means the test stays the same, even though the risk profile is changing.
  • 28. DOES EXPLORATORY TESTING TAKE CARE OF RISK MANAGEMENT?
  • 29. EXPLORATORY TESTING IS ONLY FOR AGILE TEAMS (MYTH)
  • 30. IS EXPLORATORY TESTING ONLY ABOUT AGILE TEAMS? INSPECT AND ADAPT INSANITY: DOING THE SAME THING OVER AND OVER AGAIN AND EXPECTING A DIFFERENT RESULT EMPOWER YOUR TEAM BY ALLOWING CREATIVITY LOOK FOR NEW WAYS OF TESTING
  • 31. EXPLORATORY TESTING CAN‘T BE APPLIED TO LARGE TEAMS OR MULTISITE TEAMS (MYTH)
  • 32. CAN EXPLORATORY TESTING WORK FOR LARGE / MULTISITE TEAMS? If you scale up Exploratory Testing to large teams and/or multi-site it may become a problem.
  • 33. CAN EXPLORATORY TESTING WORK FOR LARGER TEAMS / MULTISITE TEAMS?
  • 34. CAN EXPLORATORY TESTING WORK FOR LARGE TEAMS / MULTISITE TEAMS? Guidelines for Large / Multisite Teams  Monitoring of progress (visible to everyone)  Work Progress is made visible – one dashboard, one agile board  Early resolution of any communication issue  Multiple means of communication (E-mail, IM, Screen sharing, videoconferencing, SMS, telephone)  Web-based tools
  • 35. Guidelines for Large / Multisite Teams  One collaborative workspace: centralized repositories that are accessible to all team members at any time. This enables easy report generation and insight into day-to-day work.  This can include systems for:  Test executions/results  Defect tracking  Templates  Checklists  One Sprint management tool  One document management repository  One software configuration management environment  One test management tool CAN EXPLORATORY TESTING WORK FOR LARGE TEAMS / MULTISITE TEAMS?
  • 37. EXPLORATORY TESTING IS NOT ONLY A TESTING TECHNIQUE. IT‘S A CHANGE IN MINDSET
  • 41. Ravneet Kaur November 11, 2015 Ravneet Kaur Certified Scrum Professional (CSP) Certified SCRUM Master (CSM) Certified Scrum Product Owner (CSPO) PMI- Agile Certified Practitioner (PMI-ACP) LKU Certified Kanban Practitioner (AKP) SAFe Program Consultant (SPC) SAFe Agilist (SA) ISTQB® Certified Tester ETSI Certified TTCN-3® Expert OMG Certified UML Professional™ Intel Certified Project Manager Intel Certified Expert Leader Lean Agile SAFe Coach ravneetkj@yahoo.com 0049-176-31043855