SlideShare a Scribd company logo
Testing, the next level
Challenges in software testing
Erik Boelen
QA Consult Services
Erik.boelen@qaconsult.eu
www.qaconsult.eu
Testing, the next level Erik Boelen2
What will I talk about?
View on where we are in testing right now
What are the challenges out there for us testers?
Can these challenges help us grow as testers?
Testing, the next level Erik Boelen3
So where are we now?
‘In the starting blocks’
‘Finally getting some structure in software testing’
‘The future is looking bright for software testers!’
Opinion of peers
My opinion?
BOOTCAMP
Testing, the next level Erik Boelen4
So where are we now?
Have you ever played computer games?
Or any other games as such?
Testing, the next level Erik Boelen5
So where are we now?
Remember the introduction screens?
Or the moments where somebody
explained the game during the
first round?
Guitar Hero Piper Panic
Scrabble hints from your opponents?!
Testing, the next level Erik Boelen6
So where are we now?
Computer games’ Boot camps
In order to pick a weapon – E
In order to fire a weapon – SPACE
In order to holster – F
In order to press a button – ENTER
In order to activate a switch - A
Enemy behind the door that is opened by a switch
Now what?
Testing, the next level Erik Boelen7
So where are we now?
Our instructions have been set
– Methodologies
– Testing principles
– V-Model
– ISTQB
– IEEE
Our instructions are ready to be
challenged!
Testing, the next level Erik Boelen8
Challenges in software testing
V-Model needs to be brought back to its roots
Knowledge sharing needs improvement in software
testing
The objectives of testers within a project need to be
fine tuned
Look one step further in your tool selection
Apply certain aspects of different methodologies in
order to fit your need
Think about test driven analysis
… and many more
Testing, the next level Erik Boelen9
Apply the V-Model, do not use it
According to TMap Next©
Development
Tests
System
Tests
Acceptance
Tests
T
We loose flexibility
What is behind the label?
Testing, the next level Erik Boelen10
Apply the V-Model, do not use it
Test Types
Dev Test
Test Types
System Test
Test Types
Acceptance Test
Test Stage 1 TS 2 TS3 Test Stage 4
T
Test Basis
Back to the roots
Testing, the next level Erik Boelen11
Apply the V-Model, do not use it
Test Types are the drivers of testing
– What to test?
– How to test?
– Where to test?
– Who to test?
Test basis is according to the V-Model principle!
Test Levels are LABELS
Test Stages give the flexibility to the project to
– Define the test types;
– According to their test basis;
– Including the timing aspect
V-Model applied and fit for purpose
Testing, the next level Erik Boelen12
Build, maintain and share knowledge
Quick Google Research
Type in a search string at Google and look at the first
page results
Testing, the next level Erik Boelen13
Build, maintain and share knowledge
Computer games
– Walkthroughs
– Guidelines
– Tips & Tricks
So many opportunities for testers
– Blogs
– Forums
– Wiki
– Online communities
… and that’s just the internet
Conferences – EuroSTAR
Discussion groups
Testing, the next level Erik Boelen14
Set shared objectives
Methodology says:
‘All testers need to be independent from the other skills within
a project’
Testing, the next level Erik Boelen15
Set shared objectives
All testers in a separate bubble?
What about letting others in our bubble?
– Designers
– Developers
– End users
It’s the team effort that delivers projects
Nothing new here!
Specify team objectives in your entry & exit criteria of
your testing process
Release notes are written
Test execution covers all requirements
The end user approves the guidelines
Team cooperation
required!!
Testing, the next level Erik Boelen16
Be creative in your tool selection
Easy to stay with the most common tools
Make sure that you have the right tool for the job, not
the most obvious one
Practical example
– If I need a tool to test usability, what can I do?
Take an obvious tool and record test cases in there
on usability, execute them and log the result – all
textual
Use the application Silverback and record all my
actions, my visual expression and my voice while
testing the new software – a lot more than just
textual!!
Testing, the next level Erik Boelen17
Be creative in your tool selection
Testing, the next level Erik Boelen18
Combine testing methodologies
‘We use TMAP’
‘We follow the SCRUM method’
‘We only work
iteratively’
‘We combine methodologies in order to fit for purpose’
And very rarely
Testing, the next level Erik Boelen19
Combine testing methodologies
Practical example
We work in iterations while in a non-iterative
environment, using exploratory testing as test
preparation for scripted testing
Clear combination of
different approaches
Fit for purpose!
Testing, the next level Erik Boelen20
Test Driven Analysis
“Test-Driven Development (TDD) is a software
development technique consisting of short iterations where
new test cases covering the desired improvement or new
functionality are written first, then the production code
necessary to pass the tests is implemented, and finally the
software is re-factored to accommodate changes. The
availability of tests before actual development ensures rapid
feedback after any change. Practitioners emphasize that
test-driven development is a method of designing software,
not merely a method of testing.”
Used for more than a decade
Most developers are OK with this
According to Wikipedia
Testing, the next level Erik Boelen21
Test Driven Analysis
Can we apply this to analysis?
Are analysts OK to let testers in their bubble?
‘Test Driven Analysis (TDA) is a software analysis
technique consisting of short iterations where new test
cases covering the desired improvement or new
functionality are written first, then the production of analysis
documents to pass the tests are written, and finally, the
analysis documents are re-factored to accommodate
changes. ‘
Testing, the next level Erik Boelen22
Conclusion
Get out of boot camp and face the
challenges in testing
Be creative
Let people know about it
Make sure you apply testing principles instead of just
using them
Do not get stuck at the instructions you get from others
Testing, the next level Erik Boelen23
Questions?
Questions?
Remarks?
Challenges?

More Related Content

PDF
Henrik Andersson - Exploratory Testing Champions - EuroSTAR 2010
PPT
'Customer Testing & Quality In Outsourced Development - A Story From An Insur...
PPT
Jelle Calsbeek - Stay Agile with Model Based Testing revised
PPT
Vipul Kocher - Software Testing, A Framework Based Approach
PDF
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
PPT
'Continuous Quality Improvements – A Journey Through The Largest Scrum Projec...
PDF
Christian Bk Hansen - Agile on Huge Banking Mainframe Legacy Systems - EuroST...
PPT
'Architecture Testing: Wrongly Ignored!' by Peter Zimmerer
Henrik Andersson - Exploratory Testing Champions - EuroSTAR 2010
'Customer Testing & Quality In Outsourced Development - A Story From An Insur...
Jelle Calsbeek - Stay Agile with Model Based Testing revised
Vipul Kocher - Software Testing, A Framework Based Approach
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
'Continuous Quality Improvements – A Journey Through The Largest Scrum Projec...
Christian Bk Hansen - Agile on Huge Banking Mainframe Legacy Systems - EuroST...
'Architecture Testing: Wrongly Ignored!' by Peter Zimmerer

What's hot (20)

PPTX
'Growing to a Next Level Test Organisation' by Tim Koomen
PPT
'Acceptance Testing' by Erik Boelen
PPTX
Mickiel Vroon - Test Environment, The Future Achilles’ Heel
PPT
Bart Knaack - The Truth About Model-Based Quality Improvements
PPT
Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...
PPT
Mattias Ratert - Incremental Scenario Testing
PPT
Derk jan de Grood - ET, Best of Both Worlds
PPT
Elise Greveraars - Tester Needed? No Thanks, We Use MBT!
PDF
Paul Gerrard - Advancing Testing Using Axioms - EuroSTAR 2010
PPT
Testing
PPT
Mats Grindal - Risk-Based Testing - Details of Our Success
PPT
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
PPT
Klaus Olsen - Agile Test Management Using Scrum
PPT
Better Software Classic Testing Mistakes
PDF
James Whittaker - Pursuing Quality-You Won't Get There - EuroSTAR 2011
PPT
'Houston We Have A Problem' by Rien van Vugt & Maurice Siteur
PDF
Istqb ctal tm
PPT
Darius Silingas - From Model Driven Testing to Test Driven Modelling
PDF
Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010
'Growing to a Next Level Test Organisation' by Tim Koomen
'Acceptance Testing' by Erik Boelen
Mickiel Vroon - Test Environment, The Future Achilles’ Heel
Bart Knaack - The Truth About Model-Based Quality Improvements
Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...
Mattias Ratert - Incremental Scenario Testing
Derk jan de Grood - ET, Best of Both Worlds
Elise Greveraars - Tester Needed? No Thanks, We Use MBT!
Paul Gerrard - Advancing Testing Using Axioms - EuroSTAR 2010
Testing
Mats Grindal - Risk-Based Testing - Details of Our Success
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Klaus Olsen - Agile Test Management Using Scrum
Better Software Classic Testing Mistakes
James Whittaker - Pursuing Quality-You Won't Get There - EuroSTAR 2011
'Houston We Have A Problem' by Rien van Vugt & Maurice Siteur
Istqb ctal tm
Darius Silingas - From Model Driven Testing to Test Driven Modelling
Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010
Ad

Similar to Erik Boelen - Testing, The Next Level (20)

PPTX
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...
PPTX
Software presentation
PPT
SE chapter 5
PPT
Slides chapter 5
PDF
Campbell & Readman - TDD It's Not Tester Driven Development - EuroSTAR 2012
PPT
PDF
Alexandru Bolboaca - Unit Testing from the Trenches
PPT
Bcc exceed ste_cert
PDF
Testing practicies not only in scala
PPTX
Рамелла Басенко - Вчимося на помилках - як підготуватися до повторного іспиту...
PDF
Introduction to test automation in java and php
PDF
PPTX
Aim (A).pptx
PPTX
Imagine Cup 2014 Korea Top 20 Orientation
DOCX
Resume 21 10 2015(5 yrs)
PPTX
Досвід здачі іспиту ISTQB Expert level: подробиці, перепідготовка, актуальніс...
PDF
stm f.pdf
PDF
Software Testing Interview Questions & Answers | Edureka
DOCX
Mca5020 advanced software engineering-de
PPTX
Intro to Unit Testing with test Driven Development
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...
Software presentation
SE chapter 5
Slides chapter 5
Campbell & Readman - TDD It's Not Tester Driven Development - EuroSTAR 2012
Alexandru Bolboaca - Unit Testing from the Trenches
Bcc exceed ste_cert
Testing practicies not only in scala
Рамелла Басенко - Вчимося на помилках - як підготуватися до повторного іспиту...
Introduction to test automation in java and php
Aim (A).pptx
Imagine Cup 2014 Korea Top 20 Orientation
Resume 21 10 2015(5 yrs)
Досвід здачі іспиту ISTQB Expert level: подробиці, перепідготовка, актуальніс...
stm f.pdf
Software Testing Interview Questions & Answers | Edureka
Mca5020 advanced software engineering-de
Intro to Unit Testing with test Driven Development
Ad

More from TEST Huddle (20)

PPTX
Why We Need Diversity in Testing- Accenture
PPTX
Keys to continuous testing for faster delivery euro star webinar
PPTX
Why you Shouldnt Automated But You Will Anyway
PDF
Being a Tester in Scrum
PDF
Leveraging Visual Testing with Your Functional Tests
PPTX
Using Test Trees to get an Overview of Test Work
PPTX
Big Data: The Magic to Attain New Heights
PPTX
Will Robots Replace Testers?
PPTX
TDD For The Rest Of Us
PDF
Scaling Agile with LeSS (Large Scale Scrum)
PPTX
Creating Agile Test Strategies for Larger Enterprises
PPTX
Is There A Risk?
PDF
Are Your Tests Well-Travelled? Thoughts About Test Coverage
PDF
Growing a Company Test Community: Roles and Paths for Testers
PDF
Do we need testers on agile teams?
PDF
How to use selenium successfully
PDF
Testers & Teams on the Agile Fluency™ Journey
PDF
Practical Test Strategy Using Heuristics
PDF
Thinking Through Your Role
PDF
Using Selenium 3 0
Why We Need Diversity in Testing- Accenture
Keys to continuous testing for faster delivery euro star webinar
Why you Shouldnt Automated But You Will Anyway
Being a Tester in Scrum
Leveraging Visual Testing with Your Functional Tests
Using Test Trees to get an Overview of Test Work
Big Data: The Magic to Attain New Heights
Will Robots Replace Testers?
TDD For The Rest Of Us
Scaling Agile with LeSS (Large Scale Scrum)
Creating Agile Test Strategies for Larger Enterprises
Is There A Risk?
Are Your Tests Well-Travelled? Thoughts About Test Coverage
Growing a Company Test Community: Roles and Paths for Testers
Do we need testers on agile teams?
How to use selenium successfully
Testers & Teams on the Agile Fluency™ Journey
Practical Test Strategy Using Heuristics
Thinking Through Your Role
Using Selenium 3 0

Recently uploaded (20)

PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
PDF
Design an Analysis of Algorithms II-SECS-1021-03
PPTX
ai tools demonstartion for schools and inter college
PDF
2025 Textile ERP Trends: SAP, Odoo & Oracle
PPTX
Operating system designcfffgfgggggggvggggggggg
PPTX
ManageIQ - Sprint 268 Review - Slide Deck
PDF
top salesforce developer skills in 2025.pdf
PPTX
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
PDF
How Creative Agencies Leverage Project Management Software.pdf
PDF
PTS Company Brochure 2025 (1).pdf.......
PPTX
Transform Your Business with a Software ERP System
PDF
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
PDF
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 41
PDF
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
PPT
Introduction Database Management System for Course Database
PDF
System and Network Administration Chapter 2
PDF
AI in Product Development-omnex systems
PPTX
Introduction to Artificial Intelligence
PPTX
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
VVF-Customer-Presentation2025-Ver1.9.pptx
Design an Analysis of Algorithms II-SECS-1021-03
ai tools demonstartion for schools and inter college
2025 Textile ERP Trends: SAP, Odoo & Oracle
Operating system designcfffgfgggggggvggggggggg
ManageIQ - Sprint 268 Review - Slide Deck
top salesforce developer skills in 2025.pdf
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
How Creative Agencies Leverage Project Management Software.pdf
PTS Company Brochure 2025 (1).pdf.......
Transform Your Business with a Software ERP System
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
Internet Downloader Manager (IDM) Crack 6.42 Build 41
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
Introduction Database Management System for Course Database
System and Network Administration Chapter 2
AI in Product Development-omnex systems
Introduction to Artificial Intelligence
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx

Erik Boelen - Testing, The Next Level

  • 1. Testing, the next level Challenges in software testing Erik Boelen QA Consult Services Erik.boelen@qaconsult.eu www.qaconsult.eu
  • 2. Testing, the next level Erik Boelen2 What will I talk about? View on where we are in testing right now What are the challenges out there for us testers? Can these challenges help us grow as testers?
  • 3. Testing, the next level Erik Boelen3 So where are we now? ‘In the starting blocks’ ‘Finally getting some structure in software testing’ ‘The future is looking bright for software testers!’ Opinion of peers My opinion? BOOTCAMP
  • 4. Testing, the next level Erik Boelen4 So where are we now? Have you ever played computer games? Or any other games as such?
  • 5. Testing, the next level Erik Boelen5 So where are we now? Remember the introduction screens? Or the moments where somebody explained the game during the first round? Guitar Hero Piper Panic Scrabble hints from your opponents?!
  • 6. Testing, the next level Erik Boelen6 So where are we now? Computer games’ Boot camps In order to pick a weapon – E In order to fire a weapon – SPACE In order to holster – F In order to press a button – ENTER In order to activate a switch - A Enemy behind the door that is opened by a switch Now what?
  • 7. Testing, the next level Erik Boelen7 So where are we now? Our instructions have been set – Methodologies – Testing principles – V-Model – ISTQB – IEEE Our instructions are ready to be challenged!
  • 8. Testing, the next level Erik Boelen8 Challenges in software testing V-Model needs to be brought back to its roots Knowledge sharing needs improvement in software testing The objectives of testers within a project need to be fine tuned Look one step further in your tool selection Apply certain aspects of different methodologies in order to fit your need Think about test driven analysis … and many more
  • 9. Testing, the next level Erik Boelen9 Apply the V-Model, do not use it According to TMap Next© Development Tests System Tests Acceptance Tests T We loose flexibility What is behind the label?
  • 10. Testing, the next level Erik Boelen10 Apply the V-Model, do not use it Test Types Dev Test Test Types System Test Test Types Acceptance Test Test Stage 1 TS 2 TS3 Test Stage 4 T Test Basis Back to the roots
  • 11. Testing, the next level Erik Boelen11 Apply the V-Model, do not use it Test Types are the drivers of testing – What to test? – How to test? – Where to test? – Who to test? Test basis is according to the V-Model principle! Test Levels are LABELS Test Stages give the flexibility to the project to – Define the test types; – According to their test basis; – Including the timing aspect V-Model applied and fit for purpose
  • 12. Testing, the next level Erik Boelen12 Build, maintain and share knowledge Quick Google Research Type in a search string at Google and look at the first page results
  • 13. Testing, the next level Erik Boelen13 Build, maintain and share knowledge Computer games – Walkthroughs – Guidelines – Tips & Tricks So many opportunities for testers – Blogs – Forums – Wiki – Online communities … and that’s just the internet Conferences – EuroSTAR Discussion groups
  • 14. Testing, the next level Erik Boelen14 Set shared objectives Methodology says: ‘All testers need to be independent from the other skills within a project’
  • 15. Testing, the next level Erik Boelen15 Set shared objectives All testers in a separate bubble? What about letting others in our bubble? – Designers – Developers – End users It’s the team effort that delivers projects Nothing new here! Specify team objectives in your entry & exit criteria of your testing process Release notes are written Test execution covers all requirements The end user approves the guidelines Team cooperation required!!
  • 16. Testing, the next level Erik Boelen16 Be creative in your tool selection Easy to stay with the most common tools Make sure that you have the right tool for the job, not the most obvious one Practical example – If I need a tool to test usability, what can I do? Take an obvious tool and record test cases in there on usability, execute them and log the result – all textual Use the application Silverback and record all my actions, my visual expression and my voice while testing the new software – a lot more than just textual!!
  • 17. Testing, the next level Erik Boelen17 Be creative in your tool selection
  • 18. Testing, the next level Erik Boelen18 Combine testing methodologies ‘We use TMAP’ ‘We follow the SCRUM method’ ‘We only work iteratively’ ‘We combine methodologies in order to fit for purpose’ And very rarely
  • 19. Testing, the next level Erik Boelen19 Combine testing methodologies Practical example We work in iterations while in a non-iterative environment, using exploratory testing as test preparation for scripted testing Clear combination of different approaches Fit for purpose!
  • 20. Testing, the next level Erik Boelen20 Test Driven Analysis “Test-Driven Development (TDD) is a software development technique consisting of short iterations where new test cases covering the desired improvement or new functionality are written first, then the production code necessary to pass the tests is implemented, and finally the software is re-factored to accommodate changes. The availability of tests before actual development ensures rapid feedback after any change. Practitioners emphasize that test-driven development is a method of designing software, not merely a method of testing.” Used for more than a decade Most developers are OK with this According to Wikipedia
  • 21. Testing, the next level Erik Boelen21 Test Driven Analysis Can we apply this to analysis? Are analysts OK to let testers in their bubble? ‘Test Driven Analysis (TDA) is a software analysis technique consisting of short iterations where new test cases covering the desired improvement or new functionality are written first, then the production of analysis documents to pass the tests are written, and finally, the analysis documents are re-factored to accommodate changes. ‘
  • 22. Testing, the next level Erik Boelen22 Conclusion Get out of boot camp and face the challenges in testing Be creative Let people know about it Make sure you apply testing principles instead of just using them Do not get stuck at the instructions you get from others
  • 23. Testing, the next level Erik Boelen23 Questions? Questions? Remarks? Challenges?