The End Of Testing As We Know It (TestCon - Rik Marselis).pdf

1
© 2023 Sogeti. All rights reserved.
The end of testing as we know it !!
Rik Marselis
TestCon
Vilnius
25 October 2023
TMAP: the body of knowledge for
quality engineering in IT delivery

2
The end of testing as we know it…

3
Why would we want to test?

4
Rik Marselis
Principal Quality Consultant
2007 2012 2012
2008 2014
2009
2018
1980 2020

5
ISTQB
International
Software
Testing
Excellence
Award
2022
EuroSTAR
2023
Testing
Excellence
Award
Olivier Denoo presents the award
at the ISTQB general assembly
in Marrakech on 20 October 2022
Bob van de Burgt presents the award
at the EuroSTAR Awards Gala night
in Antwerp on 15 June 2023

6

7
Testing in the 1970’s
“Testing is
the process of
executing a program
with the intent
of finding errors”

8
Which activity is missing in this picture?
?

9
You were thinking of “testing” or “quality assurance”
(weren’t you?)

10
You were thinking of “testing” or “quality assurance”
(weren’t you?)
Fixing at the end of the IT delivery process is not efficient and not effective.
So, instead of hunting faults… don’t implement a fixing phase…
Organize your DevOps process properly, to get sufficient quality right first time!
Actually, this is the activity where all faults that were inserted previously are hunted for and when
found they are fixed.
Therefore, we like to refer to it as the “fixing phase”.

11
Lesson from 1979, the Böhm curve, still relevant:
Shift left & early quality & built-in quality
The “Böhm-curve”:
If you find and solve a problem early that’s cheaper than later…
SHIFT LEFT !!!!

12
Make sure quality engineering
is part of all IT delivery activities
Note: this picture shows some general activities, in DevOps these are performed in parallel.
Quality engineering

13
So, today testing is
NOT hunting
bugs, then
what is it?

14
Challenges of today’s IT delivery
The business demands:
• Deliver business value
• Deliver quality at speed
The team challenges are:
• Quality engineering is everyone's responsibility
• QA & testing is integrated in process and people
The focus is:
• Organize high-performing cross-functional teams (you build it, you run it!)
• Automate everything (as long as it is useful)
Value
and
speed

15
Deliver quality at speed…

16
Focus on BUSINESS VALUE

17
Build quality in by
applying relevant
quality measures
Supply information
based on
measuring indicators
The VOICE model: align activities with pursued business value
Measuring indicators
=
(mainly) testing
Figure 3.1 from the book Quality for DevOps teams

18
Embrace continuous improvement  Quality Engineering (definition)
Quality Engineering
is about team members and their stakeholders
taking joint responsibility
to continuously deliver IT systems
with the right quality at the right moment
to the businesspeople and their customers.
It is a principle of software engineering
concerned with applying quality measures
to assure the quality of IT systems.
Definition from TMAP glossary (see www.TMAP.net)

19

20
Quality Engineering & Testing support delivering business value
Quality Engineering
Testing
“Detective”
quality measures
“Preventive”
quality measures
Build quality in,
right first time
Provide information
about quality & risks
“Corrective”
quality measures
Pro-active quality
improvement

21
Definition of testing within business delivery & quality engineering
Testing consists of verification, validation and exploration activities
that provide information about the quality and the related risks,
to establish the level of confidence
that a test object will be able to deliver the pursued business value.

22
Quality engineering
& testing topics
Team scope
Multi-team
scope
Organizing
Aimed at:
orchestrating, arranging,
planning, preparing and
controlling
Performing
Aimed at:
operational
QA & testing
activities.

23
The relation of quality engineering topics and DevOps

24
Quality is a team
responsibility

25
is an approach
that enables cross-functional teams
to continuously improve
the products, processes and people
that are required to
deliver value
to the end users.
High-performance IT delivery

26
TEAM:
Together
Everyone
Achieves
More
Example of a cross-functional
high-performance IT delivery team
The starting point:
A cross-functional team
takes joint responsibility
Aligned with the DevOps culture of IT delivery – where roles are important and functions
are not – keep in mind that if in TMAP you see a term such as developer or tester, we
refer to the role of a team member at a specific moment in time, not to a function.

27
Business value depends on the quality of products, processes & people
Quality
Products People
Processes

28
Software bill of materials

29
Static versus Dynamic testing
(examples)
Perspective based reviewing “Running” the system

30
Testing new & changed versus unchanged deliverables
Testing new and changed
deliverables
Testing unchanged
deliverables
Testing fixed problems

31
Structured testing with test approaches and techniques
Experience-based
testing
Error-guessing
Exploratory
testing
Crowd
testing
Checklists
Figures 43.1, 45.1 and 47.5 from the book Quality for DevOps teams

32
Quiz
How many different test design techniques do you know?
How many different test design techniques are in literature?
How many different test design techniques do you use?

33
TMAP describes 16+ test design techniques and has templates for
most of them.

34
What is a test case and how is it used?
Initial situation
(preconditions)
Input (test data)
& actions
Expected
results
Test case Test design
QA&Testing Topic:
A Test case is a set of preconditions, inputs, actions, expected results and
postconditions used to examine whether the system displays the desired behavior
under specific circumstances.

35
What is a test case and how is it used?
Initial situation
(preconditions)
Input (test data)
& actions
Expected
results
Processing
(running the test
object)
Actual results
(incl. resulting
situation &
postconditions)
Test case
Behavior of test object
Investigate and
assess the outcome
of testing
Test design
Test execution
QA&Testing Topic:

36
A test case consists of:
input & actions, expected outcome, actual outcome, pass/fail
EXPECTED
outcome
!!!!

37
Quality Engineering Strategy
A quality engineering strategy relates
quality measures with IT delivery items
(e.g. user stories, features etc.),
and indicates the intensity of the
quality measures that are needed.
Goal: Built-in quality

38
IT Delivery item
(e.g.: User story,
feature, epic)
Relevant Quality
attributes
(e.g.: performance,
security, usability, …)
Risk class
(e.g:
A – high risk)
Select
appropriate
Quality
measure
Determine
applied
intensity of QM
Download this template from www.TMAP.net

39

40
Continuous feedback & shift left

41
Quality at speed  Automate everything (as long as it is useful)
An automated pipeline enables: • Elimination of errors due to manual task execution
• Provisioning of standardized development feedback loops
• Enabling of fast product iterations
Figure 6.1 from the book
One team
Multiple
teams

42
The testing pyramid automated testing (as long as it is useful)
g

43
It’s seldom wise to
automate nothing…
It’s NEVER wise to
automate everything!

44
And what about Artificial Intelligence?
AI may be very powerful, and more and
more AI-powered testing tools show up…
But remember:
AI is still just another tool !!
It may make your work easier, but it
does not totally replace the need for
human involvement in testing.

45
Conclusion…
transition from
testing at the end to
Quality Engineering
from the start

46
Conclusion: The change that quality engineering achieves
Testing = Messenger
of bad news
Quality engineering =
Enabler of an
adequate quality level
that delivers
Business Value
No more Instead

47
Questions & Answers
www.ICT-books.com

48
www.TMAP.net information and downloads, for example templates

49
The TMAP certification scheme
2023
New
Focused on people in IT delivery teams Focused on people related to
business and maintenance
TMAP: Quality
for cross-
functional teams
TMAP: High-
performance
quality
engineering
TMAP:
Organizing built-
in quality
at scale
TMAP: Quality
engineering for
SAP
Exams provided by
Info about TMAP training & certification at:
www.TMAP.net/page/tmap-training
www.TMAPcert.com

50
About Sogeti
Learn more about us at
www.sogeti.com This message contains information that may be privileged or
confidential and is the property of the Capgemini Group.
Copyright© 2023 Sogeti. All rights reserved.
Sogeti is a leading provider of technology and engineering services. Sogeti delivers
solutions that enable digital transformation and offers cutting-edge expertise in Cloud,
Cybersecurity, Digital Manufacturing, Digital Assurance & Testing, and emerging
technologies. Sogeti combines agility and speed of implementation with strong technology
supplier partnerships, world class methodologies and its global delivery model,
Rightshore®. Sogeti brings together more than 25,000 professionals in 15 countries,
based in over 100 locations in Europe, USA and India. Sogeti is a wholly-owned subsidiary
of Capgemini SE, listed on the Paris Stock Exchange.
TMAP website:
www.tmap.net
Sogeti academy:
academy.sogeti.nl
TMAP: body of knowledge
for quality engineering
and testing
email: Rik.Marselis@sogeti.com
www.ICT-books.com

The End Of Testing As We Know It (TestCon - Rik Marselis).pdf

More Related Content

What's hot (20)

Similar to The End Of Testing As We Know It (TestCon - Rik Marselis).pdf (20)

More from Rik Marselis (18)

Recently uploaded (20)

The End Of Testing As We Know It (TestCon - Rik Marselis).pdf