SlideShare a Scribd company logo
Agile Quality Improvement:
7 common challenges and
good practices
QX Day 2019
Wouter Ruigrok & Leo van der Aalst
2© 2019 Sogeti. All rights reserved.
Challenges
3© 2019 Sogeti. All rights reserved.
1. How to involve people in testing?
4© 2019 Sogeti. All rights reserved.
2. How to get grip on testing in
decentralized organizations?
5© 2019 Sogeti. All rights reserved.
3. How to cover business risks?
6© 2019 Sogeti. All rights reserved.
4. How to achieve first time right?
7© 2019 Sogeti. All rights reserved.
5. How to get Dev and Ops working
together?
8© 2019 Sogeti. All rights reserved.
6. How to organize E2E testing?
9© 2019 Sogeti. All rights reserved.
7. How to make optimal use of test
automation?
10© 2019 Sogeti. All rights reserved.
How to get grip on testing in decentralized organizations?
How to organize E2E testing?
How to get Dev and Ops really working together?
How to achieve first time right?
How to cover business risks?
How to involve people in testing?
How to make optimal use of test automation?
11© 2019 Sogeti. All rights reserved.
Our experiences
12© 2019 Sogeti. All rights reserved.
1. Give people responsibility and
knowledge to involve them in testing.
13© 2019 Sogeti. All rights reserved.
2. Create WoW by test guild to get grip on
testing in decentralized organizations.
14© 2019 Sogeti. All rights reserved.
3. Apply PRBA with the Four Amigo’s to
identify en cover business risks.
15© 2019 Sogeti. All rights reserved.
4. Conduct VSM with whole team to
identify waste and bottlenecks.
16© 2019 Sogeti. All rights reserved.
5. From Dev and Ops to DevOps by shared
understanding of each others
challenges.
17© 2019 Sogeti. All rights reserved.
6. Involve teams in E2E testing supported
by the business.
18© 2019 Sogeti. All rights reserved.
7. Bring testers with development skills
into your organization for optimal use
of test automation.
19© 2019 Sogeti. All rights reserved.
Our vision
20© 2019 Sogeti. All rights reserved.
1. ‘Coach to perform’ track (Ad hoc, "fire fighting“)
2. 'Improvement' track (Structural, "fire prevention“)
▪ Create quality awareness in all people involved
▪ "Integrate" QA & Testing activities in all people involved
▪ Integrate QA & Testing activities in all software development activities
Two Tracks – Agile Quality Improvement Framework
Built-in Quality
instead of combating symptoms
QA Awareness QA & Testing Governance Transparency Automation Infrastructure
Leo.vander.Aalst@Sogeti.com Wouter.Ruigrok@Sogeti.com

More Related Content

PDF
Worldwide Testing & Cutover at Cargill - Daniele Hernandez-Aita & Leo Janssen
PDF
Vers l'entreprise agile
PDF
Accelerating Your Digital Agenda with Continuous Testing ft. Forrester
PDF
Microservices: The Netflix Way
PDF
Application Archaeology: Accelerating App Modernization at DICK’S Sporting Goods
PPTX
Jeremy Kaszycki_Intern Presentation
PDF
Ensuring accessibility by Kenny Gilles
PPTX
CWIN17 telford api management, practical implementation experience - david ru...
Worldwide Testing & Cutover at Cargill - Daniele Hernandez-Aita & Leo Janssen
Vers l'entreprise agile
Accelerating Your Digital Agenda with Continuous Testing ft. Forrester
Microservices: The Netflix Way
Application Archaeology: Accelerating App Modernization at DICK’S Sporting Goods
Jeremy Kaszycki_Intern Presentation
Ensuring accessibility by Kenny Gilles
CWIN17 telford api management, practical implementation experience - david ru...

What's hot (19)

PDF
Covestro - How Does the Maker of High-Tech Polymers Use One Source of Truth t...
PDF
leaf - Lean Enterprise Agile Framework - Scaling Deliverables
PPTX
Succeed with Scrum - Part 1
PDF
How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%
PDF
Lesson learned from React native and Flutter
PDF
Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...
PDF
Agile SAP ACTIVATE
PDF
They Told Me to “Be Agile”, but I’m Not a Developer
PPTX
Eclipse Duttile
PPTX
Test Case Management Tools
PDF
Certificate - Ankit Kumar Anshu
PDF
8 steps to requirements success
PDF
Atagg2015 Testing QA transformation trends - capgemini’s 2015 world quality r...
PPTX
AgileCamp Silicon Valley 2015: Harnessing Useful Models for Accelerating Agility
PPTX
End of term presentation
PDF
DevOps & Cloud-Native for Enterprise Architects Not Dead Yet
PPTX
Barabara Sanders SpringOne Platform keynote
PDF
TenKod EZ TestApp Mobile Application Testing Introduction
PDF
Sck spring-reactive
Covestro - How Does the Maker of High-Tech Polymers Use One Source of Truth t...
leaf - Lean Enterprise Agile Framework - Scaling Deliverables
Succeed with Scrum - Part 1
How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%
Lesson learned from React native and Flutter
Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...
Agile SAP ACTIVATE
They Told Me to “Be Agile”, but I’m Not a Developer
Eclipse Duttile
Test Case Management Tools
Certificate - Ankit Kumar Anshu
8 steps to requirements success
Atagg2015 Testing QA transformation trends - capgemini’s 2015 world quality r...
AgileCamp Silicon Valley 2015: Harnessing Useful Models for Accelerating Agility
End of term presentation
DevOps & Cloud-Native for Enterprise Architects Not Dead Yet
Barabara Sanders SpringOne Platform keynote
TenKod EZ TestApp Mobile Application Testing Introduction
Sck spring-reactive
Ad

Similar to Agile Quality Improvement 7: common challenges and good practices - Wouter Ruigrok & Leo van der Aalst (20)

PDF
Quality for DevOps teams - Quality engineering in the DevOps culture
PDF
Quality engineering instead of testing... Why? How?
PDF
DevOps and Testing slides at DASA Connect
PDF
The End Of Testing As We Know It (TestCon - Rik Marselis).pdf
PDF
My presentation at UniCom Agile methods conference in Amsterdam at 14 Novembe...
PDF
We did it!!? There is place for QAs in Agile!!?
PDF
GTR-The End Of Testing As We Know It
PDF
Agile Testing: Best Practices and Methodology
PDF
Helpful Practices in Agile Testing
PPTX
Quality Assurance vs. Quality Control, Future of Software Quality
PPTX
Istqb implementation
PPTX
Istqb implementation
PDF
Quality Engineering in today's cross-functTeams with TMAP
PDF
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
PPTX
Useful stepping stones in growth towards Agile testing door Kees Blokland.
PDF
How to Build in Quality from Day 1 using Lean QA and Agile Testing
PDF
Atlassian Summit 2015 Lean QA and Agile Testing
PDF
Test i agile projekter af Gitte Ottosen, Sogeti
PPTX
unit-2_20-july-2018 (1).pptx
PDF
Agile testing practice
Quality for DevOps teams - Quality engineering in the DevOps culture
Quality engineering instead of testing... Why? How?
DevOps and Testing slides at DASA Connect
The End Of Testing As We Know It (TestCon - Rik Marselis).pdf
My presentation at UniCom Agile methods conference in Amsterdam at 14 Novembe...
We did it!!? There is place for QAs in Agile!!?
GTR-The End Of Testing As We Know It
Agile Testing: Best Practices and Methodology
Helpful Practices in Agile Testing
Quality Assurance vs. Quality Control, Future of Software Quality
Istqb implementation
Istqb implementation
Quality Engineering in today's cross-functTeams with TMAP
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
Useful stepping stones in growth towards Agile testing door Kees Blokland.
How to Build in Quality from Day 1 using Lean QA and Agile Testing
Atlassian Summit 2015 Lean QA and Agile Testing
Test i agile projekter af Gitte Ottosen, Sogeti
unit-2_20-july-2018 (1).pptx
Agile testing practice
Ad

More from Sogeti Nederland B.V. (20)

PDF
Sogeti User eXperience (UX) Lab - Usability Testing
PDF
Usability Lab Live Roleplay - Charlotte Janus & Randy Semeleer
PDF
OPS als enabler voor DevOps bij KvK - Robbert van der Houwen (KvK) & Conrad H...
PDF
Imagine Digital Safety Assured - Arno van de Velde (Micro Focus)
PDF
Good practices in pentesting - Bas de Heer
PDF
Revolutionising Testing with the Power of AI - Deepa Mamtani, Pillay Almira &...
PDF
Quality Assurance in fast paced DevOps projects using automation - Patrick Ve...
PDF
Neste: How to Build Business Case, Ramp-up and Run SAP Test Automation Factory
PDF
HEAT KILLS: Drink plenty of water - Michael de Boer (DATPROF)
PDF
Hands-off performance testing - Twan Koot & Addy Zwiebel
PDF
Analyze your application portfolio to know where the quality and risk issues ...
PDF
Workshop: Usability Lab Live Roleplay - Charlotte Janus & Randy Semeleer
PDF
The state of Continuous Testing in 2019 - Antoine Aymer
PDF
Reduceer je False Negatives - Peter Wanders van KLM
PDF
Effective Insights in an Hour - Daan Oosters
PDF
Data Driven Ecosystemen - Marcel Schmidt & Dennis Van Gelder
PDF
(Niet) effectief exploratory testen - Rik Marselis
PDF
Charlotte van 't Wout - Slim ondernemen met Instagram
PDF
Isabel Meijering - Een ontspannende online connectie
PDF
Siri Beerends - De authenticiteit van nep
Sogeti User eXperience (UX) Lab - Usability Testing
Usability Lab Live Roleplay - Charlotte Janus & Randy Semeleer
OPS als enabler voor DevOps bij KvK - Robbert van der Houwen (KvK) & Conrad H...
Imagine Digital Safety Assured - Arno van de Velde (Micro Focus)
Good practices in pentesting - Bas de Heer
Revolutionising Testing with the Power of AI - Deepa Mamtani, Pillay Almira &...
Quality Assurance in fast paced DevOps projects using automation - Patrick Ve...
Neste: How to Build Business Case, Ramp-up and Run SAP Test Automation Factory
HEAT KILLS: Drink plenty of water - Michael de Boer (DATPROF)
Hands-off performance testing - Twan Koot & Addy Zwiebel
Analyze your application portfolio to know where the quality and risk issues ...
Workshop: Usability Lab Live Roleplay - Charlotte Janus & Randy Semeleer
The state of Continuous Testing in 2019 - Antoine Aymer
Reduceer je False Negatives - Peter Wanders van KLM
Effective Insights in an Hour - Daan Oosters
Data Driven Ecosystemen - Marcel Schmidt & Dennis Van Gelder
(Niet) effectief exploratory testen - Rik Marselis
Charlotte van 't Wout - Slim ondernemen met Instagram
Isabel Meijering - Een ontspannende online connectie
Siri Beerends - De authenticiteit van nep

Recently uploaded (20)

PPTX
SAP 2 completion done . PRESENTATION.pptx
PPTX
(Ali Hamza) Roll No: (F24-BSCS-1103).pptx
PDF
How to run a consulting project- client discovery
PDF
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
PPTX
importance of Data-Visualization-in-Data-Science. for mba studnts
PPTX
IMPACT OF LANDSLIDE.....................
PPT
Predictive modeling basics in data cleaning process
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PPT
ISS -ESG Data flows What is ESG and HowHow
PPTX
Qualitative Qantitative and Mixed Methods.pptx
PPTX
Market Analysis -202507- Wind-Solar+Hybrid+Street+Lights+for+the+North+Amer...
PDF
REAL ILLUMINATI AGENT IN KAMPALA UGANDA CALL ON+256765750853/0705037305
PPTX
Pilar Kemerdekaan dan Identi Bangsa.pptx
PPTX
A Complete Guide to Streamlining Business Processes
PPTX
Managing Community Partner Relationships
PPTX
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
PPTX
Database Infoormation System (DBIS).pptx
PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PDF
Introduction to the R Programming Language
PPTX
Leprosy and NLEP programme community medicine
SAP 2 completion done . PRESENTATION.pptx
(Ali Hamza) Roll No: (F24-BSCS-1103).pptx
How to run a consulting project- client discovery
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
importance of Data-Visualization-in-Data-Science. for mba studnts
IMPACT OF LANDSLIDE.....................
Predictive modeling basics in data cleaning process
Acceptance and paychological effects of mandatory extra coach I classes.pptx
ISS -ESG Data flows What is ESG and HowHow
Qualitative Qantitative and Mixed Methods.pptx
Market Analysis -202507- Wind-Solar+Hybrid+Street+Lights+for+the+North+Amer...
REAL ILLUMINATI AGENT IN KAMPALA UGANDA CALL ON+256765750853/0705037305
Pilar Kemerdekaan dan Identi Bangsa.pptx
A Complete Guide to Streamlining Business Processes
Managing Community Partner Relationships
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
Database Infoormation System (DBIS).pptx
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
Introduction to the R Programming Language
Leprosy and NLEP programme community medicine

Agile Quality Improvement 7: common challenges and good practices - Wouter Ruigrok & Leo van der Aalst

  • 1. Agile Quality Improvement: 7 common challenges and good practices QX Day 2019 Wouter Ruigrok & Leo van der Aalst
  • 2. 2© 2019 Sogeti. All rights reserved. Challenges
  • 3. 3© 2019 Sogeti. All rights reserved. 1. How to involve people in testing?
  • 4. 4© 2019 Sogeti. All rights reserved. 2. How to get grip on testing in decentralized organizations?
  • 5. 5© 2019 Sogeti. All rights reserved. 3. How to cover business risks?
  • 6. 6© 2019 Sogeti. All rights reserved. 4. How to achieve first time right?
  • 7. 7© 2019 Sogeti. All rights reserved. 5. How to get Dev and Ops working together?
  • 8. 8© 2019 Sogeti. All rights reserved. 6. How to organize E2E testing?
  • 9. 9© 2019 Sogeti. All rights reserved. 7. How to make optimal use of test automation?
  • 10. 10© 2019 Sogeti. All rights reserved. How to get grip on testing in decentralized organizations? How to organize E2E testing? How to get Dev and Ops really working together? How to achieve first time right? How to cover business risks? How to involve people in testing? How to make optimal use of test automation?
  • 11. 11© 2019 Sogeti. All rights reserved. Our experiences
  • 12. 12© 2019 Sogeti. All rights reserved. 1. Give people responsibility and knowledge to involve them in testing.
  • 13. 13© 2019 Sogeti. All rights reserved. 2. Create WoW by test guild to get grip on testing in decentralized organizations.
  • 14. 14© 2019 Sogeti. All rights reserved. 3. Apply PRBA with the Four Amigo’s to identify en cover business risks.
  • 15. 15© 2019 Sogeti. All rights reserved. 4. Conduct VSM with whole team to identify waste and bottlenecks.
  • 16. 16© 2019 Sogeti. All rights reserved. 5. From Dev and Ops to DevOps by shared understanding of each others challenges.
  • 17. 17© 2019 Sogeti. All rights reserved. 6. Involve teams in E2E testing supported by the business.
  • 18. 18© 2019 Sogeti. All rights reserved. 7. Bring testers with development skills into your organization for optimal use of test automation.
  • 19. 19© 2019 Sogeti. All rights reserved. Our vision
  • 20. 20© 2019 Sogeti. All rights reserved. 1. ‘Coach to perform’ track (Ad hoc, "fire fighting“) 2. 'Improvement' track (Structural, "fire prevention“) ▪ Create quality awareness in all people involved ▪ "Integrate" QA & Testing activities in all people involved ▪ Integrate QA & Testing activities in all software development activities Two Tracks – Agile Quality Improvement Framework Built-in Quality instead of combating symptoms QA Awareness QA & Testing Governance Transparency Automation Infrastructure Leo.vander.Aalst@Sogeti.com Wouter.Ruigrok@Sogeti.com