SlideShare a Scribd company logo
QA in and Agile World
Tom Churchwell
TChurchwell@GMail.com
Agenda
2
 Survey
 Exercise 1
 Agile vs. Traditional
 Effect of Test Driving
 Testing Pyramid
 Exercise 2
 Q&A
Quick Survey
3
 How many QA folks are focused on testing?
 Who owns Quality?
 Who owns improvement?
What is different?
4
 Old Focus
 No Defects
◦ By Requirements
 Comprehensive
Testing
◦ Slow
◦ Manual
 Integration at the
End of Dev
 Quality Tested In
 No Defects
◦ By PO Demo
 Fast
◦ Automated Testing
◦ Continuous
Integration
 Clean Code
◦ Modular
 Quality Built In
Manifesto for Agile Software
Development
We are uncovering better ways of developing
software by doing it and helping others do it.
Through this work we have come to value:
• Individuals and interactions over processes and tools
• Working software over comprehensive documentation
• Customer collaboration over contract negotiation
• Responding to change over following a plan
That is, while there is value in the items on the right, we value the
items on the left more.
Working Software
6
 Quality Assurance is all about working
software.
 Quality Standards
 Confidence in the codebase is the key to
sente; having choices, momentum,
velocity, autonomy, adaptability,
competitive advantage and the inherent
propensity for innovation and luck.
Exercise 1
7
What does a traditional QA do that an Agile QA
does not do?
What skills does an agile QA need that a
traditional QA does not?
Report Outs…
Cultural
Environmental Practical
Collaborative
Big & Visible
Perpetual Buzz
Food
Thorough
Courageous
Adaptable
Forthright
FUN
TDD
Quality Standards
Iterative Development
Business Verification
Whole Team Ownership
 Quality as a fundamental ongoing concern for the
team
◦ Not just at the end of a release
◦ Meeting quality standards has become a part of the “Definition
of Done” for the whole team
 An Integrated Team Focus
◦ QA throughout development
 Elimination of QA as a sequential process
◦ Whole Team collaboration from beginning to end
◦ Teams take ownership
 Definition of Done
 Quality Standards
 Level of quality being produced every day
 Business Verification
◦ Weekly verification demo
◦ Product Owner Drives the Demo
10
Tasting after baking
Bake Quality In…
We Cannot Improve Our
Recipe’s By Eating More
Cookies…
We Must Bake, Rather Than
Try To Test Quality In!
Whole Team Ownership of
Quality
 Historically QA has been:
◦ An event that occurs after development is
done
 Point in time validation rather than an ongoing
standard for quality
 Verification before production launch
◦ Held by QA
 Not part of “Definition of Done” for the team
 Not part of what every member of the team was
committed to uphold.
◦ Part of a rigid sequential process
 At the end of development
 An event rather than an ongoing concern
Definition Of Done
14
Build it RIGHT -- “Done”
• Quality Metrics Passed
• Unit test coverage at or above 80% overall
• Cyclomatic Complexity 1-3
• Fewer Than 10 Statements per Method
• Integration tests created and successfully passed for each
external dependency (minimum one per dependency)
• Deploy scripts updated for deployment to DevInt and QA.
• Functional tests pass in DevInt or preferably QA
• Functional tests automated (Selenium, Fitnesse or other)
• Single user execution against functional timing SLA passed
for each story.
• Business verified by product owner OR technical
lead/architect if technical card.
• Exploratory Testing Complete
Definition Of Done
15
“Production Ready” -- “Done” – Done
• Performance testing executed and passed.
• Production-level content successfully
integrated and tested
• Accessibility & Usability Tested
• Full browser testing for all specified browsers
and versions
Traditional Development
16
Specify
Design
Code
Test
Deploy
Sustain
Test Driving
17
Test Driving
18
Specify
Design
Code
Test
Deploy
Sustain
Working Software Environment
19
 Source Code
Management
Environment
20
 Source Code
Management
 Continuous Integration
Environment
21
 Pairing Stations
 Source Code
Management
 Continuous Integration
Environment
22
 Pairing Stations
 Source Code
Management
 Continuous Integration
Building Work Software
23
 Code Check Out
 Source Code
Management
Building Work Software
24
 Code
Development
 Source Code
Management
Building Work Software
25
 Coding Pair
 Source Code
Management
 Code Check-In
 Continuous Integration
Iterative Development
26
Spike - End-to-End
What’s
needed
end to
end?
Travel
Light
Iterative Growth
What’s
needed
end to
end?
• Project Concerns
– Tight Schedules
– Maintaining “High Quality” despite changes
– Responsiveness to customer needs
• Project Situations
– Don’t know all of what is needed at onset of project
• ONLY Commit for the “Known's”
– Requirements Change During the Project
• Accommodate change with later releases
• Value to the Customer
– Give customers regular functionality reviews
– Realizing Value often rather than “big bang”
Accommodates Multiple Challenges
• Project Concerns
– Burn-Down Chart
– Burn-Up Charts
• Practices
– Consistency Allows Ease of Spool Up
– Allows Migration of Team Members
• Tools
– Consistency Allows Ease Migration of Team Members
• Quality
– Defects
– Components
Big Visible Charts
Burnup ChartsBurning Up Tasks
Burnup
0
20
40
60
80
100
120
140
160
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
En
d
WorkingDays
TaskHours
Burnup Total Linear (Burnup) Linear (Total)
31
32
1026 1013
982
951 924 913
879
847
798
742
695
16 13
31
31
27 32
34
45
16
23
34
40 43 53
62
66 90
72
61
70
93
120
53 62 62
67
90
102
138 173
189
200 223
150 160 180 190 198
198
143 150
180 184
196.5
0
50
100
150
200
250
300
350
400
450
500
550
600
650
700
750
800
850
900
950
1000
1050
1100
1150
1200
1250
1300
1350
1400
1450
2/3
2/10
2/17
2/24
3/3
3/10
3/17
3/24
3/31
4/7
4/14
4/21
4/28
5/5
5/12
5/19
5/26
6/2
6/9
6/16
6/23
6/30
7/7
7/14
7/21
7/28
TeamPoints
Sprint Iteration
K12 Burndown
Content Verified / DONE QA Verified Complete / Business Verified Active Remaining
Release 1
Release 2 & 3
BVC’s
BVC’s
BVC’s
BVC’s
Working Software
Questions?

More Related Content

PPTX
QA in an Agile World for Agile and Beyond 2015
PPT
Agile QA presentation
PPTX
Agile QA: Redefining Quality in the Wild West
PPTX
QA in Agile World
PPT
Intro to Agile
PDF
Agile QA 2.0
PPTX
QA Best Practices in Agile World_new
PPTX
Scrum Testing
QA in an Agile World for Agile and Beyond 2015
Agile QA presentation
Agile QA: Redefining Quality in the Wild West
QA in Agile World
Intro to Agile
Agile QA 2.0
QA Best Practices in Agile World_new
Scrum Testing

What's hot (20)

PPTX
ScrumInTenSlides
PPT
Applying Quality to the Project and Product Management Process
PPTX
Scrum_BLR 10th meet up 13 sept-2014 - How to Measure Efficiency or Productivi...
PDF
Scrum_BLR 10th meet up 13 sept-2014 - Challenges of Transformation to Agile -...
PPT
Quality assurance activities in agile
PPTX
Agile basics
PDF
Agile Methodology - Agile Project Management Training
PDF
Agile Methodology
PPT
Two Things You Must Have for Lasting Agility
PPTX
Gwc agile and scrum
PPTX
Scrum in 5 slides
PPTX
Agile software development
PDF
Optimising Quality Assurance in an Agile World
PPT
Agile Engineering Practices
PPTX
Scrum rules
PDF
Scrum_BLR 10th meet up 13 sept-2014 - The Slippery Slope from Agile to Scrum ...
PDF
Agile Scrum CMMI
PDF
Scrum, A Brief Introduction
PPTX
Agile project management with scrum
PPT
Walls agile2013
ScrumInTenSlides
Applying Quality to the Project and Product Management Process
Scrum_BLR 10th meet up 13 sept-2014 - How to Measure Efficiency or Productivi...
Scrum_BLR 10th meet up 13 sept-2014 - Challenges of Transformation to Agile -...
Quality assurance activities in agile
Agile basics
Agile Methodology - Agile Project Management Training
Agile Methodology
Two Things You Must Have for Lasting Agility
Gwc agile and scrum
Scrum in 5 slides
Agile software development
Optimising Quality Assurance in an Agile World
Agile Engineering Practices
Scrum rules
Scrum_BLR 10th meet up 13 sept-2014 - The Slippery Slope from Agile to Scrum ...
Agile Scrum CMMI
Scrum, A Brief Introduction
Agile project management with scrum
Walls agile2013
Ad

Similar to QA in an agile world Tom Churchwell (20)

PPTX
Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...
PPTX
PTAQ L - Adam Makarowicz - The quality, or there and back again
PDF
We did it!!? There is place for QAs in Agile!!?
PPTX
QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...
PDF
Code campiasi qa-in-agile-projects-ana-figher-embarcadero
PDF
QA metrics in Agile (GUIDE)
PPTX
The quality, or there and back again
PDF
QA Role in Agile Teams
PDF
The Speed to Cool: Agile Testing & Building Quality In
PDF
Testing in Agile Development
PDF
Testers in an agile world
PPTX
Challenges with measuring quality for agile distributed research type project
PDF
JDD2014: QA to AQ: shifting from quality assurance to agile quality - Joseph ...
PPT
Qa In Agile
PPT
QA в Agile
PPTX
A Roadmap to Enterprise Quality
PPTX
Introduction to Agile Testing
PDF
White paper quality at the speed of digital
PDF
Quality culture transition guide model - full
PDF
Agile testing practice
Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...
PTAQ L - Adam Makarowicz - The quality, or there and back again
We did it!!? There is place for QAs in Agile!!?
QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...
Code campiasi qa-in-agile-projects-ana-figher-embarcadero
QA metrics in Agile (GUIDE)
The quality, or there and back again
QA Role in Agile Teams
The Speed to Cool: Agile Testing & Building Quality In
Testing in Agile Development
Testers in an agile world
Challenges with measuring quality for agile distributed research type project
JDD2014: QA to AQ: shifting from quality assurance to agile quality - Joseph ...
Qa In Agile
QA в Agile
A Roadmap to Enterprise Quality
Introduction to Agile Testing
White paper quality at the speed of digital
Quality culture transition guide model - full
Agile testing practice
Ad

Recently uploaded (20)

PDF
Navsoft: AI-Powered Business Solutions & Custom Software Development
PPTX
Transform Your Business with a Software ERP System
PDF
Tally Prime Crack Download New Version 5.1 [2025] (License Key Free
PPTX
Patient Appointment Booking in Odoo with online payment
PPTX
Operating system designcfffgfgggggggvggggggggg
PDF
Digital Systems & Binary Numbers (comprehensive )
PPTX
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
PDF
Download FL Studio Crack Latest version 2025 ?
PDF
Design an Analysis of Algorithms I-SECS-1021-03
PPTX
history of c programming in notes for students .pptx
PDF
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
PDF
Salesforce Agentforce AI Implementation.pdf
PPTX
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
PDF
Wondershare Filmora 15 Crack With Activation Key [2025
PDF
iTop VPN 6.5.0 Crack + License Key 2025 (Premium Version)
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
PDF
How to Make Money in the Metaverse_ Top Strategies for Beginners.pdf
PPTX
CHAPTER 2 - PM Management and IT Context
PDF
Nekopoi APK 2025 free lastest update
PPTX
Computer Software and OS of computer science of grade 11.pptx
Navsoft: AI-Powered Business Solutions & Custom Software Development
Transform Your Business with a Software ERP System
Tally Prime Crack Download New Version 5.1 [2025] (License Key Free
Patient Appointment Booking in Odoo with online payment
Operating system designcfffgfgggggggvggggggggg
Digital Systems & Binary Numbers (comprehensive )
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
Download FL Studio Crack Latest version 2025 ?
Design an Analysis of Algorithms I-SECS-1021-03
history of c programming in notes for students .pptx
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
Salesforce Agentforce AI Implementation.pdf
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
Wondershare Filmora 15 Crack With Activation Key [2025
iTop VPN 6.5.0 Crack + License Key 2025 (Premium Version)
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
How to Make Money in the Metaverse_ Top Strategies for Beginners.pdf
CHAPTER 2 - PM Management and IT Context
Nekopoi APK 2025 free lastest update
Computer Software and OS of computer science of grade 11.pptx

QA in an agile world Tom Churchwell

  • 1. QA in and Agile World Tom Churchwell TChurchwell@GMail.com
  • 2. Agenda 2  Survey  Exercise 1  Agile vs. Traditional  Effect of Test Driving  Testing Pyramid  Exercise 2  Q&A
  • 3. Quick Survey 3  How many QA folks are focused on testing?  Who owns Quality?  Who owns improvement?
  • 4. What is different? 4  Old Focus  No Defects ◦ By Requirements  Comprehensive Testing ◦ Slow ◦ Manual  Integration at the End of Dev  Quality Tested In  No Defects ◦ By PO Demo  Fast ◦ Automated Testing ◦ Continuous Integration  Clean Code ◦ Modular  Quality Built In
  • 5. Manifesto for Agile Software Development We are uncovering better ways of developing software by doing it and helping others do it. Through this work we have come to value: • Individuals and interactions over processes and tools • Working software over comprehensive documentation • Customer collaboration over contract negotiation • Responding to change over following a plan That is, while there is value in the items on the right, we value the items on the left more.
  • 6. Working Software 6  Quality Assurance is all about working software.  Quality Standards  Confidence in the codebase is the key to sente; having choices, momentum, velocity, autonomy, adaptability, competitive advantage and the inherent propensity for innovation and luck.
  • 7. Exercise 1 7 What does a traditional QA do that an Agile QA does not do? What skills does an agile QA need that a traditional QA does not? Report Outs…
  • 8. Cultural Environmental Practical Collaborative Big & Visible Perpetual Buzz Food Thorough Courageous Adaptable Forthright FUN TDD Quality Standards Iterative Development Business Verification
  • 9. Whole Team Ownership  Quality as a fundamental ongoing concern for the team ◦ Not just at the end of a release ◦ Meeting quality standards has become a part of the “Definition of Done” for the whole team  An Integrated Team Focus ◦ QA throughout development  Elimination of QA as a sequential process ◦ Whole Team collaboration from beginning to end ◦ Teams take ownership  Definition of Done  Quality Standards  Level of quality being produced every day  Business Verification ◦ Weekly verification demo ◦ Product Owner Drives the Demo
  • 10. 10
  • 12. Bake Quality In… We Cannot Improve Our Recipe’s By Eating More Cookies… We Must Bake, Rather Than Try To Test Quality In!
  • 13. Whole Team Ownership of Quality  Historically QA has been: ◦ An event that occurs after development is done  Point in time validation rather than an ongoing standard for quality  Verification before production launch ◦ Held by QA  Not part of “Definition of Done” for the team  Not part of what every member of the team was committed to uphold. ◦ Part of a rigid sequential process  At the end of development  An event rather than an ongoing concern
  • 14. Definition Of Done 14 Build it RIGHT -- “Done” • Quality Metrics Passed • Unit test coverage at or above 80% overall • Cyclomatic Complexity 1-3 • Fewer Than 10 Statements per Method • Integration tests created and successfully passed for each external dependency (minimum one per dependency) • Deploy scripts updated for deployment to DevInt and QA. • Functional tests pass in DevInt or preferably QA • Functional tests automated (Selenium, Fitnesse or other) • Single user execution against functional timing SLA passed for each story. • Business verified by product owner OR technical lead/architect if technical card. • Exploratory Testing Complete
  • 15. Definition Of Done 15 “Production Ready” -- “Done” – Done • Performance testing executed and passed. • Production-level content successfully integrated and tested • Accessibility & Usability Tested • Full browser testing for all specified browsers and versions
  • 19. Working Software Environment 19  Source Code Management
  • 21. Environment 21  Pairing Stations  Source Code Management  Continuous Integration
  • 22. Environment 22  Pairing Stations  Source Code Management  Continuous Integration
  • 23. Building Work Software 23  Code Check Out  Source Code Management
  • 24. Building Work Software 24  Code Development  Source Code Management
  • 25. Building Work Software 25  Coding Pair  Source Code Management  Code Check-In  Continuous Integration
  • 29. • Project Concerns – Tight Schedules – Maintaining “High Quality” despite changes – Responsiveness to customer needs • Project Situations – Don’t know all of what is needed at onset of project • ONLY Commit for the “Known's” – Requirements Change During the Project • Accommodate change with later releases • Value to the Customer – Give customers regular functionality reviews – Realizing Value often rather than “big bang” Accommodates Multiple Challenges
  • 30. • Project Concerns – Burn-Down Chart – Burn-Up Charts • Practices – Consistency Allows Ease of Spool Up – Allows Migration of Team Members • Tools – Consistency Allows Ease Migration of Team Members • Quality – Defects – Components Big Visible Charts
  • 31. Burnup ChartsBurning Up Tasks Burnup 0 20 40 60 80 100 120 140 160 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 En d WorkingDays TaskHours Burnup Total Linear (Burnup) Linear (Total) 31
  • 32. 32 1026 1013 982 951 924 913 879 847 798 742 695 16 13 31 31 27 32 34 45 16 23 34 40 43 53 62 66 90 72 61 70 93 120 53 62 62 67 90 102 138 173 189 200 223 150 160 180 190 198 198 143 150 180 184 196.5 0 50 100 150 200 250 300 350 400 450 500 550 600 650 700 750 800 850 900 950 1000 1050 1100 1150 1200 1250 1300 1350 1400 1450 2/3 2/10 2/17 2/24 3/3 3/10 3/17 3/24 3/31 4/7 4/14 4/21 4/28 5/5 5/12 5/19 5/26 6/2 6/9 6/16 6/23 6/30 7/7 7/14 7/21 7/28 TeamPoints Sprint Iteration K12 Burndown Content Verified / DONE QA Verified Complete / Business Verified Active Remaining Release 1 Release 2 & 3 BVC’s