SlideShare a Scribd company logo
How to Brew a Tasty
                                Agile Test Strategy?

                                Agile Development/Testing and
                                  Brewing/Kitchen Analogies




                                                         Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Nice Cookbooks




                                                Alex Schwartz
Sonntag, 10. Oktober 2010 KW
In our agile pantry..
                                                               contains many...

                                                               • books
                                                               • ingredients
                                                               • tools
                                                               • cookbooks
                                                               • restaurants
                                                               • styles
                www.flickr.com/photos/52192754@N00/220946716/


                                                                          Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Why Cooking/Brewing Analogy?

                               • Examples     can help

                               • Analogies from a different (known)
                                 context can help

                               • It’s   fun




                                                                      Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Analogy #1: The Definition of Done (DoD) in a Kitchen

     Assume a professional cook in a
     restaurant kitchen is asked to
     create a nice meal for a customer.                                NO
     When it’s DONE?




                       www.flickr.com/photos/28549294@N05/4273275734        Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Analogy #1: The Definition of Done (DoD) in a Kitchen

     Assume a professional cook in a
     restaurant kitchen is asked to
     create a nice meal for a customer.                                                                  YES
     When it’s DONE?




                          http://www.flickr.com/photos/28549294@N05/4273275734/sizes/l/in/photostream/
                                                                                                          Alex Schwartz
Sonntag, 10. Oktober 2010 KW
What we find in a cookbook
       • Ingredients

       • Techniques

       • Tools

       • Mindset

       • Skills

       • Recipes



                                       Alex Schwartz
Sonntag, 10. Oktober 2010 KW
What we find in a cookbook
                               This talk....
       • Ingredients
                                                  (META-)Recipes to create
       • Techniques                               a Test Strategy
                                                                 p    les
                                                               am en
       • Tools                                             ex ch
                                                          e kit
                                                        om u r
                                                       s o
       • Mindset                                  ith m
                                                 w ro
                                                     f
       • Skills                          recipe                  recipe

       • Recipes                               Spikes into
                                               details



                                                                             Alex Schwartz
Sonntag, 10. Oktober 2010 KW
La Cuisine
    • mobile.de                  - e-Commerce, selling vehicles
    • belongs                  to eBay Classifieds Group
    • Marketplaces
            France, Italy, Poland and Romania




                                                                  Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Our Agile Transition

                        •first Scrum pilot project 3.5 years ago
                        •3 years Scrum with multiple teams
                           - 70+ people
                           - 6+ teams, 2 distributed teams
                           - parallel development on same product
                        •1.5 million LoC
                        •1 year Kanban for maintenance


                                                                    Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Votré chef de cusine
          • programming                background (20 years)
          • Agile              from 2004, Scrum Master
          • my          current role:
                               Team Lead “Engineering Support Group”
                                supporting agile project teams with...
                                 - Release Management
                                 - Test Automation
             tic
          lis




                                 - Build Management
        ho




                                 - Tools
                                 - Configuration Management


                                                                         Alex Schwartz
Sonntag, 10. Oktober 2010 KW
What I mean by “Agile Test Strategy”?
    • What                 to test? What not to test?

    • Which                    kinds of tests?
         - Test categories / taxonomy
         - Tools

    • When                     to test (what)?

    • How                to introduce/improve?

                                                        Alex Schwartz
Sonntag, 10. Oktober 2010 KW
The Recipe

                               • Which    kind of restaurant?

                               • Get   to know your craft
                               • Try   to use ... adapt & learn




                                                                  Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Step 1: What kind of restaurant?


                  - Who   are your clients?
                  - Your style?               Quality is a business
                                                 requirement
                  - Competitors, market?
                  - Your team




                                                             Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Step 2: Get to know your craft...

                               • Ingredients

                               • Tools

                               • Techniques

                               • Principles




                                               Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Principle: Visibility




     www.flickr.com/photos/shannonsturgis/4274202367    Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Principle: Care about your tools



          Sharpen your knifes.


www.flickr.com/photos/st3f4n/3641653927




                                                  Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Principle: Care about your tools



          Sharpen your knifes.


www.flickr.com/photos/st3f4n/3641653927




                                                  Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Principle: Whole team approach


                          •... not   very kitchen-like?




                                                          Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Question: Use instant ingredients or not?




  www.flickr.com/photos/vegetarian/2292620706
                                               Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Example from our kitchen: Principles

         • Early feedback

         • From risk to test
                           strategy


       • Test as low as
                         possible

                                              Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Recipe: From Risk to Test
  Criteria                           Test Automation ROI Radar Chart
  • Incident prio                                      Incident prio
                                                       What is the prio of a
  • Change frequency                                    possible incident?
  • Bug density
  • Overhead for manual         Overhead of
                                                                high
                                                                                  Bug density
    tests                       manual test                                high   How many bugs in
                                                                                  the past?
                                              high
  • Complexity of
    requirements
  • Maintenance overhead                                                          Change frequency
    for automated tests
                                 Maintenance     low                     often

                                overhead for                    high               How many changes in the
  • Known domain                                                                          future?
                               automated tests
                                                       Complexity
                                                 How complicated is the
                                                       feature?


                                                                                             Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Ingedients - Test Categorization / Taxonomy
                                                                      Overhead / Complexity




                                                               .



                                    Source:
                                    Lisa Crispin & Janet Gregory
                                    Agile Testing: A Practical Guide for Testers and Agile Teams



                                                                                            Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Ingedients - Test Categorization / Taxonomy




                                                               .



                                    Source:
                                    Lisa Crispin & Janet Gregory
                                    Agile Testing: A Practical Guide for Testers and Agile Teams



                                                                                            Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Recipe: The “Tetris Principle” - Test as low as possible
                      Story: As a customer I can contact the seller of an interesting ad.




             Risk/aspect 1               Risk/aspect            Risk/aspect:              Risk/aspect:
             Mail is not sent           Layout of mail          Wrong mail            Javascript problem
              due to config                is crap               language               in contact form
               problems




                  Story Test / UI                                                           Story Test / UI
                   (Integration)                                                              (Browser)




                                                                 Story test
                                                                 below UI




            automated tests


            no automated tests




                                        Manual tests

                                                                                                              Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Analogy #2: QA or When do you flip a pancake?


                                          Robert “Uncle Bob” Martin
                                          thecleancoder.blogspot.com/2010/08/
                                             qa-or-when-do-you-flip-pancake.html




    www.flickr.com/ /mrlerone/106039369/
                               photos




                                                                   Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Test
      Automation

                               Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Goal: A happy kitchen crew




                               www.flickr.com/photos/fractalv/1341923133
                                                                    Alex Schwartz
Sonntag, 10. Oktober 2010 KW
Thanks for
                               your attention.




                                                 Alex Schwartz
Sonntag, 10. Oktober 2010 KW

More Related Content

PPTX
Agile Testing Strategy
PDF
Why a Mobile Test Strategy is just Test Strategy
PDF
Building an Effective International Software QA Test Strategy
PPTX
Testing strategy for agile projects updated
PPTX
The Three Pillars Approach to Your Agile Test Strategy
PDF
Agile 2012 the 0-page agile test plan - paul carvalho
PDF
Practical Test Strategy Using Heuristics
PPTX
Test Strategy
Agile Testing Strategy
Why a Mobile Test Strategy is just Test Strategy
Building an Effective International Software QA Test Strategy
Testing strategy for agile projects updated
The Three Pillars Approach to Your Agile Test Strategy
Agile 2012 the 0-page agile test plan - paul carvalho
Practical Test Strategy Using Heuristics
Test Strategy

Viewers also liked (16)

PPTX
Designing Agile Test Strategy for Mobile Apps By Parimala Hariprasad
PPTX
Agile tour ncr test360_degree - agile testing on steroids
PDF
Building a Test Automation Strategy for Success
PPT
Jarian van de Laar - Test Policy - Test Strategy
PPT
AJRA Test Strategy Discussion
PPTX
Agile Testing by Example
PDF
Enough is not enough - Test Strategy for Mobile
PPT
Agile Testing Process
PDF
Introduction to Agile software testing
PDF
Agile QA Process
PDF
Kravspec best brains 4. okt. 2012
PDF
Psykologien i agile teams
PDF
Essentielle agile værktøjer
PDF
Det er svært at spå – især om fremtiden! Et berømt citat fra Storm P. – og al...
PDF
Switch -den_agile_omstilling
PPTX
Test af driftsplatform af Vibeke Kvist, KMD A/S
Designing Agile Test Strategy for Mobile Apps By Parimala Hariprasad
Agile tour ncr test360_degree - agile testing on steroids
Building a Test Automation Strategy for Success
Jarian van de Laar - Test Policy - Test Strategy
AJRA Test Strategy Discussion
Agile Testing by Example
Enough is not enough - Test Strategy for Mobile
Agile Testing Process
Introduction to Agile software testing
Agile QA Process
Kravspec best brains 4. okt. 2012
Psykologien i agile teams
Essentielle agile værktøjer
Det er svært at spå – især om fremtiden! Et berømt citat fra Storm P. – og al...
Switch -den_agile_omstilling
Test af driftsplatform af Vibeke Kvist, KMD A/S
Ad

Similar to How to brew a tasty agile test strategy (20)

PDF
Saasu Conference: Service Design
PDF
Conceptbakery - Agency Introduction (extended version)
PDF
Socially cooked software
PPTX
Windows phone 8 wave guide montreal code camp intro to microsoft's modern u...
PPTX
RecipEase website demo
PDF
The master chef lesson. Luz De-León
PDF
UX for ecommerce: A masterchef lesson
PDF
digital gastronomy: culinary + mobile culture
PDF
Cem planning
PDF
Extraction of Adaptation Knowledge from Internet Communities
DOCX
Kto12 tle home economics lm-commercial cooking
PDF
El catálogo IKEA 2017, proceso creativo- IKEA
PDF
May2010 cq53-worldwide-tour
PDF
PDF
Alistpitch
PDF
TM Italia Business Design
PDF
Ikea in the kitchen final
PDF
Николас Йонссон – IKEA
PDF
Breville
PDF
BR-ND Kitchen Presentation
Saasu Conference: Service Design
Conceptbakery - Agency Introduction (extended version)
Socially cooked software
Windows phone 8 wave guide montreal code camp intro to microsoft's modern u...
RecipEase website demo
The master chef lesson. Luz De-León
UX for ecommerce: A masterchef lesson
digital gastronomy: culinary + mobile culture
Cem planning
Extraction of Adaptation Knowledge from Internet Communities
Kto12 tle home economics lm-commercial cooking
El catálogo IKEA 2017, proceso creativo- IKEA
May2010 cq53-worldwide-tour
Alistpitch
TM Italia Business Design
Ikea in the kitchen final
Николас Йонссон – IKEA
Breville
BR-ND Kitchen Presentation
Ad

More from Dr. Alexander Schwartz (20)

PDF
Qconf 2025 - Testing Tomorrow: Doing the right things at the right price
PPT
Wrestling with Conway's Law: How to support cross-functional teams working on...
PDF
#AT16VIE: Does Agile mean we have no time for testing?
PDF
Does agile mean having even less time for testing?!
PDF
User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)
PDF
Hilfe, wir haben keine Zeit zum Testen!
PPTX
Change Dojo - Agile Testing Days 2015
PDF
ScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneiden
PDF
Insights From Happy Change Agents
PDF
Ein neues Dojo: Anwendergeschichten zerschneiden
PPTX
A New Dojo: The Art of Story Splitting
PDF
DevOps in the Enterprise: Our Experiences at HERE/Nokia
PDF
Wie verändert sich Testen mit Continuous Delivery?
PDF
What is Agile Testing?
PDF
Ripening of a RESTful API
PDF
Help, we have no more time for testing! (gotoCon Berlin 2013)
PDF
AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...
PPTX
Ignite Talk: Help, we have no more time for testing!
PDF
How releasing faster changes testing
PDF
How to Introduce Continuous Delivery
Qconf 2025 - Testing Tomorrow: Doing the right things at the right price
Wrestling with Conway's Law: How to support cross-functional teams working on...
#AT16VIE: Does Agile mean we have no time for testing?
Does agile mean having even less time for testing?!
User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)
Hilfe, wir haben keine Zeit zum Testen!
Change Dojo - Agile Testing Days 2015
ScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneiden
Insights From Happy Change Agents
Ein neues Dojo: Anwendergeschichten zerschneiden
A New Dojo: The Art of Story Splitting
DevOps in the Enterprise: Our Experiences at HERE/Nokia
Wie verändert sich Testen mit Continuous Delivery?
What is Agile Testing?
Ripening of a RESTful API
Help, we have no more time for testing! (gotoCon Berlin 2013)
AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...
Ignite Talk: Help, we have no more time for testing!
How releasing faster changes testing
How to Introduce Continuous Delivery

Recently uploaded (20)

PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
GamePlan Trading System Review: Professional Trader's Honest Take
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Advanced Soft Computing BINUS July 2025.pdf
PDF
cuic standard and advanced reporting.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
Cloud computing and distributed systems.
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPT
Teaching material agriculture food technology
PDF
Approach and Philosophy of On baking technology
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Per capita expenditure prediction using model stacking based on satellite ima...
Spectral efficient network and resource selection model in 5G networks
GamePlan Trading System Review: Professional Trader's Honest Take
Advanced methodologies resolving dimensionality complications for autism neur...
Network Security Unit 5.pdf for BCA BBA.
Dropbox Q2 2025 Financial Results & Investor Presentation
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Advanced Soft Computing BINUS July 2025.pdf
cuic standard and advanced reporting.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Understanding_Digital_Forensics_Presentation.pptx
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Cloud computing and distributed systems.
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
20250228 LYD VKU AI Blended-Learning.pptx
Teaching material agriculture food technology
Approach and Philosophy of On baking technology
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows

How to brew a tasty agile test strategy

  • 1. How to Brew a Tasty Agile Test Strategy? Agile Development/Testing and Brewing/Kitchen Analogies Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 2. Nice Cookbooks Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 3. In our agile pantry.. contains many... • books • ingredients • tools • cookbooks • restaurants • styles www.flickr.com/photos/52192754@N00/220946716/ Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 4. Why Cooking/Brewing Analogy? • Examples can help • Analogies from a different (known) context can help • It’s fun Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 5. Analogy #1: The Definition of Done (DoD) in a Kitchen Assume a professional cook in a restaurant kitchen is asked to create a nice meal for a customer. NO When it’s DONE? www.flickr.com/photos/28549294@N05/4273275734 Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 6. Analogy #1: The Definition of Done (DoD) in a Kitchen Assume a professional cook in a restaurant kitchen is asked to create a nice meal for a customer. YES When it’s DONE? http://www.flickr.com/photos/28549294@N05/4273275734/sizes/l/in/photostream/ Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 7. What we find in a cookbook • Ingredients • Techniques • Tools • Mindset • Skills • Recipes Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 8. What we find in a cookbook This talk.... • Ingredients (META-)Recipes to create • Techniques a Test Strategy p les am en • Tools ex ch e kit om u r s o • Mindset ith m w ro f • Skills recipe recipe • Recipes Spikes into details Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 9. La Cuisine • mobile.de - e-Commerce, selling vehicles • belongs to eBay Classifieds Group • Marketplaces France, Italy, Poland and Romania Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 10. Our Agile Transition •first Scrum pilot project 3.5 years ago •3 years Scrum with multiple teams - 70+ people - 6+ teams, 2 distributed teams - parallel development on same product •1.5 million LoC •1 year Kanban for maintenance Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 11. Votré chef de cusine • programming background (20 years) • Agile from 2004, Scrum Master • my current role: Team Lead “Engineering Support Group” supporting agile project teams with... - Release Management - Test Automation tic lis - Build Management ho - Tools - Configuration Management Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 12. What I mean by “Agile Test Strategy”? • What to test? What not to test? • Which kinds of tests? - Test categories / taxonomy - Tools • When to test (what)? • How to introduce/improve? Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 13. The Recipe • Which kind of restaurant? • Get to know your craft • Try to use ... adapt & learn Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 14. Step 1: What kind of restaurant? - Who are your clients? - Your style? Quality is a business requirement - Competitors, market? - Your team Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 15. Step 2: Get to know your craft... • Ingredients • Tools • Techniques • Principles Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 16. Principle: Visibility www.flickr.com/photos/shannonsturgis/4274202367 Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 17. Principle: Care about your tools Sharpen your knifes. www.flickr.com/photos/st3f4n/3641653927 Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 18. Principle: Care about your tools Sharpen your knifes. www.flickr.com/photos/st3f4n/3641653927 Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 19. Principle: Whole team approach •... not very kitchen-like? Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 20. Question: Use instant ingredients or not? www.flickr.com/photos/vegetarian/2292620706 Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 21. Example from our kitchen: Principles • Early feedback • From risk to test strategy • Test as low as possible Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 22. Recipe: From Risk to Test Criteria Test Automation ROI Radar Chart • Incident prio Incident prio What is the prio of a • Change frequency possible incident? • Bug density • Overhead for manual Overhead of high Bug density tests manual test high How many bugs in the past? high • Complexity of requirements • Maintenance overhead Change frequency for automated tests Maintenance low often overhead for high How many changes in the • Known domain future? automated tests Complexity How complicated is the feature? Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 23. Ingedients - Test Categorization / Taxonomy Overhead / Complexity . Source: Lisa Crispin & Janet Gregory Agile Testing: A Practical Guide for Testers and Agile Teams Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 24. Ingedients - Test Categorization / Taxonomy . Source: Lisa Crispin & Janet Gregory Agile Testing: A Practical Guide for Testers and Agile Teams Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 25. Recipe: The “Tetris Principle” - Test as low as possible Story: As a customer I can contact the seller of an interesting ad. Risk/aspect 1 Risk/aspect Risk/aspect: Risk/aspect: Mail is not sent Layout of mail Wrong mail Javascript problem due to config is crap language in contact form problems Story Test / UI Story Test / UI (Integration) (Browser) Story test below UI automated tests no automated tests Manual tests Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 26. Analogy #2: QA or When do you flip a pancake? Robert “Uncle Bob” Martin thecleancoder.blogspot.com/2010/08/ qa-or-when-do-you-flip-pancake.html www.flickr.com/ /mrlerone/106039369/ photos Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 27. Test Automation Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 28. Goal: A happy kitchen crew www.flickr.com/photos/fractalv/1341923133 Alex Schwartz Sonntag, 10. Oktober 2010 KW
  • 29. Thanks for your attention. Alex Schwartz Sonntag, 10. Oktober 2010 KW