Pitfalls in
                                                     Agile Testing
                                                      and How to
                                                      Avoid Them


                            by Paul Carvalho
                          Agile 2012, Dallas, Texas
                                August 2012
  @can_test                      http://STAQS.com/             Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


                      Pitfall #1: Agile Testing
     •    There is no Agile Testing
     •    There is testing you do on an agile team
     •    You can be agile when testing
     •    It is Agile Software Development and there
          are many testing activities you may
          choose to do
     • You are not Agile Testers,
       You are Agile Developers.

  @can_test                                          Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


                          Pitfall #2: Not Agile      Organisation
                                                     Team
                                                     Individual

     •    Mini-waterfall                              Symptom:
                                                      Are testers
     •    Separation of roles, no collaboration       included in
                                                      planning
                                                       sessions?
     •    Focus on Process and Tools
     •    Stories not “done” at end of sprints
                               Story
     • Done                    Sprint
                               Release




  @can_test                                              Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


                          Pitfall #3: Not Testing
     • Checking vs. Testing - Effort vs. value?
     • Symptom: detailed test cases with expected
       results                                                                           “Only”
                                                                         Testing         Manual
                                                                 SUT
                                                                          Effort         Testing
              What is               Oracles
              Quality?                      Models, Techniques
       Constraints            Testing
         (Time, $)                            Tools

                          Env’t         Context,                 Where is the
                                        Information              customer needs in
                                                                 this Venn diagram?
     Some Traps:
                                                                 (where does the
     • Forgetting the big picture                                 3rd circle go?)
     • Inattentional blindness
     • Communication barriers, silos
          (e.g. not allowed to talk to P.O. or customer)

  @can_test                                                                           Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


                          Pitfall #4: Automation
     •    Software not designed for Testability
     •    Developers don’t automate unit tests
     •    Automated tests not maintained - failed tests ignored?
     •    Automation Frameworks - may be a trap: evolve them!
     •    Computers are blind:


                    Input                   Output
                              SUT




  @can_test                                              Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


                     Pitfall #5: Types of Testing
     • Traditional idea:
                        • Unit, Integration, System, Acceptance
                        Naïve, Waterfall-view
     Perform the Tests that Provide VALUE




              (Agile Testing Quadrants from Brian Marick)




                                                            (Test pyramid from Janet Gregory)

  @can_test                                                                                     Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


                     Getting Past The Traps
         Let’s dive deeper into these pitfalls and
         come up with ideas to get around or
         through them




  @can_test                                          Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


              Bonus Pitfall: Exercise (1/3)
     • You will need:
                 • 1 piece of paper
                 • Pens, pencils, markers, crayons, lipstick, charcoal, whatever..
     • Task: Create a Map - to your favourite store/shop
                            As a fan of this store
                            I want to create a map
                            So that I can show someone how to get
                            there (to buy me something I like) 

     • When done:
                 • Put your Name and Date on the back (i.e., code check-in)
                 • Place it upside-down in the centre of the table


  @can_test                        (Exercise © Paul Carvalho - please attribute)     Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


              Bonus Pitfall: Exercise (2/3)
     Testing Phase
     • Test Strategy: Personas
                 • Work as a group, and record on a flip chart
                 • Create 6 different personas for people who like to travel
                 • For each persona, identify:
                           » Mode of transport - be specific! (e.g. Bicycle, Tandem)
                           » Person’s name
                           » Person’s job, or main hobby

     • Evaluate Maps according to Personas
                 • Select a map (NOT yours!)
                 • Mark the map with a  or  for each persona tested
                 • Return the map to the owner when testing is complete

  @can_test                        (Exercise © Paul Carvalho - please attribute)   Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


              Bonus Pitfall: Exercise (3/3)


                     Q: What is the final Pitfall here?

                    Q: What are some ways to avoid
                     negative feelings and results?



  @can_test                        (Exercise © Paul Carvalho - please attribute)   Agile 2012
Monday, August 13, 2012
Pitfalls in Agile Testing and How to Avoid Them


                                    Questions?


                    If you have any additional questions,
                                 please ask:

                          Email: Paul -at- STAQS.com
                                http://staqs.com
                                      Twitter: @can_test




  @can_test                                                 Agile 2012
Monday, August 13, 2012

More Related Content

PDF
User testing presentation
PDF
The Art of Questioning to improve Software Testing, Agile and Automating
PDF
Agile Career Development from the trenches - XP 2013 Vienna
PDF
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
PPTX
Refactoring (the brain) for developers
PDF
No product to test yet? No problem. By Irja Straus @ WebCamp 2019 (Zagreb)
PDF
The what, when, why and how of usability
PDF
Creating Maintainable Automated Acceptance Tests
User testing presentation
The Art of Questioning to improve Software Testing, Agile and Automating
Agile Career Development from the trenches - XP 2013 Vienna
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
Refactoring (the brain) for developers
No product to test yet? No problem. By Irja Straus @ WebCamp 2019 (Zagreb)
The what, when, why and how of usability
Creating Maintainable Automated Acceptance Tests

Similar to Agile 2012 pitfalls in agile testing - paul carvalho (20)

PPTX
Testing in the Wild
PPTX
Agile testing for mere mortals
PDF
Swiss Testing Day - Testautomation, 10 (sometimes painful) lessons learned
PDF
Agile process
PDF
Tester Challenges in Agile ?
PPTX
10+ Testing Pitfalls and How to Avoid them
PDF
Agile 2012 the 0-page agile test plan - paul carvalho
PDF
James Lyndsay - Testing in an agile environment
PDF
How To Test With Agility
PPT
PDF
Manoj Kolhe - Testing in Agile Environment
PDF
Why agile testing isn't working
PPT
Agile testing
PDF
Software testing agile_environment_wp
PDF
Establishing an Agile Testing Culture
PPTX
Agile Testing: The Role Of The Agile Tester
PPT
A confused tester in agile world finalversion
PDF
10 Lessons learned in test automation
PDF
Agile Pathologies: Backyards of Agile Shops
PDF
Agile pathologies
Testing in the Wild
Agile testing for mere mortals
Swiss Testing Day - Testautomation, 10 (sometimes painful) lessons learned
Agile process
Tester Challenges in Agile ?
10+ Testing Pitfalls and How to Avoid them
Agile 2012 the 0-page agile test plan - paul carvalho
James Lyndsay - Testing in an agile environment
How To Test With Agility
Manoj Kolhe - Testing in Agile Environment
Why agile testing isn't working
Agile testing
Software testing agile_environment_wp
Establishing an Agile Testing Culture
Agile Testing: The Role Of The Agile Tester
A confused tester in agile world finalversion
10 Lessons learned in test automation
Agile Pathologies: Backyards of Agile Shops
Agile pathologies
Ad

More from drewz lin (20)

PPTX
Web security-–-everything-we-know-is-wrong-eoin-keary
PDF
Via forensics appsecusa-nov-2013
PPTX
Phu appsec13
PPTX
Owasp2013 johannesullrich
PDF
Owasp advanced mobile-application-code-review-techniques-v0.2
PPTX
I mas appsecusa-nov13-v2
PDF
Defeating xss-and-xsrf-with-my faces-frameworks-steve-wolf
ODP
Csrf not-all-defenses-are-created-equal
PPTX
Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21
PPTX
Appsec usa roberthansen
PDF
Appsec usa2013 js_libinsecurity_stefanodipaola
PPT
Appsec2013 presentation-dickson final-with_all_final_edits
PPTX
Appsec2013 presentation
PPTX
Appsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitations
PPTX
Appsec2013 assurance tagging-robert martin
PPTX
Amol scadaowasp
PPTX
Agile sdlc-v1.1-owasp-app sec-usa
PPTX
Vulnex app secusa2013
PDF
基于虚拟化技术的分布式软件测试框架
PPTX
新浪微博稳定性经验谈
Web security-–-everything-we-know-is-wrong-eoin-keary
Via forensics appsecusa-nov-2013
Phu appsec13
Owasp2013 johannesullrich
Owasp advanced mobile-application-code-review-techniques-v0.2
I mas appsecusa-nov13-v2
Defeating xss-and-xsrf-with-my faces-frameworks-steve-wolf
Csrf not-all-defenses-are-created-equal
Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21
Appsec usa roberthansen
Appsec usa2013 js_libinsecurity_stefanodipaola
Appsec2013 presentation-dickson final-with_all_final_edits
Appsec2013 presentation
Appsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitations
Appsec2013 assurance tagging-robert martin
Amol scadaowasp
Agile sdlc-v1.1-owasp-app sec-usa
Vulnex app secusa2013
基于虚拟化技术的分布式软件测试框架
新浪微博稳定性经验谈
Ad

Agile 2012 pitfalls in agile testing - paul carvalho

  • 1. Pitfalls in Agile Testing and How to Avoid Them by Paul Carvalho Agile 2012, Dallas, Texas August 2012 @can_test http://STAQS.com/ Agile 2012 Monday, August 13, 2012
  • 2. Pitfalls in Agile Testing and How to Avoid Them Pitfall #1: Agile Testing • There is no Agile Testing • There is testing you do on an agile team • You can be agile when testing • It is Agile Software Development and there are many testing activities you may choose to do • You are not Agile Testers, You are Agile Developers. @can_test Agile 2012 Monday, August 13, 2012
  • 3. Pitfalls in Agile Testing and How to Avoid Them Pitfall #2: Not Agile Organisation Team Individual • Mini-waterfall Symptom: Are testers • Separation of roles, no collaboration included in planning sessions? • Focus on Process and Tools • Stories not “done” at end of sprints Story • Done Sprint Release @can_test Agile 2012 Monday, August 13, 2012
  • 4. Pitfalls in Agile Testing and How to Avoid Them Pitfall #3: Not Testing • Checking vs. Testing - Effort vs. value? • Symptom: detailed test cases with expected results “Only” Testing Manual SUT Effort Testing What is Oracles Quality? Models, Techniques Constraints Testing (Time, $) Tools Env’t Context, Where is the Information customer needs in this Venn diagram? Some Traps: (where does the • Forgetting the big picture 3rd circle go?) • Inattentional blindness • Communication barriers, silos (e.g. not allowed to talk to P.O. or customer) @can_test Agile 2012 Monday, August 13, 2012
  • 5. Pitfalls in Agile Testing and How to Avoid Them Pitfall #4: Automation • Software not designed for Testability • Developers don’t automate unit tests • Automated tests not maintained - failed tests ignored? • Automation Frameworks - may be a trap: evolve them! • Computers are blind: Input Output SUT @can_test Agile 2012 Monday, August 13, 2012
  • 6. Pitfalls in Agile Testing and How to Avoid Them Pitfall #5: Types of Testing • Traditional idea: • Unit, Integration, System, Acceptance Naïve, Waterfall-view Perform the Tests that Provide VALUE (Agile Testing Quadrants from Brian Marick) (Test pyramid from Janet Gregory) @can_test Agile 2012 Monday, August 13, 2012
  • 7. Pitfalls in Agile Testing and How to Avoid Them Getting Past The Traps Let’s dive deeper into these pitfalls and come up with ideas to get around or through them @can_test Agile 2012 Monday, August 13, 2012
  • 8. Pitfalls in Agile Testing and How to Avoid Them Bonus Pitfall: Exercise (1/3) • You will need: • 1 piece of paper • Pens, pencils, markers, crayons, lipstick, charcoal, whatever.. • Task: Create a Map - to your favourite store/shop As a fan of this store I want to create a map So that I can show someone how to get there (to buy me something I like)  • When done: • Put your Name and Date on the back (i.e., code check-in) • Place it upside-down in the centre of the table @can_test (Exercise © Paul Carvalho - please attribute) Agile 2012 Monday, August 13, 2012
  • 9. Pitfalls in Agile Testing and How to Avoid Them Bonus Pitfall: Exercise (2/3) Testing Phase • Test Strategy: Personas • Work as a group, and record on a flip chart • Create 6 different personas for people who like to travel • For each persona, identify: » Mode of transport - be specific! (e.g. Bicycle, Tandem) » Person’s name » Person’s job, or main hobby • Evaluate Maps according to Personas • Select a map (NOT yours!) • Mark the map with a  or  for each persona tested • Return the map to the owner when testing is complete @can_test (Exercise © Paul Carvalho - please attribute) Agile 2012 Monday, August 13, 2012
  • 10. Pitfalls in Agile Testing and How to Avoid Them Bonus Pitfall: Exercise (3/3) Q: What is the final Pitfall here? Q: What are some ways to avoid negative feelings and results? @can_test (Exercise © Paul Carvalho - please attribute) Agile 2012 Monday, August 13, 2012
  • 11. Pitfalls in Agile Testing and How to Avoid Them Questions? If you have any additional questions, please ask: Email: Paul -at- STAQS.com http://staqs.com Twitter: @can_test @can_test Agile 2012 Monday, August 13, 2012