SlideShare a Scribd company logo
Testing in an agile
                              environment
                             James Lyndsay, Workroom Productions




                                                                       Testing in an Agile Environment
                                                                       © Workroom Productions 2008
SoftTest June 2008                                                     www.workroom-productions.com




                                  Agility (agility)
      Manifesto for Agile Software Development                                         Kent Beck
                                                                                      Mike Beedle
                                                                                  Arie van Bennekum
                     We are uncovering better ways of developing                   Alistair Cockburn
                     software by doing it and helping others do it.               Ward Cunningham
                      Through this work we have come to value:                       Martin Fowler
                                                                                   James Grenning
                                                                                     Jim Highsmith
   Individuals and interactions over processes and tools                             Andrew Hunt
                                                                                       Ron Jeffries
    Working software over comprehensive documentation                                   Jon Kern
                                                                                      Brian Marick
     Customer collaboration over contract negotiation                              Robert C. Martin
                                                                                      Steve Mellor
       Responding to change over following a plan                                    Ken Schwaber
                                                                                    Jeff Sutherland
                       That is, while there is value in the items on                  Dave Thomas
                     the right, we value the items on the left more.
                                                                                        © 2001, the above authors
                                                                                 this declaration may be freely copied in
                                                                                 any form, but only in its entirety through
                                                                                                this notice.
                                                                       Testing in an Agile Environment
                                                                       © Workroom Productions 2008
SoftTest June 2008                                                     www.workroom-productions.com
Working software
          is preferable to

      comprehensive
      documentation




Individuals and interactions
         are preferable to

   processes and tools
Customer collaboration
       is preferable to

 contract negotiation




Responding to change
       is preferable to
   following a plan
My conclusions

                     Challenge your beliefs:
                       the virtues of independent testing
                       the importance of documentation
                       the necessity of long-term planning

                     Bring your skills, and work within the team


                                                             Testing in an Agile Environment
                                                             © Workroom Productions 2008
SoftTest June 2008                                           www.workroom-productions.com




                             Agility (agility)

          Testing is Automatic

                                                   Errors should be Avoided


                         Friction is reduced by
                       Improved Communication

                                                             Testing in an Agile Environment
                                                             © Workroom Productions 2008
SoftTest June 2008                                           www.workroom-productions.com
Testing is Automatic

                     Comprehensive testing, but not by testers
                     Refactoring
                     Continuous integration



                                                     Testing in an Agile Environment
                                                     © Workroom Productions 2008
SoftTest June 2008                                   www.workroom-productions.com




           Errors should be Avoided

                     Metaphor
                     Pair work
                     40-hour week
                     Coding standard


                                                     Testing in an Agile Environment
                                                     © Workroom Productions 2008
SoftTest June 2008                                   www.workroom-productions.com
Friction is reduced by
         Improved Communication
                     Planning game
                     Small releases
                     Simple design
                     Collective ownership
                     On-site customer


                                            Testing in an Agile Environment
                                            © Workroom Productions 2008
SoftTest June 2008                          www.workroom-productions.com




                           Old or new?
                       Style or Substance?
My experiences

                     Tester – reported bugs
                     Participant – part of the agile team
                     Mentor – to a test lead on an agile project
                     Consultant – after implementation problems


                                                                  Testing in an Agile Environment
                                                                  © Workroom Productions 2008
SoftTest June 2008                                                www.workroom-productions.com




                              Bugs missed,
                            lessons learned
                     You can’t get the bugs out of Microsoft Word
                       even automated unit test have their limits

                     The side-effects of unexpected truncation
                       Test driven design? No test = no code

                     Discounts that don’t
                       It’s easy to get used to a bad behaviour


                                                                  Testing in an Agile Environment
                                                                  © Workroom Productions 2008
SoftTest June 2008                                                www.workroom-productions.com
What’s it like?

        You’ll talk to everyone, and get involved in their testing
        You’ll occasionally fix a bug


        You’ll lose your independence
        You learn to live without (some) documentation


                                                      Testing in an Agile Environment
                                                      © Workroom Productions 2008
SoftTest June 2008                                    www.workroom-productions.com




                       Common problems

                     Testing in later iterations
                     Keeping testing and coding in sync
                     Test management



                                                      Testing in an Agile Environment
                                                      © Workroom Productions 2008
SoftTest June 2008                                    www.workroom-productions.com
Common problems

                     Passing tests ! working code
                     Agile ! Exploratory
                     Testers can make a terrible mess



                                                         Testing in an Agile Environment
                                                         © Workroom Productions 2008
SoftTest June 2008                                       www.workroom-productions.com




                              Testers help


                     Bring your own stories and skills
                     Expose and diagnose the unexpected




                                                         Testing in an Agile Environment
                                                         © Workroom Productions 2008
SoftTest June 2008                                       www.workroom-productions.com
Exploration and
                              diagnosis

                     Necessary
                     Similar spirit
                     Not a perfect fit



                                                     Testing in an Agile Environment
                                                     © Workroom Productions 2008
SoftTest June 2008                                   www.workroom-productions.com




                            Supporting the
                           learning process
                     Give fast feedback
                     Enhance the work of the team
                     Be involved in retrospectives
                     Re-factor required processes


                                                     Testing in an Agile Environment
                                                     © Workroom Productions 2008
SoftTest June 2008                                   www.workroom-productions.com
Exploratory Testing
                            Seminar
                         31 July, Dublin
                     Through Insight www.insight-test.com
                     ... or see workroom-productions.com




                                                     Testing in an Agile Environment
                                                     © Workroom Productions 2008
SoftTest June 2008                                   www.workroom-productions.com




                       jdl@workroom-productions.com

                           AIM/Skype: workroomprds
I mentioned the following resources:


                     Paper at
                     www.workroom-productions.com/papers.html


                     Beck: eXtreme Programming Explained
                     Yahoo Groups: aa-ftt, agile testing
                     Variations on this talk will be delivered at
                     Agile2008, EuroStar
                                                           Testing in an Agile Environment
                                                           © Workroom Productions 2008
SoftTest June 2008                                         www.workroom-productions.com

More Related Content

PDF
Integrating Quality into Project Portfolio Management
PPTX
Agile User Experience
 
PDF
Refactoring AOMs For AgilePT2010
PPT
Chapter 1 ASE Slides ppt
PDF
Agile for Startups
PDF
Recognizing Software Debt - Beyond Agile Puget Sound
PDF
Integrating Quality into Portfolio Management
PDF
Managing Software Debt - Quality Debt Focus for QASIG Seattle
Integrating Quality into Project Portfolio Management
Agile User Experience
 
Refactoring AOMs For AgilePT2010
Chapter 1 ASE Slides ppt
Agile for Startups
Recognizing Software Debt - Beyond Agile Puget Sound
Integrating Quality into Portfolio Management
Managing Software Debt - Quality Debt Focus for QASIG Seattle

What's hot (20)

PDF
Model-Based Testing to Help You Enhance Your Agile Testing Process
PDF
Agile tour 2011 ralph jocham - scrum primer
PDF
Earned Value Management and Agile Tips for Success
PDF
Ralph jocham agile portfolio based release trains
PDF
Stop the Line practice in SW development
PDF
2011 pmo symposium Bridging the Agile-to-PMO Communication Gap
PDF
Product Ownership Challenges
PDF
Removing the Systemic Project Barriers
PDF
Dollars and Dates are Killing Agile
PDF
Agiles 2009 - An Evolutive Approach From Cmmi Iso - Miguel Insaurralde
PDF
Faster apps. faster time to market. faster mean time to repair
PDF
Effective Strategies for Distributed Testing
KEY
Essential practices and thinking tools for Agile Adoption
PDF
Agile meets waterfall
PDF
Amy.stapleton
PDF
New Zealand Premiere! A first look at Rational Insight
PDF
How to live with agile - Aware in BugDay Bangkok 2012
PPTX
Simulation Professional - What each module can do for me
PPTX
Plörk discovery session
PDF
Value stream mapping
Model-Based Testing to Help You Enhance Your Agile Testing Process
Agile tour 2011 ralph jocham - scrum primer
Earned Value Management and Agile Tips for Success
Ralph jocham agile portfolio based release trains
Stop the Line practice in SW development
2011 pmo symposium Bridging the Agile-to-PMO Communication Gap
Product Ownership Challenges
Removing the Systemic Project Barriers
Dollars and Dates are Killing Agile
Agiles 2009 - An Evolutive Approach From Cmmi Iso - Miguel Insaurralde
Faster apps. faster time to market. faster mean time to repair
Effective Strategies for Distributed Testing
Essential practices and thinking tools for Agile Adoption
Agile meets waterfall
Amy.stapleton
New Zealand Premiere! A first look at Rational Insight
How to live with agile - Aware in BugDay Bangkok 2012
Simulation Professional - What each module can do for me
Plörk discovery session
Value stream mapping
Ad

Viewers also liked (7)

PDF
Janet Gregory presents Current Testing Challenges with SoftTest Ireland
PPTX
Ios driver presentation copy
PDF
Stephen K. Allott - People Challenges for Test Teams - SoftTest Ireland
PDF
Workgroup Form
PDF
Stephen Allott - Testing Techniques - Are they of any Practical Use? - SoftTe...
PDF
Bon Secours health: system network design and delivery case study
PDF
Tester's are doing it for themselves - Julie Gardiner - SoftTest Ireland
Janet Gregory presents Current Testing Challenges with SoftTest Ireland
Ios driver presentation copy
Stephen K. Allott - People Challenges for Test Teams - SoftTest Ireland
Workgroup Form
Stephen Allott - Testing Techniques - Are they of any Practical Use? - SoftTe...
Bon Secours health: system network design and delivery case study
Tester's are doing it for themselves - Julie Gardiner - SoftTest Ireland
Ad

Similar to James Lyndsay - Testing in an agile environment (20)

PDF
Estimation Agile Projects
PPTX
Gl istqb testing fundamentals
PDF
Integrating Quality into Portfolio Management, PMI Silicon Valley Chapter Din...
PDF
Agile Testing 20021015
PDF
Quality Best Practices & Toolkit for Enterprise Flex
PDF
Agile Software Development Process Practice in Thai Culture
PPT
How We Built Test Automation within a Manual Testing Organization
PDF
Testing in an agile environment
PDF
Combining Performance Testing And Modelling For Easy Jet.Com V 1.0
PDF
New & Emerging _ Jeremy Ashley _ What's next for Oracle's Applications User E...
PDF
ICTSS 2010 - Iterative Software Testing Process for Scrum and Waterfall Projects
PPT
Building an Agile framework that fits your organisation
PDF
Evento SugarCRM 2008 - Corporate Overview
PDF
IHS Webcast - Navigating Today’s Global Regulatory Environment
PDF
Pivotal Labs Open View Presentation Quality Assurance And Developer Testing
PDF
Hypothesis Based Testing: Power + Speed.
PPTX
Agile Testing at eBay
PDF
QA Service Sheet
PDF
IBM Rational Software Conference 2009: Quality Management Track Keynote
PPTX
Redistributable introtoscrum
Estimation Agile Projects
Gl istqb testing fundamentals
Integrating Quality into Portfolio Management, PMI Silicon Valley Chapter Din...
Agile Testing 20021015
Quality Best Practices & Toolkit for Enterprise Flex
Agile Software Development Process Practice in Thai Culture
How We Built Test Automation within a Manual Testing Organization
Testing in an agile environment
Combining Performance Testing And Modelling For Easy Jet.Com V 1.0
New & Emerging _ Jeremy Ashley _ What's next for Oracle's Applications User E...
ICTSS 2010 - Iterative Software Testing Process for Scrum and Waterfall Projects
Building an Agile framework that fits your organisation
Evento SugarCRM 2008 - Corporate Overview
IHS Webcast - Navigating Today’s Global Regulatory Environment
Pivotal Labs Open View Presentation Quality Assurance And Developer Testing
Hypothesis Based Testing: Power + Speed.
Agile Testing at eBay
QA Service Sheet
IBM Rational Software Conference 2009: Quality Management Track Keynote
Redistributable introtoscrum

More from David O'Dowd (20)

PDF
Current Testing Challenges Ireland
PPT
Gordon baisley - eircom - Introducing the EDM role with www.softtest.ie
PDF
Subhendu Mohapatra - BearingPoint - Environments Management talk with www.sof...
PPTX
Intune Agile Testing Talk with www.softtest.ie
PPTX
Mobile Testing Challenges Lighting Talk with www.softtest.ie
PPT
HMH Agile Testing Lightning Talk with www.softtest.ie
ODP
Soft Test Ireland - Introduction to Jakarta Jmeter - Philip Bannon
PPT
www.softtest.ie presents Selenium 2 With David Burn's
PDF
Agile Test Management - www.softtest.ie
PDF
Michael Bolton - Two futures of software testing - Sept 2010
PDF
Markus Clermont - Surviving in an Agile Environment - Google - SoftTest Ireland
PPT
Whittaker How To Break Software Security - SoftTest Ireland
PDF
David Parnas - Documentation Based Software Testing - SoftTest Ireland
PDF
Neil Tompson - SoftTest Ireland
PDF
Neil Thompson - Thinking tools: from top motors, through software process imp...
PDF
Test Automation: A Roadmap For Sucesss
PPT
Susan windsor soft test 16th november 2005
PPT
Steven K Allott - Effective Testing - SoftTest Ireland
PDF
Anne-Marie Charrett - Startups and Software Testing
PDF
John McArdle - Professionalism in Testing - SoftTest Ireland
Current Testing Challenges Ireland
Gordon baisley - eircom - Introducing the EDM role with www.softtest.ie
Subhendu Mohapatra - BearingPoint - Environments Management talk with www.sof...
Intune Agile Testing Talk with www.softtest.ie
Mobile Testing Challenges Lighting Talk with www.softtest.ie
HMH Agile Testing Lightning Talk with www.softtest.ie
Soft Test Ireland - Introduction to Jakarta Jmeter - Philip Bannon
www.softtest.ie presents Selenium 2 With David Burn's
Agile Test Management - www.softtest.ie
Michael Bolton - Two futures of software testing - Sept 2010
Markus Clermont - Surviving in an Agile Environment - Google - SoftTest Ireland
Whittaker How To Break Software Security - SoftTest Ireland
David Parnas - Documentation Based Software Testing - SoftTest Ireland
Neil Tompson - SoftTest Ireland
Neil Thompson - Thinking tools: from top motors, through software process imp...
Test Automation: A Roadmap For Sucesss
Susan windsor soft test 16th november 2005
Steven K Allott - Effective Testing - SoftTest Ireland
Anne-Marie Charrett - Startups and Software Testing
John McArdle - Professionalism in Testing - SoftTest Ireland

James Lyndsay - Testing in an agile environment

  • 1. Testing in an agile environment James Lyndsay, Workroom Productions Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com Agility (agility) Manifesto for Agile Software Development Kent Beck Mike Beedle Arie van Bennekum We are uncovering better ways of developing Alistair Cockburn software by doing it and helping others do it. Ward Cunningham Through this work we have come to value: Martin Fowler James Grenning Jim Highsmith Individuals and interactions over processes and tools Andrew Hunt Ron Jeffries Working software over comprehensive documentation Jon Kern Brian Marick Customer collaboration over contract negotiation Robert C. Martin Steve Mellor Responding to change over following a plan Ken Schwaber Jeff Sutherland That is, while there is value in the items on Dave Thomas the right, we value the items on the left more. © 2001, the above authors this declaration may be freely copied in any form, but only in its entirety through this notice. Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com
  • 2. Working software is preferable to comprehensive documentation Individuals and interactions are preferable to processes and tools
  • 3. Customer collaboration is preferable to contract negotiation Responding to change is preferable to following a plan
  • 4. My conclusions Challenge your beliefs: the virtues of independent testing the importance of documentation the necessity of long-term planning Bring your skills, and work within the team Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com Agility (agility) Testing is Automatic Errors should be Avoided Friction is reduced by Improved Communication Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com
  • 5. Testing is Automatic Comprehensive testing, but not by testers Refactoring Continuous integration Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com Errors should be Avoided Metaphor Pair work 40-hour week Coding standard Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com
  • 6. Friction is reduced by Improved Communication Planning game Small releases Simple design Collective ownership On-site customer Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com Old or new? Style or Substance?
  • 7. My experiences Tester – reported bugs Participant – part of the agile team Mentor – to a test lead on an agile project Consultant – after implementation problems Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com Bugs missed, lessons learned You can’t get the bugs out of Microsoft Word even automated unit test have their limits The side-effects of unexpected truncation Test driven design? No test = no code Discounts that don’t It’s easy to get used to a bad behaviour Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com
  • 8. What’s it like? You’ll talk to everyone, and get involved in their testing You’ll occasionally fix a bug You’ll lose your independence You learn to live without (some) documentation Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com Common problems Testing in later iterations Keeping testing and coding in sync Test management Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com
  • 9. Common problems Passing tests ! working code Agile ! Exploratory Testers can make a terrible mess Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com Testers help Bring your own stories and skills Expose and diagnose the unexpected Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com
  • 10. Exploration and diagnosis Necessary Similar spirit Not a perfect fit Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com Supporting the learning process Give fast feedback Enhance the work of the team Be involved in retrospectives Re-factor required processes Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com
  • 11. Exploratory Testing Seminar 31 July, Dublin Through Insight www.insight-test.com ... or see workroom-productions.com Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com jdl@workroom-productions.com AIM/Skype: workroomprds
  • 12. I mentioned the following resources: Paper at www.workroom-productions.com/papers.html Beck: eXtreme Programming Explained Yahoo Groups: aa-ftt, agile testing Variations on this talk will be delivered at Agile2008, EuroStar Testing in an Agile Environment © Workroom Productions 2008 SoftTest June 2008 www.workroom-productions.com