Agile Testing - Testing from Day 1

While we wait for the
session to start, meet your
neighbors and discuss …
AGILE TESTING @fadistephan | @excellaco | excella.com
• Do you currently work on an Agile team?
• Does you team include testers?
• What testing challenges are you facing?

• Consultant @ Excella
• Software Development
Practice Lead
• Scrum Trainer and Coach
• 15+ years of experience in
software development
• Co-organizer of the DC
Scrum User Group
• @FadiStephan
FADI STEPHAN

Requirement Design Code Test
2 Weeks 2 Weeks 2 Weeks 2 Weeks

4 Weeks
Requirements Design C o o o o o o o o o o o o o o o o o o o o o o o o o d e
Test

Code 1 Code 2
Test 1 Test 2
2 Weeks 2 Weeks 2 Weeks 2 Weeks
Code 3 Code 4
Test 3

2 Weeks
Requirement
Design
Code
Test
Story 1 Story 1
Story 3
Story 4
Story 6
Story 2
Story 1
Story 2
Story 3
Story 5
Story
Story 4
Story 1
Story 2
Story 3
Story 5
Story 4
Story 1
Story 2
Story 3
Story 5
Story 6
Story 7

Requirements
Design
Development
Test
DeployWATERFALL
APPROACH

Requirements
Design
Development
Test
Deploy
ITERATIVE &
INCREMENTAL
APPROACH

“Our highest priority is to satisfy the
customer through early and continuous
delivery of valuable software.”
“Deliver working software frequently,
from a couple of weeks to a couple
of months, with a preference to the
shorter timescale.”
- First and third of the Twelve Principles behind the Agile Manifesto
A LEANER PMO IN THE FEDERAL GOVERNMENTAGILE TESTING @fadistephan | @excellaco | excella.com

REQUIREMENTS
DESIGN
DEVELOPMENTTEST
DEPLOY

Days
Not
Months or
Years
REQUIREMENTS
DESIGN
DEVELOPMENTTEST
DEPLOY

WHAT KIND OF
TESTING?

Functional Tests
Acceptance Tests
Unit Tests
Integration Test
Component Tests
System Tests
Exploratory Tests
Usability Tests
Performance Tests
Load Tests
Stress Tests
Security Tests
Types of Testing

Functional Tests
Acceptance Tests
Unit Tests
Integration Tests
Component Tests
System Tests
Exploratory Tests
Usability Tests
Performance Tests
Load Tests
Stress Tests
Security Tests
SupportProgramming
CritiqueProduct
Business Facing
Technology Facingfrom Brian Marick
Testing Quadrant

WHICH TESTS DO WE
AUTOMATE?

Functional Tests
Acceptance Tests
Unit Tests
Integration Tests
Component Tests
System Tests
Exploratory Tests
Usability Tests
Performance Tests
Load Tests
Stress Tests
Security Tests
SupportProgramming
CritiqueProduct
Business Facing
Technology Facingfrom Brian Marick
Automated
Automated
Automated
Manual
Testing Quadrant

HOW MANY OF EACH
TYPE?

Testing Pyramid
Unit Tests
Integration/System
Tests
Functional
Tests
UI
Tests
Manual

WHEN DO WE START
TESTING?

Task Board
To Do In Progress Testing Done
User
Story
User
Story
User
Story
Task Task Task
Task Task
Task Task
Task Task

TESTING IS NOT A
PHASE

Task Board
To Do In Progress Done
User
Story
User
Story
User
Story
Task Task Task
Task Task
Task Task
Task Task

WHO IS DOING THE
TESTING?

TESTING IS
EVERYONE’S
RESPONSIBILITY

Think
Test
Code
Refactor
Test Driven Development

EXECUTABLE
SPECIFICATION

As a customer I want to collect books in a shopping
cart So that I can order several books at once.
• Books can be added to the shopping basket
• Books can be removed from the shopping basket
• Shopping basket is initially empty
• The same book can be added multiple times to
the shopping basket
User Story

• Requirements and tests are just two sides of
the same coin
– You can’t have a user story (requirement) without
acceptance criteria (test)
• Agile testing focuses on melding requirements
and tests into executable specifications
Executable Specifications

As a potential customer I want to collect books in a
shopping cart So that I can order several books at
once.
• Books can be added to the shopping basket
– Given my shopping basket is empty
– When I add the book “Harry Potter” to my shopping
basket
– Then my shopping basket should contain 1 copy of
“Harry Potter”
Specification by Example

As a potential customer I want to collect books in a
shopping cart So that I can order several books at once.
• The same book can be added multiple times to the
shopping basket
– Given my shopping basket contains 1 copy of “Harry
Potter”
– When I add the book “Harry Potter” to my shopping
basket
– Then my shopping basket should contain 2 copies of
“Harry Potter”
Specification by Example

Green Documents
• Use Specification by Example to create “green documents”
– Less Likely to rot
– Not write once documents
– Help people think and collaborate
– Communicate what the product really does
– Become automated acceptance tests
– Become part of regression test suite

PASS
REFACTOR CODE
FAIL
FAIL
PASS
Automated Acceptance Test Automated Unit Test
User Story
Acceptance Criteria
Back

DO NOT DO
FUNCTIONAL TESTING
VIA THE UI

Business Layer
Web Layer
Browser
Data Layer
Code
Code
Code
Code
Code
Code

USABILITY TESTING

Credit: John Bellomy

EXPLORATORY
TESTING

EXPLORATORY
TESTING IS NOT
AD-HOC TESTING

EXPLORATORY
TESTING IS NOT
EXHUASTIVE
TESTING

Exploratory Testing
• A sophisticated, thoughtful approach to
testing without a script
• Enables going beyond the obvious variations
that have already been tested
• Combines learning, test design and test
execution into one test approach
• Applies heuristics and techniques in a
disciplined way

Session Based Testing
• Time-boxed and structured
• Mission/charter based
• Look for patterns that do not look right
• Divert from the mission if necessary
• Report on your results

SUMMARY
1. Testing in not a phase
2. Testing is everyone’s responsibility
3. Testing starts on day 1
4. Do automate all scripted tests
5. Developers are the one’s doing most of the
automation
6. Do use executable documentation
7. Do not automate functional testing via the UI
8. Save most manual testing for usability and
exploratory testing

Agile Testing - Testing from Day 1

More Related Content

What's hot (20)

Similar to Agile Testing - Testing from Day 1 (20)

More from Fadi Stephan (19)

Recently uploaded (20)

Agile Testing - Testing from Day 1