SlideShare a Scribd company logo
Testing in Continuous Delivery
Aistė Stikliūtė, Agile turas 2015
Agenda
What is Continuous Delivery
and why it’s (slowly) going
mainstream
Examples
Challenge - testing
• Problems
• Solutions
What is Continuous Delivery
C.D.
Build
Deploy
Test
Release
Do you do Continuous Delivery?
How often do you / can you deploy to Prod?
What if you’ve got to do a big change?
Who decides when to deploy / release?
Some examples
Aistė Stikliutė - Testing in continuous delivery
… examples
The testing challenge
Months → Weeks → Days → Hours → Minutes
Have the cake and eat it too?
● do thorough regression testing
and do it often?
● add changes fast
and keep up with automated tests?
● ensure good quality
without (much) manual testing?
Cycle time: idea  production
Design Develop Test
Merge to
trunk
Deploy to
test
environment
Test
Deploy to
stage
Test
Deploy to
production
Cycle time to production: testing
Manual tests
before merge
Automated
tests after
merge
Staging tests
Analyse results
Update tests
Bugfix
Clarify open questions
Bugfix
Analyse results
Bugfix
Solve the testing challenge
Patterns and ideas
[obvious] agile testing
Testers involved in team:
grooming, planning, development
“Show me”
testing before it’s finished, input for automated tests
When it’s finished, tester must be ready to test
[obvious] developer testing
Develop Test
developer responsibility
You are responsible for your code
• Testing
• Deploying
• Supporting
• Defined code ownership
• Better automated tests
• Monitoring. Faster corrections
• Faster & more successful deployments
branching patterns
Centralized Finds and fixes problems ASAP
Distributed Develop every change in its own branch and test
Temporary
branches
Effective, combines centralized and distributed
Matrix of
services
Use centralized CI for a massively scalable system
test automation
Fast tests Reliable tests
test automation
Test
optimization
Well-thought
infrastructure
Run in
parallel
Test
categories
test automation
Test
coverage
Test
environment
Keep tests
green
“Pass” ratio
testing in production
A/B
testing
feature
toggling
monitoring
feature toggling
● Needs to be implemented
● Reduces need for lab-testing, but it’s still needed
● Needs to be tested itself
● Reduces risk
● Enables A/B testing
on off staff user_list opt-in 0-100%
A/B testing
monitoring
Errors Performance
User
behavior
User
community /
support
automatic notifications
The future
Aistė Stikliutė - Testing in continuous delivery

More Related Content

PDF
Automated testing
PDF
Unit testing
PPTX
Increase selenium tests stability via java script
PDF
Testing activities in CI/CD as exploratory tester
PPTX
Testing activities in continuous integration and continuous delivery as an ex...
PDF
Giving automated tests the love they deserve at Listings
PPTX
Why test automation projects are failing
PPTX
Bdd and spec flow
Automated testing
Unit testing
Increase selenium tests stability via java script
Testing activities in CI/CD as exploratory tester
Testing activities in continuous integration and continuous delivery as an ex...
Giving automated tests the love they deserve at Listings
Why test automation projects are failing
Bdd and spec flow

What's hot (20)

PPTX
j meter
PDF
Creating Maintainable Automated Acceptance Tests
PPT
Webinar TI4Agile EuroStar 2013
PPTX
Writing Better Tests - Applying Clean-Code TDD at 99designs
PPTX
Automated Testing with Logic Apps and Specflow
PDF
Introduction to Automated Testing
PPTX
Continuous Integration: Finding problems soonest
PPTX
Being Lean Agile
PPTX
Episode 3 – Classes, Inheritance, Abstract Class, and Interfaces
PDF
Unit testing in PHP
PDF
Unit testing (workshop)
PDF
Fast end-to-end-tests
PPTX
Adapt your testing for Agile
PDF
Test-Driven Development with Plone
PPTX
Value of Unit Testing
PDF
UPC Plone Testing Talk
PPTX
Test Driven Development with Laravel
PPTX
Winning the battle against Automated testing
PDF
Agile test
PPTX
Automation is Easy! (python version)
j meter
Creating Maintainable Automated Acceptance Tests
Webinar TI4Agile EuroStar 2013
Writing Better Tests - Applying Clean-Code TDD at 99designs
Automated Testing with Logic Apps and Specflow
Introduction to Automated Testing
Continuous Integration: Finding problems soonest
Being Lean Agile
Episode 3 – Classes, Inheritance, Abstract Class, and Interfaces
Unit testing in PHP
Unit testing (workshop)
Fast end-to-end-tests
Adapt your testing for Agile
Test-Driven Development with Plone
Value of Unit Testing
UPC Plone Testing Talk
Test Driven Development with Laravel
Winning the battle against Automated testing
Agile test
Automation is Easy! (python version)
Ad

Viewers also liked (13)

PPTX
Herramientas tic michael diaz
DOCX
3 year plan (autosaved)
PDF
Taizhou Xiaojin Mould Co.,Ltd
PDF
Community Works Fact Sheet 2014
PPTX
Project Protocol qualification certificates
PPTX
The wood shed Psalm 38
PPT
Актуалізація опорних знань
PDF
Presentation bozlo.ru
PPTX
Vision Map Project
DOC
Practica de laboratorio_instrumentacion
DOC
Resume - Anil Kumar Krishna
PPTX
JETSON : AI at the EDGE
PPT
Civil War: The North and its Advantages
Herramientas tic michael diaz
3 year plan (autosaved)
Taizhou Xiaojin Mould Co.,Ltd
Community Works Fact Sheet 2014
Project Protocol qualification certificates
The wood shed Psalm 38
Актуалізація опорних знань
Presentation bozlo.ru
Vision Map Project
Practica de laboratorio_instrumentacion
Resume - Anil Kumar Krishna
JETSON : AI at the EDGE
Civil War: The North and its Advantages
Ad

Similar to Aistė Stikliutė - Testing in continuous delivery (20)

PPTX
XStudio supports agile and sdlc projects
PPTX
Getting a grip on your test maturity using the ambition chart
PPTX
Agile ncr2016 ppt
PDF
ATA CP-MAT program highlights
PPT
Stc chandan patary_ua_testing _ stc
PPTX
Adam Howard and Joanna Yip - Lean, Again: Reiterating Lean Thinking in Testing
PDF
Agile testing
PDF
Continuous Testing for CTOs (Webinar Slides)
PPT
Transitioning To Agile Webinar Presentation
PPT
Test Improvement - Any place, anytime, any where
PDF
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
PDF
Continuous Delivery Distilled
PPTX
Dev ops != Dev+Ops
PDF
Continuous testing in agile projects 2015
PPTX
DevOps – The Evolution of Agile
PPT
Agile testing
PPT
Testing Framework
PDF
Integrate testing activities in Agile (EuroSTAR webinar)
PPT
QA in Agile
PPTX
New model
XStudio supports agile and sdlc projects
Getting a grip on your test maturity using the ambition chart
Agile ncr2016 ppt
ATA CP-MAT program highlights
Stc chandan patary_ua_testing _ stc
Adam Howard and Joanna Yip - Lean, Again: Reiterating Lean Thinking in Testing
Agile testing
Continuous Testing for CTOs (Webinar Slides)
Transitioning To Agile Webinar Presentation
Test Improvement - Any place, anytime, any where
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
Continuous Delivery Distilled
Dev ops != Dev+Ops
Continuous testing in agile projects 2015
DevOps – The Evolution of Agile
Agile testing
Testing Framework
Integrate testing activities in Agile (EuroSTAR webinar)
QA in Agile
New model

More from Agile Lietuva (20)

PPTX
Agile Pusryčiai 2023 - „Skaitmeninė transformacija viešajame sektoriuje: nuo ...
PPTX
Agile Pusryčiai 2023 - „Kaip užsitikrinti projekto sėkmę dar iki projekto pra...
PPTX
Agile pusryčiai 2023 - „Pirštas ant projekto pulso: CPO LT Agile patirtis ir ...
PPTX
Agile Pusryčiai 2023 - „Viešasis sektorius – neatskleistas inovacijų paklauso...
PPTX
M. Kaminskas ir A. K. Remeikienė. LEAN projektas: sėkmės istorijos, iššūkiai ...
PDF
B. den Haak. How to make OKRs Lean Again
PDF
D. Aitcheson. How to make forecasts that are actually accurate.
PDF
Aleksandra Černiauskienė. Misija Bloomberg: Agile pagal amerikiečius
PDF
Maija Aniskovič. Agile įtaka komandos motyvacijai.
PDF
dr. E. Janiūnienė. Asociacijos Agile Lietuva atlikto Agile tyrimo pristatymas
PPTX
M. Aniskovič. Laužome stereotipus: Agile gali drąsiai taikyti visi
PPTX
R. Krukonis. Reikalingas greitas rezultatas – pakeiskime projekto darbų organ...
PPTX
M. Jovaišas. Viešojo sektoriaus lankstumas įgyvendinant transformacijas
PPTX
A. Kovaliov. Kas nėra Agile jaunystėje, tas neturi širdies. Kas nėra Watefall...
PDF
V. Vasiliauskas. Nestandartinis atvejis: nuo Kanban prie Scrum
PDF
Leonard Vorobej. Agile projektų valdymas pradedantiesiems
PDF
Giedrė Žemulaitytė. Agile personalo skyriaus valdyme
PDF
Gabija Fatėnaitė. Agile ir Scrum turinio kūrimo ir marketingo komandose
PPTX
Gediminas Milieška. Agile kelionės: nuo transformacijos iki planavimo dideliu...
PPT
Denis Vanpoucke. Agile kelionės:nuo transformacijos iki planavimo dideliu mastu
Agile Pusryčiai 2023 - „Skaitmeninė transformacija viešajame sektoriuje: nuo ...
Agile Pusryčiai 2023 - „Kaip užsitikrinti projekto sėkmę dar iki projekto pra...
Agile pusryčiai 2023 - „Pirštas ant projekto pulso: CPO LT Agile patirtis ir ...
Agile Pusryčiai 2023 - „Viešasis sektorius – neatskleistas inovacijų paklauso...
M. Kaminskas ir A. K. Remeikienė. LEAN projektas: sėkmės istorijos, iššūkiai ...
B. den Haak. How to make OKRs Lean Again
D. Aitcheson. How to make forecasts that are actually accurate.
Aleksandra Černiauskienė. Misija Bloomberg: Agile pagal amerikiečius
Maija Aniskovič. Agile įtaka komandos motyvacijai.
dr. E. Janiūnienė. Asociacijos Agile Lietuva atlikto Agile tyrimo pristatymas
M. Aniskovič. Laužome stereotipus: Agile gali drąsiai taikyti visi
R. Krukonis. Reikalingas greitas rezultatas – pakeiskime projekto darbų organ...
M. Jovaišas. Viešojo sektoriaus lankstumas įgyvendinant transformacijas
A. Kovaliov. Kas nėra Agile jaunystėje, tas neturi širdies. Kas nėra Watefall...
V. Vasiliauskas. Nestandartinis atvejis: nuo Kanban prie Scrum
Leonard Vorobej. Agile projektų valdymas pradedantiesiems
Giedrė Žemulaitytė. Agile personalo skyriaus valdyme
Gabija Fatėnaitė. Agile ir Scrum turinio kūrimo ir marketingo komandose
Gediminas Milieška. Agile kelionės: nuo transformacijos iki planavimo dideliu...
Denis Vanpoucke. Agile kelionės:nuo transformacijos iki planavimo dideliu mastu

Recently uploaded (20)

PPTX
L1 - Introduction to python Backend.pptx
PDF
How Creative Agencies Leverage Project Management Software.pdf
PDF
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
PPTX
history of c programming in notes for students .pptx
PDF
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
PPTX
Operating system designcfffgfgggggggvggggggggg
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
PDF
Nekopoi APK 2025 free lastest update
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
PDF
Design an Analysis of Algorithms II-SECS-1021-03
PPTX
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
PDF
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
PDF
Which alternative to Crystal Reports is best for small or large businesses.pdf
PDF
Navsoft: AI-Powered Business Solutions & Custom Software Development
PDF
How to Choose the Right IT Partner for Your Business in Malaysia
PDF
PTS Company Brochure 2025 (1).pdf.......
PDF
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
PPTX
Introduction to Artificial Intelligence
PDF
2025 Textile ERP Trends: SAP, Odoo & Oracle
L1 - Introduction to python Backend.pptx
How Creative Agencies Leverage Project Management Software.pdf
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
history of c programming in notes for students .pptx
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
Operating system designcfffgfgggggggvggggggggg
Adobe Illustrator 28.6 Crack My Vision of Vector Design
Nekopoi APK 2025 free lastest update
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
Design an Analysis of Algorithms II-SECS-1021-03
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
Which alternative to Crystal Reports is best for small or large businesses.pdf
Navsoft: AI-Powered Business Solutions & Custom Software Development
How to Choose the Right IT Partner for Your Business in Malaysia
PTS Company Brochure 2025 (1).pdf.......
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
VVF-Customer-Presentation2025-Ver1.9.pptx
Introduction to Artificial Intelligence
2025 Textile ERP Trends: SAP, Odoo & Oracle

Aistė Stikliutė - Testing in continuous delivery