SlideShare a Scribd company logo
TechTalk: Reducing Risk with Canary
Deployments
Marta Benach
DevOps: Continuous Delivery
CA Technologies
Sr. Engineering Services Architect
DO4T32T
@TwitterHandle
#CAWorld
2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of
warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only
Terms of this Presentation
3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Abstract
During this session, we’ll discuss concepts like
Canary, Blue/Green and A/B deployments. We
will show you just how easy it is to use CA
Release Automation to automate these
advanced techniques to reduce your overall risk
and ensure that the applications you are
deploying will perform as expected.
Marta
Benach
CA Technologies
Principal Engineering
Services Architect
4 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
WHAT IS A CANARY DEPLOYMENT
DEPLOYMENT TYPES
NETFLIX/ETSY CANARY DEPLOYMENT
HOW RELEASE AUTOMATION SUPPORTS CANARY DEPLOYMENTS
QUESTIONS
1
2
3
4
5
5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Every company
is becoming a
technology company,
every business a digital
business.
Re-think how the
business operates to find
new ways to create and
deliver customer value.DIGITAL
TRANSFORMATION
DIGITAL
TRANSFORMATION
Increase agility Increase qualityIncrease release
velocity and cadence
CONTINUOUS DELIVERY
The Ability to Reliably Release High-Quality Applications at Any Time
6 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
What is a canary deployment?
The basic idea of a canary
deployment is to deploy
new code to a small
subset of your production
infrastructure to see how
the new code (the canary)
compares to the old code
(the baseline).
7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
How do canary deployments help us?
 Reducing risk/increases
confidence in the release
 Contain failure/faster
recovery due to failure
 Faster time to end user
 Key technique of
Continuous Delivery
8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Deployment and Testing Techniques
A/B
Testing performance
and usability,
generally front-end
testing
Blue/Green
Two identical
product systems in
which one is live and
the other is standby
Canary
Rolling out code to a
small subset of
servers/users at a
time, sometimes
referred to as a
phased or
incremental rollout
9 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
A/B Testing
 A randomized experiment
with variations in the
application.
 A subset of users is exposed
to each version.
 Metrics are collected and
used to determine
effectiveness (performance,
usability). Christian Posta, “Dzone, Blue-green Deployments, A/B Testing and Canary Releases,”
https://dzone.com/articles/blue-green-deployments-ab-testing-and-canary-relea-2
50% visitors
see variation A
50% visitors
see variation B
variation A
variation B
23%conversion
11%conversion
10 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Blue Green Deployments
Releasing Applications in a consistent manner with limited down time
 Two identical production systems,
Blue and Green
 Either Blue or Green is live at any
given time
 New code is pushed to the standby
system(Green) and tested
 New users are directed to Green, active
Blue users are gradually directed to
Green when active sessions timeout
 Blue then becomes standby system
Reverse
proxy
App1 App3
DB
App2
App1 App3
DB
App2
Reverse
proxy
App1 App3
DB
App2
App1 App3
DB
App2
Christian Posta —Dzone —Blue-green Deployments, A/B Testing and Canary Releases
https://dzone.com/articles/blue-green-deployments-ab-testing-and-canary-relea-2
11 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Canary Deployments
Christian Posta —Dzone —Blue-green Deployments, A/B Testing and Canary Releases
https://dzone.com/articles/blue-green-deployments-ab-testing-and-canary-relea-2
 Canary in the coalmine—warns
of danger.
 A small subset of servers are taken off
the load balancer.
 The latest build is deployed to the
subset and tested.
 After successful testing, code is
fully deployed.
LOADBALANCER
v1 v1 v1
v1 v1
12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
A Few Examples
 Online video streaming service
 Continuous delivery model
 Deploy after every commit
 Canary deployments
– Test.
– Gather metrics.
– Analyze.
– Release to full production.
 A premier destination for handmade
goods, vintage items and craft supplies.
 Continuous delivery model
 Configuration as code/database schema
changes
 Canary Deployments
– Test.
– Gather Metrics.
– Analyze.
– Release.
ETSYNETFLIX
13 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Canary Deployments with Release Automation
 Ability to deploy code to limited number of servers
during deployment
 Dynamically add/remove servers to canary group
 Ability to execute canary deployments in all
environments not just prod
 Rollback for failures
 Run staggered and scheduled deployments
 Clear visualization of the deployment status
 Consistent delivery of the artifacts
14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
A Typical Canary Deployment Scenario with
CA Release Automation
Stage artifacts for
deployments, including:
build artifacts, test scripts,
config files and deployment
manifests.
Remove canary servers
from load balancing.
Upgrade canary
application.
Proceed with automated
testing
of application
Restore Canary servers
to load balancing
(connectivity and
sanity checks).
Upgrade the rest of the
servers if the Canary
testing with live usage is
successful (otherwise
rollback).
15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Pipeline Report
Canary Environment
16 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Pre-Deployment
17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Deployment
18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Post Deployment
19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Canary Deployments with CA Release Automation
• A deployment technique helps to reduce risk while introducing new content to production.
• Easily define and execute canary deployments with CA Release Automation.
• Consistently and reliably deploy new functionality to production environments.
• Fail faster and mitigate risk.
Notice: No canaries were harmed during the creation of this presentation.
Summary
20 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
DO4T06S
Vision and Roadmap: Learn How Application Release
Solutions Help You Lead the Way
11/18/2015 at 2:00 pm
DO4X213L
Hands-On Lab: Complement CA Release Automation with
a New Continuous Delivery Solution Offering A Visual
Approach for Complex Application Releases
11/18/2015 at 4:30 pm
DO4X210L
Hands-On Lab: Build Integrations You Need with CA
Release Automation Rapid Development Kit (RDK) and
Software Development Kit (SDK)
11/19/2015 at 3:00 pm
21 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Must See Demos
CA Release
Automation
CA Release
Automation
Theater 4
CA
Continuous
Delivery
Director
Theater 4
CA RA Rapid
Dev. Kit, SDK
CA Release
Automation
Theater 4
Integrations
CA Release
Automation
Theater 4
22 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Follow On Conversations At…
Smart Bar
CA Release
Automation
Theater 4
Tech Talks
CA Release
Automation
Theater 4
23 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Q & A
24 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For More Information
To learn more, please visit:
http://cainc.to/Nv2VOe
CA World ’15

More Related Content

PDF
Canary deployment with Traefik and K3S
PDF
CANARY DEPLOYMENT
PPTX
Azure DevOps
PPTX
Why to Cloud Native
PDF
CI:CD in Lightspeed with kubernetes and argo cd
PDF
AWS Control Tower
PDF
초보 개발자도 바로 따라할 수 있는 AWS 미디어 서비스를 이용한 Live/VOD 서비스 구축 – 현륜식 AWS 솔루션즈 아키텍트:: A...
Canary deployment with Traefik and K3S
CANARY DEPLOYMENT
Azure DevOps
Why to Cloud Native
CI:CD in Lightspeed with kubernetes and argo cd
AWS Control Tower
초보 개발자도 바로 따라할 수 있는 AWS 미디어 서비스를 이용한 Live/VOD 서비스 구축 – 현륜식 AWS 솔루션즈 아키텍트:: A...

What's hot (20)

PDF
ArgoCD Meetup PPT final.pdf
PDF
What Is Kubernetes | Kubernetes Introduction | Kubernetes Tutorial For Beginn...
PDF
Choose your own adventure Chaos Engineering - QCon NYC 2017
PDF
What is Jenkins | Jenkins Tutorial for Beginners | Edureka
PPTX
Docker networking Tutorial 101
PDF
Your Journey to Cloud-Native Begins with DevOps, Microservices, and Containers
PPTX
Docker 101 - High level introduction to docker
PPTX
Docker 101 : Introduction to Docker and Containers
PPTX
Canary Releases on Kubernetes w/ Spinnaker, Istio, and Prometheus
PDF
EKS Workshop
PDF
Kubernetes Basics
PPTX
DevOps seminar ppt
PPTX
Docker 101 - Nov 2016
PPTX
Azure DevOps CI/CD For Beginners
PPTX
What Is A Docker Container? | Docker Container Tutorial For Beginners| Docker...
PDF
PPTX
Introduction to Docker - 2017
PDF
Application & Account Monitoring in AWS
PPTX
Dockers and containers basics
PPTX
Container Orchestration
ArgoCD Meetup PPT final.pdf
What Is Kubernetes | Kubernetes Introduction | Kubernetes Tutorial For Beginn...
Choose your own adventure Chaos Engineering - QCon NYC 2017
What is Jenkins | Jenkins Tutorial for Beginners | Edureka
Docker networking Tutorial 101
Your Journey to Cloud-Native Begins with DevOps, Microservices, and Containers
Docker 101 - High level introduction to docker
Docker 101 : Introduction to Docker and Containers
Canary Releases on Kubernetes w/ Spinnaker, Istio, and Prometheus
EKS Workshop
Kubernetes Basics
DevOps seminar ppt
Docker 101 - Nov 2016
Azure DevOps CI/CD For Beginners
What Is A Docker Container? | Docker Container Tutorial For Beginners| Docker...
Introduction to Docker - 2017
Application & Account Monitoring in AWS
Dockers and containers basics
Container Orchestration
Ad

Viewers also liked (20)

PDF
Canary Analyze All The Things: How We Learned to Keep Calm and Release Often
PPTX
Canary releases & Blue green deployment
PPT
Statewide General Education Transfer Policy and Implementation Guidelines, Pr...
PDF
Hands-On Lab: Design Custom Action Packs to Support CA Release Automation Dep...
PDF
360 Policy Implementation Presentation and Understanding.
PDF
Hand-On Lab: CA Release Automation Rapid Development Kit and SDK
PDF
Pre-Con Ed: Automated Application Deployment 101—Getting Started and Best Pra...
PDF
Pre-Con Lab: Build Plug-ins for CA Release Automation Continuous Delivery Edi...
PPTX
Deployment Automation with Microservices
PPT
Fibromyalgia disease overview
PDF
Explore Advanced CA Release Automation Configuration Topics
PDF
Hands-On Lab: Complement CA Release Automation with a New Continuous Delivery...
PDF
Application release-automation-with-zero-touch-deployment
PDF
Microservices deployment patterns
PDF
Protocol buffers and Microservices
PDF
Canary Analyze All the Things
PPTX
Fibromyalgia powerpoint completed
PPT
Fibromyalgia lecture2010
PPTX
Fibromyalgia
PPT
Canary Analyze All The Things: How We Learned to Keep Calm and Release Often
Canary releases & Blue green deployment
Statewide General Education Transfer Policy and Implementation Guidelines, Pr...
Hands-On Lab: Design Custom Action Packs to Support CA Release Automation Dep...
360 Policy Implementation Presentation and Understanding.
Hand-On Lab: CA Release Automation Rapid Development Kit and SDK
Pre-Con Ed: Automated Application Deployment 101—Getting Started and Best Pra...
Pre-Con Lab: Build Plug-ins for CA Release Automation Continuous Delivery Edi...
Deployment Automation with Microservices
Fibromyalgia disease overview
Explore Advanced CA Release Automation Configuration Topics
Hands-On Lab: Complement CA Release Automation with a New Continuous Delivery...
Application release-automation-with-zero-touch-deployment
Microservices deployment patterns
Protocol buffers and Microservices
Canary Analyze All the Things
Fibromyalgia powerpoint completed
Fibromyalgia lecture2010
Fibromyalgia
Ad

Similar to TechTalk: Reduce Risk with Canary Deployments (20)

PDF
Hands-On Lab: Take CA Release Automation for a Test Drive
PDF
Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...
PDF
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
PDF
Hands-On Lab: CA Spectrum : How To Leverage UI Updates For Operational Effic...
PDF
Hands-On Labs: Introduction to CA Unified Infrastructure Management
PDF
Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...
PDF
CA Gen Exploration – What's New and Cool in Application Development
PDF
Removing Crucial Dependencies to Enable KPN as a Virtual Telecom Provider
PDF
CA Unified Infrastructure Management Network Performance Management Capabili...
PDF
Tech Talk: Service Virtualization on Demand—Have Everything, Whenever and Whe...
PDF
Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...
PDF
Technology Primer: Building Applications the New-Fashioned Way
PDF
Tech Talk: Harness the Power of Innovations Like Microservice Architecture an...
PDF
Tech Talk: Master Your Continuous Delivery Pipeline with a New Level of Orche...
PDF
CA Service Virtualization 9.0—What's the Latest and Greatest
PDF
CA Agile Central (formerly Rally) Inside DevOps
PDF
Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...
PDF
Technology Primer: New Cloud Monitoring Capabilities in CA Unified Infrastruc...
PDF
New Mainframe IT Analytics: Actionable Insight into Root Cause Analysis of Pe...
PDF
Using Artificial Intelligence to power Service Virtualization
Hands-On Lab: Take CA Release Automation for a Test Drive
Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Hands-On Lab: CA Spectrum : How To Leverage UI Updates For Operational Effic...
Hands-On Labs: Introduction to CA Unified Infrastructure Management
Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...
CA Gen Exploration – What's New and Cool in Application Development
Removing Crucial Dependencies to Enable KPN as a Virtual Telecom Provider
CA Unified Infrastructure Management Network Performance Management Capabili...
Tech Talk: Service Virtualization on Demand—Have Everything, Whenever and Whe...
Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...
Technology Primer: Building Applications the New-Fashioned Way
Tech Talk: Harness the Power of Innovations Like Microservice Architecture an...
Tech Talk: Master Your Continuous Delivery Pipeline with a New Level of Orche...
CA Service Virtualization 9.0—What's the Latest and Greatest
CA Agile Central (formerly Rally) Inside DevOps
Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...
Technology Primer: New Cloud Monitoring Capabilities in CA Unified Infrastruc...
New Mainframe IT Analytics: Actionable Insight into Root Cause Analysis of Pe...
Using Artificial Intelligence to power Service Virtualization

More from CA Technologies (20)

PPTX
CA Mainframe Resource Intelligence
PDF
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
PDF
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
PDF
Case Study: How The Home Depot Built Quality Into Software Development
PDF
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
PDF
Case Study: Privileged Access in a World on Time
PDF
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
PDF
Case Study: Putting Citizens at The Center of Digital Government
PDF
Making Security Work—Implementing a Transformational Security Program
PDF
Keynote: Making Security a Competitive Advantage
PDF
Emerging Managed Services Opportunities in Identity and Access Management
PDF
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
PDF
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
PDF
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
PDF
Application Experience Analytics Services: The Strategic Digital Transformati...
PDF
Application Experience Analytics Services: The Strategic Digital Transformati...
PDF
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
PDF
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
PDF
Blockchain: Strategies for Moving From Hype to Realities of Deployment
PDF
Establish Digital Trust as the Currency of Digital Enterprise
CA Mainframe Resource Intelligence
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How The Home Depot Built Quality Into Software Development
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
Case Study: Privileged Access in a World on Time
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
Case Study: Putting Citizens at The Center of Digital Government
Making Security Work—Implementing a Transformational Security Program
Keynote: Making Security a Competitive Advantage
Emerging Managed Services Opportunities in Identity and Access Management
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
Blockchain: Strategies for Moving From Hype to Realities of Deployment
Establish Digital Trust as the Currency of Digital Enterprise

Recently uploaded (20)

PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
KodekX | Application Modernization Development
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
Modernizing your data center with Dell and AMD
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Approach and Philosophy of On baking technology
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PPTX
Big Data Technologies - Introduction.pptx
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPT
Teaching material agriculture food technology
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Electronic commerce courselecture one. Pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Advanced methodologies resolving dimensionality complications for autism neur...
KodekX | Application Modernization Development
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Modernizing your data center with Dell and AMD
Per capita expenditure prediction using model stacking based on satellite ima...
The AUB Centre for AI in Media Proposal.docx
Mobile App Security Testing_ A Comprehensive Guide.pdf
Approach and Philosophy of On baking technology
CIFDAQ's Market Insight: SEC Turns Pro Crypto
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Big Data Technologies - Introduction.pptx
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
NewMind AI Monthly Chronicles - July 2025
Reach Out and Touch Someone: Haptics and Empathic Computing
Teaching material agriculture food technology
Unlocking AI with Model Context Protocol (MCP)
Electronic commerce courselecture one. Pdf
Dropbox Q2 2025 Financial Results & Investor Presentation

TechTalk: Reduce Risk with Canary Deployments

  • 1. TechTalk: Reducing Risk with Canary Deployments Marta Benach DevOps: Continuous Delivery CA Technologies Sr. Engineering Services Architect DO4T32T @TwitterHandle #CAWorld
  • 2. 2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD © 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies. The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA. For Informational Purposes Only Terms of this Presentation
  • 3. 3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Abstract During this session, we’ll discuss concepts like Canary, Blue/Green and A/B deployments. We will show you just how easy it is to use CA Release Automation to automate these advanced techniques to reduce your overall risk and ensure that the applications you are deploying will perform as expected. Marta Benach CA Technologies Principal Engineering Services Architect
  • 4. 4 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Agenda WHAT IS A CANARY DEPLOYMENT DEPLOYMENT TYPES NETFLIX/ETSY CANARY DEPLOYMENT HOW RELEASE AUTOMATION SUPPORTS CANARY DEPLOYMENTS QUESTIONS 1 2 3 4 5
  • 5. 5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Every company is becoming a technology company, every business a digital business. Re-think how the business operates to find new ways to create and deliver customer value.DIGITAL TRANSFORMATION DIGITAL TRANSFORMATION Increase agility Increase qualityIncrease release velocity and cadence CONTINUOUS DELIVERY The Ability to Reliably Release High-Quality Applications at Any Time
  • 6. 6 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD What is a canary deployment? The basic idea of a canary deployment is to deploy new code to a small subset of your production infrastructure to see how the new code (the canary) compares to the old code (the baseline).
  • 7. 7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD How do canary deployments help us?  Reducing risk/increases confidence in the release  Contain failure/faster recovery due to failure  Faster time to end user  Key technique of Continuous Delivery
  • 8. 8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Deployment and Testing Techniques A/B Testing performance and usability, generally front-end testing Blue/Green Two identical product systems in which one is live and the other is standby Canary Rolling out code to a small subset of servers/users at a time, sometimes referred to as a phased or incremental rollout
  • 9. 9 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD A/B Testing  A randomized experiment with variations in the application.  A subset of users is exposed to each version.  Metrics are collected and used to determine effectiveness (performance, usability). Christian Posta, “Dzone, Blue-green Deployments, A/B Testing and Canary Releases,” https://dzone.com/articles/blue-green-deployments-ab-testing-and-canary-relea-2 50% visitors see variation A 50% visitors see variation B variation A variation B 23%conversion 11%conversion
  • 10. 10 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Blue Green Deployments Releasing Applications in a consistent manner with limited down time  Two identical production systems, Blue and Green  Either Blue or Green is live at any given time  New code is pushed to the standby system(Green) and tested  New users are directed to Green, active Blue users are gradually directed to Green when active sessions timeout  Blue then becomes standby system Reverse proxy App1 App3 DB App2 App1 App3 DB App2 Reverse proxy App1 App3 DB App2 App1 App3 DB App2 Christian Posta —Dzone —Blue-green Deployments, A/B Testing and Canary Releases https://dzone.com/articles/blue-green-deployments-ab-testing-and-canary-relea-2
  • 11. 11 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Canary Deployments Christian Posta —Dzone —Blue-green Deployments, A/B Testing and Canary Releases https://dzone.com/articles/blue-green-deployments-ab-testing-and-canary-relea-2  Canary in the coalmine—warns of danger.  A small subset of servers are taken off the load balancer.  The latest build is deployed to the subset and tested.  After successful testing, code is fully deployed. LOADBALANCER v1 v1 v1 v1 v1
  • 12. 12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD A Few Examples  Online video streaming service  Continuous delivery model  Deploy after every commit  Canary deployments – Test. – Gather metrics. – Analyze. – Release to full production.  A premier destination for handmade goods, vintage items and craft supplies.  Continuous delivery model  Configuration as code/database schema changes  Canary Deployments – Test. – Gather Metrics. – Analyze. – Release. ETSYNETFLIX
  • 13. 13 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Canary Deployments with Release Automation  Ability to deploy code to limited number of servers during deployment  Dynamically add/remove servers to canary group  Ability to execute canary deployments in all environments not just prod  Rollback for failures  Run staggered and scheduled deployments  Clear visualization of the deployment status  Consistent delivery of the artifacts
  • 14. 14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD A Typical Canary Deployment Scenario with CA Release Automation Stage artifacts for deployments, including: build artifacts, test scripts, config files and deployment manifests. Remove canary servers from load balancing. Upgrade canary application. Proceed with automated testing of application Restore Canary servers to load balancing (connectivity and sanity checks). Upgrade the rest of the servers if the Canary testing with live usage is successful (otherwise rollback).
  • 15. 15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Pipeline Report Canary Environment
  • 16. 16 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Pre-Deployment
  • 17. 17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Deployment
  • 18. 18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Post Deployment
  • 19. 19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Canary Deployments with CA Release Automation • A deployment technique helps to reduce risk while introducing new content to production. • Easily define and execute canary deployments with CA Release Automation. • Consistently and reliably deploy new functionality to production environments. • Fail faster and mitigate risk. Notice: No canaries were harmed during the creation of this presentation. Summary
  • 20. 20 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Recommended Sessions SESSION # TITLE DATE/TIME DO4T06S Vision and Roadmap: Learn How Application Release Solutions Help You Lead the Way 11/18/2015 at 2:00 pm DO4X213L Hands-On Lab: Complement CA Release Automation with a New Continuous Delivery Solution Offering A Visual Approach for Complex Application Releases 11/18/2015 at 4:30 pm DO4X210L Hands-On Lab: Build Integrations You Need with CA Release Automation Rapid Development Kit (RDK) and Software Development Kit (SDK) 11/19/2015 at 3:00 pm
  • 21. 21 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Must See Demos CA Release Automation CA Release Automation Theater 4 CA Continuous Delivery Director Theater 4 CA RA Rapid Dev. Kit, SDK CA Release Automation Theater 4 Integrations CA Release Automation Theater 4
  • 22. 22 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Follow On Conversations At… Smart Bar CA Release Automation Theater 4 Tech Talks CA Release Automation Theater 4
  • 23. 23 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Q & A
  • 24. 24 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD For More Information To learn more, please visit: http://cainc.to/Nv2VOe CA World ’15