SlideShare a Scribd company logo
Continuous Delivery - The ING Story 
Improving time to market with DevOps and Continuous Delivery 
Wouter Meijs 
DOT05S #CAWorld 
ING Bank 
Head of Delivery Center Core Bank 
DevOps
2 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
3 
© 2014 CA. ALL RIGHTS RESERVED. 
ING: A global Financial Services Group 
Over 33 millionclients 
40different countries 
64,000employees of which15,000IT 
€15 bn annual revenue
4 © 2014 CA. ALL RIGHTS RESERVED. 
160 million 
euro 
distributed 
each day 
in the 
Netherlands
5 
© 2014 CA. ALL RIGHTS RESERVED. 
every 5 minutes, 100 million euro is turned over at the dealing room and our systems
6 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
7 
© 2014 CA. ALL RIGHTS RESERVED. 
Technology is changing faster every year
8 
© 2014 CA. ALL RIGHTS RESERVED. 
From 0 to 1 billion smart phones 
In less than 10 years
9 
© 2014 CA. ALL RIGHTS RESERVED. 
People’s expectations grow along 
Both customers and employees
10 
© 2014 CA. ALL RIGHTS RESERVED. 
Access anytime anywhere anyhow
11 
© 2014 CA. ALL RIGHTS RESERVED. 
Zero tolerance for digital failure
12 
© 2014 CA. ALL RIGHTS RESERVED. 
Be amazed by new features
13 
© 2014 CA. ALL RIGHTS RESERVED.
14 
© 2014 CA. ALL RIGHTS RESERVED. 
Complete industries are changing
15 
© 2014 CA. ALL RIGHTS RESERVED. 
Spotifyand Netflix are obliterating video and record stores
16 
© 2014 CA. ALL RIGHTS RESERVED. 
As a Bank We are not Immune
17 
© 2014 CA. ALL RIGHTS RESERVED. 
Traditionally people deposited their money into banks
18 
© 2014 CA. ALL RIGHTS RESERVED. 
It was kept in safes 
And accessed through checks
19 
© 2014 CA. ALL RIGHTS RESERVED. 
You don’t need 150 years of tradition to start a bank anymore
20 
© 2014 CA. ALL RIGHTS RESERVED. 
Technology opens the door to many more competitors 
…and perhaps takes banks out of the equation
21 
© 2014 CA. ALL RIGHTS RESERVED. 
People Need Banking 
not banks
22 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
23 
© 2014 CA. ALL RIGHTS RESERVED. 
Traditional Waterfall Projects Fail to Support this
24 
© 2014 CA. ALL RIGHTS RESERVED. 
The OLDways
25 
© 2014 CA. ALL RIGHTS RESERVED. 
The Dream
26 
© 2014 CA. ALL RIGHTS RESERVED. 
The Design
27 
© 2014 CA. ALL RIGHTS RESERVED. 
The Specs
28 
© 2014 CA. ALL RIGHTS RESERVED. 
The PiD
29 
© 2014 CA. ALL RIGHTS RESERVED. 
The Development 
CHANGING REQUIREMENTS 
DESIGN FAILS
30 
© 2014 CA. ALL RIGHTS RESERVED. 
The Testing 
TEST 
FAILURES 
DEPLOYMENT ISSUES
31 
© 2014 CA. ALL RIGHTS RESERVED. 
The Result
32 
© 2014 CA. ALL RIGHTS RESERVED. 
The Result
33 
© 2014 CA. ALL RIGHTS RESERVED. 
The Result
34 
© 2014 CA. ALL RIGHTS RESERVED. 
To stop this … 
You have to speed up your delivery cycle
35 
© 2014 CA. ALL RIGHTS RESERVED. 
Agile Scrum Made the First Move… 
…but the next bottleneck is deployment on production
36 
© 2014 CA. ALL RIGHTS RESERVED. 
Continuous delivery 
Every change tested on production like environment
37 
© 2014 CA. ALL RIGHTS RESERVED. 
Continuous delivery 
Multiple deploys on preproduction per day 
Releasing becomes business decision
38 
© 2014 CA. ALL RIGHTS RESERVED. 
Everything is automated 
Configuration management 
Testing 
Deployments
39 
© 2014 CA. ALL RIGHTS RESERVED. 
Bridge the gap between Devand Ops
40 
© 2014 CA. ALL RIGHTS RESERVED.
41 
© 2014 CA. ALL RIGHTS RESERVED.
42 
© 2014 CA. ALL RIGHTS RESERVED. 
DevOps 
Devand Ops working together in one team with one backlog
43 
© 2014 CA. ALL RIGHTS RESERVED. 
A NEWway of working
44 
© 2014 CA. ALL RIGHTS RESERVED. 
The Dream
45 
© 2014 CA. ALL RIGHTS RESERVED. 
The Demo
46 
© 2014 CA. ALL RIGHTS RESERVED. 
The Minimal Viable Product
47 
© 2014 CA. ALL RIGHTS RESERVED. 
The Second Release
48 
© 2014 CA. ALL RIGHTS RESERVED. 
The Nth Release
49 
© 2014 CA. ALL RIGHTS RESERVED. 
The Nth Release
50 
© 2014 CA. ALL RIGHTS RESERVED. 
The Nth Release
51 
© 2014 CA. ALL RIGHTS RESERVED. 
The Nth Release
52 
© 2014 CA. ALL RIGHTS RESERVED. 
MAKE YOUR OWN EGGS! BUY OUR PAINT
53 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
54 
© 2014 CA. ALL RIGHTS RESERVED. 
Mobile Banking App 
0 
2000 
4000 
6000 
8000 
10000 
12000 
14000 
16000 
18000 
Total number of deployments per month
55 
© 2014 CA. ALL RIGHTS RESERVED. 
Mobile Banking App
56 
© 2014 CA. ALL RIGHTS RESERVED. 
Full Continuous Delivery Process with Nightly Builds
57 
© 2014 CA. ALL RIGHTS RESERVED.
58 
© 2014 CA. ALL RIGHTS RESERVED. 
Failed test results sent by WhatsAppto all developers
59 
© 2014 CA. ALL RIGHTS RESERVED. 
3-6 Weeks Releases, Priority Set by Customers in iStore
60 
© 2014 CA. ALL RIGHTS RESERVED. 
From 1 Star to 4 Stars in the iStore
61 
© 2014 CA. ALL RIGHTS RESERVED.
62 
© 2014 CA. ALL RIGHTS RESERVED. 
Continuous Delivery is not just for Web Applications 
ING’s Core Product Engine
63 
© 2014 CA. ALL RIGHTS RESERVED. 
ING Core Bank 
Savings, Loans, Current Accounts 
12 million accounts 
10 DevOps teams
64 
© 2014 CA. ALL RIGHTS RESERVED. 
Continuous Delivery is not just for Web Applications 
One Branch 
One automated test set 
One CD pipeline
65 
© 2014 CA. ALL RIGHTS RESERVED. 
Time to market from >20 weeks 
To 4 days
66 
© 2014 CA. ALL RIGHTS RESERVED. 
Test coverage increased from 30% to 80% 
and throughput time from 4 weeks to 6 hours
67 
© 2014 CA. ALL RIGHTS RESERVED. 
From 30+ outages in 2013 to 0 in 2014 
While increasing releases from 4 per year to every 3 weeks
68 
© 2014 CA. ALL RIGHTS RESERVED. 
DR test from 4 hours to 12 minutes 
And 10 seconds by the end of next year
69 
© 2014 CA. ALL RIGHTS RESERVED. 
Infrastructure provisioning
70 
© 2014 CA. ALL RIGHTS RESERVED. 
How long does it take you to deploy your application? 
INCLUDING ROLE BASED ACCESS 
INCLUDING MONITORING 
INCLUDING CONNECTIVITY
71 
© 2014 CA. ALL RIGHTS RESERVED. 
Within ING it takes > 200 days
72 
© 2014 CA. ALL RIGHTS RESERVED.
73 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
74 
© 2014 CA. ALL RIGHTS RESERVED. 
Biggest challenge is people 
Mindset & Behaviour 
Engineering culture 
Stakeholders 
Suppliers
75 
© 2014 CA. ALL RIGHTS RESERVED. 
CD will fail without the right mindset and behavior
76 
© 2014 CA. ALL RIGHTS RESERVED. 
Start where it hurts
77 
© 2014 CA. ALL RIGHTS RESERVED. 
Realize Improvements Every Three Months
78 
© 2014 CA. ALL RIGHTS RESERVED. 
Patience
79 
© 2014 CA. ALL RIGHTS RESERVED. 
How to transform your workforce?
80 
© 2014 CA. ALL RIGHTS RESERVED. 
Training
81 
© 2014 CA. ALL RIGHTS RESERVED. 
Attract the Best Talent in the World
82 
© 2014 CA. ALL RIGHTS RESERVED. 
CD talent is rare 
War on talent 
Engineers look for great engineering, not money
83 
© 2014 CA. ALL RIGHTS RESERVED. 
Be content leaders yourself
84 
© 2014 CA. ALL RIGHTS RESERVED. 
Business stakeholders 
BEFORE 
We cannot deliver on the agreed time lines 
That is not our fault 
We need a lot of money for things you do not understand
85 
© 2014 CA. ALL RIGHTS RESERVED. 
Business stakeholders 
AFTER 
Directly responsible for prioritization of backlog 
Define minimal viable product together
86 
© 2014 CA. ALL RIGHTS RESERVED. 
Suppliers 
BEFORE 
Large releases every 6 –12 months 
Service Level Agreements
87 
© 2014 CA. ALL RIGHTS RESERVED. 
AFTER 
Small and frequent releases 
100% availability 
Suppliers 
Co-sourcing
88 
© 2014 CA. ALL RIGHTS RESERVED. 
Your CD pipeline has to be 100% available 
Dependence on Technology:
91 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
92 
© 2014 CA. ALL RIGHTS RESERVED. 
What if we’re only halfway there?
93 
© 2014 CA. ALL RIGHTS RESERVED. 
Role based access should be standardized 
Automated security 
Security settings deployed as part of the pipeline
94 
© 2014 CA. ALL RIGHTS RESERVED. 
CD pipeline as a service 
We want to build banking software, not automation
95 
© 2014 CA. ALL RIGHTS RESERVED. 
As many as 50 teams working on one release 
Chain
96 
© 2014 CA. ALL RIGHTS RESERVED. 
Where Does it Stop: Continuous Delivery in a Bank 
Secure financial service 
Managing a customer’s financial future is not like streaming video’s 
There is a danger of blindly following Google, Spotify and Netflix
97 
© 2014 CA. ALL RIGHTS RESERVED. 
For More Information 
To learn more about DevOps, please visit: 
http://bit.ly/1wbjjqX 
Insert appropriate screenshot and textoverlayfrom following“More Info Graphics” slide here; ensure it links to correct page 
DevOps

More Related Content

PDF
How to do effective pi planning?
PPTX
12 agile principles
PDF
Team Topologies - how and why to design your teams - AllDayDevOps 2017
PDF
SAFe® PI Planning - 4 locations - but how?
PPTX
SRE 101 (Site Reliability Engineering)
DOCX
Agile Methology Seminar Report
PDF
An Overview of SAFe
PPTX
Agile Methodology in Software Development
How to do effective pi planning?
12 agile principles
Team Topologies - how and why to design your teams - AllDayDevOps 2017
SAFe® PI Planning - 4 locations - but how?
SRE 101 (Site Reliability Engineering)
Agile Methology Seminar Report
An Overview of SAFe
Agile Methodology in Software Development

What's hot (20)

PDF
Foundations of the Scaled Agile Framework® (SAFe® ) 4.5
PDF
Agile Transformation Explained
PDF
Netflix: A State of Xen - Chaos Monkey & Cassandra
PPTX
Agile KPIs
PDF
Chaos Engineering, When should you release the monkeys?
PDF
Agile methodologiesvswaterfall
PDF
Site Reliability Engineering (SRE) - Tech Talk by Keet Sugathadasa
PPTX
Introduction to scaled agile framework
PDF
The Principles of product development flow - a summary
PDF
Agile & SCRUM basics
PDF
Présentation détaillée de l'Impact Mapping
PPTX
Road to DevOps ROI
PPTX
Cloud Native: what is it? Why?
PDF
Beyond the Spotify model - Team Topologies - DevTestNorth - 2019-09-25 - Matt...
PDF
Modern Agile - Joshua Kerievsky
PPTX
Scrum Master Career 2020 — Using Ecocycle Planning to Identify Opportunities
PDF
Product Validation With Product Discovery
PPTX
What is Platform Observability? An Overview
PDF
Accelerate your DevOps
PPT
Agile and waterfall
Foundations of the Scaled Agile Framework® (SAFe® ) 4.5
Agile Transformation Explained
Netflix: A State of Xen - Chaos Monkey & Cassandra
Agile KPIs
Chaos Engineering, When should you release the monkeys?
Agile methodologiesvswaterfall
Site Reliability Engineering (SRE) - Tech Talk by Keet Sugathadasa
Introduction to scaled agile framework
The Principles of product development flow - a summary
Agile & SCRUM basics
Présentation détaillée de l'Impact Mapping
Road to DevOps ROI
Cloud Native: what is it? Why?
Beyond the Spotify model - Team Topologies - DevTestNorth - 2019-09-25 - Matt...
Modern Agile - Joshua Kerievsky
Scrum Master Career 2020 — Using Ecocycle Planning to Identify Opportunities
Product Validation With Product Discovery
What is Platform Observability? An Overview
Accelerate your DevOps
Agile and waterfall
Ad

Similar to Continuous Delivery - The ING Story: Improving time to market with DevOps and Continuous Delivery (20)

PDF
CA - Entrega Continua
PPTX
What is Continuous Delivery really?
PPTX
CA Technologies Survive and Thrive in the Application Economy- August 2014
PDF
Continuous Delivery e-book
PDF
A Brave New World of Delivering IT
PDF
TDC 2021 - Better software, faster: Principles of Continuous Delivery and DevOps
PDF
Cyberland 2020 - Better software, faster: Principles of Continuous Delivery a...
PDF
Devoxx Belgium 2019 - Better software, faster: Principles of Continuous Deliv...
PPTX
Continuous Delivery Guide for Managers
PDF
OpenValue Vienna meetup september 2020 - Better software, faster: Principles ...
PPTX
Continuous Delivery: why ? where to start ? how to scale ?
PDF
OpenValue meetup June 2019 - Better, software faster: Principles of Continuou...
PDF
JavaZone 2019 - Better software, faster: Principles of Continuous Delivery an...
PPTX
Rising Above the Noise: Continuous Integration, Delivery and DevOps
PPTX
ContinuousDelivery-101
PDF
AmsterdamJUG September 2019 - Better software, faster: Principles of Continuo...
PPTX
Why DevOps Matters To The CIO
PDF
Forrester Webinar: Coming Changes in Application Delivery
PPTX
Continuous Business: Jenkins User Conference 2015
PPT
Making the Agile Leap to Continuous Deployment
CA - Entrega Continua
What is Continuous Delivery really?
CA Technologies Survive and Thrive in the Application Economy- August 2014
Continuous Delivery e-book
A Brave New World of Delivering IT
TDC 2021 - Better software, faster: Principles of Continuous Delivery and DevOps
Cyberland 2020 - Better software, faster: Principles of Continuous Delivery a...
Devoxx Belgium 2019 - Better software, faster: Principles of Continuous Deliv...
Continuous Delivery Guide for Managers
OpenValue Vienna meetup september 2020 - Better software, faster: Principles ...
Continuous Delivery: why ? where to start ? how to scale ?
OpenValue meetup June 2019 - Better, software faster: Principles of Continuou...
JavaZone 2019 - Better software, faster: Principles of Continuous Delivery an...
Rising Above the Noise: Continuous Integration, Delivery and DevOps
ContinuousDelivery-101
AmsterdamJUG September 2019 - Better software, faster: Principles of Continuo...
Why DevOps Matters To The CIO
Forrester Webinar: Coming Changes in Application Delivery
Continuous Business: Jenkins User Conference 2015
Making the Agile Leap to Continuous Deployment
Ad

More from CA Technologies (20)

PPTX
CA Mainframe Resource Intelligence
PDF
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
PDF
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
PDF
Case Study: How The Home Depot Built Quality Into Software Development
PDF
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
PDF
Case Study: Privileged Access in a World on Time
PDF
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
PDF
Case Study: Putting Citizens at The Center of Digital Government
PDF
Making Security Work—Implementing a Transformational Security Program
PDF
Keynote: Making Security a Competitive Advantage
PDF
Emerging Managed Services Opportunities in Identity and Access Management
PDF
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
PDF
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
PDF
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
PDF
Application Experience Analytics Services: The Strategic Digital Transformati...
PDF
Application Experience Analytics Services: The Strategic Digital Transformati...
PDF
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
PDF
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
PDF
Blockchain: Strategies for Moving From Hype to Realities of Deployment
PDF
Establish Digital Trust as the Currency of Digital Enterprise
CA Mainframe Resource Intelligence
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How The Home Depot Built Quality Into Software Development
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
Case Study: Privileged Access in a World on Time
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
Case Study: Putting Citizens at The Center of Digital Government
Making Security Work—Implementing a Transformational Security Program
Keynote: Making Security a Competitive Advantage
Emerging Managed Services Opportunities in Identity and Access Management
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
Blockchain: Strategies for Moving From Hype to Realities of Deployment
Establish Digital Trust as the Currency of Digital Enterprise

Recently uploaded (20)

DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PPT
Teaching material agriculture food technology
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Advanced IT Governance
PDF
Approach and Philosophy of On baking technology
PDF
cuic standard and advanced reporting.pdf
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
GamePlan Trading System Review: Professional Trader's Honest Take
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
solutions_manual_-_materials___processing_in_manufacturing__demargo_.pdf
PPTX
Cloud computing and distributed systems.
PDF
Modernizing your data center with Dell and AMD
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
The AUB Centre for AI in Media Proposal.docx
NewMind AI Monthly Chronicles - July 2025
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Teaching material agriculture food technology
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Advanced IT Governance
Approach and Philosophy of On baking technology
cuic standard and advanced reporting.pdf
Per capita expenditure prediction using model stacking based on satellite ima...
MYSQL Presentation for SQL database connectivity
Review of recent advances in non-invasive hemoglobin estimation
GamePlan Trading System Review: Professional Trader's Honest Take
Unlocking AI with Model Context Protocol (MCP)
solutions_manual_-_materials___processing_in_manufacturing__demargo_.pdf
Cloud computing and distributed systems.
Modernizing your data center with Dell and AMD
Understanding_Digital_Forensics_Presentation.pptx
20250228 LYD VKU AI Blended-Learning.pptx
Reach Out and Touch Someone: Haptics and Empathic Computing
The Rise and Fall of 3GPP – Time for a Sabbatical?

Continuous Delivery - The ING Story: Improving time to market with DevOps and Continuous Delivery

  • 1. Continuous Delivery - The ING Story Improving time to market with DevOps and Continuous Delivery Wouter Meijs DOT05S #CAWorld ING Bank Head of Delivery Center Core Bank DevOps
  • 2. 2 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 3. 3 © 2014 CA. ALL RIGHTS RESERVED. ING: A global Financial Services Group Over 33 millionclients 40different countries 64,000employees of which15,000IT €15 bn annual revenue
  • 4. 4 © 2014 CA. ALL RIGHTS RESERVED. 160 million euro distributed each day in the Netherlands
  • 5. 5 © 2014 CA. ALL RIGHTS RESERVED. every 5 minutes, 100 million euro is turned over at the dealing room and our systems
  • 6. 6 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 7. 7 © 2014 CA. ALL RIGHTS RESERVED. Technology is changing faster every year
  • 8. 8 © 2014 CA. ALL RIGHTS RESERVED. From 0 to 1 billion smart phones In less than 10 years
  • 9. 9 © 2014 CA. ALL RIGHTS RESERVED. People’s expectations grow along Both customers and employees
  • 10. 10 © 2014 CA. ALL RIGHTS RESERVED. Access anytime anywhere anyhow
  • 11. 11 © 2014 CA. ALL RIGHTS RESERVED. Zero tolerance for digital failure
  • 12. 12 © 2014 CA. ALL RIGHTS RESERVED. Be amazed by new features
  • 13. 13 © 2014 CA. ALL RIGHTS RESERVED.
  • 14. 14 © 2014 CA. ALL RIGHTS RESERVED. Complete industries are changing
  • 15. 15 © 2014 CA. ALL RIGHTS RESERVED. Spotifyand Netflix are obliterating video and record stores
  • 16. 16 © 2014 CA. ALL RIGHTS RESERVED. As a Bank We are not Immune
  • 17. 17 © 2014 CA. ALL RIGHTS RESERVED. Traditionally people deposited their money into banks
  • 18. 18 © 2014 CA. ALL RIGHTS RESERVED. It was kept in safes And accessed through checks
  • 19. 19 © 2014 CA. ALL RIGHTS RESERVED. You don’t need 150 years of tradition to start a bank anymore
  • 20. 20 © 2014 CA. ALL RIGHTS RESERVED. Technology opens the door to many more competitors …and perhaps takes banks out of the equation
  • 21. 21 © 2014 CA. ALL RIGHTS RESERVED. People Need Banking not banks
  • 22. 22 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 23. 23 © 2014 CA. ALL RIGHTS RESERVED. Traditional Waterfall Projects Fail to Support this
  • 24. 24 © 2014 CA. ALL RIGHTS RESERVED. The OLDways
  • 25. 25 © 2014 CA. ALL RIGHTS RESERVED. The Dream
  • 26. 26 © 2014 CA. ALL RIGHTS RESERVED. The Design
  • 27. 27 © 2014 CA. ALL RIGHTS RESERVED. The Specs
  • 28. 28 © 2014 CA. ALL RIGHTS RESERVED. The PiD
  • 29. 29 © 2014 CA. ALL RIGHTS RESERVED. The Development CHANGING REQUIREMENTS DESIGN FAILS
  • 30. 30 © 2014 CA. ALL RIGHTS RESERVED. The Testing TEST FAILURES DEPLOYMENT ISSUES
  • 31. 31 © 2014 CA. ALL RIGHTS RESERVED. The Result
  • 32. 32 © 2014 CA. ALL RIGHTS RESERVED. The Result
  • 33. 33 © 2014 CA. ALL RIGHTS RESERVED. The Result
  • 34. 34 © 2014 CA. ALL RIGHTS RESERVED. To stop this … You have to speed up your delivery cycle
  • 35. 35 © 2014 CA. ALL RIGHTS RESERVED. Agile Scrum Made the First Move… …but the next bottleneck is deployment on production
  • 36. 36 © 2014 CA. ALL RIGHTS RESERVED. Continuous delivery Every change tested on production like environment
  • 37. 37 © 2014 CA. ALL RIGHTS RESERVED. Continuous delivery Multiple deploys on preproduction per day Releasing becomes business decision
  • 38. 38 © 2014 CA. ALL RIGHTS RESERVED. Everything is automated Configuration management Testing Deployments
  • 39. 39 © 2014 CA. ALL RIGHTS RESERVED. Bridge the gap between Devand Ops
  • 40. 40 © 2014 CA. ALL RIGHTS RESERVED.
  • 41. 41 © 2014 CA. ALL RIGHTS RESERVED.
  • 42. 42 © 2014 CA. ALL RIGHTS RESERVED. DevOps Devand Ops working together in one team with one backlog
  • 43. 43 © 2014 CA. ALL RIGHTS RESERVED. A NEWway of working
  • 44. 44 © 2014 CA. ALL RIGHTS RESERVED. The Dream
  • 45. 45 © 2014 CA. ALL RIGHTS RESERVED. The Demo
  • 46. 46 © 2014 CA. ALL RIGHTS RESERVED. The Minimal Viable Product
  • 47. 47 © 2014 CA. ALL RIGHTS RESERVED. The Second Release
  • 48. 48 © 2014 CA. ALL RIGHTS RESERVED. The Nth Release
  • 49. 49 © 2014 CA. ALL RIGHTS RESERVED. The Nth Release
  • 50. 50 © 2014 CA. ALL RIGHTS RESERVED. The Nth Release
  • 51. 51 © 2014 CA. ALL RIGHTS RESERVED. The Nth Release
  • 52. 52 © 2014 CA. ALL RIGHTS RESERVED. MAKE YOUR OWN EGGS! BUY OUR PAINT
  • 53. 53 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 54. 54 © 2014 CA. ALL RIGHTS RESERVED. Mobile Banking App 0 2000 4000 6000 8000 10000 12000 14000 16000 18000 Total number of deployments per month
  • 55. 55 © 2014 CA. ALL RIGHTS RESERVED. Mobile Banking App
  • 56. 56 © 2014 CA. ALL RIGHTS RESERVED. Full Continuous Delivery Process with Nightly Builds
  • 57. 57 © 2014 CA. ALL RIGHTS RESERVED.
  • 58. 58 © 2014 CA. ALL RIGHTS RESERVED. Failed test results sent by WhatsAppto all developers
  • 59. 59 © 2014 CA. ALL RIGHTS RESERVED. 3-6 Weeks Releases, Priority Set by Customers in iStore
  • 60. 60 © 2014 CA. ALL RIGHTS RESERVED. From 1 Star to 4 Stars in the iStore
  • 61. 61 © 2014 CA. ALL RIGHTS RESERVED.
  • 62. 62 © 2014 CA. ALL RIGHTS RESERVED. Continuous Delivery is not just for Web Applications ING’s Core Product Engine
  • 63. 63 © 2014 CA. ALL RIGHTS RESERVED. ING Core Bank Savings, Loans, Current Accounts 12 million accounts 10 DevOps teams
  • 64. 64 © 2014 CA. ALL RIGHTS RESERVED. Continuous Delivery is not just for Web Applications One Branch One automated test set One CD pipeline
  • 65. 65 © 2014 CA. ALL RIGHTS RESERVED. Time to market from >20 weeks To 4 days
  • 66. 66 © 2014 CA. ALL RIGHTS RESERVED. Test coverage increased from 30% to 80% and throughput time from 4 weeks to 6 hours
  • 67. 67 © 2014 CA. ALL RIGHTS RESERVED. From 30+ outages in 2013 to 0 in 2014 While increasing releases from 4 per year to every 3 weeks
  • 68. 68 © 2014 CA. ALL RIGHTS RESERVED. DR test from 4 hours to 12 minutes And 10 seconds by the end of next year
  • 69. 69 © 2014 CA. ALL RIGHTS RESERVED. Infrastructure provisioning
  • 70. 70 © 2014 CA. ALL RIGHTS RESERVED. How long does it take you to deploy your application? INCLUDING ROLE BASED ACCESS INCLUDING MONITORING INCLUDING CONNECTIVITY
  • 71. 71 © 2014 CA. ALL RIGHTS RESERVED. Within ING it takes > 200 days
  • 72. 72 © 2014 CA. ALL RIGHTS RESERVED.
  • 73. 73 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 74. 74 © 2014 CA. ALL RIGHTS RESERVED. Biggest challenge is people Mindset & Behaviour Engineering culture Stakeholders Suppliers
  • 75. 75 © 2014 CA. ALL RIGHTS RESERVED. CD will fail without the right mindset and behavior
  • 76. 76 © 2014 CA. ALL RIGHTS RESERVED. Start where it hurts
  • 77. 77 © 2014 CA. ALL RIGHTS RESERVED. Realize Improvements Every Three Months
  • 78. 78 © 2014 CA. ALL RIGHTS RESERVED. Patience
  • 79. 79 © 2014 CA. ALL RIGHTS RESERVED. How to transform your workforce?
  • 80. 80 © 2014 CA. ALL RIGHTS RESERVED. Training
  • 81. 81 © 2014 CA. ALL RIGHTS RESERVED. Attract the Best Talent in the World
  • 82. 82 © 2014 CA. ALL RIGHTS RESERVED. CD talent is rare War on talent Engineers look for great engineering, not money
  • 83. 83 © 2014 CA. ALL RIGHTS RESERVED. Be content leaders yourself
  • 84. 84 © 2014 CA. ALL RIGHTS RESERVED. Business stakeholders BEFORE We cannot deliver on the agreed time lines That is not our fault We need a lot of money for things you do not understand
  • 85. 85 © 2014 CA. ALL RIGHTS RESERVED. Business stakeholders AFTER Directly responsible for prioritization of backlog Define minimal viable product together
  • 86. 86 © 2014 CA. ALL RIGHTS RESERVED. Suppliers BEFORE Large releases every 6 –12 months Service Level Agreements
  • 87. 87 © 2014 CA. ALL RIGHTS RESERVED. AFTER Small and frequent releases 100% availability Suppliers Co-sourcing
  • 88. 88 © 2014 CA. ALL RIGHTS RESERVED. Your CD pipeline has to be 100% available Dependence on Technology:
  • 89. 91 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 90. 92 © 2014 CA. ALL RIGHTS RESERVED. What if we’re only halfway there?
  • 91. 93 © 2014 CA. ALL RIGHTS RESERVED. Role based access should be standardized Automated security Security settings deployed as part of the pipeline
  • 92. 94 © 2014 CA. ALL RIGHTS RESERVED. CD pipeline as a service We want to build banking software, not automation
  • 93. 95 © 2014 CA. ALL RIGHTS RESERVED. As many as 50 teams working on one release Chain
  • 94. 96 © 2014 CA. ALL RIGHTS RESERVED. Where Does it Stop: Continuous Delivery in a Bank Secure financial service Managing a customer’s financial future is not like streaming video’s There is a danger of blindly following Google, Spotify and Netflix
  • 95. 97 © 2014 CA. ALL RIGHTS RESERVED. For More Information To learn more about DevOps, please visit: http://bit.ly/1wbjjqX Insert appropriate screenshot and textoverlayfrom following“More Info Graphics” slide here; ensure it links to correct page DevOps