Smoothing the continuous delivery path a tale of two architectures - expert talk
0 likes715 views
The document outlines practices for improving continuous delivery in software development, emphasizing the importance of hiring skilled individuals and maintaining a production-focused mindset. Key practices include learning from production incidents, automating release notes, and ensuring teams own their own microservices. Overall, it advocates for a collaborative and adaptive approach to software engineering.
Smoothing the continuous delivery path a tale of two architectures - expert talk
- 2. simple software solutions to big business problems. Making Software. Better. @EqualExperts Smoothing the Continuous Delivery path A tale of two architectures
- 3. © Equal Experts UK Ltd 2020 @EqualExperts Continuous Delivery in donuts 3 Fast Feedback Risk Reduction Satisfied customer
- 4. © Equal Experts UK Ltd 2020 @EqualExperts There is no (CD) silver bullet 4 ● >30 deploys / day ● >2 billion page views / month ● 1 (javascript) monorepo https://bit.ly/2BKuq5S ● >1000 deploys / day ● ~2 billion requests per day ● >600 java microservices https://bit.ly/2Uq5My8
- 5. © Equal Experts UK Ltd 2020 @EqualExperts There is no (CD) silver bullet 5 ● Weekly deployments ● ~100M visits / day ● 2 monoliths (C#, C++) ● Multiple deploys / day ● Recent peak of ~1000 RPS ● ~1000 microservices (Scala) C++ C# Private Sector Org. UK Government Org.
- 6. © Equal Experts UK Ltd 2020 @EqualExperts Practices for Smoothing the Continuous Delivery path 6 Practices for Microservices Practices For Monoliths Universal Practices *M 𝝁
- 7. © Equal Experts UK Ltd 2020 @EqualExperts 7 Practice #0 - Start with the best people you can hire *
- 8. © Equal Experts UK Ltd 2020 @EqualExperts ● What’s the smallest thing we can release to Production? ● How do we evolve Production behaviour ● Is this code change safe to go to Production today? 8 Practice #1 - Think about Production, all the time *
- 9. © Equal Experts UK Ltd 2020 @EqualExperts 9 ▪ Work board right to left ▪ What was deployed yesterday? ▪ What will be deployed today? Practice #1 - Think about Production, all the time - Example: Production focused Standups *
- 10. © Equal Experts UK Ltd 2020 @EqualExperts Practice #2 - Make ‘ilities’ continuous activities, not phases 10 Product Owner Define Dev Build QA Explore Web Ops Deploy Quality, Security, Operability, ... *
- 11. © Equal Experts UK Ltd 2020 @EqualExperts 11 Practice #3 - Learn from Production incidents M http://www.airliners.net/photo/uk-air-force/british-aerospace-hawk-t1-astra/949077
- 12. © Equal Experts UK Ltd 2020 @EqualExperts Practice #3 - Learn from Production incidents - 5 why’s - Run Blameless Post Mortems 12 M “Adaptability and learning. - We learn through honest, blameless reflection on lessons and surprises. - We believe that traditional root cause analysis makes learning from mistakes difficult. http://sec.edgar-online.com/etsy-inc/s-1a-securities-registration-statement/2015/04/14/section20.aspx
- 13. © Equal Experts UK Ltd 2020 @EqualExperts Practice #3 - Learn from Production incidents - Run Blameless Post Mortems 13 M https://extfiles.etsy.com/DebriefingFacilitationGuide.pdf Structure and Preparation ● Familiarize Yourself With the Timeline in Advance ● Unearth More Objective and Subjective Data ● Talking to the People Who Would Usually Be Blamed Is Really Important ● Come up With Some Initial Questions
- 14. © Equal Experts UK Ltd 2020 @EqualExperts Practice #4 - Automate release notes 14 M https://commons.wikimedia.org/wiki/File:Spot_the_difference.png
- 15. © Equal Experts UK Ltd 2020 @EqualExperts Practice #4 - Automate release notes 15 M
- 16. © Equal Experts UK Ltd 2020 @EqualExperts Practice #4 - Automate release notes 16 Source control system Login Reporting Payments API’s Agile Project Management Tool Features Stories Tasks Defects Story 123 State, areas, authors ... Defect 789 State, areas, authors ... Untracked work Areas, authors ... Release note generator Production Version Candidate Version M
- 17. © Equal Experts UK Ltd 2020 @EqualExperts Practice #5 - Teams own their own microservices 17 𝝁 Legacy and Third Party Systems ~1000 microservices Xm BusinessesXXm Individuals x130 Transaction types Back-ends Front-ends / APIs
- 18. © Equal Experts UK Ltd 2020 @EqualExperts Practice #5 - Teams own their own microservices 18 𝝁 Legacy and Third Party Systems Xm BusinessesXXm Individuals x130 Transaction types Cat Services Dog Services Tiger Services Team Tools Service Operation Platform Security Auditing Build & Deploy Infra- structure Telemetry 60 service teams 7 platform teams
- 19. © Equal Experts UK Ltd 2020 @EqualExperts Practice #5 - Teams own their own microservices 19 “You build it, you run it” - Werner Vogels Amazon CTO https://goo.gl/DyfeOf 𝝁 https://www.flickr.com/photos/jobook/4751509167/
- 20. © Equal Experts UK Ltd 2020 @EqualExperts Practice #6 - Play nicely with others (services, APIs, libraries) 20 𝝁 http://www.asterix-obelix.nl/images/albums/characters/c-fighting.gif
- 21. © Equal Experts UK Ltd 2020 @EqualExperts 21 Production Staging QA Dev Sharing through caring 𝝁Practice #6 - Play nicely with others (services, APIs, libraries)
- 22. © Equal Experts UK Ltd 2020 @EqualExperts Practices for Smoothing the Continuous Delivery path 22 0. Start with the best people you can hire 1. Think about Production, all the time 2. Make ‘ilities continuous activities, not phases 3. Learn from Production incidents 4. Automate release notes 5. Teams own their own microservices 6. Play nicely with others (services, APIs, etc) * M 𝝁