ContainerSched 2015 "Our journey to world (gifting) domination - how notonthehighstreet.com embraced Docker"
4 likes1,069 views
The document details the transformation journey of notonthehighstreet.com as it adopted Docker and microservices to enhance its development and operational efficiency. Key takeaways include the importance of designing and implementing processes effectively, conducting frequent load tests, and embracing automation in development operations. The transition has led to improved response times, simplified application packaging, and better collaboration between development and operations teams.
ContainerSched 2015 "Our journey to world (gifting) domination - how notonthehighstreet.com embraced Docker"
- 2. Who Are We? 20/11/15 @sheri>ackson | @danielbryantuk • Daniel Bryant - Chief Scien5st at OpenCredo ü Digital/technical transforma5ons ü Java, Golang, CI/CD, DevOps, cloud, containers ü Maintainer of muservicesweekly.com • Nic Jackson – Dev Manager at notonthehighstreet.com ü Powering technical excellence through people ü Ruby, Go, cloud, containers, leadership, mentoring ü Organiser of Wild West Tech Talks
- 3. 1. Setting the Scene 20/11/15 @sheri>ackson | @danielbryantuk
- 7. 2. Time for a 're-Platform' 20/11/15 @sheri>ackson | @danielbryantuk
- 9. Ini5al R&D Led to… • Docker • Mesos, Marathon and Chronos • AWS (vs Google) • Data stores and middleware – RDS, but RabbitMQ container • Consul and consul-template • Ansible (vs Puppet) • CloudForma5on (vs Terraform) • Packer 20/11/15 @sheri>ackson | @danielbryantuk
- 14. 3. The New World - From Dev to Prod 20/11/15 @sheri>ackson | @danielbryantuk
- 17. Building Services • Stubs - Wiremock (accuREST for Spring) • (Consumer-based) Contracts - Pact Ruby and Pact JVM • Lease your own QA environment (spot instances?) • Tooling – ‘borg’ CLI tool – ‘local-microservices’ project 20/11/15 @sheri>ackson | @danielbryantuk
- 18. 4. Pain Points 20/11/15 @sheri>ackson | @danielbryantuk
- 19. Ini5al S5cking Points • Crea5ng a Docker registry • Networking from office (VPN) • Service discovery – Bamboo vs registrator – srv_router (dynamic lua – not so ‘dynamic’) • The ‘underscores vs hyphens’ clone war • Monitoring all the things (statsd and Datadog) 20/11/15 @sheri>ackson | @danielbryantuk
- 20. And a Few More… • Rails – Single process (Passenger) per container – Ul5mately ran Unicorn (stats don’t lie…) – Missed ‘rails console’ • Java – OOM kills (Xmx + Metaspace + JVM Overhead + OS Overhead) • Ops learning from dev – design and development workflow • The cron/Chronos migra5on challenge 20/11/15 @sheri>ackson | @danielbryantuk
- 21. 4. The Proof of the pudding 20/11/15 @sheri>ackson | @danielbryantuk
- 22. Lesson 1: If you design a process, make sure you use it. 20/11/15 @sheri>ackson | @danielbryantuk
- 27. 5. Operations: Automate everything (except the people) 20/11/15 @sheri>ackson | @danielbryantuk
- 28. Microservices… Macro Opera5ons • Microservice Prerequisites (bit.ly/1wIjY58) – Rapid provisioning – Basic monitoring – Rapid applica5on deployment • In a nutshell… – Technical part of DevOps – CI/CD 20/11/15 @sheri>ackson | @danielbryantuk
- 33. Helpful Processes • BDD user journeys across system (via APIs) – …and individual services – Don’t forget ‘ili5es’ (ZAP, Jmeter) • Brendan Gregg’s USE methodology – check u5liza5on, satura5on, and errors. • Symptom-based Monitoring (Ticketmaster) 20/11/15 @sheri>ackson | @danielbryantuk
- 35. 6. Summarising our journey 20/11/15 @sheri>ackson | @danielbryantuk
- 36. Summary • An epic journey • Docker is now proving itself in produc5on – Reduced response 5me and footprint • Packaging applica5ons is easier – So is experimenta5on… • Increased harmony between Dev and Ops 20/11/15 @sheri>ackson | @danielbryantuk