Containers @ KitchenStories - DevOps 201704
Download as PPTX, PDF0 likes134 views
- KitchenStories is a mobile app with over 2 million users and 12 million installations across 226 countries. It provides recipes, cooking videos and supports 12 languages. - Previously, deploying a new backend version took over 1 hour due to manual processes across multiple servers. - They now use Docker, AWS services like ECS, automated testing/deployment with GitHub runners to deploy a new version in under 6 minutes, reducing downtime significantly. - Key learnings included treating containers differently than machines, using Docker cache to improve build times, using small base images, and reducing image traffic.
Containers @ KitchenStories - DevOps 201704
- 1. 1 Container @ KitchenStories Trung Phan - Lead Backed Developer
- 2. 2 Agenda • About KitchenStories • Deployment / before (macro Architecture) • Deployment / now (macro Architecture) • Learnings
- 3. 3 About KitchenStories - Facts • iOS • Best of 2014, 2015 • iPhone • iPad • AppleTV • Android • Material Award: 2016 • Most beautiful • Smartphone • Tablet • Chromecast • Amazon - Alexa • >2 Mio. Users • >12 Mio. Installations • 226 Countries • Supporting 12 Languages (3 Main) • 12 API-Versions
- 4. 4 Backend & Operations Team structure • Using Docker in production for 1.5 years • Backend (Python/Django) • Norman Sanders - FullStack Developer • Trung Phan - Lead Backend Developer • 98% time for development + features • 2% time looking for servers, services, updating tools • No Operations Team • Terraform for infrastructure • fabric for manual/automatic deployment • Deploy a new Backend-Version worldwide within 6min. includes steps • build • lint • test (unit-tests, integration-tests, API-Tests) • coverage (96%) • Zero-Downtime deployment
- 26. 26 Deployment now (live release)
- 27. 27 Deployment now (live release)
- 28. 28 Deployment now (live release)
- 29. EC 2 29 Deployment now (live release)
- 30. EC 2 30 Deployment now (live release) Runners.
- 31. EC 2 31 Deployment now (live release) Runners.
- 32. 32 Deployment now (live release) Web Hook. Runners. EC 2
- 33. 33 Deployment now (live release) Web Hook. Runners. • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. EC 2
- 34. 34 Deployment now (live release) Web Hook. Runners. ECR • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. EC 2
- 35. 35 Deployment now (live release) Web Hook. Runners. ECR • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. EC 2
- 36. 36 Deployment now (live release) Web Hook. Runners. ECR • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. • Cleanup dangling images 0:01m. EC 2
- 37. 37 Deployment now (live release) Web Hook. Runners. ECR fab deploy:1.0.0 • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. • Cleanup dangling images 0:01m. EC 2
- 38. 38 Deployment now (live release) Web Hook. Runners. ECR fab deploy:1.0.0 Managed-Server EC2 • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. • Cleanup dangling images 0:01m. EC 2
- 39. 39 Deployment now (live release) Web Hook. Runners. ECR fab deploy:1.0.0 Managed-Server EC2 ECS • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. • Cleanup dangling images 0:01m. EC 2
- 40. 40 Deployment now (live release) Web Hook. Runners. ECR fab deploy:1.0.0 Managed-Server EC2 ECS AWS API • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. • Cleanup dangling images 0:01m. EC 2
- 41. 41 Deployment now (live release) Web Hook. Runners. ECR fab deploy:1.0.0 Managed-Server EC2 ECS AWS API • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. • Cleanup dangling images 0:01m. EC 2
- 42. 42 Deployment now (live release) Web Hook. Runners. ECR fab deploy:1.0.0 Managed-Server EC2 ECS AWS API • Update tasks 0:30min. • Deploy CMS / API • Deploy Background-Workers • Deploy Background-Scheduler • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. • Cleanup dangling images 0:01m. EC 2
- 43. 43 Deployment now (live release) Web Hook. Runners. ECR fab deploy:1.0.0 Managed-Server EC2 ECS AWS API • Update tasks 0:30min. • Deploy CMS / API • Deploy Background-Workers • Deploy Background-Scheduler TTL ~0:06h • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. • Cleanup dangling images 0:01m. EC 2
- 44. 44 Deployment now (dev/beta release) Web Hook. Runners. ECR ECS AWS API • Update tasks 0:30min. • Deploy CMS / API • Deploy Background-Workers • Deploy Background-Scheduler • Build 0:50min. • Lint 0:04min. • Test1 4:30min. • Test2 3:50min. • Push Image 0:10min. • Coverage combine + coveralls 0:02min. • Deploy • Cleanup dangling images 0:01m. new version deployed EC 2
- 45. 45 Learnings • Don’t treat Containers like machines • Use Docker-build cache to improve build time • Use small Docker base image like Alpine 4Mb • Reduce docker-image traffic
- 46. 46 We’re hiring! • Senior iOS - Developer (f/m) • Senior Backend/Web (FullStack) Developer (f/m)