Scalable Python with Docker, Kubernetes, OpenShift
4 likes2,693 views
This document summarizes a presentation about scaling Python applications using Docker, Kubernetes, and OpenShift. It discusses how the speaker previously ran Python applications on virtual servers, the shortcomings of that approach, and how containerization tools address those issues. It provides an overview of Docker for building application images, Kubernetes for orchestrating containers, and OpenShift for deploying applications to production. The speaker advocates these tools to gain benefits like continuous deployment, easy scaling, and portability across infrastructures.
Scalable Python with Docker, Kubernetes, OpenShift
- 1. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Swiss Python Summit 2017 Scalable Python with Docker, Kubernetes, OpenShift Aarno Aukia VSHN AG
- 2. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Agenda ● About Aarno / VSHN ● How were we running python before ● Shortcomings & wishes ● What is Docker, Kubernetes, OpenShift ? ● Why use them ? ● Demo
- 3. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Who Aarno Aukia, CTO & co-founder ETH → Google → Atrila → VSHN @aarnoaukia http://about.me/aarno VSHN - the DevOps Company Since 2014: 18 people in Zürich Running web applications on-premises and in the clouds making both visitors and developers happy https://vshn.ch @vshn_ch
- 4. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Ops: firefighting as a Service
- 5. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch DevOps: collaboration to fix source of problem
- 6. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch
- 7. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch How were we running python applications ? Virtual servers Web-/App-/Cache-/Queue-/DB-services managed by Puppet & Ansible Config in GIT, separate repo from application Local VM with vagrant from same config for development
- 8. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Customer project with python, celery, postgres
- 9. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Shortcomings Scaling up/down servers takes manual effort & time Python/Postgres/Apache/RabitMQ versions/plugins defined by configuration management for each server, not for each project/deployment and have to be communicated separately Adding new components is complex, lots of moving parts and risk
- 10. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Wishful thinking... Solves build-ship-run workflow, integrates in CI/CD, DevOps & self-service Handles the standard software plattform problems: scaling, hitless deployment, monitoring, backup, etc Open standards: 100% open source, backed by big community No lock-in, free to choose any provider, works on any infrastructure Extensible with API
- 11. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Docker Lightweight container runtime Package code, runtime, plugins, libraries 'Dockerfile' describes image, Automatically built, quickly started Helps you to use 12-Factor-App pattern (explicit entrypoint, port, volume configurations) https://blog.vshn.ch/2016/11/docker https://github.com/docker/docker
- 12. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch 12 Factor App Patterns: https://12factor.net/ ● Use declarative formats for setup automation ● Have a clean, portable contract with the underlying operating system ● Are suitable for deployment on modern cloud platforms ● Minimize divergence between development and production, enabling continuous deployment ● And can scale up without significant changes to tooling, architecture, or development practices.
- 13. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch From container to production ?
- 14. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Kubernetes Container orchestrator: 'here is a container, run 3 of these with this config and give me a loadbalancer' 'distribute all my containers over these servers and make sure they can talk to each other' 'here is a new version of this container, update all my services without interruption' https://blog.vshn.ch/2016/08/openshift https://github.com/kubernetes/kubernete s
- 15. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Container orchestration
- 16. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch OpenShift How to get the application in the container ? Web-GUI, CLI client, REST-API https://blog.vshn.ch/2016/08/openshift https://github.com/openshift/origin
- 17. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch OpenShift
- 18. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Why? You have full control over the container contents → no more old versions by the hosting provider You control the build, deploy, run process from the GUI/CLI/API Plattform takes care of seamless deployment, SSL, load balancing, scaling, system updates, monitoring, backups, hardware, storage, network, etc You don't need to handle Docker, Kubernetes, OpenShift internals if you don't want to
- 19. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch APPUiO by VSHN Managed Docker, Kubernetes, OpenShift Flavours: Big shared plattform in the cloud, private plattform in the cloud or on- premises Hosted in Switzerland (ISO/FINMA- certified) or whereever you want (AWS, Azure, on-premises, etc) Community for Developers and Operations, Dev & Ops = DevOps Free monthly half-day training TechLabs Starting at CHF 40/mt
- 20. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Get a free year of APPUiO ● Get a free demo-account: http://appuio.ch ● Get a free-tier-account (soon) ● Enter the draw for a year of APPUiO M (1GB application RAM, 5GB SSD Storage) ● http://bit.ly/pyappuio
- 21. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Demotime Links: https://github.com/arska/python-hellowor ld https://github.com/arska/flask-helloworld https://github.com/arska/cherrypy-hellow orld https://github.com/openshift/django-ex
- 22. VSHN AG I Neugasse 10 I 8005 Zürich I T 044 545 53 00 www.vshn.ch Thanks! We're looking fo Python DevOps Engineers ! http://bit.ly/pydevops Talk to @aarnoaukia or @andrekeller_ch