DockerCon SF 2015: Orchestration for Sysadmins
8 likes7,905 views
This document summarizes a presentation about orchestrating containers using Docker Swarm and integrating it with Mesos. It discusses setting up a Swarm cluster, the Swarm scheduler, running Swarm on Mesos, and using Docker Machine to provision Swarm clusters on various providers. It also covers Swarm manager replication for fault tolerance and demos of these features.
DockerCon SF 2015: Orchestration for Sysadmins
- 1. Orchestration for Sysadmins Andrea Luzzardi / Victor Vieux Software Engineers @ docker
- 2. Agenda • Introduction to Docker Swarm • Swarm Fault Tolerance: Replication • Integrating Swarm with Mesos • Provisioning Swarm with Docker Machine
- 3. “Running containers on multiple hosts.”
- 4. Swarm in a nutshell • Exposes several Docker Engines as a single virtual Engine • Serves the standard Docker API • Extremely easy to get started • Batteries includes but swappable
- 5. Timeline Oct Nov Dec Jan Feb Jun Proof of Concept DockerCon EU Open Repository First Release Candidate Swarm Beta Release Global Hack Day Open Proposal 0.2.0 Release 0.3.0 Release Apr
- 6. Setting up Swarm • Create a cluster: - $ swarm create • Add nodes to a cluster: - $ swarm join --advertise=<node_ip> token://<token> • Start Swarm: - $ swarm manage -H <swarm_ip> token://<token> Or you can use your own etcd, zookeeper or consul
- 7. Swarm Scheduler • Resource Management - Memory, CPU, Network • Fit containers - Apply filters to exclude nodes - Use a strategy to rank and pick the best node • Scheduling Knobs - Constraints - Affinities
- 8. “Batteries Included but Swappable”
- 9. Docker Swarm + Mesos • Experimental • Docker Swarm act as a Mesos Framework • In collaboration with $> swarm manage --cluster mesos-experimental <mesos_master_url>
- 10. Mesos Cluster + Mesos CLI Mesos Slaves + + + + + + + + + + + + + Mesos Masters Marathon
- 11. Mesos Cluster + Docker Swarm + Mesos CLI Mesos Slaves + + + + + + + + + + + + + Mesos Masters Marathon Docker CLI
- 12. Mesos Cluster + Docker Swarm + Mesos CLI Mesos Slaves + + + + + + + + + + + + + Mesos Masters Marathon Docker CLI shipyard kitematic compose
- 13. BY
- 15. Replication Docker CLI Swarm Cluster • Swarm Manager is a Single Point of Failure API Request Manage
- 16. Replication Docker CLI Swarm Cluster • Upon failure it becomes impossible to manage the cluster • Cluster continues to run un-managed API Request Manage
- 17. Replica Replication Primary Docker CLI Swarm Cluster Forward API Request Manage Replica • One primary, many replicas • Leader Election built on top of Consul, etcd, ZooKeeper • Replicas forward API calls to primary • CLI can talk to any instance
- 18. Replica Replication Primary Docker CLI Swarm Cluster Forward API Request Manage Replica • Replicas monitor health of primary instance • Leader gets re-elected upon primary failure
- 19. PrimaryReplica Replication Replica Docker CLI Swarm Cluster Forward API Request Manage • One replica promoted to primary • Other replicas notified of leadership update • CLI can continue talking to same instance
- 20. Demo
- 21. “From Zero to Docker”
- 22. Machine in a nutshell • Host management for a container centric world • Provisions Virtual Machines • Installs & Manages Docker Engine • Swarm Cluster Provisioning
- 23. Machine Provisioning 5 Local Providers 9 Cloud Providers 7 Operating Systems
- 24. Machine Management • Install, Configure & Upgrade Docker Engine - docker-machine upgrade node-{1,2,3} • PKI Management - TLS Encryption & Authentication by default - CA generation, Key signing and Re-keying - Seamless integration: Auto-configure the CLI • Bring Your Own Machine - Generic Driver
- 25. Machine Operations • Operate - List, Start, Stop and Kill machines • Debug - docker-machine ssh node-2 • Script - docker-machine toolkit: ip, url, …
- 26. Machine Clustering • Integration with Docker Swarm • Provision Swarm management nodes • Pre-configure machines to join a Swarm cluster • Tweak Swarm options
- 27. Demo
- 28. Thank you, Questions? Andrea Luzzardi - @aluzzardi Victor Vieux - @vieux