SlideShare a Scribd company logo
Docker containers at scale with
Apache Mesos
Distributed Systems Engineer
Apache Mesos PMC
Timothy Chen
@tnachen
tim@mesosphere.io
Mesoswhat?    Marathon
Chronos
Demo!
Status quo is static partitioning 
and use of virtual machines
Add some virtual machines
Provision Hadoop
Provision a web service
Moar data, moar Hadoop
Mesos let us treat a cluster of
nodes...
As one big computer
Not as individual machines
Not as VMs
But as computational resources
like cores, memory, disks, etc.
240 million monthly active
users
500 million tweets per day
Up to 150k tweets per second
More than 100TB per day of
compressed data
“Mesos is the cornerstone of our elastic
compute infrastructure — it's how we build all
our new services and is critical for Twitter's
continued success at scale. It's one of the
primary keys to our data center efficiency.” —
Chris Fry, SVP of Engineering at Twitter
Scale your docker containers with Mesos
Scale your docker containers with Mesos
Scale your docker containers with Mesos
Scale your docker containers with Mesos
 
Containerization in Mesos, a brief history
Mesos is...
 A top-level Apache project
 A cluster resource negotiator
 Scalable to 10,000s of nodes
 Fault-tolerant, battle-tested
 An SDK for distributed apps
 
Mesos for all the things
 Marathon  Mesoswhat?
Chronos
Demo!
a self-serve interface to your cluster
distributed "init" for long-running services
a private fault-tolerant PaaS
Marathon does it!
Start, stop, scale, update apps
Nice web interface, API
Highly available, no SPoF
Native Docker support
Fully featured REST API
Pluggable event bus
Rolling deploy / restart
Application health checks
Artifact staging
   Chronos
Mesoswhat?
Marathon
Demo!
Introducing Chronos
a scheduler for batch and one-off jobs
Distribute a graph of jobs
Dependency graph for execution
Features
Distributed job scheduler
Web interface, API
Highly available, no SPoF
Native Docker support
Easy scheduling with repeating intervals
Chronos  REST
PUTchronos-node:8080/scheduler/job/job1
GETchronos-node:8080/scheduler/jobs
DELETEchronos-node:8080/scheduler/task/kill/job2
   
Demo!
Mesoswhat?
Marathon
Chronos
Thanks!
Come and talk to me
P.S., we're hiring!

More Related Content

PDF
Doing Big Data for Real with Docker
PDF
Mesos: The Operating System for your Datacenter
PDF
Mesos vs kubernetes comparison
PDF
Federated mesos clusters for global data center designs
PPTX
HA Kubernetes on Mesos / Marathon
PDF
Discover the all new Mesosphere DC/OS 1.10
PDF
IoT on DCOS - Scala By the Bay 2015
PDF
Mesos: Cluster Management System
Doing Big Data for Real with Docker
Mesos: The Operating System for your Datacenter
Mesos vs kubernetes comparison
Federated mesos clusters for global data center designs
HA Kubernetes on Mesos / Marathon
Discover the all new Mesosphere DC/OS 1.10
IoT on DCOS - Scala By the Bay 2015
Mesos: Cluster Management System

What's hot (20)

PDF
DEPLOYING A DOCKERIZED DISTRIBUTED APPLICATION IN MESOS
PDF
Datacenter Computing with Apache Mesos - シリコンバレー日本人駐在員Meetup
PDF
OSDC 2018 | Lifecycle of a resource. Codifying infrastructure with Terraform ...
PDF
Downtime is not an option - day 2 operations - Jörg Schad
PPTX
Introduction to DC/OS
PPTX
How to build an HA container orchestrator infrastructure for production – Giu...
PDF
Highly scalable caching service on cloud - Redis
PPTX
Running Distributed TensorFlow with GPUs on Mesos with DC/OS
PDF
OSDC 2018 | The operational brain: how new Paradigms like Machine Learning ar...
PDF
Cloud Foundry Summit 2015: Building a Robust Cloud Foundry (HA, Security and DR)
PPTX
Micro services vs hadoop
PPTX
Cloud Foundry and OpenStack - A Marriage Made in Heaven! (Cloud Foundry Summi...
PPTX
Introduction to helm
PPTX
Introduction to container mangement
PPTX
PDF
Managing Ceph operational complexity with Juju
PPTX
Mario Cartia - SMACK is the new LAMP! - Codemotion Milan 2017
PDF
Performance improvements in etcd 3.5 release
PPTX
The Mushroom Cloud Effect or What Happens When Containers Fail? by Alois Mayr...
PDF
Re-Platforming All the Things
DEPLOYING A DOCKERIZED DISTRIBUTED APPLICATION IN MESOS
Datacenter Computing with Apache Mesos - シリコンバレー日本人駐在員Meetup
OSDC 2018 | Lifecycle of a resource. Codifying infrastructure with Terraform ...
Downtime is not an option - day 2 operations - Jörg Schad
Introduction to DC/OS
How to build an HA container orchestrator infrastructure for production – Giu...
Highly scalable caching service on cloud - Redis
Running Distributed TensorFlow with GPUs on Mesos with DC/OS
OSDC 2018 | The operational brain: how new Paradigms like Machine Learning ar...
Cloud Foundry Summit 2015: Building a Robust Cloud Foundry (HA, Security and DR)
Micro services vs hadoop
Cloud Foundry and OpenStack - A Marriage Made in Heaven! (Cloud Foundry Summi...
Introduction to helm
Introduction to container mangement
Managing Ceph operational complexity with Juju
Mario Cartia - SMACK is the new LAMP! - Codemotion Milan 2017
Performance improvements in etcd 3.5 release
The Mushroom Cloud Effect or What Happens When Containers Fail? by Alois Mayr...
Re-Platforming All the Things
Ad

Similar to Scale your docker containers with Mesos (20)

PDF
Building Web Scale Apps with Docker and Mesos by Alex Rukletsov (Mesosphere)
PDF
Apache Mesos Overview and Integration
PDF
ContainerDayVietnam2016: Docker at scale with Mesos
PDF
Introduction to Apache Mesos and DC/OS
PDF
Scaling and Embracing Failure: Clustering Docker with Mesos
PDF
Musings on Mesos: Docker, Kubernetes, and Beyond.
PDF
Introduction to DC/OS
PPTX
Intro to cluster scheduler for Linux containers
PDF
From Monolith to Docker Distributed Applications. JavaOne
PPTX
Containerization - The DevOps Revolution
PDF
DCOS Presentation
PDF
Thinking in Terms of a Data Center Operating System
PPTX
Scalable On-Demand Hadoop Clusters with Docker and Mesos
PPTX
Scalable On-Demand Hadoop Clusters with Docker and Mesos
PDF
Introduction to DC/OS
PPTX
Mesos and Kubernetes ecosystem overview
PPTX
To Build My Own Cloud with Blackjack…
PPTX
Cluster Management _ kubernetes MADIHA HARIFI
PDF
Mesos: A State-of-the-art Container Orchestrator
PDF
Choosing PaaS: Cisco and Open Source Options: an overview
Building Web Scale Apps with Docker and Mesos by Alex Rukletsov (Mesosphere)
Apache Mesos Overview and Integration
ContainerDayVietnam2016: Docker at scale with Mesos
Introduction to Apache Mesos and DC/OS
Scaling and Embracing Failure: Clustering Docker with Mesos
Musings on Mesos: Docker, Kubernetes, and Beyond.
Introduction to DC/OS
Intro to cluster scheduler for Linux containers
From Monolith to Docker Distributed Applications. JavaOne
Containerization - The DevOps Revolution
DCOS Presentation
Thinking in Terms of a Data Center Operating System
Scalable On-Demand Hadoop Clusters with Docker and Mesos
Scalable On-Demand Hadoop Clusters with Docker and Mesos
Introduction to DC/OS
Mesos and Kubernetes ecosystem overview
To Build My Own Cloud with Blackjack…
Cluster Management _ kubernetes MADIHA HARIFI
Mesos: A State-of-the-art Container Orchestrator
Choosing PaaS: Cisco and Open Source Options: an overview
Ad

Recently uploaded (20)

PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
PDF
PPT on Performance Review to get promotions
PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
PPTX
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
PDF
composite construction of structures.pdf
PPT
Project quality management in manufacturing
PPTX
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
PPTX
Lesson 3_Tessellation.pptx finite Mathematics
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PDF
Operating System & Kernel Study Guide-1 - converted.pdf
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
PPTX
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PPTX
Recipes for Real Time Voice AI WebRTC, SLMs and Open Source Software.pptx
PDF
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
PPT
Mechanical Engineering MATERIALS Selection
PPTX
Foundation to blockchain - A guide to Blockchain Tech
PDF
Structs to JSON How Go Powers REST APIs.pdf
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
PPT on Performance Review to get promotions
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
composite construction of structures.pdf
Project quality management in manufacturing
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
Lesson 3_Tessellation.pptx finite Mathematics
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
Operating System & Kernel Study Guide-1 - converted.pdf
UNIT-1 - COAL BASED THERMAL POWER PLANTS
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
Recipes for Real Time Voice AI WebRTC, SLMs and Open Source Software.pptx
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
Mechanical Engineering MATERIALS Selection
Foundation to blockchain - A guide to Blockchain Tech
Structs to JSON How Go Powers REST APIs.pdf

Scale your docker containers with Mesos