Doing Dropbox the Native Cloud Native Way

© 2017 Mesosphere, Inc. All Rights Reserved. 1
Doing “DropBox” the
Cloud Native Way
@__krishnan @joerg_schad @dcos @Minio

Krishnan Parthasarathi
Distributed Systems Engineer
@__krishnan
Jörg Schad
Distributed Systems Engineer
@joerg_schad

In the beginning
there was a big
Monolith

© 2015 Mesosphere, Inc. All Rights Reserved.
Hardware
Operating System
Application
4
COMPUTERS

noun | ˈmīkrō/ /ˈsərvəs/ :
an approach to application development in which a
large application is built as a suite of modular services.
Each module supports a specific business goal and
uses a simple, well-defined interface to communicate
with other modules.*
Microservices are designed to be flexible, resilient,
efficient, robust, and individually scalable.
*From whatis.com
OVERVIEW

LEGACY STACK (LAMP)
Linux
Apache
MySQL
PHP
MODERN STACK
(Linux)
Container Runtime
Container Orchestration
Persistence
(Redis / ElasticSearch / Object Storage / etc)
6

© Gerard Julien/AFP
Run everything in containers!

STATELESS CONTAINERS
Application logic
Immutable (no state)
Think “functional” programming or SSA
Scalable instances:
single → thousands → millions
STATEFUL CONTAINERS
Use mix of technologies
depending on needs
8
PARADIGM: MANY STATELESS + FEW STATEFUL

ServiceApp ServiceServiceAppApp
OS
9
CONTAINER
S
- Rapid deployment
- Dependency
vendoring
- Container image
repositories
- Spreadsheet
scheduling
OS OS
Machine
Infrastructure
Machine Machine
Container Runtime Container Runtime Container Runtime
ServiceService ServiceServiceServiceService

CONTAINER
SCHEDULING
RESOURCE
MANAGEMENT
SERVICE
MANAGEMENT
- Load Balancing
- Readiness Checking
CONTAINER ORCHESTRATION

CONTAINER
SCHEDULING
- Placement
- Replication/Scaling
- Resurrection
- Rescheduling
- Rolling Deployment
- Upgrades
- Downgrades
- Collocation
RESOURCE
MANAGEMENT
- Memory
- CPU
- GPU
- Volumes
- Ports
- IPs
- Images/Artifacts
SERVICE
MANAGEMENT
- Labels
- Groups/Namespaces
- Dependencies
- Load Balancing
- Readiness Checking
CONTAINER ORCHESTRATION

Orchestration
12
Machine Infrastructure
Web Apps & Services
Scheduling
Resource Management
Container Runtime
Machine & OS
Service Management
CONTAINER
ORCHESTRA
TION
Machine & OS Machine & OS
Container Runtime Container Runtime

MINIO
Provision object storage as
containers
Infrastructure
Services
Orchestration Docker Swarm
13

Persistence

etc..
DIFFERENT KINDS OF STATE / DATA
15
SQL
AMQP Kafka
MESSAGES
TEXTJSONLARGE BLOBS KV DATA
Consul etcd
CONFIG DATA

USE OBJECT STORAGE FOR UNSTRUCTURED DATA/BLOBS
EXAMPLES:
16

MINIO SERVER MINIO CLIENT MINIO SDK
17
MINIO

1 BINARY / 3 FLAVORS
FS backend
$ minio server /dir
XL backend with Erasure code & bitrot protection
$ minio server /disk1 /disk2 /disk3 /disk4 ... /disk16
Distributed up to 16 servers
$ minio server host1:/disk host2:/disk host3:/disk ... host16:/disk
18
MINIO

OBJECT ERASURE-CODED OVER 16 DRIVES
19

Minio 2 Minio 3 Minio 16
JBOD
Erasure Code (2x2, 4x4, 6x6, 8x8) - Maximum 16 Disks / Setup
JBODJBODJBOD
Minio 1
20

Minio constrained by design
Don’t worry about failed drives, designed to let things fail
16 disk/server: can stand up to 8 failed
Migrate data to new servers as servers age (think 5 years)
Deploy many Minio instances
Use KV store to keep track of Minio instance
Provision more instances as you grow
21

NAIVE APPROACH
Typical Datacenter
siloed, over-provisioned servers,
low utilization
Industry Average
12-15% utilization
mySQL
microservice
Cassandra
Spark/Hadoop
Kafka

MULTIPLEXING OF DATA, SERVICES, USERS,
ENVIRONMENTS
Typical Datacenter
siloed, over-provisioned servers,
low utilization
Mesos/ DC/OS
automated schedulers, workload multiplexing onto the
same machines
mySQL
microservice
Cassandra
Spark/Hadoop
Kafka

• A top-level Apache project
• A cluster resource
negotiator
• Scalable to 10,000s of
nodes
• Fault-tolerant, battle-tested
• An SDK for distributed apps
• Native Docker support
26
Apache Mesos

Persistence
● Multiple storage requirements
for different apps & data
services
● Multiple storage technologies
and backends (SAN, NAS, DAS
Local Disk, NFS, iSCSI)
● Storage operations (Create,
Destroy, Mount, Unmount) not
traditionally automated
● Dynamically load the
appropriate driver/plug-ins
(Image source: DELL EMC {CODE} BLOG)

OSS Datacenter Operating System (DC/OS)
Distributed Systems Kernel (Mesos)
DC/OS ENABLES MODERN DISTRIBUTED APPS
Big Data + Analytics EnginesMicroservices (in containers)
Streaming
Batch
Machine Learning
Analytics
Functions &
Logic
Search
Time Series
SQL / NoSQL
Databases
Modern App Components
Any Infrastructure (Physical, Virtual, Cloud)
29

STATELESS STATEFUL
API Server
(golang)
Webserver
(node.js/angular)
(users)
(index)(blobs)
(text search)
30

Demo

Keep it running!

Operations
● Configuration Updates (ex: Scaling, re-configuration)
● Binary Upgrades
● Cluster Maintenance (ex: Backup, Restore, Restart)
● Monitor progress of operations
● Debugging any runtime blockages

Monitoring
- Collecting metrics
- Routing events
- Downstream processing
● Alerting
● Dashboards
● Storage (long-term retention)
Logging
- Scopes
- Local vs. Central
- Security considerations
DAY 2 OPERATIONS

Maintenance
- Cluster Upgrades
- Cluster Resizing
- Capacity Planning
- User & Package Management
- Networking Policies
- Auditing
- Backups & Disaster Recovery
Troubleshooting
- Debugging
● Services
● System
● Access?
- Tracing
- Chaos Engineering
DAY 2 OPERATIONS

/minio
slack.minio.io
@minio
@dcos
/dcos
/dcos/demos
chat.dcos.io
Questions?

Doing Dropbox the Native Cloud Native Way

More Related Content

What's hot (20)

Similar to Doing Dropbox the Native Cloud Native Way (20)

Recently uploaded (20)

Doing Dropbox the Native Cloud Native Way