SlideShare a Scribd company logo
Persistent, Portable Storage
for Docker Containers and Microservices
Container adoption
2 Source: DevOps.com – “The Current State of Container Usage” – survey of 285 IT pros – commissioned by ClusterHQ, June 2015.
Visit https://clusterhq.com/2015/06/17/container-survey/ to access study.
70%want to run a database
or other stateful service
in containers
65%plan to use containers
in production in the
next 12 months
66%say data management is
critical to success and a
gating factor
State of Docker and storage
The nature of container architectures. . .
• Data inside a container is ephemeral
• Volumes not portable between hosts
But what if I want to. . .
• Run a stateful application?
• Dynamically provision storage?
• Move apps between hosts?
• Retain data past the life of the container?
3
Solution: ClusterHQ and Hedvig
• Creators of open-source
project Flocker
• Container data volume
management software
4
+
• Creators of the Hedvig
Distributed Storage Platform
• Founded by Cassandra
inventor, Avinash Lakshman
Elastic
Scale to petabytes of data
5
Simple
Provision block, file, and object
storage with enterprise features
Flexible
Connects to any compute, runs
in any cloud
6
Dynamic storage
provisioning
Instantly create persistent virtual
volumes up to petabytes in size
Automatic data
migration
Automate volume movement from
source to target nodes
Flexible volume
configuration
Set volume features to meet
unique application needs
+
Hedvig Distributed Storage Platform
Dynamic storage provisioning and migration
7
Container
Data
Volume
Container
Data
Volume
Container
Data
Volume
Container
Data
Volume
Container
Data
Volume
Server A
Container
Data
Volume
Container
Data
Volume
Container
Data
Volume
Container
Data
Volume
Container
Data
Volume
Server B
Hedvig-Flocker driver functions:
• create_volume – creates a new volume with chosen parameters
• attach_volume – gives volume access to a specific node
• get_device_path – returns device mount path on a node
• list_volumes – lists volumes attached to a node
• detach_volume – removes volume access from a node
• destroy_volume – deletes the volume
Composition
e.g., Docker
Compose
Flocker
control service
Orchestration e.g.,
Docker SwarmFlocker plugin
Volume 1
Docker
Container 1
Hedvig-Flocker driver
Flocker agent
Flocker plugin
Volume 1
Docker
Container 1
Hedvig-Flocker driver
Flocker agent
Hedvig Distributed Storage Platform
Server A Server B
Thank You!

More Related Content

PPTX
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
PPTX
Modern storage for modern business: get to know Hedvig
PPT
Containerized Storage
PDF
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
PPTX
Red Hat Storage Day Seattle: Stretching A Gluster Cluster for Resilient Messa...
PPTX
Implementation of Dense Storage Utilizing HDDs with SSDs and PCIe Flash Acc...
PPTX
Red Hat Storage Day Dallas - Why Software-defined Storage Matters
PPTX
Best practices for using flash in hyperscale software storage architectures
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Modern storage for modern business: get to know Hedvig
Containerized Storage
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Red Hat Storage Day Seattle: Stretching A Gluster Cluster for Resilient Messa...
Implementation of Dense Storage Utilizing HDDs with SSDs and PCIe Flash Acc...
Red Hat Storage Day Dallas - Why Software-defined Storage Matters
Best practices for using flash in hyperscale software storage architectures

What's hot (20)

PDF
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
PDF
Red Hat Storage Day New York - Red Hat Gluster Storage: Historical Tick Data ...
PDF
Red Hat Storage Day Boston - Persistent Storage for Containers
PPTX
Red Hat Storage Day Dallas - Defiance of the Appliance
PPTX
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
PDF
Red Hat Storage Day New York - Welcome Remarks
PPTX
Red Hat Storage Day Atlanta - Why Software Defined Storage Matters
PPTX
Hedvig slides from VMworld 2016
PDF
Red Hat Storage Day New York - Intel Unlocking Big Data Infrastructure Effici...
PDF
Achieving Separation of Compute and Storage in a Cloud World
PDF
Red Hat Storage: Emerging Use Cases
PPTX
Red Hat Storage Day Dallas - Gluster Storage in Containerized Application
PPTX
Red Hat Storage Day Seattle: Persistent Storage for Containerized Applications
PDF
Building modern data lakes
PPTX
Red Hat Storage Day LA - Performance and Sizing Software Defined Storage
PDF
Distributed storage system
PDF
Data Virtualization in the Cloud: Accelerating Data Virtualization Adoption
PPTX
Survey of distributed storage system
PDF
Ceph c01
PPTX
Red Hat Storage Day LA - Why Software-Defined Storage Matters and Web-Scale O...
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
Red Hat Storage Day New York - Red Hat Gluster Storage: Historical Tick Data ...
Red Hat Storage Day Boston - Persistent Storage for Containers
Red Hat Storage Day Dallas - Defiance of the Appliance
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red Hat Storage Day New York - Welcome Remarks
Red Hat Storage Day Atlanta - Why Software Defined Storage Matters
Hedvig slides from VMworld 2016
Red Hat Storage Day New York - Intel Unlocking Big Data Infrastructure Effici...
Achieving Separation of Compute and Storage in a Cloud World
Red Hat Storage: Emerging Use Cases
Red Hat Storage Day Dallas - Gluster Storage in Containerized Application
Red Hat Storage Day Seattle: Persistent Storage for Containerized Applications
Building modern data lakes
Red Hat Storage Day LA - Performance and Sizing Software Defined Storage
Distributed storage system
Data Virtualization in the Cloud: Accelerating Data Virtualization Adoption
Survey of distributed storage system
Ceph c01
Red Hat Storage Day LA - Why Software-Defined Storage Matters and Web-Scale O...
Ad

Similar to Hedvig & ClusterHQ - Persistent, portable storage for Docker (20)

PPTX
Persistent, Portable Storage for Docker Containers and Microservices
PDF
A Tight Ship: How Containers and SDS Optimize the Enterprise
PPTX
Data Agility for Devops - OSI 2018
PPTX
From Insights to Value - Building a Modern Logical Data Lake to Drive User Ad...
PPTX
Project update: A collaborative approach to "filling the digital preservation...
PPTX
OpenSource and the Cloud ApacheCon.pptx
PPTX
Case Study: Implementing Hadoop and Elastic Map Reduce on Scale-out Object S...
PPT
Enabling Fast IT using Containers, Microservices and DevOps Model
PDF
2022-Devnexus-StatefulMicroservices.pptx.pdf
PPT
Intelligent Cloud Enablement
PPTX
OpenStack Swift In the Enterprise
PPTX
Потоковая обработка больших данных
PDF
Moving data to the cloud BY CESAR ROJAS from Pivotal
PDF
Data Warehouse or Data Lake, Which Do I Choose?
PPTX
In-Stream Processing Service Blueprint, Reference architecture for real-time ...
PDF
2022 Trends in Enterprise Analytics
PPTX
Working With Containers In The Enterprise
PPTX
Working With Containers In The Enterprise
PDF
Clouds, Clusters, and Containers: Tools for responsible, collaborative computing
PDF
Geo-distributed Analytics with NetApp StorageGRID and Alluxio
Persistent, Portable Storage for Docker Containers and Microservices
A Tight Ship: How Containers and SDS Optimize the Enterprise
Data Agility for Devops - OSI 2018
From Insights to Value - Building a Modern Logical Data Lake to Drive User Ad...
Project update: A collaborative approach to "filling the digital preservation...
OpenSource and the Cloud ApacheCon.pptx
Case Study: Implementing Hadoop and Elastic Map Reduce on Scale-out Object S...
Enabling Fast IT using Containers, Microservices and DevOps Model
2022-Devnexus-StatefulMicroservices.pptx.pdf
Intelligent Cloud Enablement
OpenStack Swift In the Enterprise
Потоковая обработка больших данных
Moving data to the cloud BY CESAR ROJAS from Pivotal
Data Warehouse or Data Lake, Which Do I Choose?
In-Stream Processing Service Blueprint, Reference architecture for real-time ...
2022 Trends in Enterprise Analytics
Working With Containers In The Enterprise
Working With Containers In The Enterprise
Clouds, Clusters, and Containers: Tools for responsible, collaborative computing
Geo-distributed Analytics with NetApp StorageGRID and Alluxio
Ad

Recently uploaded (20)

PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
A comparative analysis of optical character recognition models for extracting...
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Encapsulation theory and applications.pdf
PPTX
Machine Learning_overview_presentation.pptx
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PPT
Teaching material agriculture food technology
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Electronic commerce courselecture one. Pdf
PPTX
A Presentation on Artificial Intelligence
PPTX
MYSQL Presentation for SQL database connectivity
PPTX
Big Data Technologies - Introduction.pptx
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Diabetes mellitus diagnosis method based random forest with bat algorithm
NewMind AI Weekly Chronicles - August'25-Week II
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Assigned Numbers - 2025 - Bluetooth® Document
A comparative analysis of optical character recognition models for extracting...
The AUB Centre for AI in Media Proposal.docx
Encapsulation theory and applications.pdf
Machine Learning_overview_presentation.pptx
MIND Revenue Release Quarter 2 2025 Press Release
Teaching material agriculture food technology
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Electronic commerce courselecture one. Pdf
A Presentation on Artificial Intelligence
MYSQL Presentation for SQL database connectivity
Big Data Technologies - Introduction.pptx
Per capita expenditure prediction using model stacking based on satellite ima...
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Encapsulation_ Review paper, used for researhc scholars

Hedvig & ClusterHQ - Persistent, portable storage for Docker

  • 1. Persistent, Portable Storage for Docker Containers and Microservices
  • 2. Container adoption 2 Source: DevOps.com – “The Current State of Container Usage” – survey of 285 IT pros – commissioned by ClusterHQ, June 2015. Visit https://clusterhq.com/2015/06/17/container-survey/ to access study. 70%want to run a database or other stateful service in containers 65%plan to use containers in production in the next 12 months 66%say data management is critical to success and a gating factor
  • 3. State of Docker and storage The nature of container architectures. . . • Data inside a container is ephemeral • Volumes not portable between hosts But what if I want to. . . • Run a stateful application? • Dynamically provision storage? • Move apps between hosts? • Retain data past the life of the container? 3
  • 4. Solution: ClusterHQ and Hedvig • Creators of open-source project Flocker • Container data volume management software 4 + • Creators of the Hedvig Distributed Storage Platform • Founded by Cassandra inventor, Avinash Lakshman
  • 5. Elastic Scale to petabytes of data 5 Simple Provision block, file, and object storage with enterprise features Flexible Connects to any compute, runs in any cloud
  • 6. 6 Dynamic storage provisioning Instantly create persistent virtual volumes up to petabytes in size Automatic data migration Automate volume movement from source to target nodes Flexible volume configuration Set volume features to meet unique application needs +
  • 7. Hedvig Distributed Storage Platform Dynamic storage provisioning and migration 7 Container Data Volume Container Data Volume Container Data Volume Container Data Volume Container Data Volume Server A Container Data Volume Container Data Volume Container Data Volume Container Data Volume Container Data Volume Server B
  • 8. Hedvig-Flocker driver functions: • create_volume – creates a new volume with chosen parameters • attach_volume – gives volume access to a specific node • get_device_path – returns device mount path on a node • list_volumes – lists volumes attached to a node • detach_volume – removes volume access from a node • destroy_volume – deletes the volume
  • 9. Composition e.g., Docker Compose Flocker control service Orchestration e.g., Docker SwarmFlocker plugin Volume 1 Docker Container 1 Hedvig-Flocker driver Flocker agent Flocker plugin Volume 1 Docker Container 1 Hedvig-Flocker driver Flocker agent Hedvig Distributed Storage Platform Server A Server B

Editor's Notes

  • #4: Container clusters where volumes are a first class citizen Ephemeral Not portable Data inside containers is ephemeral Lack of data portability Stateful apps Persistent storage Friction…
  • #7: The missing link between enterprise storage and microservices environments.
  • #8: Docker daemon on typically Linux hosts.