SlideShare a Scribd company logo
HEKETI FUNCTIONALITY
INTO GLUSTERD2
as seen by heketi developers...
Michael Adam
hacker, Red Hat ;-)
Raghavendra Talur
developer, Red Hat
@raghavendra_t
1
AGENDA
1
Glusterd.Next
2
Heketi
3
Heketi features into Glusterd2 ?!
4
Demo/PoC
2
GLUSTERD.NEXT
1 RESTful API
Next generation Infrastructure setup and management needs tool to tool
communication
2 Abstract bricks and treat Volumes as smallest unit
Opens possibility of many features like brick splitting, dynamic replication, automatic
failover/migration
3 Easier and safer management operations
Need to reduce involvement of admin in operations like rebalance, self heal, node &
disk replacement
4 Better integration with other tools/programs
Better coupling with Samba, NFS-Ganesha, Swift to provide more guarantees on
service
3
GLUSTERD2
1
People started to talk about a glusterd2 project
2
There were concrete designs/ideas for the api and implementation of
disk-manangement features...
4
ENTER HEKETI
1
project glusterd2 was started in mid 2015
2
In early/mid 2015, Luis Pabon started an external project
https://github.com/heketi/heketi
3
Should probably have been https://github.com/gluster/heketi ...
4
Implements several of the ideas of higher-level disk/volume-
management of gd.next / gd2 (much more narrow scope)
5
heketi was put into production in mid 2016 (Aplo/CNS)
6
development can be in sync with kubernetes pace!
7
golang, ~ 28K loc, > 50% test code
5
HEKETI
1
RESTful API
(=> One Glusterd.Next request satisfied)
2
hide vol create complexity, disk management
(=> Second request for Glusterd.Next satisfied)
3
implements complicated admin ops (newer)...
(=> third request partially satisfied)
4
Manage multiple Gluster clusters
5
allow for N+1 scaling
6
HEKETI - DESIGN
7
HEKETI - DESIGN
[
{Zone3, Node 192.168.13.100, Device /dev/sda},
{Zone2, Node 192.168.12.100, Device /dev/sda},
{Zone4, Node 192.168.14.100, Device /dev/sda},
{Zone1, Node 192.168.11.100, Device /dev/sda},
{Zone3, Node 192.168.13.100, Device /dev/sdb},
{Zone2, Node 192.168.12.100, Device /dev/sdb}
]
8
HEKETI - TRADE-OFFS
1
state additional to gluster
=> no brown-field, no cli-mixing...
2
need to mirror gluster features in heketi for support
3
Heketi is not distributed
=>spof, but HA in kubernetes
4
Acceptance in gluster community :-)
=> almost only used by kubernetes...
9
HEKETI FEATURES IN GLUSTERD2
1
Volume create should support providing bricks OR size
maintains backward compatibility
2
Adding new volume types to Gluster becomes easier
small changes to brick creator/selector code
3
New features related to brick selection should work
For example, brick splitting as a feature should work with the design
10
HEKETI FEATURE IN GLUSTERD2
11
HEKETI FEATURE IN GLUSTERD2
12
HEKETI FEATURE IN GLUSTERD2
13
HEKETI FEATURE IN GLUSTERD2
DEMO
14

More Related Content

PDF
Gluster as Native Storage for Containers - past, present and future
PDF
Scalability and Performance of CNS 3.6
PDF
Gluster: a SWOT Analysis
PDF
Data Reduction for Gluster with VDO
PDF
Gluster and Kubernetes
PDF
reInvent 2021 Recap and k9s review
PDF
Kubernetes Webinar - Using ConfigMaps & Secrets
PDF
Kubernetes Workshop
Gluster as Native Storage for Containers - past, present and future
Scalability and Performance of CNS 3.6
Gluster: a SWOT Analysis
Data Reduction for Gluster with VDO
Gluster and Kubernetes
reInvent 2021 Recap and k9s review
Kubernetes Webinar - Using ConfigMaps & Secrets
Kubernetes Workshop

What's hot (19)

ODP
Gluster containers!
ODP
GlusterFS Containers
PDF
Arbiter volumes in gluster
ODP
Persistent Storage in Openshift using GlusterFS
PDF
Gluster Containerized Storage for Cloud Applications
PDF
Kubernetes Webinar Series - Exploring Daemon Sets and Jobs
PDF
Introduction to Kubernetes
PDF
Kubernetes: training micro-dragons for a serious battle
PPTX
Kuberenetes - From Zero to Hero
PDF
Kubernetes in 20 minutes - HDE Monthly Technical Session 24
ODP
Accessing gluster ufo_-_eco_willson
PDF
Using ansible to core os & kubernetes clusters
PDF
CRI Runtimes Deep-Dive: Who's Running My Pod!?
PDF
Microservices on Kubernetes - The simple way
PPTX
Containerd internals: building a core container runtime
PPTX
Introduction kubernetes 2017_12_24
PDF
Gluster as Block Store in Containers
PDF
Getting started with kubernetes
PDF
Using linuxKit to build custom rancherOS systems
Gluster containers!
GlusterFS Containers
Arbiter volumes in gluster
Persistent Storage in Openshift using GlusterFS
Gluster Containerized Storage for Cloud Applications
Kubernetes Webinar Series - Exploring Daemon Sets and Jobs
Introduction to Kubernetes
Kubernetes: training micro-dragons for a serious battle
Kuberenetes - From Zero to Hero
Kubernetes in 20 minutes - HDE Monthly Technical Session 24
Accessing gluster ufo_-_eco_willson
Using ansible to core os & kubernetes clusters
CRI Runtimes Deep-Dive: Who's Running My Pod!?
Microservices on Kubernetes - The simple way
Containerd internals: building a core container runtime
Introduction kubernetes 2017_12_24
Gluster as Block Store in Containers
Getting started with kubernetes
Using linuxKit to build custom rancherOS systems
Ad

Similar to Heketi Functionality into Glusterd2 (20)

PDF
2008-06-25 Marist System z Summer Professors Series
PDF
[EXTENDED] Ceph, Docker, Heroku Slugs, CoreOS and Deis Overview
PDF
Put the dev back in devops - Cloud-native at local speed! - RH Summit 19
PDF
Zaragoza dev ops-activiti-khd-20181212
PDF
Shifter: Containers in HPC Environments
PDF
2008-11-13 CAVMEN RHEL for System z Deep Dive
PDF
Load-balancing high-available web-app with Docker Swarm cluster. - Simone Sol...
PDF
OpenShift: Java EE in the clouds
PPTX
Codemotion Rome 2018 Docker Swarm Mode
PDF
Building Hopsworks, a cloud-native managed feature store for machine learning
PPT
vBACD - Introduction to Opscode Chef - 2/29
PDF
DevFest 2022 - Cloud Workstation Introduction TaiChung
PDF
Painless ruby deployment on shelly cloud
PDF
Red Hat Summit 2017: Wicked Fast PaaS: Performance Tuning of OpenShift and D...
PDF
Techtalks: taking docker to production
PDF
JOSA TechTalk: Taking Docker to Production
PDF
Kubernetes laravel and kubernetes
PDF
Best practices for optimizing Red Hat platforms for large scale datacenter de...
PDF
Kubernetes extensibility: CRDs & Operators
PDF
Kubernetes extensibility: crd & operators
2008-06-25 Marist System z Summer Professors Series
[EXTENDED] Ceph, Docker, Heroku Slugs, CoreOS and Deis Overview
Put the dev back in devops - Cloud-native at local speed! - RH Summit 19
Zaragoza dev ops-activiti-khd-20181212
Shifter: Containers in HPC Environments
2008-11-13 CAVMEN RHEL for System z Deep Dive
Load-balancing high-available web-app with Docker Swarm cluster. - Simone Sol...
OpenShift: Java EE in the clouds
Codemotion Rome 2018 Docker Swarm Mode
Building Hopsworks, a cloud-native managed feature store for machine learning
vBACD - Introduction to Opscode Chef - 2/29
DevFest 2022 - Cloud Workstation Introduction TaiChung
Painless ruby deployment on shelly cloud
Red Hat Summit 2017: Wicked Fast PaaS: Performance Tuning of OpenShift and D...
Techtalks: taking docker to production
JOSA TechTalk: Taking Docker to Production
Kubernetes laravel and kubernetes
Best practices for optimizing Red Hat platforms for large scale datacenter de...
Kubernetes extensibility: CRDs & Operators
Kubernetes extensibility: crd & operators
Ad

More from Gluster.org (20)

PDF
Automating Gluster @ Facebook - Shreyas Siravara
PDF
nfusr: a new userspace NFS client based on libnfs - Shreyas Siravara
PDF
Facebook’s upstream approach to GlusterFS - David Hasson
PDF
Throttling Traffic at Facebook Scale
PDF
GlusterFS w/ Tiered XFS
PDF
Gluster Metrics: why they are crucial for running stable deployments of all s...
PDF
Up and Running with Glusto & Glusto-Tests in 5 Minutes (or less)
PDF
Releases: What are contributors responsible for
PDF
RIO Distribution: Reconstructing the onion - Shyamsundar Ranganathan
PDF
Native Clients, more the merrier with GFProxy!
PDF
GlusterD-2.0: What's Happening? - Kaushal Madappa
PDF
What Makes Us Fail
PDF
Hands On Gluster with Jeff Darcy
PDF
Architecture of the High Availability Solution for Ganesha and Samba with Kal...
PDF
Challenges with Gluster and Persistent Memory with Dan Lambright
PDF
Deploying pNFS over Distributed File Storage w/ Jiffin Tony Thottan and Niels...
PDF
Sharding: Past, Present and Future with Krutika Dhananjay
PDF
State of Gluster Performance
PDF
Integration of Glusterfs in to commvault simpana
PDF
GFProxy: Scaling the GlusterFS FUSE Client
Automating Gluster @ Facebook - Shreyas Siravara
nfusr: a new userspace NFS client based on libnfs - Shreyas Siravara
Facebook’s upstream approach to GlusterFS - David Hasson
Throttling Traffic at Facebook Scale
GlusterFS w/ Tiered XFS
Gluster Metrics: why they are crucial for running stable deployments of all s...
Up and Running with Glusto & Glusto-Tests in 5 Minutes (or less)
Releases: What are contributors responsible for
RIO Distribution: Reconstructing the onion - Shyamsundar Ranganathan
Native Clients, more the merrier with GFProxy!
GlusterD-2.0: What's Happening? - Kaushal Madappa
What Makes Us Fail
Hands On Gluster with Jeff Darcy
Architecture of the High Availability Solution for Ganesha and Samba with Kal...
Challenges with Gluster and Persistent Memory with Dan Lambright
Deploying pNFS over Distributed File Storage w/ Jiffin Tony Thottan and Niels...
Sharding: Past, Present and Future with Krutika Dhananjay
State of Gluster Performance
Integration of Glusterfs in to commvault simpana
GFProxy: Scaling the GlusterFS FUSE Client

Recently uploaded (20)

PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
KodekX | Application Modernization Development
PDF
Chapter 3 Spatial Domain Image Processing.pdf
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Modernizing your data center with Dell and AMD
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Empathic Computing: Creating Shared Understanding
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
NewMind AI Monthly Chronicles - July 2025
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PPTX
Big Data Technologies - Introduction.pptx
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
NewMind AI Weekly Chronicles - August'25 Week I
KodekX | Application Modernization Development
Chapter 3 Spatial Domain Image Processing.pdf
The AUB Centre for AI in Media Proposal.docx
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Modernizing your data center with Dell and AMD
20250228 LYD VKU AI Blended-Learning.pptx
The Rise and Fall of 3GPP – Time for a Sabbatical?
Empathic Computing: Creating Shared Understanding
Per capita expenditure prediction using model stacking based on satellite ima...
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
NewMind AI Monthly Chronicles - July 2025
Understanding_Digital_Forensics_Presentation.pptx
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Big Data Technologies - Introduction.pptx
Network Security Unit 5.pdf for BCA BBA.
Unlocking AI with Model Context Protocol (MCP)
Building Integrated photovoltaic BIPV_UPV.pdf

Heketi Functionality into Glusterd2

  • 1. HEKETI FUNCTIONALITY INTO GLUSTERD2 as seen by heketi developers... Michael Adam hacker, Red Hat ;-) Raghavendra Talur developer, Red Hat @raghavendra_t 1
  • 3. GLUSTERD.NEXT 1 RESTful API Next generation Infrastructure setup and management needs tool to tool communication 2 Abstract bricks and treat Volumes as smallest unit Opens possibility of many features like brick splitting, dynamic replication, automatic failover/migration 3 Easier and safer management operations Need to reduce involvement of admin in operations like rebalance, self heal, node & disk replacement 4 Better integration with other tools/programs Better coupling with Samba, NFS-Ganesha, Swift to provide more guarantees on service 3
  • 4. GLUSTERD2 1 People started to talk about a glusterd2 project 2 There were concrete designs/ideas for the api and implementation of disk-manangement features... 4
  • 5. ENTER HEKETI 1 project glusterd2 was started in mid 2015 2 In early/mid 2015, Luis Pabon started an external project https://github.com/heketi/heketi 3 Should probably have been https://github.com/gluster/heketi ... 4 Implements several of the ideas of higher-level disk/volume- management of gd.next / gd2 (much more narrow scope) 5 heketi was put into production in mid 2016 (Aplo/CNS) 6 development can be in sync with kubernetes pace! 7 golang, ~ 28K loc, > 50% test code 5
  • 6. HEKETI 1 RESTful API (=> One Glusterd.Next request satisfied) 2 hide vol create complexity, disk management (=> Second request for Glusterd.Next satisfied) 3 implements complicated admin ops (newer)... (=> third request partially satisfied) 4 Manage multiple Gluster clusters 5 allow for N+1 scaling 6
  • 8. HEKETI - DESIGN [ {Zone3, Node 192.168.13.100, Device /dev/sda}, {Zone2, Node 192.168.12.100, Device /dev/sda}, {Zone4, Node 192.168.14.100, Device /dev/sda}, {Zone1, Node 192.168.11.100, Device /dev/sda}, {Zone3, Node 192.168.13.100, Device /dev/sdb}, {Zone2, Node 192.168.12.100, Device /dev/sdb} ] 8
  • 9. HEKETI - TRADE-OFFS 1 state additional to gluster => no brown-field, no cli-mixing... 2 need to mirror gluster features in heketi for support 3 Heketi is not distributed =>spof, but HA in kubernetes 4 Acceptance in gluster community :-) => almost only used by kubernetes... 9
  • 10. HEKETI FEATURES IN GLUSTERD2 1 Volume create should support providing bricks OR size maintains backward compatibility 2 Adding new volume types to Gluster becomes easier small changes to brick creator/selector code 3 New features related to brick selection should work For example, brick splitting as a feature should work with the design 10
  • 11. HEKETI FEATURE IN GLUSTERD2 11
  • 12. HEKETI FEATURE IN GLUSTERD2 12
  • 13. HEKETI FEATURE IN GLUSTERD2 13
  • 14. HEKETI FEATURE IN GLUSTERD2 DEMO 14