Gluster Webinar: Introduction to GlusterFS v3.3
6 likes3,247 views
GlusterFS is a scalable, open-source file system designed for both object and network-attached storage, offering high availability, unified file and object access, and the ability to scale to petabytes. It operates in user space without reliance on kernel modifications, allowing for flexibility and compatibility with commodity hardware. The architecture features elastic hashing for metadata elimination, enabling faster access times and easier management across various deployment scenarios, including public and private clouds.
Gluster Webinar: Introduction to GlusterFS v3.3
- 1. Introduction To GlusterFS Audio is available via VoIP or Landline. For VoIP You will be connected to audio using your computer‟s speakers or headset. For Landline: Please select Use Telephone after joining the Webinar. US/Canada attendees dial (773) 945-1011 Access Code 584-930-717
- 2. Today’s Speakers Heather Wellington Tom Trainer Marketing Manager Director Gluster, Inc. Product Marketing Gluster, Inc. A Better Way To Do Storage 2
- 3. History of Gluster How it all started – Backgrounds in high performance, clustered computing – Working at Lawrence Livermore National Labs • AB Periasamy & Hitesh Chellani design “Thunder” • One of the worlds fastest super computers • On Intel commodity hardware • Solved filesystem scalability and performance limitations – Large customer in oil & gas persuaded them to focus on storage – Gluster founded by Hitesh & AB to bring technology to market Thunder Result: award winning technology A Better Way To Do Storage 3
- 4. What is the Gluster File System? A scale-out file system for object and network attached storage (NAS) GlusterFS provides – Flexibility to deploy in ANY environment – High availability – Unified files and objects – Scalability to Petabytes & beyond – Linearly scalable performance – Superior storage economics A Better Way To Do Storage 4
- 5. GlusterFS Architecture Design Goals Innovation – Eliminate metadata – improve file access time – Unify files and objects Elasticity – Flexibility adapt to growth/reduction – Add, delete volumes & users – Without disruption Scale linearly – Multiple dimensions • Performance • Capacity – Aggregated resources Performance Eliminate metadata – Improve file access speed Simplicity Capacity – Ease of management – No complex Kernel patches – Run in user space A Better Way To Do Storage 5
- 6. Key Differentiators Filesystem runs in user space Software only Open source Modular, stackable storage OS architecture Data stored in native formats No metadata – Elastic hashing Unified files and objects Virtual Machine (VM) virtual motion enabler A Better Way To Do Storage 6
- 7. Filesystem Runs in User Space User Space Not tied to kernel GlusterFS No reassemblies Server (CPU/Mem) Independence Kernel 1 TB 1 TB 1 TB 1 TB 1 TB 1 TB 1 TB 1 TB 1 TB 1 TB 1 TB 1 TB 1 TB 1 TB A Better Way To Do Storage 7
- 8. Software Only Hardware agnostic Superior storage economics & flexibility – Data center / private cloud use commodity hardware – Public cloud – i.e. AWS, RackSpace, GoGrid – pay for only what you need No lock-in – Hardware vendors-at purchase time or in the future – Public or private cloud – Performance, capacity, or availability levels – GlusterFS – not proprietary, files are stored in native formats (i.e. EXT4) A Better Way To Do Storage 8
- 9. Open Source 200,000+ downloads Global Adoption – ~15,000 /month 500+ registered deployments – 45 countries 2,500+ registered users – Mailing lists, Forums, etc. Active community – Diverse testing environments – Bugs identification and fixes – Code contributions Member of broader ecosystem – OpenStack, Linux Foundation, Open Virtualization Alliance A Better Way To Do Storage 9
- 10. Elastic Hashing No metadata server An algorithmic approach – Unique hash tag for each file stored – Tags stored within the file system – Rapid file read – low latency Traditional Central Metadata Server Innovative Elastic Approach A Better Way To Do Storage Traditional Distributed Metadata Server 10
- 11. A Standard Gluster NAS Deployment Clients/Apps Clients/Apps Clients/Apps Standard clients running standard apps IP Network Over any standard IP network Access application data, as files & folders, Gluster Global Namespace (NFS, CIFS, Gluster Native) in a global namespace, Application data VMs VMDK VMDK using a variety of standard protocols Stored in a commoditized, virtual storage pool virtualized, scale-out, centrally managed pool DAS, SAN, NAS A Better Way To Do Storage 11
- 12. Unifying Public and Private Cloud Storage Client/Apps Client/Apps Client/Apps Client/Apps Client/Apps Client/Apps Client/Apps Client/Apps Client/Apps IP Network Gluster Global Namespace Private Cloud Public Cloud Replication A Better Way To Do Storage 12
- 13. Deployment Scenarios Common Solutions Built on GlusterFS Media serving (CDN) Large scale file storage Unified file and object storage Tier 2 & 3 archive File sharing Multi-tenant file systems Storage for High Performance Computing (HPC) IaaS storage layer Disaster recovery Backup & restore Private cloud A Better Way To Do Storage 13
- 14. Introducing GlusterFS 3.3 (BETA) July 20, 2011 GlusterFS 3.3: Next generation file and object storage – The first system for data storage that enables you to store and access data as an object and as a file – Flexible and powerful, it simplifies access and management of data – Eases migration of legacy, file-based applications to object storage for use in the cloud Public beta availability: July 20, 2011 – Broad community testing and participation – Selected enterprise customer engagements A Better Way To Do Storage 14
- 15. The “Traditional” Unified Approach Files Objects DB’s “VNX reminds me of my old VHS, DVD and cable box…. ….one thing fails and I’m blown out of the water.” NAS Object Block Beta Customer , 2011 Carved Up Proprietary Storage Pool Bolt-on hardware approach – Combined hardware raises costs – Higher TCO Traditional Monolithic Hardware – Paying for what you many not need Bolt-on Approach (i.e. EMC VNX) Increased risk – Common hardware elements can fail • Power supplies • Fans • Cabling…lots of cabling A Better Way To Do Storage 15
- 16. Software Approach to File and Object High performance storage across heterogeneous server environments Window Access – Improves Windows performance – Uses HTTP, not slower CIFS – We will still support SAMBA Object Storage – API – Internet Protocol (IP) – ResTFul – Get/Put – Buckets – Objects seen as files Standards based – Amazon S3 ReSTFul interface compatible – Access data as objects and a NAS Network Attached Storage (NAS) interface to access files (NFS, CIFS, – NFS / CIFS / GlusterFS GlusterFS) – POSIX compliant – Access files within objects A Better Way To Do Storage 16
- 17. GlusterFS 3.3 Unified File & Object Storage Widely deployable and extremely flexible – On-premise, virtualized and in public and private clouds – Deep unification of file and object data storage • Not just unified at the management layer • Not a bolt-together hardware product – Access data within objects as files – Compatible with Amazon Web Services • S3 • Create S3 on EC2 and EBS – Back up objects from the data center to AWS – Enable S3 functionality in the data center – Built to run on commodity hardware A Better Way To Do Storage 17
- 18. GlusterFS 3.3 Easing & Accelerating Legacy App Migration Unified file & object storage accelerates legacy app migration to the cloud Gluster FS 3.3 Object Storage Data Center, Virtual Public, Private Cloud Object Info Enterprise Apps / Enterprise Data Center Enables cloudification of applications – Removes remaining storage hurdles related to file only access – Allows for gradual app migration to the cloud – Enables moves to both private and public cloud infrastructures A Better Way To Do Storage 18
- 19. Gluster 3.3 Unified File & Object – Use Cases S3 Data Center: S3 in house &/ integrate with S3 Data Center IaaS: Deliver S3 to clients – Take control of cloud services – Reduce AWS S3 costs – Deliver S3 like global services in-house – Legacy application migration IaaS – Deliver File and S3 Services – Unified file and object • Competitive differentiator – Drastically reduce storage costs Traditional Data Center Private Cloud – Increase offerings, revenues and margins IaaS A Better Way To Do Storage 19
- 20. The Gluster Connector for OpenStack – July 27, 2011 Enables GlusterFS to be the underlying file system Connects GlusterFS to Xen and KVM hypervisor – Unified File and Object storage OpenStack with Gluster – Highly-available, scale-out NAS – Alternative to SWIFT Mobile Apps. Web Clients. Enterprise Software Ecosystem API Layer OpenStack Prior to Gluster … Compute Unified File & Object Storage SWIFT OpenStack Imaging Services A Better Way To Do Storage 20
- 21. The Gluster Connector for OpenStack – July 27, 2011 Connector enables GlusterFS to be chosen as the filesystem – Provides: • Unified File and Object storage • Highly scalable NAS • High Availability – synchronous and asynchronous replication • Preferred, scalable alternative to SWIFT • Virtual motion of virtual machines (a.k.a. vmotion) VM VM VM VM VM VM VM VM Hypervisor Hypervisor GlusterFS GlusterFS Server Server (CPU/Mem) (CPU/Mem) Virtual storage pool A Better Way To Do Storage 21
- 22. Pandora Internet Radio Problem • Explosive user & title growth • As many as 12 file formats for each song • „Hot‟ content and long tail Solution • Three data centers, each with a six-node GlusterFS cluster • 1.2 PB of audio served • Replication for high availability per week • 250+ TB total capacity • 13 million files Benefits • Over 50 GB/sec peak • Easily scale capacity traffic • Centralized management; one administrator to manage day-to-day operations • No changes to application • Higher reliability A Better Way To Do Storage 22
- 23. Brightcove Problem • Cloud-based online video platform • Explosive customer & title growth • Massive video in multiple locations • Costs rising, esp. with HD formats Solution • Complete scale-out based on commodity DAS/JBOD • Replication for high availability • Over 1 PB currently in • 1PB total capacity Gluster • Separate 4 PB project Benefits in the works • Easily scale capacity • Centralized management; one administrator to manage day-to-day operations • Higher reliability • Path to multi-site A Better Way To Do Storage 23
- 24. Cincinnati Bell Technology Solutions Problem • Host a dedicated enterprise cloud solution • Large scale VMware environment • Need high availability Solution • Large scale VM • Gluster for VM storage, NFS to clients storage • SAS drives on back-end • Low cost service • Replication for high availability delivery for enterprise customer Benefits • Drastic reduction in • Storage provisioning from 6 wks to 15 min. provisioning time • Vendor agnostic storage • Low cost of service delivery • Elastic growth A Better Way To Do Storage 24
- 25. Partners Healthcare Private Cloud: Centralized Storage as a Service Problem • Capacity growth from 144TB to 1+PB • Multiple distributed users/departments • Multi OS access - Windows, Linux and Unix Solution • Over 500 TB • GlusterFS Cluster • 9 Sun “Thumper” • Solaris/ZFS/x4500 w/ InfiniBand systems in cluster • Native CIFS/ NFS access Benefits • Capacity on demand / pay as you grow • Centralized management • Higher reliability • OPEX decreased by 10X A Better Way To Do Storage 25
- 26. 4 Supported Ways to Consume GlusterFS Virtual Machines – GlusterFS deployable on the leading virtual machines Amazon Web Services (AWS) – GlusterFS deployed within Amazon Machine Image (AMI) RightScale Cloud Management – GlusterFS is available within a RightScale ServerTemplate – Deployable via the RightScale Cloud Management Dashboard Storage software appliance – Deployable on bare metal and supports any hardware on the Red Hat Hardware Compatibility List (HCL) of certified servers and storage A Better Way To Do Storage 26
- 27. Many Enterprises Rely on Gluster Now A Better Way To Do Storage 27
- 28. Summary GlusterFS – A scale-out file system – NAS – Object Flexibility, scalability, superior economics OpenStack cloud – Unified file and object storage – Virtual machine (VM) virtual motion Innovative architecture provides a better way to do storage A Better Way To Do Storage 28
- 29. Questions and Answers Your turn - ask our experts Try Gluster for free here: http://www.gluster.com/trybuy/ Additional resources here: http://www.gluster.com/products/resources/ Join the community: http://www.gluster.org/ Follow on twitter: @gluster. Read our blog: http://blog.gluster.com/ Contact us at: info@gluster.com or 1-800-805-5215 A Better Way To Do Storage 29