GlusterFS as a DFS
- 1. GlusterFS as a Distributed File System (DFS) Department of Computer Engineering K. N. Toosi Univ. of Technology Lecturer: Mahmoud Shiri Varamini Mar 4 2017
- 2. 2 Agenda What’s file system and List of file systems DFS fundamental Distributed parallel fault-tolerant file systems Type of storage Advantages of using object storage What is gluster GlusterFS data access overview Gluster Architecture Q & A
- 3. 3 List of file systems ● Disk file systems (Btrfs,FAT,ext3,ext4,ntfs,ZFS,XFS,HFS,ReiserFS , ...) ● File systems with built-in fault-tolerance (Btrfs,ZFS,Reliance,HAMMER, …) ● Distributed parallel fault-tolerant file systems (BeeGFS ,Ceph,Gluster,Google File System (GFS),Hadoop Distributed File System,XtreemFS , ...)
- 4. 4 DFS fundamental ● What’s DFS ● Why We should use DFS ● DFS case study ● cons and pros of DFS ● DFS vs SDS ● The future of DFS
- 5. 5 Distributed parallel fault-tolerant file systems ● Distributed file systems, which also are parallel and fault tolerant, stripe and replicate data over multiple servers for high performance and to maintain data integrity. ● Even if a server fails no data is lost. The file systems are used in both high-performance computing (HPC) and high-availability clusters.
- 6. 6 Type of Storage ● File-level storage ● Block-level storage ● Object storage
- 7. 7 Advantages of using object storage ● Data model (structured vs unstructured) ● Protocol (NFS,SMB,iSCSI,FC) ● Type of access (locally,remote) ● Access data (server,network,API) ● Caching and meta data mechanism ● Performance and Scability ● Use case (physical,virtual,cloud) ● Real world scenario
- 8. 8 What is Gluster? (1) ● GlusterFS is a SDS solution for any industry. ● GlusterFS is a scalable network filesystem. ● Using common off-theshelf hardware, you can create large, distributed storage solutions for media streaming, data analysis, and other data- and bandwidth-intensive tasks. ● GlusterFS is free and open source software.
- 9. 9 What is Gluster? (2) ● Scalable, general-purpose storage platform ● POSIX-y Distributed File System ● Object storage (swift) ● Distributed block storage (qemu) ● Flexible storage (libgfapi) ● No Metadata Server ● Heterogeneous Commodity Hardware ● Flexible and Agile Scaling ● Capacity – Petabytes and beyond ● Performance – Thousands of Clients
- 10. 10 GlusterFS data access overview ● GlusterFS Native Client ● Filesystem in Userspace (FUSE) ● NFS ● Built-in Service, NFS-Ganesha with libgfapi ● SMB/CIFS ● Samba server required (libgfapi based module) ● Gluster For OpenStack (Swift-on-file) ● Object-based access via Swift ● libgfapi flexible abstracted storage ● Integrated with QEMU, Bareos and oth
- 12. 12 Q & A Questions? You can contact me via: shirivaramini@gmail.com
- 13. 13 Thank You!