IT Press Tour #17 - OpenIO & Technology
1 like911 views
The document discusses the growth of object storage technology, which is increasingly used for managing unstructured data, forecasting a market rise from $1.2 billion today to $4.6 billion by 2020. It highlights the advantages of OpenIO’s unique architecture, which allows for scalability without the need for data rebalancing, resulting in immediate performance benefits. OpenIO's open-source approach, interoperability with existing storage solutions, and human-free management position it as a key player in this evolving market.
IT Press Tour #17 - OpenIO & Technology
- 7. 88% (2015) Unstructured data worldwide ratio Each year Facts: ESG Digital Archive Market Forecast IDGSource: +62%
- 10. Object storage ?
- 11. Object storage ?
- 12. Object storage !
- 13. Object storage Advantages But not optimized for Scalability 100s PBs, low TCO Ease of access Simple API GET/PUT/DELETE Resiliency Replication, erasure coding, geodistribution Heavily updated data No POSIX-like API • VMs • SQL DBs
- 14. 10+ yearsMarket: 1.2 B$ today 4.6 B$ > 2020 Maturity Fast growing IDCSource:
- 15. Gartner, Critical Capabilities for Object Storage Scalability Efficiency Interoperability Ease of management Performance Resiliency Security
- 16. Very high capacity Optimized TCO* Unstructured data Price per GB low Rather low capacity Very high performance VMs, SQL DBs Price per GB high Object store Flash Arrays Vision: 88% 12% No future for traditional vendors? *Total Cost of Ownership
- 17. Performance Tightly integrated application connectors Quality of Service <Vision: Very high capacity Optimized TCO Unstructured data Price per GB low 88% Object store
- 18. Object storage is not only storage. It is a new way to build backend services for applications. As Docker has disrupted sysadmin, we want to disrupt storage management.
- 20. WHO
- 21. AntiSpam - AntiPhishing - eMail classification 235M MailBoxes in 76 countries IaaS - PaaS - DaaS Network & Security for legacy, SaaS and Web Apps Lille San Francisco Montréal Hong-Kong Tokyo Innovative technologies for IT infrastructure 100 people
- 22. 7 8 50 fellow co-founders years experience million end users 16 people 2015 launch (June)
- 23. 2006 Idea & 1st concept 2007 Design dev starts 2009 1st massive production above 1PB
- 24. 2006 Idea & 1st concept 2007 Design dev starts 2009 1st massive production above 1PB 2015 OpenIO fork 2012 Open sourced 2014 10+ PB managed
- 26. Member of Partners Customers
- 27. WE LOVE OPEN SOURCE
- 28. • AGPL V3 for core services • LGPL V3 for libraries and client APIs LICENSES github.com/open-io
- 29. WHAT
- 30. Grid for apps ConscienceDirectory with indirections 1. 2. 4. Grid of nodes 3. Unique design
- 31. … … … Namespace Account Container Object Multi tenancy Flat structure Track containers, not objects Directory with indirections1. UNIQUE DESIGN containers objects
- 32. Distributed Hash Tables Consistent Hashing Single name node • Good for trillion of objects • Bad because of rebalancing data when scaling • Good for few large files • Bad for numerous small objects Directory with indirections1. • Good for trillion of objects • Good, no need to rebalance data when scaling Indirection table Existing technologies OpenIO UNIQUE DESIGN
- 33. Grid of nodes2. UNIQUE DESIGN • Share nothing architecture • Scale-out design with no contention • New nodes are auto discovered • No gateway in native object mode • No SPOF, resilient to node failures
- 34. 1. Collects metrics from the services of each node 2. Computes a score for each service 3. Distributes scores to every nodes and clients 4. On the fly best match making for each request Conscience3. UNIQUE DESIGN Realtime load balancing for optimal data placement The score is computed with a configurable formula usually based on: capacity, io performance, CPU
- 35. Storage CPU/RAM usage Over the years > Don’t waste servers Use their free CPU & RAM! Grid for Apps4. UNIQUE DESIGN
- 36. Scality Ceph OpenIO LICENSE Proprietary Open Source Open Source ARCHITECTURE RING Crush maps 3-level distributed directory CONTAINERS External DB RADOS GW only Native with strong consistency SCALING rebalance rebalance No rebalance, immediate availability LOAD BALANCING Static, consistent hashing based Static, consistent hashing based Real time, automatic Competitors
- 37. Hardware agnostic 0TB > 1000+PB 1. 2. Never Rebalance 3. Different
- 38. • Simple to use • Low-latency and linear performance • Never rebalance when scaling • Immediate benefits in terms of capacity & performance • Flexible increments “True scalability” 0TB > 1000+PB1. DIFFERENT
- 39. Consistent hashing Each node owns a part of the key space New nodes get parts of the key space from the older ones Never rebalance2. DIFFERENT Recalculate key space Scaling
- 40. OpenIO New nodes automatically discovered and immediately available Scaling Immediate benefits in terms of performance from the new nodes Never rebalance2. DIFFERENT
- 41. • Work with heterogeneous hardware • No vendor lockin Hardware agnostic3. DIFFERENT • Hardware is used according to its capacity and performance • Scores are also based on I/O figures and CPU, not only capacity Conscience
- 42. Interoperability 1. 2. 3. ConnectorsOpen Source Native APIs
- 43. >_ Amazon S3® OpenStack Swift® Optimized native APIs • Python • Go • C • Java Command line interface Native APIs2. INTEROPERABILITY
- 44. Storage Email Video Connectors3. INTEROPERABILITY • File System (NFS) • OpenStack SWIFT • Amazon S3 • Cyrus 3.0 • Zimbra • Mail Object • Dovecot • HTTP connector • Adaptive streaming connector • Event based transcoding
- 45. Hardware agnostic, True scalability 0 > 1000+PBs Storage-tier, Conscience auto-optimization, Grid for Apps Open Source, S3 and SWIFT APIs, Specific App connectors Human free management, Simple to deploy Low-latency design, Specific App connectors Grid of nodes, Replication, Erasure Coding, Geodistribution Multitenancy, silent corruption checks, WORM for compliance and encryption Scalability Efficiency Interoperability Ease of management Performance Resiliency Security Gartner, Critical Capabilities for Object Storage
- 46. HOW
- 47. Time > PB> Deployed Used ISP 40+ M mailboxes Real life use case REFERENCES
- 49. OIO Core Standard Support 24/7 Premium Support 24/7 Professional Services Mail Connectors Video Connectors File Connectors WebUI Open SourceSubscriptionService
- 51. New release scheme & new release 15.12 • One release for our projects • Fuse & NFS file connector • First LTS (long term support) release • Multiple OpenIO core optimizations • New python-based CLI #1
- 52. File connector (Fuse & NFS) • To ease adoption by the market • Ability to « mount » an account as a filesystem • Targets performance - close to our core solution • Files will also appear as read-only objects under the traditional object APIs #2
- 53. Philippe Nicolas #3 As advisor Welcome aboard! :-)
- 54. OpenIO to quickly become a major player
- 55. info@openio.io