Open Cloud Consortium Overview (01-10-10 V6)
Download as PPTX, PDF2 likes8,271 views
The Open Cloud Consortium (OCC) is a non-profit organization that supports cloud computing standards and develops testbeds for interoperability. It has members from companies, universities, and government agencies. The OCC manages the Open Cloud Testbed, Intercloud Testbed, and Open Science Data Cloud. It also has working groups focused on large data clouds, applications, and cloud services. The Intercloud Testbed aims to address gaps in linking infrastructure and platform services. Benchmarks like Gray Sort and MalStone are used to evaluate large data cloud performance. The Open Cloud Testbed provides shared cloud resources through a "condominium cloud" model. The Open Science Data Cloud hosts scientific data sets for research.
Open Cloud Consortium Overview (01-10-10 V6)
- 1. www.opencloudconsortium.orgOpen Cloud Consortium: An UpdateRobert GrossmanOpen Cloud ConsortiumJanuary 10, 2010
- 2. Part 1. Overview of theOpen Cloud Consortium (OCC)www.opencloudconsortium.org2
- 3. 501(3)(c) Not-for-profit corporationSupports the development of standards, interoperability frameworks, and reference implementations.Manages testbeds: Open Cloud Testbed and Intercloud Testbed.Manages cloud computing infrastructure to support scientific research: Open Science Data Cloud.Develops benchmarks.3www.opencloudconsortium.org
- 4. OCC MembersCompanies: Aerospace, Booz Allen Hamilton, Cisco, InfoBlox, Open Data Group, Raytheon, YahooUniversities: CalIT2, Johns Hopkins, MIT Lincoln Lab, Northwestern Univ., University of Illinois at Chicago, University of ChicagoGovernment agencies: NASAOpen Source Projects: Sector Project4
- 5. OCC Working GroupsLarge Data Cloud Working GroupOpen Cloud Testbed Working Group.Intercloud Testbed Working GroupOpen Science Data Cloud Working Group
- 6. ApplicationsAppsCompute ServicesData ServicesIF-MAP (Metadata) ServicesPaaSStorage ServicesIdentity ManagerVirtual Machine ManagerVirtual Network ManagerIaaSNetwork Transport
- 7. Part 2. Intercloud Testbed7Cloud 2Cloud 1
- 8. We have several cloud standards…Platform as a Service
- 11. Cloud Storage ServicesLarge Data Cloud Interoperability FrameworkSNIA Cloud Data Management Interface (CDMI)Infrastructure as a Service
- 12. Virtual Data Centers (VDC)
- 14. Virtual Machines (VM)Open Cloud Computing Interface (OCCI)Open Virtualization Format (OVF)
- 15. Where are the Gaps?Naming entities in IaaS & PaaS
- 16. Bridging IaaS & DaaS
- 17. Services that span multiple VMs, ….
- 18. Platform as a Service
- 20. Data as a ServiceLarge Data Cloud Interoperability FrameworkSNIA Cloud Data Management Interface (CDMI)Infrastructure as a Service
- 21. Virtual Data Centers (VDC)
- 24. Physical ResourcesOpen Cloud Computing Interface (OCCI)Open Virtualization Format (OVF)
- 25. Bridging the Gaps…A Small StepPlatform as a Service
- 27. Data as a ServiceLarge Data Cloud Interoperability FrameworkSNIA Cloud Data Management Interface (CDMI)Metadata service linking IaaS and DaaSMetadata service naming and linking entities in the IaaS layersInfrastructure as a Service
- 28. Virtual Data Centers (VDC)
- 31. Physical ResourcesOpen Cloud Computing Interface (OCCI)Open Virtualization Format (OVF)
- 32. Part 3. Large Data Cloud Working Group11Standards for integrating and interoperating large data cloud services such as those provided by Hadoop and similar systems.
- 33. Focus of Working Group12AppAppAppAppAppTable-based Data ServicesRelational-like Data ServicesAppAppCloud Compute Services (MapReduce, UDF, & other programming frameworks)AppAppCloud Storage ServicesDeveloping APIs for this framework.
- 34. Benchmarks for Large Data CloudsUntil recently, the only benchmark used was Terasort (sorting 10 billion 100 byte records)Replaced by Gray Sort and Minute SortGray Sort tries to maximize TB / min sorted on 100 TB or more of data.Hadoop holds the current Gray Sort and Minute Sort records.Problem: sort is just one of the types of work load for analytic applications
- 35. MalStoneMalGen – generates synthetic data with realistic distributions.MalStone A & B – “stylized” computations that can be used as benchmarks for architectures, software and systems for large data clouds.Open source and available at malgen.googlecode.com14
- 36. Part 4. OCC Testbeds
- 37. Condominium CloudsIn a condominium cloud, you buy your own rack or bunch of racks.The racks are managed and operated by the condominium association, in this case the OCC.If your rack is 120 TB, you get the rights to c. 40 TB of storage in the cloud. The rest is a shared resource. The Open Cloud Testbed is a condo cloud managed by the OCC.16
- 38. Open Cloud TestbedC-WaveCENICDragonPhase 29 racks250+ Nodes1000+ Cores10+ Gb/s Hadoop
- 39. Sector/Sphere
- 40. Thrift
- 41. KVM VMs
- 43. Part 5. Open Science Data Cloud Working Group18
- 44. Open Science Data CloudAstronomical dataBiological data (Bionimbus)Networking data19