SlideShare a Scribd company logo
Crowbar:
An operations framework for
 Cloud Scale Environments

              Joey Jablonski
       Principal Solution Architect
Team Introduction


Revolutionary Cloud Solutions
  Focus is green field and scale
  Advanced technologies
  Open Source




                        2
Projects Introduction


Crowbar
 DevOps inspired Cloud deployment solution
OpenStack
 IaaS ….. PaaS
Hadoop
 Rapid deployment RA & DG




                     3
Community Cloud Infrastructure


    We needed Cloud Infrastructure that

         Had support from major industry players
         Was collaboratively developed without a single owner
         Had an API that was Service Provider license friendly
         Could be demonstrated to run at scale
         Was built on open source components
         Had global reach and support

Dell Cloud Solutions          4
Open Cloud Operations


         Intersection of two major technology waves:
              Operational Automation (DevOps)
              Open Source Cloud (OpenStack)

         Together, a practical approach to cloud scale
              Manages elastic resources
              Embraces constant change
              Productizes best practices

Dell Cloud Solutions              5
Lessons from Hyper-scale


         Hyper-scale (1000s of servers) forced customers to
         change their core assumptions.

         To operate large systems, customers
              Embraced scale out design (inconsistency is OK)
              Eliminated hardware redundancy (too expensive)
              Shunned manual steps (too slow)


Dell Cloud Solutions              6
Crowbar
Images vs. Layers: Lifecycle
                                              Layers: Upgrade
         Images: Replacement



Config       Config     Config
                                            I                      I
                                           Foo                    Foo




                                     Config




                                                            Config
I+A+U+       I+A+U+     I+A+U+
                                          Bar v1                 Bar v2
  O/S          O/S        O/S
                                            U                      U
                                           OS                     OS

               Config                              Bar v2
               I+A+U+
                 O/S

                                 8
Modular Design: Barclamps
                  APIs, User Access,        Nagios        Ganglia    Dashboard
                  & Ecosystem
                  Partners
Ops Management




                                           Hadoop        OpenStack   Barclamps
 Dell “Crowbar”




                  Cloud
                  Infrastructure &
                  Dell IP Extensions


                                           Crowbar         DNS        Logging
                  Core Components &
                  Operating Systems
                                           Deployer        NTP


                                           Provisioner     BIOS        IPMI
                  Physical Resources
                                           Network         RAID




                                       9
Crowbar = Install State Machine




             10
Dashboard




Dell Cloud Solutions     11
Barclamps and Proposals




Dell Cloud Solutions     12
Monitoring




Dell Cloud Solutions      13
OpenStack
Dell’s Destination for OpenStack
                                      VM mgmt                     Billing                  Portals              Monitoring          Security
                     Ecosystem

                                                                                                                                   & Perform.
API Clients



                      Partner



                                     Orchestrate                Aggregate                 User Mgmt.              Status            Identity
                                      Templates                  Charging                 Delegation              Health           IP Inspect
                                     Provisioning               Thresholds                VM Mgmt.                Alerts          Log Monitor




                                     Amazon API                                             OpenStack Cloud API
                                     Compatibility




                       Operations                     Nova                       Glance              Swift
                        Mgmt.                                                                                                Network




                                                                                                                 Ecosystem
Ops Infrastructure




                                                     VM Mmgt.                Image Mgmt.         Obj. Mgmt.                  Monitoring




                                                                                                                  Partner
                                                                                                                             Metering
                            Nagios
                                                                                                                             Console
                                              Hypervisor                                                                     Security
                             LDAP             (KVM, Xen, etc)

                             Chef
                                              Operating Systems        (Ubuntu, RedHat, CentOS, Windows, etc)

                           Crowbar
                                              Physical Infrastructure: Servers & Networks



                                                                            15
OpenStack Timeline
                       • Image              • 8 options for host virt         • Network as a Service
                         Registry &           (incl KVM, Hyper-               • Volume as a Services (LunR)
   • OpenStack           Delivery             V, Xen, ESX)                    • GPU accelerators, larger multi-core
     Compute             service            • Live migration (KVM)            • Multi-cluster container sync
     and               • Compute &          • Compute API 1.0                 • Multi-zone support, intra-data center and
     Storage             storage            • Glance CLI                        federation across data centers.
                         enhance -          • IPv6                            • Stability and QA automation
                         ments                                                • Complete, stable OpenStack API 1.1




Nov 2010   Dec    Jan 2011   Feb      Mar    Apr      May       Jun     Jul       Aug     Sep     Oct       Nov      Dec
                                                                              1.0                           1.5


                     Feb 2011:         Apr 2011:                                   Sep 2011:            Oct 2011:
                   OpenStack          OpenStack                                   OpenStack             OpenStack
                 Bexar Release          Cactus                                        Diablo            Design Summit
                                        Release                                      Release


                                                       16
Links


https://github.com/cloudedge
http://dell.com/hadoop
http://dell.com/openstack




                    17
OpenStack Community




Dell Cloud Solutions          18

More Related Content

PDF
OSCON 2012 OpenStack Automation and DevOps Best Practices
PDF
Open stack design 2012 applications targeting openstack-final
PDF
Cloumon enterprise
PPTX
Openstack in action2! Automate and accelerate Cloud deployments with Dell Cro...
PDF
Joyent Cloud Data Sheet
PDF
OpenStack at Xen summit Asia
PDF
The Sirocco multi-cloud management framework, OW2con'12, Paris
 
PPTX
Dell openstack boston meetup dell crowbar and open stack
OSCON 2012 OpenStack Automation and DevOps Best Practices
Open stack design 2012 applications targeting openstack-final
Cloumon enterprise
Openstack in action2! Automate and accelerate Cloud deployments with Dell Cro...
Joyent Cloud Data Sheet
OpenStack at Xen summit Asia
The Sirocco multi-cloud management framework, OW2con'12, Paris
 
Dell openstack boston meetup dell crowbar and open stack

What's hot (17)

PDF
Roger boesch news xd_xa_nov (1)
PPTX
Private cloud infrastructure configure and deploy 24 hiapc fabrizio volpe
PDF
WSO2 Carbon and WSO2 Stratos Summer Release Roundup
PDF
Ubuntu in the cloud What's Coming - Nick Barcet, Canonical
PDF
Open stack for open source private cloud 20120425-shanghai
PPTX
Stacking up with OpenStack: building for High Availability
PDF
Cloud Computing - Making IT Simple
PPTX
Protect your app from Outages
PDF
CompatibleOne Collaborative Project OW2con11
PDF
Simplifying Cloud Implementation
PPTX
Navantis & Microsoft "Find Your Silver Lining in the Cloud" Event Slidedeck
PDF
Wicked Easy Ceph Block Storage & OpenStack Deployment with Crowbar
PDF
Sap Virtualization Week 2009
KEY
Nuxeo on the Cloud - Nuxeo World 2011
KEY
Ga cloud scaling 3 30-2012
PDF
Open repository 2011_duracloud-final
ZIP
EMEA OpenStack Day Intro, July 13th 2011 in London
Roger boesch news xd_xa_nov (1)
Private cloud infrastructure configure and deploy 24 hiapc fabrizio volpe
WSO2 Carbon and WSO2 Stratos Summer Release Roundup
Ubuntu in the cloud What's Coming - Nick Barcet, Canonical
Open stack for open source private cloud 20120425-shanghai
Stacking up with OpenStack: building for High Availability
Cloud Computing - Making IT Simple
Protect your app from Outages
CompatibleOne Collaborative Project OW2con11
Simplifying Cloud Implementation
Navantis & Microsoft "Find Your Silver Lining in the Cloud" Event Slidedeck
Wicked Easy Ceph Block Storage & OpenStack Deployment with Crowbar
Sap Virtualization Week 2009
Nuxeo on the Cloud - Nuxeo World 2011
Ga cloud scaling 3 30-2012
Open repository 2011_duracloud-final
EMEA OpenStack Day Intro, July 13th 2011 in London
Ad

Similar to Dell web monsters-oct2011-v6-public (20)

PDF
Operating the Hyperscale Cloud
PDF
CA Nimsoft xen desktop monitoring
PPTX
Deploying OpenStack using Crowbar
PDF
2011 04-dsi-javaee-in-the-cloud-andreadis
PDF
Venus-c: Using open source clouds in eScience
 
PDF
Cybera - Clouds & other computational frameworks for science
PDF
Stairway to heaven webinar
PDF
Paving the Way to IT-as-a-Service
PDF
g Eclipse @ Eclipse Summit Europe 2008
PDF
Micro service in aws meetup
PDF
Mon1420 build clouds-oliviermaes-citrix
PDF
OpenCms Days 2012 - OpenCms on open clouds
PDF
Dell open stack powered cloud solution introduce & crowbar demo cosug-2012
PPTX
Hitchhiker's Guide to Open Source Cloud Computing
PDF
Development Model for The Cloud
PDF
Understanding the WSO2 Platform and Technology
PDF
2009 Q2 WSO2 Technical Update
PDF
OpenStack at PayPal
PPTX
Successful PaaS and CI in the Cloud - EclipseCon 2012
PPTX
Hadoop World 2011: Proven Tools to Manage Hadoop Environments - Joey Jablonsk...
Operating the Hyperscale Cloud
CA Nimsoft xen desktop monitoring
Deploying OpenStack using Crowbar
2011 04-dsi-javaee-in-the-cloud-andreadis
Venus-c: Using open source clouds in eScience
 
Cybera - Clouds & other computational frameworks for science
Stairway to heaven webinar
Paving the Way to IT-as-a-Service
g Eclipse @ Eclipse Summit Europe 2008
Micro service in aws meetup
Mon1420 build clouds-oliviermaes-citrix
OpenCms Days 2012 - OpenCms on open clouds
Dell open stack powered cloud solution introduce & crowbar demo cosug-2012
Hitchhiker's Guide to Open Source Cloud Computing
Development Model for The Cloud
Understanding the WSO2 Platform and Technology
2009 Q2 WSO2 Technical Update
OpenStack at PayPal
Successful PaaS and CI in the Cloud - EclipseCon 2012
Hadoop World 2011: Proven Tools to Manage Hadoop Environments - Joey Jablonsk...
Ad

More from Barton George (19)

PDF
Demystifying Developer Engagement: Seven simple principles to guide organizat...
PPTX
Driving Innovation at a large company and the 5 lessons learned
PDF
Untangling DevOps - A high-level overview and how we got here
PDF
DevOps -- A 10 year retrospective (based on interviews conducted at DevOps Da...
PDF
Implementing DevOps – How it came to the fore, its key elements and example d...
PDF
Seven Guiding Principles for Developer Engagement
PDF
Container landscape 2015 vs 2021
PDF
EdgeX Foundry - Open Interop Platform for the IoT Edge.
PDF
Project Sputnik - Driving Innovation at a large company
PDF
DevOps, Microservices and containers - a high level overview
PPTX
Container Landscape -05.01.15
PDF
Ignite Talk - Digital Transformation for Government
PPTX
Project Sputnik: Crowd sourcing a Developer laptop
PDF
Cloud Presentation and OpenStack case studies -- Harvard University
PPTX
The Story of Project Sputnik - Client to cloud solution
PPTX
Xps 13 developer edition - slide share presentation-02.20.13
PPTX
Into the Cloud - An introduction to cloud computing
PPTX
Cio webinar - 04 12 10
PDF
How to get started documenting processes: The Tillamook story
Demystifying Developer Engagement: Seven simple principles to guide organizat...
Driving Innovation at a large company and the 5 lessons learned
Untangling DevOps - A high-level overview and how we got here
DevOps -- A 10 year retrospective (based on interviews conducted at DevOps Da...
Implementing DevOps – How it came to the fore, its key elements and example d...
Seven Guiding Principles for Developer Engagement
Container landscape 2015 vs 2021
EdgeX Foundry - Open Interop Platform for the IoT Edge.
Project Sputnik - Driving Innovation at a large company
DevOps, Microservices and containers - a high level overview
Container Landscape -05.01.15
Ignite Talk - Digital Transformation for Government
Project Sputnik: Crowd sourcing a Developer laptop
Cloud Presentation and OpenStack case studies -- Harvard University
The Story of Project Sputnik - Client to cloud solution
Xps 13 developer edition - slide share presentation-02.20.13
Into the Cloud - An introduction to cloud computing
Cio webinar - 04 12 10
How to get started documenting processes: The Tillamook story

Recently uploaded (20)

PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PPTX
Week 4 Term 3 Study Techniques revisited.pptx
PDF
Mark Klimek Lecture Notes_240423 revision books _173037.pdf
PPTX
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
PDF
O7-L3 Supply Chain Operations - ICLT Program
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPTX
Introduction to Child Health Nursing – Unit I | Child Health Nursing I | B.Sc...
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PDF
Pre independence Education in Inndia.pdf
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PPTX
Institutional Correction lecture only . . .
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
O5-L3 Freight Transport Ops (International) V1.pdf
Week 4 Term 3 Study Techniques revisited.pptx
Mark Klimek Lecture Notes_240423 revision books _173037.pdf
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
O7-L3 Supply Chain Operations - ICLT Program
human mycosis Human fungal infections are called human mycosis..pptx
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
Introduction to Child Health Nursing – Unit I | Child Health Nursing I | B.Sc...
Renaissance Architecture: A Journey from Faith to Humanism
Pre independence Education in Inndia.pdf
FourierSeries-QuestionsWithAnswers(Part-A).pdf
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Institutional Correction lecture only . . .
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Module 4: Burden of Disease Tutorial Slides S2 2025
102 student loan defaulters named and shamed – Is someone you know on the list?
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx

Dell web monsters-oct2011-v6-public

  • 1. Crowbar: An operations framework for Cloud Scale Environments Joey Jablonski Principal Solution Architect
  • 2. Team Introduction Revolutionary Cloud Solutions Focus is green field and scale Advanced technologies Open Source 2
  • 3. Projects Introduction Crowbar DevOps inspired Cloud deployment solution OpenStack IaaS ….. PaaS Hadoop Rapid deployment RA & DG 3
  • 4. Community Cloud Infrastructure We needed Cloud Infrastructure that Had support from major industry players Was collaboratively developed without a single owner Had an API that was Service Provider license friendly Could be demonstrated to run at scale Was built on open source components Had global reach and support Dell Cloud Solutions 4
  • 5. Open Cloud Operations Intersection of two major technology waves: Operational Automation (DevOps) Open Source Cloud (OpenStack) Together, a practical approach to cloud scale Manages elastic resources Embraces constant change Productizes best practices Dell Cloud Solutions 5
  • 6. Lessons from Hyper-scale Hyper-scale (1000s of servers) forced customers to change their core assumptions. To operate large systems, customers Embraced scale out design (inconsistency is OK) Eliminated hardware redundancy (too expensive) Shunned manual steps (too slow) Dell Cloud Solutions 6
  • 8. Images vs. Layers: Lifecycle Layers: Upgrade Images: Replacement Config Config Config I I Foo Foo Config Config I+A+U+ I+A+U+ I+A+U+ Bar v1 Bar v2 O/S O/S O/S U U OS OS Config Bar v2 I+A+U+ O/S 8
  • 9. Modular Design: Barclamps APIs, User Access, Nagios Ganglia Dashboard & Ecosystem Partners Ops Management Hadoop OpenStack Barclamps Dell “Crowbar” Cloud Infrastructure & Dell IP Extensions Crowbar DNS Logging Core Components & Operating Systems Deployer NTP Provisioner BIOS IPMI Physical Resources Network RAID 9
  • 10. Crowbar = Install State Machine 10
  • 12. Barclamps and Proposals Dell Cloud Solutions 12
  • 15. Dell’s Destination for OpenStack VM mgmt Billing Portals Monitoring Security Ecosystem & Perform. API Clients Partner Orchestrate Aggregate User Mgmt. Status Identity Templates Charging Delegation Health IP Inspect Provisioning Thresholds VM Mgmt. Alerts Log Monitor Amazon API OpenStack Cloud API Compatibility Operations Nova Glance Swift Mgmt. Network Ecosystem Ops Infrastructure VM Mmgt. Image Mgmt. Obj. Mgmt. Monitoring Partner Metering Nagios Console Hypervisor Security LDAP (KVM, Xen, etc) Chef Operating Systems (Ubuntu, RedHat, CentOS, Windows, etc) Crowbar Physical Infrastructure: Servers & Networks 15
  • 16. OpenStack Timeline • Image • 8 options for host virt • Network as a Service Registry & (incl KVM, Hyper- • Volume as a Services (LunR) • OpenStack Delivery V, Xen, ESX) • GPU accelerators, larger multi-core Compute service • Live migration (KVM) • Multi-cluster container sync and • Compute & • Compute API 1.0 • Multi-zone support, intra-data center and Storage storage • Glance CLI federation across data centers. enhance - • IPv6 • Stability and QA automation ments • Complete, stable OpenStack API 1.1 Nov 2010 Dec Jan 2011 Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec 1.0 1.5 Feb 2011: Apr 2011: Sep 2011: Oct 2011: OpenStack OpenStack OpenStack OpenStack Bexar Release Cactus Diablo Design Summit Release Release 16