Cloud Foundry and OpenStack: How They Fit - Cloud Expo 2014
2 likes501 views
This document discusses Cloud Foundry and OpenStack, two open source cloud platforms. It describes what each platform is and its architecture. Cloud Foundry is an open platform for building, deploying, and running applications, while OpenStack is an infrastructure for managing compute, storage, and networking resources. The document proposes that Cloud Foundry and OpenStack are a good fit because they are both open source, their communities can collaborate on automation tools, and OpenStack can provide the infrastructure required to handle Cloud Foundry's scale.
Cloud Foundry and OpenStack: How They Fit - Cloud Expo 2014
- 1. 1 Cloud Foundry and OpenStack - How They Fit Apps Jason Anderson, Animesh Singh @andersonljason, @animeshsingh Cloud Expo, Santa Clara Nov 4, 2014
- 2. 2 What Is OpenStack? • An open source cloud computing platform for public & private clouds • IaaS for managing compute, storage, and networking resource • Standard and massively scalable cloud operating system • Largest open source Cloud project (76K commits, 2K contributors)
- 3. 3 OpenStack Architecture • A collection of well integrated projects (github.com/openstack): • Compute (Nova) • Networking (Neutron) • Block Storage (Cinder) • Object Storage (Swift) • Identity (Keystone) • Image Service (Glance) • Dashboard (Horizon) • …and others
- 4. 4 What is Cloud Foundry? • An open cloud platform which suffices the increasing appetite for cloud-based mobile, social and analytics applications from line-of-business executives • Provides developers easy access to services (e.g. databases, messaging services, caching) and facilitates agile development • Cloud Foundry has a compelling community and emerging ecosystem as well as a mature set of capabilities and robustness TOTAL CONTRIBUTORS 1.3K LINES OF CODE 711K PULL REQUESTS 3K Platinum Founding Sponsors
- 5. 5 Cloud Foundry Architecture • Another collection of integrated projects (github.com/cloudfoundry) • Each component can be scaled independently • Robust architecture with fault tolerant properties Router UAA DEA Pool Service Gateway Apps Service Connector Health Manager Cloud Controller Messaging Build Packs Service Nodes
- 6. 6 IBM Bluemix (powered by Cloud Foundry) • IBM’s hosted Platform as a Services offering • IBM and partner cloud services (e.g. Cloudant, New Relic, Twilio) • Integrated DevOps with both Browser and Eclipse-based tools Come experiment at http://bluemix.net
- 7. 7 Integrate!
- 8. Cloud Foundry – OpenStack Integration 8 Pla%orm as a Service Cloud Integra3on Infrastructure as a Service BOSH Cloud Provider Interface
- 9. 9 BOSH Deployment Process Deployment Manifest • Release name/ version • # VMs, job params • Stemcells to use Stemcell • Base OS • BOSH agent Release • Name • Software packages • Config templates • Scripts Deployed Cloud Foundry BOSH Virtual Machine • Configuration • Software Packages Virtual Machine • Configuration • Software Packages Virtual Machine • Configuration • Software Packages Virtual Machine • Configuration • Software packages
- 10. 10 Automate (Leverage the Power of Community)!
- 11. 11 Leverage the Open Source Community for Automation! Deploy Cloud Foundry and OpenStack using Open Source • Open technologies provides the power and flexibility to seamlessly integrate them together • Lets see some examples of the power of open technologies to go from bare metal hardware to a deployed Cloud Foundry ready to push apps
- 12. 12 Chef for OpenStack Install Automation OpenStack Installation • Leverage the open source Chef cloud infrastructure automation framework • Requires information about hardware, network environment and software repositories Setup Controller Setup Compute Setup Network Setup Storage From 1 week down to 20 minutes
- 13. 13 Fog for OpenStack Discovery / Setup Automation OpenStack Discovery / Cloud Foundry Pre-Req Setup • Leverage the open source Fog gem to discover / setup OpenStack artifacts in an automated manner (requires OpenStack credentials) • Setup according to best practices and guidelines – still giving users the flexibility to change if desired Discover / Create Security Credentials Discover / Create VM Configuration Sizes Discover / Create Network Subnets Discover / Create Network Security Rules Discover / Create DHCP, DNS Gateway & Public IPs From 1 hour down to milliseconds
- 14. 14 BOSH / Ruby for Cloud Foundry Automation Cloud Foundry Deployment Automation • Automate base OS image or Stemcell modification • Automate manifest file generation using Ruby ERB templates • Automate upload of Cloud Foundry core release, services and runtime frameworks, followed by Cloud Foundry deployment RUBY BOSH Stemcell Creation/ Modification and Upload Generate BOSH and Cloud Foundry Manifest Deploy Microbosh Upload Cloud Foundry core, Services and runtime Deploy Cloud Foundry From 1 week down to 40 minutes
- 15. 15 Open is the Only Way! Automate end to end deployments in under an hour! • Previous example signify the power of Open source community • Leveraging tools like Chef, Fog, BOSH, Ruby ERB from the community can help create powerful automation which can be repeatedly and consistently replicated in under an hour! BOSH RUBY From 2 week down to 1 hour
- 16. 16 Maintain the Deployment!
- 17. 17 Deployment Maintenance • After Cloud Foundry and OpenStack are deployed, maintenance and updates activities are required • BOSH not only handles deployment but also the instance’s lifecycle operations going forward • Example updates: • Cloud Foundry release • Stemcell (with customization) • VM configuration size • Number of DEAs • Domain name • Router floating IP
- 18. 18 Maintenance Automation • Updates can be automated using code from the initial automated deployment (e.g. bosh deploy) • To ensure application availability throughout the update, leverage JMeter to test application responsiveness (100 user agents making requests twice a second)
- 19. 19 Scale!
- 20. 20 Scaling Number of Apps on Cloud Foundry • Sample sizing for 1000 small applications • Total Resources: 160 VCPU, 500GB Memory, 1.5TB of VM disk
- 21. 21 Scaling OpenStack • Optimize Internal Communication • Configure OpenStack for scaled concurrency • Optimize Performance • Configure OpenStack scheduler to evenly distribute load • Setup Highly Available Architecture for PaaS workloads Load Balancer Nodes Data Nodes 3x Storage Compute 15x Nodes Nodes 2x Controller Nodes 2x 6x
- 22. 22 Scaling Cloud Foundry / BOSH • Optimize Internal Communication • Configure messaging bus for VM communication • Optimized routing and bandwidth allocation • Isolate Cloud Foundry components using multiple networks • Maintain Cloud Foundry’s Highly Available Architecture Service Gateways 3x Routers 10x Service Nodes 15x DEAs 20x Cloud Controllers 2x
- 23. 23 Summary Why Cloud Foundry and OpenStack are a great fit? • 100% Open PaaS and IaaS solutions (no vendor lock-ins) with a growing community of contributors and sponsors on both sides • Power of Open Source community can be leveraged to automate the deployment and lifecycle management of Cloud Foundry on OpenStack • OpenStack meets Cloud Foundry integration requirements, and is totally configurable and adaptable to handle the scale of a PaaS solution like Cloud Foundry Bottom Line: Cloud Foundry and OpenStack are a great match!
- 24. 24 What’s next? Join us at our Silicon Valley Meetups http://www.meetup.com/Bluemix/ http://www.meetup.com/CloudFoundry/ For more technical details, refer to the slides and video here http://www.slideshare.net/AnimeshSingh/optimizing-cloud-foundry-and-openstack-for-large-scale-deployments https://www.openstack.org/assets/presentation-media/A-Practical-Approach-to-HA-Final.pdf https://www.youtube.com/watch?v=jCwtV9n_ak4 https://www.youtube.com/watch?v=FsrCGkBo4Vg