Managing Performance in the Cloud
Download as PPTX, PDF2 likes1,590 views
The document discusses the evolution of cloud computing, highlighting its service models (IaaS, PaaS, SaaS) and deployment types (private, public, hybrid). It addresses performance management challenges in the cloud, including connectivity issues and the complexities of scale, along with strategies for maintaining service-level agreements. Additionally, it emphasizes the need for awareness of operational risks and the importance of monitoring and disaster recovery plans in cloud environments.
Managing Performance in the Cloud
- 1. Managing Performance in the Cloud TheDevMgr
- 3. • Desktop internet computing • Shift from local to centralised computing • Software was cheap and hardware was expensive. In the nineties…
- 4. • Shift from desktop to mobile • The cloud is born • Bezos and his book company start to shape the future. The carefree noughty days
- 5. • Shift from centralised to distributed computing • Commoditisation of computing (PAYG) • Anything-as-a-Service (XaaS). The twenty-tens
- 7. THE CLOUD What is it?
- 10. Infrastructure (IaaS) • Outsource hardware to support operations – Storage, servers, networking components • Service provider owns and hosts equipment • Service provider responsible for management & maintenance.
- 12. Platform (Paas) • Paradigm for delivering operating systems and associated services over the Internet • No downloads or installation • Google App Engine, Microsoft Windows Azure, Heroku & Force.com.
- 13. Software (SaaS) • Software distribution model in which applications are hosted by a vendor or service provider • Made available to customers over the Internet • SalesForce.com, many...many...more.
- 15. • “Virtualised” infrastructure operated for a single organisation (single tenant) • Hosted internally or externally • Managed internally or by a third-party • Can be secured to meet compliance • More expensive, less flexible. Private Cloud
- 16. • Service provider makes resources available to the general public over the Internet – Compute, Storage, O/S, Applications • May be free or pay-per-usage model • Fast deployment, short commitments • Shared services, less control. Public Cloud
- 17. • Core platform on private cloud • Burstable capability into public cloud • Brings best of both private and public • Brings problems of both private and public. Hybrid
- 18. THE COST OF POOR CLOUD PERFORMANCE Financial and customer satisfaction
- 20. Cost • Compuware survey suggests large business losses can exceed £500k due to poor cloud performance • 57% of European IT Directors believe that they can’t manage cloud application performance • You still have to deliver 2 second response times.
- 21. Performance • 50% of ops teams have suffered more than one P-1 performance issue in the cloud • 33% experience a P-1 issue every month • 60% of incidents took more than 2 hours to resolve • Good luck webops (cloudops). Source: AppDynamics
- 22. COMMON PERFORMANCE CHALLENGES Traditional and new problems
- 23. Performance Challenges • Traditional • Connectivity – Bandwidth / Latency • Bottlenecks – CPU, IO, Database • Contemporary • Bigger scale – More stuff • Shared infrastructure – Not your stuff (entirely).
- 24. Traditional • Connectivity • Latency, jitter & Packet loss • Bandwidth limitations • Users demand fast access to data • Bottlenecks • Will still occur! • Virtualised hardware – Host Contention – Storage.
- 25. Contemporary • Bigger Scale • 10’s, 100’s, 1000’s, 10,0 00’s of servers – VM Sprawl • Dynamically allocated physical resource • Over-provisioning • Hidden billing costs • Shared Resources • Room for one more? • Deal with other peoples problems – DDOS, general stupidity? – Mi casa, es tu casa.
- 26. • Elasticity – Planned (scheduled/controlled scaling) – Unplanned (auto-scaling) • Global distribution – Data Centres – Data • Less Control. Paradigm Shift
- 28. CLOUD EXPERIENCES Stories from the trenches
- 30. • Adactus Food Ordering Platform • Transacts – > 7 million orders & > $100M USD a year – 30% daily of orders taken in1 hour • Adopted as eCommerce platform for Pizza Hut and KFC globally. Application
- 31. Platform • Private • Global instances all deployed on private clouds • VMWare ESX Hosts – V-Web’s • Dedicated / Non- Virtualised SQL • Public • Rackspace public cloud • On-Demand – Load Balancers – Web Servers – SQL Servers • High-scale, high- volume.
- 32. • Big Scale – A lot more to manage • Virtual Platform – Contention • End-to-End Application Performance Management. Challenges
- 33. Solutions • Cloud-centric APM – AppDynamics – CloudKick (now Rackspace APM) – Rightscale • Automated Operations – Chef, Puppet (SysOps) – CloudFoundry, OpenShift (App LifeCycle) – Heroku, AppFog (NoOps?)
- 36. • Adactus Pulse • Claims management solution for the insurance industry delivered as SaaS • Processed over a million claims • Deployed for ISS and Aviva. Application
- 37. Platform • Deployed into Windows Azure Platform – Web Roles – Worker Roles – SQL Azure – SQL Azure Reporting Services • Upgrade of traditional ASP.NET application • Continuous Deployment Process.
- 38. Challenges • Disproving the “shared resource” impact – Is it the infrastructure? • Database performance is a black-box – Limitations and more limitations • Getting performance data is hard work – Not easy to access, dispersed everywhere • Baseline performance is not linear.
- 39. Baseline Performance Large variances in baseline performance.
- 40. Windows Azure is more consistent.
- 41. Solutions • Instrumentation is king – Aspect Orientation (AOP) • Gibraltar – Does your provider offer a Performance API? • Dedicated Cloud (Azure) Tools • Dynatrace • Cerebrata • You must automate – Deployment (and everything else!) – Consistency is key.
- 45. • Service provider takes responsibility for installing and maintaining the database. • Amazon (mySQL) • Microsoft SQL Azure • Google App Engine Datastore • CouchDB, MongoDB. Overview
- 46. Challenges • Most service providers are having performance issues (even Google!) • Database is a (performance) black-box – You will find limitations • Need to handle transient connections – Your database will be there, but not always.
- 47. Solutions • Do as much tuning outside of the cloud as possible • Instrument your data access • DB sharding becomes viable easy • Build connection resiliency into your data- framework.
- 48. • On-premise databases – Are you sure? • You might be about to create your own data storm? – Too much on-premise data – Too little bandwidth. Caution
- 50. Overview • Adactus Pulse – Delivered on a SaaS Model • We consume SaaS (heavily) – CRM, Performance, Google Apps, WIKI, Bug Tracking, Testing, Accounting, Planning & Forecasting, Document Management, CMS, Exception Handling, Business Intelligence, Deployment, APM, Collaboration, HRM, ERP and more.
- 51. Challenges • Consumer • Good news – Performance is out of your control! • Bad news – Performance is out of your control! • Provider • Expectations are high! – Response times • Performance is still king! – Competitors – Repeat use.
- 52. Real User Monitoring • Consumer • It’s your new best friend • Get to know your SLA – Its your new best friend • Simple rules – Be the first to know – Get your money back • Provider • It’s your new best friend • You will live & die by your SLA’s • Simple rules – Be the first to know – Tell your customers.
- 56. BEYOND PERFORMANCE Stories from the trenches
- 57. Service-Level-Agreements • Critical element for both provider and consumer • Don’t waste time on detailed numerical service level agreements • SLAs need to be based on end-user experience.
- 58. Service-Level-Agreements 1. Establish system availability 2. Establish system response time 3. Establish error resolution time 4. Establish a fail over window for disaster recovery 5. Ensure that you can get your data back.
- 59. Service-Level-Agreements • IaaS – The O/S is your responsibility • Managed Cloud Platforms are available • PaaS – SLA’s stop at the O/S • Your application still remains your responsibility • SaaS – Know your SLA inside out. Its your responsibility.
- 60. Disaster Recovery • It’s hard in the cloud • DR strategies are still emerging • Bandwidth & network capacity limits • Security is still a concern.
- 61. Disaster Recovery • There isn’t a single blueprint • Identify critical resources and recovery methods • Architect for redundancy • Back up to/from and restore to/from the cloud • Most cloud SLA’s > 99.5% availability – 4 hours, 39 minutes downtime per month.
- 62. THANK YOU. QUESTIONS? That’s all folks!
Editor's Notes
- #5: The Cloud is the perfect (the natural) environment for distributed applications & the idea of service orientation Amazon played a key role in the development of cloud computing by modernising their data centers, which were using as little as 10% of their capacity at any one time, just to leave room for occasional spikes.
- #7: Source: Intel
- #10: Source: Horn Group
- #12: Source: Gartner
- #13: Azure = .NETHeroku = Ruby, Java, Python, Scala, Clojure, and Node.jsGoogle = Java Force.com = Java
- #21: Source: Compuware
- #22: Source: Appdynamics
- #26: Are youtroubleshootingyourproblemorsomeoneelses?
- #28: Source http://www.cloudslueth.netData is sampled for regional backbones
- #33: http://www.hostingreview.com/2012/03/01/massive-data-needs-the-server-requirements-and-costs-for-the-webs-biggest-websites/
- #34: Centralised logging and reportingOver 60% are still using log files (Source:CloudFoundry)http://www.virtualizationpractice.com/rackspace-buys-cloudkick-implications-for-iaas-performance-management-8697/
- #35: Source: Appdynamics
- #40: Source: http://www.cloudslueth.net
- #41: Source: http://www.cloudslueth.net
- #43: Source: Redgate Diagnostics Manager (Cerebrata)
- #44: Source: Gibraltar (http://www.gibraltarsoftware.com/)
- #48: Cloud Sharding;managed infrastructure, elastic provisioning
- #49: http://www.computerworld.com/s/article/9223117/Bandwidth_bottlenecks_loom_large_in_the_cloud
- #53: Providers – tell customers, save phone calls, support and bad PR
- #58: http://esj.com/blogs/enterprise-insights/2011/03/costs-of-poor-application-performance.aspx