Cloud@ebay
4 likes4,008 views
The document provides an overview of eBay's cloud architecture and infrastructure, detailing its server utilization, user base, and cost implications of using public versus internal cloud resources. It highlights eBay's performance metrics, such as the number of application servers and transaction volumes, while also discussing automation challenges and management solutions. Future plans include adopting open-source solutions and enhancing their cloud readiness and resource management capabilities.
Cloud@ebay
- 1. Cloud @ eBayFrom ground level to cloudsJC MartinCloud Architect, eBay Marketplace@jchmartin
- 2. QuizNumber of App Servers:More than 100,00010 big onesAround 6,000Number of active usersPopulation of the Philippines (~94M)Population of China (~ 1.3B)Population of Mendocino, CA (800)1 second of downtime$5 lost$2,000 lost$2,000,000 lostBest Company to work foreBay
- 3. What is eBay.com92322Bpage views/day23MSLOC9Pbof data94200250$6294M active users200Mlive listings250Mqueries/day$62B2010 gross merchandise volume6,000756,000 application servers75B database calls/dayData AnalyticsSearchFront End
- 4. Data AnalyticsSearchFront EndWhat is eBay.comPCICompliantBetaPCICompliantProductionResearchQASkunkworks
- 7. DRBurst toexternalCloud ?Number of servers required based on utilization for 8 pools
- 8. Even at 4x the internal cost, public cloud would save moneyCloud cost toInternal cost ratioCost ratioInternal cost is dominantExternal cost is dominantServers owned
- 10. Hybrid Cloud optionseBay DCPublic CloudeBayDCPublicCloudEbay environmentEbay environmentEbay InfrastructureEbay InfrastructureVirtual Data CenterPublic Shared Cloud
- 11. Application ArchitectureFuture‘Cloud ready’Ongoing“Cloud Friendly”Before
- 12. Internal Cloud Technology stackService CatalogREST APIsTicket driven run book automationModel driven close loopautomation Configuration ManagementDatabase (CMDB)Distributed state ManagementChargebackPay as you goServer VirtualizationMultitenant infrastructure with secure isolation
- 13. Infrastructure virtualizationVirtual EnvironmentsProdQAExp.QAExp.ProdApplicationAppAppAppApplicationAppAppAppSparesparesparespareGlobal resource poolInfraInfraInfraInfraShared infrastructureSilos with custom designVirtualized Infrastructure
- 14. Automate EverythingCannot be automatedThe task requires human involvement (e.g. racking and wiring)No support forautomationComponent lacks API or requires UI based actions (e.g. checkpoint) Limited rate ofchangeConfiguration requires restart, reload, file sync (e.g. Bind, ISC DHCP)No permissionConfiguration requires special credential/role (e.g. firewall, network)
- 15. Process Simplificationrequest{nb servers,model, app } orderreceive &rack & wireLabel (app)deliver“several”weeks1 w2-3 wrepurposerequest{nb servers,model } orderReceive pre-rackedPre-wireddeliver tocacherequest{nb servers,model, app } deliverquarterly45 min1 day2-3 wrepurpose
- 16. Open Source IntegrationIaaS/PaaS APIIaaS/PaaS APIorchestrationResourceAllocationDistributedStateorchestrationResourceAllocationDistributedStateeBayCloud ManagerAuthN/AuthZApplicationControllerAccess PointControllerAuthN/AuthZApplicationControllerAccess PointControllerComputeControllerClusterControllerPoolControllerComputeControllerClusterControllerPoolControllerAdopt andContributeInfrastructureManagementServicesOpen SourceSolution(openstack / Cloudstack)Compute Mgt.DNS Mgt.LB Mgt.MonitoringNetwork ProvImage/Pkg RepoSoftware Dist.