SlideShare a Scribd company logo
InMobi Private Cloud: Going the
CloudPlatform Way
Iliyas Shirol
InMobi
#whoami
• BigData/Cloud Evangelist at InMobi
• Working in CloudStack Since 2012
• CloudStack Community Gardener
@iliyas_shirol
Agenda
• About InMobi
• Going Cloud Way
• Architecture & Design
• Questions
About InMobi
About InMobi
Going Cloud Way
• Development and Test Environment
• Scalable Web Applications and Content Services
• High Speed Server Resource Deployment
• And More..
Why Cloud ?
• Disconnected Tools, Servers, People
• Slow Build and Release Cycles
• Multiple Build and Test Systems Across Locations
• Home-Built Systems are Brittle, Error-Prone, and Not Scalable
• Difficult to Build, Test, and Recreate the Data
• Difficult to Audit Processes and Predict Schedules
• Time, Money Wasted on Broken Builds
• Dedicated Build/Test Servers are not Fully Utilized
Why Dev / Test in the Cloud ?
• Self-Service
Developers can provision their own environments
• Usage Measurement
We worry about VM sprawl
• Isolated Networks
Must not let dev/test interfere with the real world
• Commodity
As cheap as practical
• May also House Production Workloads
How Does a Dev/Test Cloud Look Like ?
• Budget
• Integration with Public Cloud
• Scaling
• Reconfiguration
• Legacy Hardware
Early Assessments & Results
• Leverage Existing Infrastructure
• Customization and Control
• Regulatory/Security Requirements
• Cost
Why Private Cloud ?
• Scalable
Grow-as-you-need, expand across borders
• Open Source Community Support
Active user and development support base
• Advanced Networking
VLAN integrated, SDN ready
• Multi-Tenancy
• Multi-Hypervisor Support
Why Citrix CloudPlatform ?
• Easy to Deploy
• Speed to Production
• Documentation
Why Citrix CloudPlatform ?
Architecture & Design
• Bring Everyone in the Room
• Know the Fine Print
• Understand Workloads
• Understand Bottlenecks
The Design Phase
• CloudStack Management Server
• MySQL Servers
• Primary & Secondary Storage
• Hypervisor Farm
Redundancy and Resilience
Management Layout & Design
• Dell PE R610’s & R720’s
• 96 – 256 GB RAM
• 40-80 CPU Cores
• 2 Advanced + 1 Basic Zones
• 1 Pod in Each Zone
• 1 – 5 Clusters in Each Pod
• XenServer 6.2
Compute
• Gigabytes
• Management Uses 1 Bonded NIC
• Public + Guest Uses 1 Bonded NIC
• Storage Uses 1 Bonded NIC (10G)
• Access & Storage Networks are Isolated
• Dell 6248
• Dell 8132
Network
• ZFS Filesystem, Based on OpenSolaris and Debian
• Linux Open Source Code Bases
( Moving to illumos)
• Software Only
• Platform, Plugins and Adapters
• Compelling Advantages over Proprietary Filesystems
Primary Storage Design (NexentaStor)
What is NexentaStor ?
• Simple Installation and Management.
• Optimized Base Configuration that Allows for:
‣ Easily reproducible configuration on a massive scale
‣ Generalized storage skill set required to maintain extensive infrastructure
‣ Little or no need for modification to achieve high performance
Advantages of NexentaStor Storage Appliance
Head Nodes – 2 Numbers
2x Dell R720 with Onboard Intel 1Gbps NIC, Perc H710
4x Intel® Xeon® Hex Core – 2.3Ghz or higher
24x 16GB 1600Mhz Memory
4x 300GB 2.5" 10K RPM SAS disks (Nexenta Syspool Configuration)
4x 2port Dell (LSI) SAS HBA
4x 10Gbps Intel NIC's low profile
Primary Storage – Hardware List
JBODs – 2 Numbers
PowerVault(TM) MD1220 Disk Storage Enclosure, 2U
24 Disk Slots
SSD Disks
30 x 2TB SSD Drives
Primary Storage – Hardware List
HeadNode-JBOD SAS Connectivity
HeadNode Network Connectivity
• Expose a Volume Using NFS/iSCSI as per the Cluster
Requirement
• Add the Respective Volume as a ‘Primary Storage’ from the
CloudPlatform Management Portal
• CloudPlatform Provisioning with NexentaStor is Automated
Using Enterprise Chef™ Cookbooks, using the Knife API Plug-ins
Provisioning Primary Storage
• GlusterFS with One-to-One Replication
• uCarp to Manage Floating IP
• Hardware Specs
• SuperMicro MBD-XS8DTE-F-O
• 32GB Memory
• 24x1TB SATA
Secondary Storage Design
GlusterFS Network Layout
• Cassandra Cluster
• Client Facing Applications
• Database Servers (PostgreSQL, MySQL, Redis etc.)
• And More …
Current Workload
• Preparation
• Compatibility Testing
• Stable Network
• Pay Attention on HA
• Staging Cluster
• Schedule Backup Solution
• Contribute Back to the Community
What We Learnt ?
• Migrate traditional data centers into Cloud
• Evaluate and build a Hyper-V zone
Steps Ahead
Questions ?
Thank You!
mailto: iliyas.shirol@inmobi.com

More Related Content

PDF
Orchestrating MySQL
PPTX
My local test Environment
PDF
Webinar - DreamObjects/Ceph Case Study
PDF
Developing the Stratoscale System at Scale - Muli Ben-Yehuda, Stratoscale - D...
PDF
Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...
PPTX
Leveraging OpenStack Cinder for Peak Application Performance
PDF
Percona Live 4/14/15: Leveraging open stack cinder for peak application perfo...
PPTX
RedisConf17 - Home Depot - Turbo charging existing applications with Redis
Orchestrating MySQL
My local test Environment
Webinar - DreamObjects/Ceph Case Study
Developing the Stratoscale System at Scale - Muli Ben-Yehuda, Stratoscale - D...
Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...
Leveraging OpenStack Cinder for Peak Application Performance
Percona Live 4/14/15: Leveraging open stack cinder for peak application perfo...
RedisConf17 - Home Depot - Turbo charging existing applications with Redis

What's hot (20)

PPTX
Geode introduction
PDF
Scylla Summit 2016: ScyllaDB, Present and Future
PPTX
Share point 2013 on azure
PPTX
Docker y azure container service
PPTX
Scylla Summit 2018: Scylla Feature Talks - Gains by Using Scylla-Specific Dri...
PDF
Muli Ben-Yehuda, Stratoscale - The Road to a Hyper-Converged OpenStack, OpenS...
PPTX
Reaching the Cloud: The Architecture
ODP
Guaranteeing Storage Performance by Mike Tutkowski
PPTX
Cassandra @ Sony: The good, the bad, and the ugly part 1
PDF
The Fabric of the Future
PPTX
RedisConf18 - Redis Cluster Provisioning with Kubernetes Service-Catalog Exte...
PDF
Getting it Right: OpenStack Private Cloud Storage
PPTX
Sqlite Introduction
PDF
RedisDay London 2018 - Layered Orchestration & Redis Enterprise for fun and p...
PPTX
Cassandra tech talk
PPTX
SQL Azure for ISUG(SQL Server Israeli User Group)
PPTX
2021 March Pravega Community Meeting
PPTX
Gain Storage Control with SIOC and Take Performance Control with QoS from Sol...
PPTX
Scylla Summit 2019 Keynote - Avi Kivity
PDF
Software is Eating The Data center
Geode introduction
Scylla Summit 2016: ScyllaDB, Present and Future
Share point 2013 on azure
Docker y azure container service
Scylla Summit 2018: Scylla Feature Talks - Gains by Using Scylla-Specific Dri...
Muli Ben-Yehuda, Stratoscale - The Road to a Hyper-Converged OpenStack, OpenS...
Reaching the Cloud: The Architecture
Guaranteeing Storage Performance by Mike Tutkowski
Cassandra @ Sony: The good, the bad, and the ugly part 1
The Fabric of the Future
RedisConf18 - Redis Cluster Provisioning with Kubernetes Service-Catalog Exte...
Getting it Right: OpenStack Private Cloud Storage
Sqlite Introduction
RedisDay London 2018 - Layered Orchestration & Redis Enterprise for fun and p...
Cassandra tech talk
SQL Azure for ISUG(SQL Server Israeli User Group)
2021 March Pravega Community Meeting
Gain Storage Control with SIOC and Take Performance Control with QoS from Sol...
Scylla Summit 2019 Keynote - Avi Kivity
Software is Eating The Data center
Ad

Similar to Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best practices from Inmobi Technologies (20)

PPTX
Citrix Synergy 2014: Going the CloudPlatform Way
PDF
OSS Presentation Metro Cluster by Andy Bennett & Roel De Frene
PPT
110629 nexenta- andy bennett
PPTX
V mware2012 20121221_final
PDF
Why Software Defined Storage is Critical for Your IT Strategy
PDF
Nexenta ttec-2012
PDF
NetApp Industry Keynote - Flash Memory Summit - Aug2015
PDF
OSS Presentation by Bryan Badger
PDF
Nexenta Powered by Apache CloudStack from Iliyas Shirol
PDF
nutanix-infrastructure-presentation01.pdf
PDF
A complete Open Source cloud: Storage, Virt, IaaS, PaaS
PDF
Nexenta transtec
PPTX
Taming the cost of your first cloud - CCCEU 2014
PDF
S cv3179 spectrum-integration-openstack-edge2015-v5
PPT
How to Design a Scalable Private Cloud
PPT
SmartCloud Provisioning - servere i skyen på et splitsekund. Steen Eriksen &...
PDF
New Networking Technology Survey & Analysis
PPTX
CloudOpen Japan - Controlling the cost of your first cloud
PDF
Migrating to Public Cloud
PDF
Nuage Networks - Cloud Platforms - 101 and beyond
Citrix Synergy 2014: Going the CloudPlatform Way
OSS Presentation Metro Cluster by Andy Bennett & Roel De Frene
110629 nexenta- andy bennett
V mware2012 20121221_final
Why Software Defined Storage is Critical for Your IT Strategy
Nexenta ttec-2012
NetApp Industry Keynote - Flash Memory Summit - Aug2015
OSS Presentation by Bryan Badger
Nexenta Powered by Apache CloudStack from Iliyas Shirol
nutanix-infrastructure-presentation01.pdf
A complete Open Source cloud: Storage, Virt, IaaS, PaaS
Nexenta transtec
Taming the cost of your first cloud - CCCEU 2014
S cv3179 spectrum-integration-openstack-edge2015-v5
How to Design a Scalable Private Cloud
SmartCloud Provisioning - servere i skyen på et splitsekund. Steen Eriksen &...
New Networking Technology Survey & Analysis
CloudOpen Japan - Controlling the cost of your first cloud
Migrating to Public Cloud
Nuage Networks - Cloud Platforms - 101 and beyond
Ad

More from Citrix (20)

PDF
2015 03-26 cloud platform master class for cloudplatform 4 5 - public
PPTX
2015 02-10 xen server master class
PPTX
Citrix cloud case study kit 2014
PPTX
Citrix SaaS and Citrix CloudPlatform Case Study
PPTX
Citrix Cloud Master Class Nov. 13, 2014
PPTX
Citrix Cumulus Case Study Oct. 2014
PDF
Citrix cloud-works-with-the-new-it-reality-1-638
PPTX
2014-09-15 cloud platform master class
PPTX
Citrix education cloud case study kit 2014
PPTX
2014 08-21 Citrix cloud works with a single management platform technical web...
PPTX
Citrix Cloud Works with...the new it reality
PDF
Citrix Cloud Works with… the new IT reality
PPTX
Citrix Cloud Master Class June 2014
PPTX
Citrix xa xd cloud provisioning webinar
PDF
Citrix Synergy 2014 - Syn235 Supporting graphical software in a cloud environ...
PPTX
Citrix Synergy 2014 - Syn230 Building successful clouds based on citrix consu...
PPTX
Citrix Synergy 2014 - Syn231 Why cloud projects fail
PDF
Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...
PPTX
Citrix Synergy 2014 - Syn229 What's new in Citrix Cloud Portal Business Manager
PPTX
Citrix Synergy 2014 - Syn227 Architecting your private cloud infrastructure f...
2015 03-26 cloud platform master class for cloudplatform 4 5 - public
2015 02-10 xen server master class
Citrix cloud case study kit 2014
Citrix SaaS and Citrix CloudPlatform Case Study
Citrix Cloud Master Class Nov. 13, 2014
Citrix Cumulus Case Study Oct. 2014
Citrix cloud-works-with-the-new-it-reality-1-638
2014-09-15 cloud platform master class
Citrix education cloud case study kit 2014
2014 08-21 Citrix cloud works with a single management platform technical web...
Citrix Cloud Works with...the new it reality
Citrix Cloud Works with… the new IT reality
Citrix Cloud Master Class June 2014
Citrix xa xd cloud provisioning webinar
Citrix Synergy 2014 - Syn235 Supporting graphical software in a cloud environ...
Citrix Synergy 2014 - Syn230 Building successful clouds based on citrix consu...
Citrix Synergy 2014 - Syn231 Why cloud projects fail
Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...
Citrix Synergy 2014 - Syn229 What's new in Citrix Cloud Portal Business Manager
Citrix Synergy 2014 - Syn227 Architecting your private cloud infrastructure f...

Recently uploaded (20)

PDF
Modernizing your data center with Dell and AMD
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Electronic commerce courselecture one. Pdf
PPTX
A Presentation on Artificial Intelligence
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
KodekX | Application Modernization Development
PDF
Encapsulation theory and applications.pdf
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
cuic standard and advanced reporting.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Machine learning based COVID-19 study performance prediction
Modernizing your data center with Dell and AMD
Spectral efficient network and resource selection model in 5G networks
Review of recent advances in non-invasive hemoglobin estimation
Electronic commerce courselecture one. Pdf
A Presentation on Artificial Intelligence
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Per capita expenditure prediction using model stacking based on satellite ima...
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
NewMind AI Weekly Chronicles - August'25 Week I
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
KodekX | Application Modernization Development
Encapsulation theory and applications.pdf
Digital-Transformation-Roadmap-for-Companies.pptx
Advanced methodologies resolving dimensionality complications for autism neur...
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
cuic standard and advanced reporting.pdf
20250228 LYD VKU AI Blended-Learning.pptx
Encapsulation_ Review paper, used for researhc scholars
Machine learning based COVID-19 study performance prediction

Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best practices from Inmobi Technologies

  • 1. InMobi Private Cloud: Going the CloudPlatform Way Iliyas Shirol InMobi
  • 2. #whoami • BigData/Cloud Evangelist at InMobi • Working in CloudStack Since 2012 • CloudStack Community Gardener @iliyas_shirol
  • 3. Agenda • About InMobi • Going Cloud Way • Architecture & Design • Questions
  • 7. • Development and Test Environment • Scalable Web Applications and Content Services • High Speed Server Resource Deployment • And More.. Why Cloud ?
  • 8. • Disconnected Tools, Servers, People • Slow Build and Release Cycles • Multiple Build and Test Systems Across Locations • Home-Built Systems are Brittle, Error-Prone, and Not Scalable • Difficult to Build, Test, and Recreate the Data • Difficult to Audit Processes and Predict Schedules • Time, Money Wasted on Broken Builds • Dedicated Build/Test Servers are not Fully Utilized Why Dev / Test in the Cloud ?
  • 9. • Self-Service Developers can provision their own environments • Usage Measurement We worry about VM sprawl • Isolated Networks Must not let dev/test interfere with the real world • Commodity As cheap as practical • May also House Production Workloads How Does a Dev/Test Cloud Look Like ?
  • 10. • Budget • Integration with Public Cloud • Scaling • Reconfiguration • Legacy Hardware Early Assessments & Results
  • 11. • Leverage Existing Infrastructure • Customization and Control • Regulatory/Security Requirements • Cost Why Private Cloud ?
  • 12. • Scalable Grow-as-you-need, expand across borders • Open Source Community Support Active user and development support base • Advanced Networking VLAN integrated, SDN ready • Multi-Tenancy • Multi-Hypervisor Support Why Citrix CloudPlatform ?
  • 13. • Easy to Deploy • Speed to Production • Documentation Why Citrix CloudPlatform ?
  • 15. • Bring Everyone in the Room • Know the Fine Print • Understand Workloads • Understand Bottlenecks The Design Phase
  • 16. • CloudStack Management Server • MySQL Servers • Primary & Secondary Storage • Hypervisor Farm Redundancy and Resilience
  • 18. • Dell PE R610’s & R720’s • 96 – 256 GB RAM • 40-80 CPU Cores • 2 Advanced + 1 Basic Zones • 1 Pod in Each Zone • 1 – 5 Clusters in Each Pod • XenServer 6.2 Compute
  • 19. • Gigabytes • Management Uses 1 Bonded NIC • Public + Guest Uses 1 Bonded NIC • Storage Uses 1 Bonded NIC (10G) • Access & Storage Networks are Isolated • Dell 6248 • Dell 8132 Network
  • 20. • ZFS Filesystem, Based on OpenSolaris and Debian • Linux Open Source Code Bases ( Moving to illumos) • Software Only • Platform, Plugins and Adapters • Compelling Advantages over Proprietary Filesystems Primary Storage Design (NexentaStor)
  • 22. • Simple Installation and Management. • Optimized Base Configuration that Allows for: ‣ Easily reproducible configuration on a massive scale ‣ Generalized storage skill set required to maintain extensive infrastructure ‣ Little or no need for modification to achieve high performance Advantages of NexentaStor Storage Appliance
  • 23. Head Nodes – 2 Numbers 2x Dell R720 with Onboard Intel 1Gbps NIC, Perc H710 4x Intel® Xeon® Hex Core – 2.3Ghz or higher 24x 16GB 1600Mhz Memory 4x 300GB 2.5" 10K RPM SAS disks (Nexenta Syspool Configuration) 4x 2port Dell (LSI) SAS HBA 4x 10Gbps Intel NIC's low profile Primary Storage – Hardware List
  • 24. JBODs – 2 Numbers PowerVault(TM) MD1220 Disk Storage Enclosure, 2U 24 Disk Slots SSD Disks 30 x 2TB SSD Drives Primary Storage – Hardware List
  • 27. • Expose a Volume Using NFS/iSCSI as per the Cluster Requirement • Add the Respective Volume as a ‘Primary Storage’ from the CloudPlatform Management Portal • CloudPlatform Provisioning with NexentaStor is Automated Using Enterprise Chef™ Cookbooks, using the Knife API Plug-ins Provisioning Primary Storage
  • 28. • GlusterFS with One-to-One Replication • uCarp to Manage Floating IP • Hardware Specs • SuperMicro MBD-XS8DTE-F-O • 32GB Memory • 24x1TB SATA Secondary Storage Design
  • 30. • Cassandra Cluster • Client Facing Applications • Database Servers (PostgreSQL, MySQL, Redis etc.) • And More … Current Workload
  • 31. • Preparation • Compatibility Testing • Stable Network • Pay Attention on HA • Staging Cluster • Schedule Backup Solution • Contribute Back to the Community What We Learnt ?
  • 32. • Migrate traditional data centers into Cloud • Evaluate and build a Hyper-V zone Steps Ahead