SlideShare a Scribd company logo
Ravello Labs
Virtualizing the cloud
Alex Fishman, 05.27.13
http://www.ravellosystems.com
Challenge
How to build a truly
elastic private cloud?
Strategies for building a private cloud
➜ Build a data center to accommodate peaks
› Expensive to build and maintain
› Not efficient because of resource under-utilization
› Not truly elastic
➜ VPC on a public cloud (Amazon VPC, Rackspace private
cloud)
› Can’t run original VM images
› Network configuration is limited
› Lock in to a specific provider
› Perceptually less secure
➜ Build a hybrid cloud
› Mostly a hype at this moment
3
How to achieve elasticity
4
The only way to build a truly elastic
private cloud is to utilize public
cloud infrastructure
Challenges of using public cloud
➜ Incompatible APIs
› EC2, OpenStack flavors, Azure
➜ Different virtualization technologies
› PV vs HVM
› Virtual HW exposed to VM
➜ Network topology
› Vary from provider to provider
› Often rigid and inflexible
➜ Storage
› Incompatible solutions
5
Imagine an OpenStack managing a private cloud built
on top of public cloud infrastructure…
➜ Building blocks of our
OpenStack private cloud
› OpenStack compute nodes
on public cloud VMs
› Quantum L2 overlay on
top of a cloud provider’s
network
› Abstraction for Cinder,
Glance and Swift
6
Sounds easy… But how do you run an OpenStack
compute node on top of a VM?
Public Cloud A Public Cloud B
Compute nodes Compute nodes
Network and Storage
The answer: nested virtualization
➜ HVX is a high performance
nested hypervisor
› Can run on top of any hypervisor
› Runs unmodified guest VMs
› Supports PV and HVM for bottom
virtualization layer
➜ Implements its own set of
virtual hardware
› Compatible with KVM, ESX, XEN
HVX architecture
7
Unmodified guest
VM
Guest VM
hardware
HVX hypervisor
Linux
Cloud VM
hardware
Cloud VM
HVX highlights
➜ High performance
› Benchmarks were run
with Phoronix test
suite
➜ Advanced memory
management
› Allows cpu/memory
overcommit by
utilizing KSM (page
sharing) and swap
8
HVX implementation details
➜ Employs binary translation technique
› Translates guest binary code into platform
compatible code
› 32bit guest into 64 bit host
› Replaces privileged instructions
› CPU registers are shadowed
➜ Performance optimizations
› Translated code is cached and chained
› Fast shadow MMU implementation
› Direct execution or user space code (Ring 3)
› PV device implementation for fast IO
› Fast context switching between guest and host kernel
› Uses Linux for guest CPU scheduling and memory
management
➜ Memory protection and data isolation
› Each guest runs in its own context and cannot access
hvx or host memory
› Guest resource usage (CPU/IO) can be throttled if
needed
9
..
9
Instruction
Instruction
Instruction
….
Jump to next
Tc Instruction
Tc Instruction
Tc Instruction
….
Jump to HVX
Original guest code Translated guest code
Next:
Instruction
Instruction
Instruction
….
Instruction
Next TC:
Tc Instruction
Tc Instruction
Tc Instruction
….
Jump to HVX
HVX compiles next
code section
• HVX reads and compiles a guest
code section. It then gets executed.
• At the end of each translated code
section there is a jump back to HVX
and the process repeats
Combining OpenStack with HVX
10
Build a fully elastic “virtual” private
cloud built on top of any public
cloud provider
Added bonus: get a truly hybrid cloud by adding
compute nodes that run on top of “real” hardware in a
private data center
Use cases
➜ Cost savings for existing cloud users
› EC2 cr1.8xlarge: 244GB, 32 vcpus – $3.5 per hour. When
running 100 VMs: 0.035$ per VM per hour.
➜ Dev/Test
› Deploy and provision a “virtual” private data center in a
matter of minutes
➜ DR
› Migrate easily between clouds
➜ Cloud burst:
› Add a new hardware when demand for computing
capacity spikes
11
OpenStack demo
➜ Configuration:
› EC2 VM running a management node
› EC2 VM (m3.4xlarge, 4 cpus, 16GB ram) as a compute
node 1
› HPCloud VM (4 cpus, 16 Gb RAM) as a compute node 2
➜ Live migration of a guest VM running on HPCloud
compute node to EC2 compute node
12

More Related Content

ODP
Openvz booth
PPTX
Containerization - The DevOps Revolution
PPTX
DevCloud - Setup and Demo on Apache CloudStack
PPTX
The Good, the Bad and the Ugly of Networking for Microservices by Mathew Lodg...
PPT
OpenNebula Administrator View
PDF
OSv presentation from Linux Foundation Collaboration Summit
ODP
Using CloudStack With Clustered LVM
PPTX
Xenserver Networking
Openvz booth
Containerization - The DevOps Revolution
DevCloud - Setup and Demo on Apache CloudStack
The Good, the Bad and the Ugly of Networking for Microservices by Mathew Lodg...
OpenNebula Administrator View
OSv presentation from Linux Foundation Collaboration Summit
Using CloudStack With Clustered LVM
Xenserver Networking

What's hot (20)

PDF
Ceph with CloudStack
PPTX
OSv: probably the best OS for cloud workloads you've never hear of
PPTX
Amazon Cloud Overview
PPTX
XenServer Virtualization In Cloud Environments
PDF
Hacking apache cloud stack
PDF
Build a Docker Swarm cluster on Azure
PDF
OpenNebulaconf2017US: Vtastic:Akamai innovations for distributed system testi...
PDF
OpenNebula 5.4 Enhancements vCenter Integration
PDF
How Can OpenNebula Fit Your Needs: A European Project Feedback
PPTX
Hypervisor Selection in CloudStack and OpenStack
PDF
Improving Development and Deployment with Docker
ODP
Implementing CloudStack's VPC feature
PDF
Monitoring Large-scale Cloud Infrastructures with OpenNebula
PDF
Monitoring of OpenNebula installations
PPTX
Docker for Ops: Docker Networking Deep Dive, Considerations and Troubleshooti...
PDF
Ceph and Apache CloudStack
PPTX
Cloud stack networking shapeblue technical deep dive
PDF
OpenNebulaconf2017US: Orchestration of vMware datacenters with OpenNebula by ...
PPTX
Nested Virtualization Update from Intel
PDF
OpenNebulaconf2017US: Configuration management with OpenNebula and Ansible by...
Ceph with CloudStack
OSv: probably the best OS for cloud workloads you've never hear of
Amazon Cloud Overview
XenServer Virtualization In Cloud Environments
Hacking apache cloud stack
Build a Docker Swarm cluster on Azure
OpenNebulaconf2017US: Vtastic:Akamai innovations for distributed system testi...
OpenNebula 5.4 Enhancements vCenter Integration
How Can OpenNebula Fit Your Needs: A European Project Feedback
Hypervisor Selection in CloudStack and OpenStack
Improving Development and Deployment with Docker
Implementing CloudStack's VPC feature
Monitoring Large-scale Cloud Infrastructures with OpenNebula
Monitoring of OpenNebula installations
Docker for Ops: Docker Networking Deep Dive, Considerations and Troubleshooti...
Ceph and Apache CloudStack
Cloud stack networking shapeblue technical deep dive
OpenNebulaconf2017US: Orchestration of vMware datacenters with OpenNebula by ...
Nested Virtualization Update from Intel
OpenNebulaconf2017US: Configuration management with OpenNebula and Ansible by...
Ad

Similar to Alex Fishman - Virtualizing the Cloud (20)

PPTX
HVX: Virtualizing the Cloud
PDF
Advanced Docker Developer Workflows on MacOS X and Windows
PDF
OSCON: Advanced Docker developer workflows on Mac OS and Windows
PPTX
Microsoft Server Virtualization and Private Cloud
PPTX
Server Virtualization using Hyper-V
PDF
VMUG St Louis - SDN in the Real World
PPTX
Server 2016 sneak peek
PDF
Unikernels: Rise of the Library Hypervisor
PDF
Unikernels: the rise of the library hypervisor in MirageOS
PPTX
CloudStackFinalProject
PPTX
Whats new in Microsoft Windows Server 2016 Clustering and Storage
PDF
Oracle VM - the Heart of Oracle Cloud
PPTX
Docker - Portable Deployment
PPTX
Containers and Docker
PPTX
OpenStack and Windows
PDF
The lies we tell our code, LinuxCon/CloudOpen 2015-08-18
PDF
The Lies We Tell Our Code (#seascale 2015 04-22)
PDF
VMworld 2013: Virtualized Network Services Model with VMware NSX
PPTX
vSphere Integrated Containers 101 and End-User Workflow
PDF
Cisco HyperFlex 3.0
HVX: Virtualizing the Cloud
Advanced Docker Developer Workflows on MacOS X and Windows
OSCON: Advanced Docker developer workflows on Mac OS and Windows
Microsoft Server Virtualization and Private Cloud
Server Virtualization using Hyper-V
VMUG St Louis - SDN in the Real World
Server 2016 sneak peek
Unikernels: Rise of the Library Hypervisor
Unikernels: the rise of the library hypervisor in MirageOS
CloudStackFinalProject
Whats new in Microsoft Windows Server 2016 Clustering and Storage
Oracle VM - the Heart of Oracle Cloud
Docker - Portable Deployment
Containers and Docker
OpenStack and Windows
The lies we tell our code, LinuxCon/CloudOpen 2015-08-18
The Lies We Tell Our Code (#seascale 2015 04-22)
VMworld 2013: Virtualized Network Services Model with VMware NSX
vSphere Integrated Containers 101 and End-User Workflow
Cisco HyperFlex 3.0
Ad

More from Cloud Native Day Tel Aviv (20)

PDF
Cloud Native is a Cultural Decision. By Reshef Mann
PDF
Container Runtime Security with Falco, by Néstor Salceda
PDF
Kafka Mirror Tester: Go and Kubernetes Powered Test Suite for Kafka Replicati...
PDF
Running I/O intensive workloads on Kubernetes, by Nati Shalom
PDF
WTF Do We Need a Service Mesh? By Anton Weiss.
PDF
Update Strategies for the Edge, by Kat Cosgrove
PDF
Building a Cloud-Native SaaS Product The Hard Way. By Arthur Berezin
PDF
The Four Questions (Every Monitoring Engineer gets asked), by Leon Adato
PDF
K8s Pod Scheduling - Deep Dive. By Tsahi Duek.
PDF
Cloud Native: The Cattle, the Pets, and the Germs, by Avishai Ish-Shalom
PDF
MySQL Shell: the daily tool for devs and admins. By Vittorio Cioe.
PDF
Cloud native transformation patterns, by Pini Reznik
PPTX
Cloud and Edge: price, performance and privacy considerations in IOT, by Tsvi...
PDF
Two Years, Zero servers: Lessons learned from running a startup 100% on Serve...
PDF
12 Factor Serverless Applications - Mike Morain, AWS - Cloud Native Day Tel A...
PDF
Not my problem! Delegating responsibilities to the infrastructure - Yshay Yaa...
PDF
Brain in the Cloud: Machine Learning on OpenStack & Kubernetes Done Right - E...
PPTX
A stateful application walks into a Kubernetes bar - Arthur Berezin, JovianX ...
PPTX
The story of how KubeMQ was born - Oz Golan, KubeMQ - Cloud Native Day Tel Av...
PPTX
I want it all: go hybrid - Orit Yaron, Outbrain - Cloud Native Day Tel Aviv 2018
Cloud Native is a Cultural Decision. By Reshef Mann
Container Runtime Security with Falco, by Néstor Salceda
Kafka Mirror Tester: Go and Kubernetes Powered Test Suite for Kafka Replicati...
Running I/O intensive workloads on Kubernetes, by Nati Shalom
WTF Do We Need a Service Mesh? By Anton Weiss.
Update Strategies for the Edge, by Kat Cosgrove
Building a Cloud-Native SaaS Product The Hard Way. By Arthur Berezin
The Four Questions (Every Monitoring Engineer gets asked), by Leon Adato
K8s Pod Scheduling - Deep Dive. By Tsahi Duek.
Cloud Native: The Cattle, the Pets, and the Germs, by Avishai Ish-Shalom
MySQL Shell: the daily tool for devs and admins. By Vittorio Cioe.
Cloud native transformation patterns, by Pini Reznik
Cloud and Edge: price, performance and privacy considerations in IOT, by Tsvi...
Two Years, Zero servers: Lessons learned from running a startup 100% on Serve...
12 Factor Serverless Applications - Mike Morain, AWS - Cloud Native Day Tel A...
Not my problem! Delegating responsibilities to the infrastructure - Yshay Yaa...
Brain in the Cloud: Machine Learning on OpenStack & Kubernetes Done Right - E...
A stateful application walks into a Kubernetes bar - Arthur Berezin, JovianX ...
The story of how KubeMQ was born - Oz Golan, KubeMQ - Cloud Native Day Tel Av...
I want it all: go hybrid - Orit Yaron, Outbrain - Cloud Native Day Tel Aviv 2018

Recently uploaded (20)

PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
August Patch Tuesday
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PPTX
A Presentation on Artificial Intelligence
PPTX
OMC Textile Division Presentation 2021.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
Tartificialntelligence_presentation.pptx
PDF
Hindi spoken digit analysis for native and non-native speakers
PPTX
A Presentation on Touch Screen Technology
PDF
Mushroom cultivation and it's methods.pdf
PDF
A novel scalable deep ensemble learning framework for big data classification...
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
WOOl fibre morphology and structure.pdf for textiles
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
project resource management chapter-09.pdf
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Zenith AI: Advanced Artificial Intelligence
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
August Patch Tuesday
gpt5_lecture_notes_comprehensive_20250812015547.pdf
A Presentation on Artificial Intelligence
OMC Textile Division Presentation 2021.pptx
Programs and apps: productivity, graphics, security and other tools
Tartificialntelligence_presentation.pptx
Hindi spoken digit analysis for native and non-native speakers
A Presentation on Touch Screen Technology
Mushroom cultivation and it's methods.pdf
A novel scalable deep ensemble learning framework for big data classification...
Accuracy of neural networks in brain wave diagnosis of schizophrenia
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
A comparative study of natural language inference in Swahili using monolingua...
Building Integrated photovoltaic BIPV_UPV.pdf
WOOl fibre morphology and structure.pdf for textiles
Assigned Numbers - 2025 - Bluetooth® Document
project resource management chapter-09.pdf
Digital-Transformation-Roadmap-for-Companies.pptx
Zenith AI: Advanced Artificial Intelligence

Alex Fishman - Virtualizing the Cloud

  • 1. Ravello Labs Virtualizing the cloud Alex Fishman, 05.27.13 http://www.ravellosystems.com
  • 2. Challenge How to build a truly elastic private cloud?
  • 3. Strategies for building a private cloud ➜ Build a data center to accommodate peaks › Expensive to build and maintain › Not efficient because of resource under-utilization › Not truly elastic ➜ VPC on a public cloud (Amazon VPC, Rackspace private cloud) › Can’t run original VM images › Network configuration is limited › Lock in to a specific provider › Perceptually less secure ➜ Build a hybrid cloud › Mostly a hype at this moment 3
  • 4. How to achieve elasticity 4 The only way to build a truly elastic private cloud is to utilize public cloud infrastructure
  • 5. Challenges of using public cloud ➜ Incompatible APIs › EC2, OpenStack flavors, Azure ➜ Different virtualization technologies › PV vs HVM › Virtual HW exposed to VM ➜ Network topology › Vary from provider to provider › Often rigid and inflexible ➜ Storage › Incompatible solutions 5
  • 6. Imagine an OpenStack managing a private cloud built on top of public cloud infrastructure… ➜ Building blocks of our OpenStack private cloud › OpenStack compute nodes on public cloud VMs › Quantum L2 overlay on top of a cloud provider’s network › Abstraction for Cinder, Glance and Swift 6 Sounds easy… But how do you run an OpenStack compute node on top of a VM? Public Cloud A Public Cloud B Compute nodes Compute nodes Network and Storage
  • 7. The answer: nested virtualization ➜ HVX is a high performance nested hypervisor › Can run on top of any hypervisor › Runs unmodified guest VMs › Supports PV and HVM for bottom virtualization layer ➜ Implements its own set of virtual hardware › Compatible with KVM, ESX, XEN HVX architecture 7 Unmodified guest VM Guest VM hardware HVX hypervisor Linux Cloud VM hardware Cloud VM
  • 8. HVX highlights ➜ High performance › Benchmarks were run with Phoronix test suite ➜ Advanced memory management › Allows cpu/memory overcommit by utilizing KSM (page sharing) and swap 8
  • 9. HVX implementation details ➜ Employs binary translation technique › Translates guest binary code into platform compatible code › 32bit guest into 64 bit host › Replaces privileged instructions › CPU registers are shadowed ➜ Performance optimizations › Translated code is cached and chained › Fast shadow MMU implementation › Direct execution or user space code (Ring 3) › PV device implementation for fast IO › Fast context switching between guest and host kernel › Uses Linux for guest CPU scheduling and memory management ➜ Memory protection and data isolation › Each guest runs in its own context and cannot access hvx or host memory › Guest resource usage (CPU/IO) can be throttled if needed 9 .. 9 Instruction Instruction Instruction …. Jump to next Tc Instruction Tc Instruction Tc Instruction …. Jump to HVX Original guest code Translated guest code Next: Instruction Instruction Instruction …. Instruction Next TC: Tc Instruction Tc Instruction Tc Instruction …. Jump to HVX HVX compiles next code section • HVX reads and compiles a guest code section. It then gets executed. • At the end of each translated code section there is a jump back to HVX and the process repeats
  • 10. Combining OpenStack with HVX 10 Build a fully elastic “virtual” private cloud built on top of any public cloud provider Added bonus: get a truly hybrid cloud by adding compute nodes that run on top of “real” hardware in a private data center
  • 11. Use cases ➜ Cost savings for existing cloud users › EC2 cr1.8xlarge: 244GB, 32 vcpus – $3.5 per hour. When running 100 VMs: 0.035$ per VM per hour. ➜ Dev/Test › Deploy and provision a “virtual” private data center in a matter of minutes ➜ DR › Migrate easily between clouds ➜ Cloud burst: › Add a new hardware when demand for computing capacity spikes 11
  • 12. OpenStack demo ➜ Configuration: › EC2 VM running a management node › EC2 VM (m3.4xlarge, 4 cpus, 16GB ram) as a compute node 1 › HPCloud VM (4 cpus, 16 Gb RAM) as a compute node 2 ➜ Live migration of a guest VM running on HPCloud compute node to EC2 compute node 12