OpenStack Nova Scheduler
Download as ODP, PDF13 likes13,070 views
OpenStack is an open source cloud operating system that provides on-demand provisioning of compute, storage, and networking resources. It consists of several interconnected components that are managed through a dashboard interface. The key components include Horizon (dashboard), Keystone (authentication), Swift (object storage), Glance (image repository), Nova (compute), Quantum (networking), and Cinder (block storage). Nova is responsible for running virtual machine instances by retrieving images from Glance and scheduling instances on compute hosts using the Nova scheduler. The Nova scheduler uses filters and weights to determine the most suitable host for an instance based on availability, capabilities, and load.
OpenStack Nova Scheduler
- 1. Solving problems, the cloud way! Peeyush Gupta
- 2. What is it? ● OpenStack is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface.(Got it!) ● Provides an Infrastructure as a Service (IaaS) - Elasticity - Virtualization
- 3. Virtualization ● Why? - Efficiency ● How? -Hypervisor - KVM/QEMU/libvirt
- 5. 7 Components ● Horizon – the Dashboard ● Keystone – the Authentication system ● Swift – the Object storage ● Glance – the Image repository ● Nova – the Core of the system ● Quantum – the Networking component ● Cinder – the Volume guy!
- 6. Communication ● Database ● Message Queue - uses AMQP - Implemented through rabbitmq server
- 9. Nova ● The big daddy! ● Responsible for storing, retrieving images from Glance and running the instances. ● Provides virtual instances on demand.
- 10. Nova – the Components ● Nova-api : Talks to the user ● Nova-compute : creates/terminates VM instances. ● Nova-volume : Volume guy, again! ● Nova-network : Performs networking tasks. ● Nova-scheduler : Determines on which host a particular instance should run. ● Console Services
- 11. Nova – the Components ● Nova-network - Floating and Fixed IPs - Supports three kind of networking - Flat - Flat DHCP - VLAN ● Nova-volume - Used to add more storage to the running instances.
- 12. Nova-scheduler ● Takes a VM instance and determine where it should run (on which host). ● 2 step process
- 13. Filtering ● 3 choices - Simple : Finds the least loaded host. - Random : Selects a random available host. - Zone : Selects a random host within an availability zone. ● Defaults - Volume Scheduler – Chance (Random) - Compute Scheduler – Filter (Availability Zone, RAM and capability) ● Need more? - Try hints!
- 14. RAM-Filter
- 16. Compute-Filter
- 17. Other Options ● Core Filter : Filters on the basis of available CPU cores. ● Isolated Hosts Filter : Allows to generate isolated sets of images and hosts. ● Disk Filter : Schedule instances if there are sufficient disk available for ephemeral storage. ● And so on...
- 18. Host Aggregates ● Partition the availability zone further. ● Only visible to admin, not to users. ● Each node can have multiple aggregates, each aggregate can have multiple key-value pairs, and the same key-value pair can be assigned to multiple aggregate. ● Uses aggregate_instance_extra_specs filter.
- 19. Weighing ● Scheduler applies cost functions on each host and calculates the weight. ● The least weighted host wins.
- 20. The Actors Behind The Scene ● Manager(gets the rpc call from API) calls up the driver to run the instance:
- 21. The Actors Behind The Scene ● The filter scheduler (default), calls up the its _scheduler function
- 22. The Actors Behind The Scene ● _schedule function calls up get-filtered-host function and weight function of host manager
- 23. The Actors Behind The Scene ● Filtering happens here, finally! ● get_filtered_hosts() function of host_manager.py filters hosts and returns only rthe ones passing all filters. ● get_weighed_host() weigh the filtered hosts, according to the weighs set by weigh handler.
- 24. In the end... ● The scheduler manager sends an rpc call to the compute manager of selected hosts. ● The compute manager receives it from the queue and runs its create_instance method and we get a running VM instance.
- 25. Thank You