Running an openstack instance
- 1. Technical User Group EMEA Architects, Bart van den Heuvel Running an OpenStack Instance July, 2014
- 2. 8/5/2014 2Red Hat Confidential Agenda โข Introduction to IaaS with OpenStack โข demo โข OpenStack components available to images โข Creating Cloud Images โข Image factoryline
- 3. as a service Software as a Service Platform as a Service Infrastructure as a Service Data Center as a Service
- 4. What they have in common โข Self service โข Automated deployment โข Management built in โข Low initial cost to deploy โข Incremental cost as your usage grows โข Best Practices embedded โข Lifecycle built in โข Re-use โข Resource sharing
- 5. IaaS Common misinterpretations โข Scale out of the box โข Is same as Virtualization โข IaaS is cloud management or cloud orchestration solution โข Runs any workload, i can replace my virtualization with this
- 6. IaaS Jargon โข Stateful and stateless workloads โข Scale out not scale up โข Tenants โข Flavors โข Private and public networks SLA for cloud services typically target the Infrastructure, not the actual virtual machine
- 7. Datacenter Virtualization Private IaaS / Private Cloud Hybrid IaaS / Hybrid Cloud LEGACY WORKLOADS โ application defined in VM โ Big VMs: vCPU, vRAM, local storage inside VM โ Application SLA = SLA of VM โ SLA requires enterprise virtualization features to keep VMs highly available โ Life cycle measured in years โ VMs scale up: add vCPU, vRAM, etc. โ Applications not designed to tolerate failure of VMs CLOUD WORKLOADS โ Stateless VMs, application distributed โ Small VMs: vCPU, vRAM, storage separate โ Application SLA not dependent on any one VM โ SLA requires ability to create and destroy VMs where needed โ Life cycle measured in hours to months โ Applications scale out: add more VMs โ Applications designed to tolerate failure of VMs
- 8. OpenStack OpenStack is a NOT a replacement for Enterprise Virtualization!
- 10. 8/5/2014 10Red Hat Confidential Maturity model
- 11. Demo
- 12. The OpenStack VM โ Called 'Instance' โ Only exists for a limited amount of time โ 'ephemeral' disk โ Based on a 'cloud' OS image โ Can be Linux, Windows, ... โ Small replaceable engine, made to be unimportant
- 13. Features directly available to the Instance Compute Storage Networking VPNaaS, DBaaS, LBaaS, MaaS, ...
- 14. Networking in OpenStack (SDN) โข Tenant networks are completely isolated โข Tenants are free to create what they want: โข Any number of layer 2 networks โข Subnets, IP4 / IP6 โข Connect networks via virtual routers โข Connect to a external network, created by admin
- 15. Tip of the iceberg
- 16. Storage available to the Instance Ephemeral storage Block storage Object storage Used to... Run operating system and scratch space Add additional persistent storage to a virtual machine (VM) Store data, including VM images Accessed throughโฆ A file system A block device that can be partitioned, formatted, and mounted (such as, /dev/vdc) The REST API Accessible fromโฆ Within a VM Within a VM Anywhere Managed byโฆ OpenStack Compute (nova) OpenStack Block Storage (cinder) OpenStack Object Storage (swift) Persists untilโฆ VM is terminated Deleted by user Deleted by user (or by set expiration date) Sizing determined byโฆ Administrator configuration of size settings, known as flavors User specification in initial request Amount of available physical storage Example of typical usageโฆ 10 GB first disk, 30 GB second disk 1 TB disk 10s of TBs of dataset storage
- 17. Creating a OpenStack Image Many options are possible, manual and automated There is no image-factory in OpenStack - Create one manually on a libvirt host - Create one semi-automatic with OZ - Create a image-factory production line
- 18. Common components in cloud images Based on a QCOW2 disk image โข very flexible, rich featured format โข Overhead compared to raw โข Minimal disk image size (deployed instance) โข โข See: http://kashyapc.com/2012/10/04/creating-rapid-thin-provisioned-g uests-using-qemu-backing-files/ See: https://people.gnome.org/~markmc/qcow-image-format.html
- 19. cloud-init package Capabilities โข Setting a default locale โข Setting a instance hostname โข Generating instance ssh private keys โข Adding ssh keys to a users .ssh/authorized_keys so they can log in โข Setting up ephemeral mount points โข Various tasks to make the system useful
- 20. The meta data agent Set or request information about the running VM. โข Facts set by OpenStack โข Facts set by user, scripts or third party software โข AWS compatible or OpenStack's version nova meta <instancename or id> set role=database partner=thelastone script="/scripts/database-v1-2014.shโ curl http://169.254.169.254/openstack/latest/meta_data.json
- 21. The metadata agent โข ami-id โข ami-launch-index โข ami-manifest-path โข block-device-mapping โข hostname โข instance-action โข instance-id โข instance-type โข kernel-id โข local-hostname โข local-ipv4 โข placement โข public-hostname โข public-ipv4 โข public-keys โข ramdisk-id โข reservation-id {"random_seed": "yJn2cgiJMI/OJ/StW4mFQnFeR2MaboH/Mt9N0MJ1hzv5 GGvLgiGZ8/kW6tebU6L0kI7D+VCIVvGCq6EnDDb2cbt lenzol26ky8dcqEwnx3qCf4vLpHO+PWONtL7VR2AHR Q2ZIOO9VXnmCiUFudtCGETlXVXdXbcF4M56UsGy36b 166fZGg/iRibcDVcDUzAnByNmd+Vb2WZH/GVNCGb5 k0p/FVk/97SUpC9i5b+4AJiFXx1e5sK/sHi65514KA8AYe +jPRw5qrCbgpypLroAWWNvUEJTh5OmQVs229sFY9x mrIjjUbCg3BhkQnGP6QJ7KQoM2CHROh2cPbOLalaSQ Mh8SlZia2aqk6RaHrRlHkF0bxe/CZYCnDnYwuHlTGUu OdTPYeL87iy8VAQao4sulb0Z4uAojiqYgCw6ZsW3iPKx MvtlKrSkpq+8Clvk1NCplkWj10tWuBNMxgQcazTj+vW +yAuS2Qk1zp/gOYS670/AtpS+S3ycRf700IOVZnmlWD jK12Vt2l8Vs/UooDlvKXBzUoOmrNZeSBguyzIsjn1UTr9 K7ghpdtMBE71aQDM+oKvchesInn9jBU9j4DRhdZ3ZC BFjQheEZKReIUO8rzO/bYYWPcxWEBpVJlqinmkkk8ZV4 bPH5lVgMKFLY+mXygcT/maHNw8fp0ZJEqOjW4c=", "uuid": "118888de-0dbc-40bb-913e-b372ceb673d7", "availability_zone": "nova", "hostname": "custometadatakeys.novalocal", "launch_index": 0, "meta": {"partner": "thelastone", "role": "database", "script": "/scripts/database-v1-2014.sh"}, "public_keys": {"VLAN-120-thelastone-key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEApNVrYIHoaCcsUf sSFtArqQJFc3J7aoM0ubUu/j61xjtE9HyhM3aQi5twfNQy cDj0aBw1XF6PZu3yJ6/gPW+UX7YAl1LwgCH03uXSIrC FHxKO3JzGaYbgn5/xmEaRuSzl8qnR82tFntn3k3oBXzU laPspmZZPQ0eJjsp+dF9xZD2JfUgtYm8aN7HnTHg19n +1PF86twDXvRj46ExpwdTqvY0N+nnEaoW1YQOrdxn 2Bz2bt0enXsDaaq1aOmjzItfGBVRB2WJw8hJTz7hGfLp TOh+NYUQ6qv0WTHaw7sSnscP533aKDbUznlfr0ogUE AZ7WWbqPXujETV0+u7SaAMA1Q== Generated by Novan"}, "name": "custometadatakeys"}
- 22. The Nova Meta-data agent Registry of meta-data available to the instance Provide 'hooks' for puppet and bootstrap scripts
- 23. Creating your own, via libvirt โข create a qcow2 file โข install the desired OS in the qcow2 file โข tune the OS, install any add-ons โข make the cloud alterations โข install the cloud-init package โข run virt-sysprep โข upload the image to glance
- 24. Creating your own, via Oz Install operating systems. Customize operating systems. Generate metadata (ICICLE) about operating systems. https://github.com/clalancette/oz/wiki โข Create a Kickstart โข Create a OZ definition file (TDL) # oz-install -a Fedora20-ks.auto -d 4 f20.tdl
- 25. Installing via Oz (Kickstart) install text keyboard us lang en_US.UTF-8 network --device eth0 --bootproto dhcp rootpw fedora firewall --enabled ssh selinux --enforcing timezone --utc America/New_York bootloader --location=mbr --append="console=tty0 console=ttyS0,115200" zerombr clearpart --all --drives=vda autopart --type=btrfs reboot %packages @core %end
- 26. Installing via Oz (TDL) <template> <name>f20btrfs</name> <os> <name>Fedora</name> <version>20</version> <arch>x86_64</arch> <install type='url'> <url>http://dl.fedoraproject.org/pub/fedora/linux/releases/20/Fedora/x86_64/os/</url> </install> <rootpw>fedora</rootpw> </os> <description>Fedora 20</description> </template>
- 27. Setting up a image factoryline with Oz
- 28. What should be in the image โข Common collection of packages โข OS layout โข Filesystems โข Network โข Management tools