Assembling an Open Source Toolchain to Manage Public, Private and Hybrid Cloud Deployments
Download as PPTX, PDF0 likes715 views
This document discusses assembling an open source tool chain for hybrid cloud environments using tools like Packer, Vagrant, Ansible, and BoxCutter. It provides examples of using Packer to build machine images for multiple platforms from a single blueprint and using Vagrant and Ansible to provision virtual machines across different cloud providers in a standardized way. Overall, the document promotes the use of these open source automation tools to help manage infrastructure across hybrid cloud environments.
![…
{
"type"
"api_key"
"client_id"
"image_id"
: "digitalocean",
: "{{user `do_api_key`}}",
: "{{user `do_client_id`}}",
: "562354",
"snapshot_name" : "centos-baseline {{timestamp}}"
}
]
…
}](https://image.slidesharecdn.com/posscon-opensourcecloudtoolchain-150501100746-conversion-gate01/85/Assembling-an-Open-Source-Toolchain-to-Manage-Public-Private-and-Hybrid-Cloud-Deployments-22-320.jpg)
![Vagrant.configure(VAGRANTFILE_API_VERSION) do |config|
boxes.each do |box|
config.vm.define box[:name], primary: box[:primary] do |config|
config.vm.box = "aws-centos"
config.vm.box_url =
https://github.com/mitchellh/vagrant-aws/raw/master/dummy.box
…
config.vm.provision :shell, :privileged => false, :inline => "sudo
yum -y install screen"
config.vm.provision :ansible do |ansible|
ansible.sudo
ansible.playbook
lamp.yml"
ansible.verbose
end
…
= true
= "provisioning/ansible/playbook-
= true](https://image.slidesharecdn.com/posscon-opensourcecloudtoolchain-150501100746-conversion-gate01/85/Assembling-an-Open-Source-Toolchain-to-Manage-Public-Private-and-Hybrid-Cloud-Deployments-40-320.jpg)
Assembling an Open Source Toolchain to Manage Public, Private and Hybrid Cloud Deployments
- 1. Assembling an Open Source Tool Chain for the Hybrid Cloud Isaac Christoffersen Bit Herder & Cloud Wrangler @ichristo
- 2. Bit Herder, Cloud Wrangler ● Geek, Insomniac, Tinkerer ● Wearer of Many Hats ● Delivering Open Source Solutions for 10+ years ● Solution Architect at Vizuri
- 3. Why the Hybrid Cloud?
- 4. Our App is going to change the world as we know it! “The best way to predict the future is to invent it” -- Ed Catmull
- 5. Unleash the System Administrators! source - http://commons.wikimedia.org/wiki/
- 6. Word of Mouth Spreads. Popularity Rises.
- 7. source - http://commons.wikimedia.org/wiki/File:Ford_assembly_line_-_1913.jpg More Sys Admins and a Little Automation
- 8. SlashDot / Oprah / Twitter Effect ...
- 9. We Need More DevOps!
- 10. Your App Has Gone Global!
- 11. All Hail the Fail Whale! source - http://www.whatisfailwhale.info/
- 12. But We Had DevOps?!
- 13. source - http://upload.wikimedia.org/wikipedia/commons/e/e0/Nagasakibomb.jpg Cloud Bursting?
- 14. Assembling the Hybrid Cloud Tool Chain
- 16. Automatically create machine images for multiple platforms from a single blueprint
- 17. AWS: AMI VMware: VMX + disks VirtualBox: OVF + disks DigitalOcean: Snapshots and many more … http://www.packer.io/docs/templates/builders.html
- 18. BoxCutter (github.com/boxcutter) • Build VirtualBox, VMWare, and Parallels Images • Choose your desired CM tool (Puppet, Chef, Ansible) Bento (https://github.com/chef/bento) • Used by Chef Release Team for Testing • Chef specific Configuration Managment
- 19. Automation No human interaction. Great for Continuous Integration / Deployment Standardization Use Puppet, Chef, Ansible, Bash to configure the image Repeatability Template goes into version control Image creation knowledge is now in code Anyone can build / rebuild the base images
- 20. EXAMPLE CentOS Image in both AWS & Digital Ocean
- 21. { "builders": [ { "type" "access_key" "secret_key" "region" "source_ami" "security_group_id" "instance_type" "ssh_username" "ssh_timeout" "ami_name" }, … : "amazon-ebs", : "{{user `aws_access_key`}}", : "{{user `aws_secret_key`}}", : "us-east-1", : "ami-8997afe0", : "sg-8f7e24e4", : "t1.micro", : "ec2-user", : "5m", : "centos-baseline {{timestamp}}"
- 22. … { "type" "api_key" "client_id" "image_id" : "digitalocean", : "{{user `do_api_key`}}", : "{{user `do_client_id`}}", : "562354", "snapshot_name" : "centos-baseline {{timestamp}}" } ] … }
- 23. $ packer validate base-image.json Template validated successfully. $ packer build base-image.json amazon-ebs output will be in this color. digitalocean output will be in this color. … ==> amazon-ebs: Deleting temporary keypair... Build 'amazon-ebs' finished. ==> digitalocean: Destroying droplet... ==> digitalocean: Deleting temporary ssh key... Build 'digitalocean' finished. ==> Builds finished. The artifacts of successful builds are: --> digitalocean: A snapshot was created: 'centos-baseline 1396457723' in region 'New York 1'
- 24. EXAMPLE BoxCutter Provisioning of Centos to VMWare
- 25. Isaacs-MBP-2:centos-vm isaac$ make list Prepend 'vmware/', 'virtualbox/', or 'parallels/' to build only one target platform: make vmware/centos66 Targets: … centos66-desktop centos66-docker centos66-i386 centos66 centos70-desktop centos70-docker centos70 Isaacs-MBP-2:centos-vm isaac$
- 26. isaac$ make vmware/centos70-docker rm -rf output-vmware-iso mkdir -p box/vmware packer build -only=vmware-iso -var 'cm=nocm’ -var 'headless=' -var 'update=' -var 'version=1.0.10' -var 'ssh_username=vagrant' -var 'ssh_password=vagrant' - var 'install_vagrant_key=true' -var "iso_url=http://mirrors.sonic.net/centos/7/isos/x86_64/Ce ntOS-7-x86_64-DVD-1503-01.iso" centos70-docker.json vmware-iso output will be in this color. …
- 27. … ==> vmware-iso: Downloading or copying ISO vmware-iso: Downloading or copying: http://mirrors.sonic.net/centos/7/isos/x86_64/CentOS-7- x86_64-DVD-1503-01.iso ==> vmware-iso: Creating floppy disk... vmware-iso: Copying: floppy/vmware9.compat_dcache.h.patch ==> vmware-iso: Creating virtual machine disk ==> vmware-iso: Building and writing VMX file ==> vmware-iso: Starting HTTP server on port 8597 ==> vmware-iso: Starting virtual machine... ==> vmware-iso: Waiting 10s for boot... ==> vmware-iso: Connecting to VM via VNC ==> vmware-iso: Typing the boot command over VNC... ==> vmware-iso: Waiting for SSH to become available.. …
- 28. +
- 29. Mature, stable, proven. Development since Jan 2010. Used by thousands of companies.
- 30. Deploy to Multiple Providers vagrant up --provider=foo AWS, DigitalOcean, HP Cloud, Joyent, KVM, libvirt, lxc, OpenStack, Rackspace, Vmware, VirtualBox
- 31. Leverage your own Packer Images • Base image as starting point. • Integrates with multiple “provisioners” including Puppet, Chef, Ansible, Bash
- 32. Automation No human interaction. Great for Continuous Integration / Deployment Standardization Use Puppet, Chef, Ansible, Bash to configure the image Repeatability Template goes into version control Image creation knowledge is now in code Anyone can build / rebuild the base images
- 33. Vagrant.configure("2") do |config| config.vm.box = "dummy" config.vm.box_url = "https://github.com/mitchellh/ vagrant-aws/raw/master/dummy.box" config.vm.provider :aws do |aws, override| aws.access_key_id = "YOUR KEY" aws.secret_access_key = "YOUR SECRET KEY" aws.keypair_name = "KEYPAIR NAME” aws.ami = ”ami-9baa9cf2” override.ssh.username = “ec2-user” override.ssh.forward_agent = true override.ssh.private_key_path = “YOUR PRIVATE KEY” end
- 34. EXAMPLE Multiple CentOS Images created in AWS from base AMI
- 35. $ vagrant up --provider=aws Use `vagrant plugin` commands to manage plugins. This warning will be removed in the next version of Vagrant. Bringing machine 'test-broker' up with 'aws' provider... Bringing machine 'test-node-01' up with 'aws' provider... Bringing machine 'test-node-02' up with 'aws' provider…
- 37. • Configuration Management tool like Puppet, Chef, CFEngine • Quick to get started • Builds on familiar tools • Run commands over SSH. No additional agents required
- 38. … config.vm.provision :ansible do |ansible| ansible.sudo = true ansible.playbook = "provisioning/ansible/playbook.yml” ansible.verbose = true end - hosts: all tasks: - name: ensure ntpd is at the latest version yum: pkg=ntp state=latest notify: - restart ntpd handlers: - name: restart ntpd service: name=ntpd state=restarted
- 39. EXAMPLE Provision a CentOS LAMP Stack in AWS
- 40. Vagrant.configure(VAGRANTFILE_API_VERSION) do |config| boxes.each do |box| config.vm.define box[:name], primary: box[:primary] do |config| config.vm.box = "aws-centos" config.vm.box_url = https://github.com/mitchellh/vagrant-aws/raw/master/dummy.box … config.vm.provision :shell, :privileged => false, :inline => "sudo yum -y install screen" config.vm.provision :ansible do |ansible| ansible.sudo ansible.playbook lamp.yml" ansible.verbose end … = true = "provisioning/ansible/playbook- = true
- 41. - name : Install LAMP Stack user: ec2-user hosts: all tasks: -name: Install mysql yum: name=mysql-server state=latest -name: install httpd yum: name=httpd - name: Install php for mysql yum: name=$item with_items: - php - php-mysql - mysql-server
- 42. Only Scratching the Surface
- 43. So many categories, so little time … ●Cloud Management (Scalr, ManageIQ) ●Log Aggregation (ELK) ●Monitoring Tools (nagios, zenoss) ●Version Control (Git, Subversion) ●CI Servers (Jenkins, TravisCI) ●… and many more
- 44. OSS DevOps Tools Ecosystem Check Out - http://www.devopsbookmarks.com/
- 45. Thank You Isaac Christoffersen www.vizuri.com ichristoffersen@vizuri.com @ichristo vagrantup.com packer.io ansible.com