Config managament for development environments iii

Conﬁguration Management
for Development Environments

PuppetConf 22nd September 2011

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/36144637@N00/159627088/

Gareth Rushgrove

gareth rushgrove | morethanseven.net

Work at UK Government Digital Service


Blog at morethanseven.net


Curate devopsweekly.com


Problems

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/iancarroll/5027441664

1. Not all developers want to be sysadmins

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/34652102@N04/5059217055

1. Sysadmins don’t want devs to be sysadmins


2. New team members getting started time


3. Running a full set of services locally

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/biggreymare

4. Works on my machine


⚡ brew info mysql
mysql 5.5.14

$ aptitude show mysql-server
Package: mysql-server
State: not installed
Version: 5.1.41-3ubuntu12.10

Homebrew is great but...


23 releases and 21 months in-between 5.1.41 and 5.5.14. Here’s
some ﬁxed bugs:

- An ORDER BY clause was bound to the incorrect substatement
when used in UNION context.
- A NOT IN predicate with a subquery containing a HAVING clause
could retrieve too many rows, when the subquery itself returned
NULL.
- MIN(year_col) could return an incorrect result in some cases.

And lots more

What’s a few versions between friends?


Spot the cross platform bug (not the security ﬂaw)


⚡ ./server.rb &
⚡ curl "http://127.0.0.1:8181/?query=Bob"
⚡ curl "http://127.0.0.1:8181/?query=bob"
⚡ ls

On our Mac


⚡ ./server.rb &
⚡ curl "http://127.0.0.1:8181/?query=Bob"
⚡ curl "http://127.0.0.1:8181/?query=bob"
⚡ ls
Bob
⚡ cat Bob
Hello bob

On our Mac


$ ./server.rb &
$ curl "http://127.0.0.1:8181/?query=Bob"
$ curl "http://127.0.0.1:8181/?query=bob"
$ ls

On Linux


$ ./server.rb &
$ curl "http://127.0.0.1:8181/?query=Bob"
$ curl "http://127.0.0.1:8181/?query=bob"
$ ls
Bob bob
$ cat Bob
Hello Bob
$ cat bob
Hello bob

On Linux


Solutions


Virtualisation

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/dawilson/2598713027

VirtualBox


VMware


Virtualisation needs powerful hardware

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/martinoc/477335951

What about editing code?

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/peteradams/2272928740

Shared Folders or NFS


Vim


Vagrantup.com


- Automated virtual machine creation using Oracle’s VirtualBox
- Automated provisioning of virtual environments using Chef or Puppet
- Full SSH access to created environments
- Assign a static IP to your VM, accessible from your machine
- Forward ports to the host machine
- Shared folders allows you to continue using your own editor
- Package environments into distributable boxes
- Completely tear down environment when you’re done
- Easily rebuild a complete environment with a single command

What is Vagrant?


Base boxes

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/dawilson/2793319903

VeeWee


Community boxes


⚡ gem install vagrant
⚡ vagrant box add lucid32 http://.../lucid32.box
⚡ vagrant init
⚡ vagrant up

Vagrant up


⚡ ls
Vagrantfile
⚡ vagrant up
⚡ vagrant ssh
⚡ vagrant reload
⚡ vagrant halt
⚡ vagrant destroy

Vagrant command line


⚡ vagrant ssh-config
Host default
HostName 127.0.0.1
User vagrant
Port 2222
IdentityFile /Users/.../vagrant-0.8.2/keys/vagrant
...

Export SSH conﬁguration


Vagrant::Config.run do |config|
config.vm.box = "lucid32"
end

Vagrantﬁle


config.vm.forward_port("web", 80, 8080)
config.vm.forward_port("ftp", 21, 4567)
config.vm.forward_port("ssh", 22, 2222, :auto => true)
end

Port forwarding


config.vm.share_folder("folder", "/guest", "../host")
end

Shared folders


config.vm.define :web do |web_config|
web_config.vm.box = "web"
web_config.vm.forward_port("http", 80, 8080)
end

config.vm.define :db do |db_config|
db_config.vm.box = "db"
db_config.vm.forward_port("db", 3306, 3306)
end
end

Multiple VMs in one ﬁle


config.vm.boot_mode = :gui
config.ssh.forward_agent = true
config.vm.network("33.33.33.10")
config.vm.customize do |vm|
vm.memory_size = 512
end
end

Lots more options


Puppet


config.vm.provision :puppet do |puppet|
puppet.manifests_path = "puppetmanifests"
puppet.manifest_file = "newbox.pp"
end
end

Vagrant provisioning with Puppet


config.vm.provision :puppet_server do |puppet|
puppet.puppet_server = "puppet.example.com"
puppet.puppet_node = "vm.example.com"
end
end

Vagrant provisioning with Puppetmaster


Chef


config.vm.provision :chef_solo do |chef|
chef.add_recipe = "garethr"
chef.cookbooks_path = “cookbooks”
end
end

Vagrant provisioning with Chef


chef.roles_path = "roles"
chef.add_role("vm")
end
end

Specifying Chef roles


chef.recipe_url = "http://github.com/cookbooks.tar.gz"
chef.add_recipe "garethr"
chef.cookbooks_path = [:vm, "cookbooks"]
chef.json.merge!({ :garethr => {
:ohmyzsh => "https://github.com/.../oh-my-zsh.git",
:dotvim => "https://github.com/garethr/dotvim.git"
}})
end
end

Remote ﬁle


- Vagrant Hosts - https://github.com/dwt/vagrant-hosts
- Sahara - https://github.com/jedi4ever/sahara
- Vagrantboxes - https://github.com/garethr/ruby-vagrantboxes

Plugins

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/s3a/4710416678

⚡ vagrant provision
[default] Running provisioner:
Vagrant::Provisioners::Puppet...
[default] Running Puppet with base.pp...
[default] notice: /Stage[main]//File[/etc/motd]/
content: content changed '{md5}
a10cc0046a5fad11470513e5f5df9d91' to '{md5}
9e5e449fc643d3e88a2cefeb1af7bc2e'
[default]
[default] notice: /Stage[main]//File[/etc/motd]/
mode: mode changed '777' to '644'

Useful for testing puppet modules


Useful for local conﬁguration management

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/crustyscumbrothersontour/2674351601

- I want my development environment on my local vms
- I don’t want a wiki page of instructions
- I don’t want to have to manually install anything
- I don’t want to care about destroying a virtual machine

Real world example


⚡ tree
├── Vagrantfile
└── modules
└── garethr
├── manifests
│   └── init.pp
├── spec
│   └── classes
│   └── base.rv
│   └── janus.rv
│   └── ohmyzsh.rv
└────── spec_helper.rb

Puppet layout


class base {
$packages = ["zsh", "wget", "curl", "lynx",
"git-core", "dvtm", “tree”,
"build-essential", "vim-nox"]
package { $packages: ensure => "installed" }
}

Packages I like


$repo = "git://github.com/robbyrussell/oh-my-zsh.git"
exec { "ohmyzsh":
command => "git clone ${repo} .oh-my-zsh",
cwd => "/home/vagrant",
creates => "/home/vagrant/.oh-my-zsh",
require => Class["base"],
}
exec { "zshrc":
command => "cp .... /home/vagrant/.zshrc",
creates => "/home/vagrant/.zshrc",
require => Exec["ohmyzsh"],
}

My Zsh conﬁgs


$repo = "git://github.com/carlhuda/janus.git"
exec { "get_janus":
command => "git clone ${repo} .vim",
cwd => "/home/vagrant",
creates => "/home/vagrant/.vim",
require => Class["base"],
}
exec { "compile_janus":
command => "rake",
creates => "/home/vagrant/.zshrc",
require => Exec["ohmyzsh"],
environment => "HOME=/home/vagrant",
}

My Vim conﬁgs


require 'spec_helper'

describe 'ohmyzsh', :type => :class do
it { should create_exec("ohmyzsh") }
it { should create_exec("zshrc") }
it { should create_class("base") }
end

Testing with Rspec


base
should create Package[zsh]
should create Package[vim-nox]
should create Package[git-core]

ohmyzsh
should create Exec[ohmyzsh]
should create Exec[zshrc]
should create Class[base]

Finished in 1.4 seconds
10 examples, 0 failures

Rspec results


- Using Virtualisation makes getting started fast
- Running the same platform catches bugs early
- Using Vagrant makes managing virtual machines easy
- Writing conﬁguration as code makes it testable

Conclusions


- IRC - #vagrant on Freenode
- Github Issues - https://github.com/mitchellh/vagrant/issues
- Google Groups - http://groups.google.com/group/vagrant-up

More information on Vagrant


Questions?

gareth rushgrove | morethanseven.net http://ﬂickr.com/photos/psd/102332391/

Config managament for development environments iii

More Related Content

What's hot (20)

Viewers also liked (9)

Similar to Config managament for development environments iii (20)

More from Puppet (20)

Recently uploaded (20)

Config managament for development environments iii