From Dev to DevOps - Apache Barcamp Spain 2011
3 likes4,604 views
The document discusses the transition from traditional development to DevOps practices, emphasizing agile methodologies and continuous integration for successful software delivery. It highlights the importance of collaboration, infrastructure as code, and tools like Puppet for automating deployment processes. Additionally, it outlines best practices and the significance of agile principles in managing development and operational challenges.
![Puppet resources
$ puppet resource user dave
ensure=present shell="/bin/zsh" home="/
home/dave" managehome=true
notice: /User[dave]/ensure: created
user { 'dave':
ensure => 'present',
home => '/home/dave',
shell => '/bin/zsh'
}](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-73-320.jpg)
![ordering
file {'/tmp/test1':
ensure => present,
content => "Hi.",
}
notify {'/tmp/test1 has already
been synced.':
require => File['/tmp/test1'],
}](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-79-320.jpg)
![package / file /service / subscribe
package { 'openssh-server':
ensure => present,
before => File['/etc/ssh/sshd_config'],
}
file { '/etc/ssh/sshd_config':
ensure => file,
mode => 600,
source => '/root/learning-manifests/sshd_config',
}
service { 'sshd':
ensure => running,
enable => true,
hasrestart => true,
hasstatus => true,
subscribe => File['/etc/ssh/sshd_config'],
}](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-83-320.jpg)
![facts
host {'self':
ensure => present,
name => $::fqdn,
host_aliases => ['puppet', $::hostname],
ip => $::ipaddress,
}
file {'motd':
ensure => file,
path => '/etc/motd',
mode => 0644,
content => "Welcome to ${::hostname},na $
{::operatingsystem} island in the sea of ${::domain}.
n",
}](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-87-320.jpg)
![conditionals
if $is_virtual {
service {'ntpd':
ensure => stopped,
enable => false,
}
}
else {
service { 'ntpd':
name => 'ntpd',
ensure => running,
enable => true,
hasrestart => true,
require => Package['ntp'],
}
}](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-89-320.jpg)
![class definition
class ntp {
package { 'ntp':
ensure => installed,
}
service { 'ntp':
name => 'ntpd',
ensure => running,
enable => true,
subscribe => File['ntp.conf'],
}
}](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-93-320.jpg)
![templating
file {'/etc/foo.conf':
ensure => file,
require => Package['foo'],
content => template('foo/foo.conf.erb'),
}](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-103-320.jpg)
![Vagrant
Vagrant::Config.run do |config|
# Every Vagrant virtual environment requires a box to build off of.
config.vm.box = "centos-6.0-x86_64"
# The url from where the 'config.vm.box' box will be fetched
config.vm.box_url = "http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box"
# Boot with a GUI so you can see the screen. (Default is headless)
#config.vm.boot_mode = :gui
# Assign this VM to a host only network IP, allowing you to access it via the IP.
# config.vm.network "33.33.33.10"
# Forward a port from the guest to the host, which allows for outside
# computers to access the VM, whereas host only networking does not.
config.vm.forward_port "sonar", 9000, 19000
# Enable provisioning with Puppet stand alone.
config.vm.share_folder("templates", "/tmp/vagrant-puppet/templates", "templates")
config.vm.provision :puppet do |puppet|
puppet.manifest_file = "base.pp"
puppet.module_path = "mymodules"
puppet.options = ["--templatedir","/tmp/vagrant-puppet/templates"]
puppet.options = "-v -d"
end
end](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-116-320.jpg)
![New Maven type
maven { "/tmp/maven-core-2.2.1.jar":
id => "org.apache.maven:maven-core:jar:2.2.1",
repos => ["http://repo1.maven.apache.org/maven2",
"http://mirrors.ibiblio.org/pub/mirrors/maven2"],
}](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-127-320.jpg)
![New Maven type
maven { "/tmp/maven-core-2.2.1.jar":
groupId => "org.apache.maven",
artifactId => "maven-core",
version => "2.2.1",
packaging => "jar",
repos => ["http://repo1.maven.apache.org/maven2",
"http://mirrors.ibiblio.org/pub/mirrors/maven2"],
}](https://image.slidesharecdn.com/2011-10fromdevtodevops-apachebarcampspain-111014064252-phpapp02/85/From-Dev-to-DevOps-Apache-Barcamp-Spain-2011-129-320.jpg)
From Dev to DevOps - Apache Barcamp Spain 2011
- 1. From Dev to DevOps Carlos Sanchez MaestroDev
- 2. Hola! Solutions Architect at MaestroDev Member of Apache Software Foundation Maven PMC, Continuum, Archiva Eclipse IAM co-lead etc...
- 3. Dev... What?
- 4. Agile
- 5. Agile planning iterative development continuous integration release soon, release often
- 10. DevQaOps ?
- 13. DevOps addresses
- 14. DevOps addresses Fear of change Risky deployments It works on my machine! Siloisation Dev Change vs. Ops stability
- 15. Agile Manifesto
- 16. Agile Manifesto Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan
- 17. Agile Manifesto
- 18. Agile Manifesto Our highest priority is to satisfy the customer through early and continuous delivery of valuable software.
- 19. Agile Manifesto
- 20. Agile Manifesto Welcome changing requirements, even late in development. Agile processes harness change for the customer's competitive advantage.
- 21. Agile Manifesto
- 22. Agile Manifesto Deliver working software frequently, from a couple of weeks to a couple of months, with a preference to the shorter timescale.
- 23. Agile Manifesto
- 24. Agile Manifesto Business people and developers must work together daily throughout the project.
- 25. Agile Manifesto
- 26. Agile Manifesto Build projects around motivated individuals. Give them the environment and support they need, and trust them to get the job done.
- 27. Agile Manifesto
- 28. Agile Manifesto The most efficient and effective method of conveying information to and within a development team is face- to-face conversation.
- 29. Agile Manifesto
- 30. Agile Manifesto Working software is the primary measure of progress.
- 31. Agile Manifesto
- 32. Agile Manifesto Agile processes promote sustainable development. The sponsors, developers, and users should be able to maintain a constant pace indefinitely.
- 33. Agile Manifesto
- 34. Agile Manifesto Continuous attention to technical excellence and good design enhances agility.
- 35. Agile Manifesto
- 36. Agile Manifesto Simplicity--the art of maximizing the amount of work not done--is essential.
- 37. Agile Manifesto
- 38. Agile Manifesto The best architectures, requirements, and designs emerge from self-organizing teams.
- 39. Agile Manifesto
- 40. Agile Manifesto At regular intervals, the team reflects on how to become more effective, then tunes and adjusts its behavior accordingly.
- 41. DevOps tools everyone thinks is intelligent enough every tool thinks it’s cloud enabled every tool thinks it’s DevOps
- 42. DevOps tools everyone thinks is intelligent enough every tool thinks it’s cloud enabled every tool thinks it’s DevOps
- 43. DevOps tools: infrastructure automation
- 44. DevOps tools: infrastructure automation infrastructure as code it’s all invented, now it’s standardized
- 45. Dev
- 53. Ops
- 54. requirements
- 55. requirements Operating System config files packages installed multi stage configurations dev QA pre-production production
- 56. Deployment How do I deploy this? documentation manual steps prone to errors
- 57. Cloud How do I deploy this? to hundreds of servers
- 59. Infrastructure as Code Follow development best practices tagging branching releasing dev, QA, production
- 60. Nice, but how can I do IT
- 61. Nice, but how can I do IT
- 62. DevOps
- 64. Puppet
- 65. Puppet infrastructure IS code declarative model state vs process - no scripting manifests ruby ERB templates master - agent architecture
- 67. Puppet file structure /etc/puppet manifests/site.pp manifests/nodes.pp
- 68. Puppet resources
- 69. Puppet resources user { 'dave': ensure => present, uid => '507', gid => 'admin', shell => '/bin/zsh', home => '/home/dave', managehome => true, }
- 70. Puppet resources
- 71. Puppet resources $ puppet resource user root user { 'root': home => '/var/root', shell => '/bin/sh', uid => '0', ensure => 'present', password => '*', gid => '0', comment => 'System Administrator' }
- 72. Puppet resources
- 73. Puppet resources $ puppet resource user dave ensure=present shell="/bin/zsh" home="/ home/dave" managehome=true notice: /User[dave]/ensure: created user { 'dave': ensure => 'present', home => '/home/dave', shell => '/bin/zsh' }
- 74. Puppet resources
- 75. Puppet resources file {'testfile': path => '/tmp/testfile', ensure => present, mode => 0640, content => "I'm a test file.", } notify {"I'm notifying you.":}
- 77. Puppet standalone $ puppet apply my_test_manifest.pp
- 78. ordering
- 79. ordering file {'/tmp/test1': ensure => present, content => "Hi.", } notify {'/tmp/test1 has already been synced.': require => File['/tmp/test1'], }
- 80. ordering
- 81. ordering file {'/tmp/test1': ensure => present, content => "Hi.", } -> notify {'/tmp/test1 has already been synced.':}
- 82. package / file /service / subscribe
- 83. package / file /service / subscribe package { 'openssh-server': ensure => present, before => File['/etc/ssh/sshd_config'], } file { '/etc/ssh/sshd_config': ensure => file, mode => 600, source => '/root/learning-manifests/sshd_config', } service { 'sshd': ensure => running, enable => true, hasrestart => true, hasstatus => true, subscribe => File['/etc/ssh/sshd_config'], }
- 84. variables
- 85. variables $longthing = "Imagine I have something really long in here. Like an SSH key, let's say." file {'authorized_keys': path => '/root/.ssh/authorized_keys', content => $longthing, }
- 86. facts
- 87. facts host {'self': ensure => present, name => $::fqdn, host_aliases => ['puppet', $::hostname], ip => $::ipaddress, } file {'motd': ensure => file, path => '/etc/motd', mode => 0644, content => "Welcome to ${::hostname},na $ {::operatingsystem} island in the sea of ${::domain}. n", }
- 88. conditionals
- 89. conditionals if $is_virtual { service {'ntpd': ensure => stopped, enable => false, } } else { service { 'ntpd': name => 'ntpd', ensure => running, enable => true, hasrestart => true, require => Package['ntp'], } }
- 90. conditionals
- 91. conditionals case $operatingsystem { centos, redhat: { $apache = "httpd" } debian, ubuntu: { $apache = "apache2" } default: { fail("Unrecognized operating system for webserver") } } $apache = $operatingsystem ? { centos => 'httpd', redhat => 'httpd', /(?i)(ubuntu|debian)/ => "apache2-$1", # (Don't actually use that package name.) default => undef, }
- 92. class definition
- 93. class definition class ntp { package { 'ntp': ensure => installed, } service { 'ntp': name => 'ntpd', ensure => running, enable => true, subscribe => File['ntp.conf'], } }
- 95. class declaration (1) class {'ntp': }
- 97. class declaration (2) include ntp
- 99. parameterized classes class paramclassexample ($value1, $value2 = "Default value") { notify {"Value 1 is ${value1}.":} notify {"Value 2 is ${value2}.":} } class {'paramclassexample': value1 => 'Something', value2 => 'Something else', } class {'paramclassexample': value1 => 'Something', }
- 100. modules
- 101. modules {module}/ files/ lib/ manifests/ init.pp {class}.pp {defined type}.pp {namespace}/ {class}.pp {class}.pp templates/ tests/
- 102. templating
- 103. templating file {'/etc/foo.conf': ensure => file, require => Package['foo'], content => template('foo/foo.conf.erb'), }
- 105. templates/foo.conf.erb OS is <%= $::operatingsystem %>
- 106. node configuration
- 107. node configuration # nodes.pp node 'someserver.domain.com' inherits basenode { $web_fqdn = 'www.domain.com' include genericwebserver include some_other_service } node 'ldapmaster.domain.com' inherits basenode { include s_ldap::master } node 'humanresources.domain.com' inherits basenode { include c_humanresources }
- 108. Vagrant
- 109. Vagrant
- 110. Vagrant Oracle VirtualBox cmdline automation Easy Puppet and Chef provisioning Keep VM configuration for different projects Share boxes and configuration files across teams base box + configuration files
- 111. Vagrant base boxes
- 112. Vagrant base boxes www.vagrantbox.es anywhere! just (big) files VeeWee tool to automate installations https://github.com/jedi4ever/veewee
- 113. using Vagrant
- 114. using Vagrant $ gem install vagrant $ vagrant box add centos-6.0-x86_64 http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box $ vagrant init myproject $ vagrant up $ vagrant ssh $ vagrant suspend $ vagrant resume $ vagrant destroy
- 115. Vagrant
- 116. Vagrant Vagrant::Config.run do |config| # Every Vagrant virtual environment requires a box to build off of. config.vm.box = "centos-6.0-x86_64" # The url from where the 'config.vm.box' box will be fetched config.vm.box_url = "http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box" # Boot with a GUI so you can see the screen. (Default is headless) #config.vm.boot_mode = :gui # Assign this VM to a host only network IP, allowing you to access it via the IP. # config.vm.network "33.33.33.10" # Forward a port from the guest to the host, which allows for outside # computers to access the VM, whereas host only networking does not. config.vm.forward_port "sonar", 9000, 19000 # Enable provisioning with Puppet stand alone. config.vm.share_folder("templates", "/tmp/vagrant-puppet/templates", "templates") config.vm.provision :puppet do |puppet| puppet.manifest_file = "base.pp" puppet.module_path = "mymodules" puppet.options = ["--templatedir","/tmp/vagrant-puppet/templates"] puppet.options = "-v -d" end end
- 117. manifests/base.pp
- 118. manifests/base.pp package { jdk: ensure => installed, name => $operatingsystem ? { centOS => "java-1.6.0-openjdk-devel", Ubuntu => "openjdk-6-jdk", default => "jdk", }, }
- 119. Maven and Puppet
- 120. What can I do to automate deployment
- 121. What can I do to automate deployment Handle full deployment including infrastructure not just webapp deployment Help Ops with clear, automated manifests Ability to reproduce production environments in local box using Vagrant / VirtualBox / VMWare
- 122. Maven-Puppet module
- 123. Maven-Puppet module A Maven Puppet module https://github.com/maestrodev/puppet-maven fetches Maven artifacts from the repo manages them with Puppet no more extra packaging
- 124. Requirements
- 125. Requirements Java JDK Apache Buildr preinstalled in the box chicken and egg problem
- 126. New Maven type
- 127. New Maven type maven { "/tmp/maven-core-2.2.1.jar": id => "org.apache.maven:maven-core:jar:2.2.1", repos => ["http://repo1.maven.apache.org/maven2", "http://mirrors.ibiblio.org/pub/mirrors/maven2"], }
- 128. New Maven type
- 129. New Maven type maven { "/tmp/maven-core-2.2.1.jar": groupId => "org.apache.maven", artifactId => "maven-core", version => "2.2.1", packaging => "jar", repos => ["http://repo1.maven.apache.org/maven2", "http://mirrors.ibiblio.org/pub/mirrors/maven2"], }
- 130. Example code
- 131. Example code Available at http://github.carlossanchez.eu http://blog.carlossanchez.eu https://github.com/maestrodev/puppet-modules
- 132. Questions?
- 134. Photo Credits
- 135. Photo Credits Son of Man Lego - Alex Eylar http://www.flickr.com/photos/hoyvinmayvin/4702772452/ Brick wall - Luis Argerich http://www.flickr.com/photos/lrargerich/4353397797/ Agile vs. Iterative flow - Christopher Little http://en.wikipedia.org/wiki/File:Agile-vs-iterative-flow.jpg DevOps - Rajiv.Pant http://en.wikipedia.org/wiki/File:Devops.png
Editor's Notes
- #2: \n
- #3: \n
- #4: \n
- #5: \n
- #6: \n
- #7: \n
- #8: \n
- #9: \n
- #10: \n
- #11: \n
- #12: \n
- #13: \n
- #14: \n
- #15: \n
- #16: \n
- #17: \n
- #18: \n
- #19: \n
- #20: \n
- #21: \n
- #22: \n
- #23: \n
- #24: \n
- #25: \n
- #26: \n
- #27: \n
- #28: \n
- #29: \n
- #30: \n
- #31: \n
- #32: \n
- #33: \n
- #34: \n
- #35: \n
- #36: \n
- #37: \n
- #38: \n
- #39: \n
- #40: \n
- #41: \n
- #42: \n
- #43: \n
- #44: \n
- #45: \n
- #46: \n
- #47: \n
- #48: \n
- #49: \n
- #50: \n
- #51: \n
- #52: \n
- #53: \n
- #54: \n
- #55: \n
- #56: \n
- #57: \n
- #58: \n
- #59: \n
- #60: \n
- #61: \n
- #62: \n
- #63: \n
- #64: \n
- #65: \n
- #66: \n
- #67: \n
- #68: \n
- #69: \n
- #70: \n
- #71: \n
- #72: \n
- #73: \n
- #74: \n
- #75: \n
- #76: \n
- #77: \n
- #78: \n
- #79: \n
- #80: \n
- #81: \n
- #82: \n
- #83: \n
- #84: \n
- #85: \n
- #86: \n
- #87: \n
- #88: \n
- #89: \n
- #90: \n
- #91: \n
- #92: \n
- #93: \n
- #94: \n
- #95: \n
- #96: \n
- #97: \n
- #98: \n
- #99: \n
- #100: \n
- #101: \n
- #102: \n
- #103: \n
- #104: \n
- #105: \n
- #106: \n
- #107: \n
- #108: \n
- #109: \n
- #110: \n
- #111: \n
- #112: \n
- #113: \n
- #114: \n
- #115: \n
- #116: \n
- #117: \n
- #118: \n
- #119: \n
- #120: \n
- #121: \n
- #122: \n
- #123: \n
- #124: \n
- #125: \n
- #126: \n
- #127: \n
- #128: \n
- #129: \n
- #130: \n
- #131: \n
- #132: \n
- #133: \n
- #134: \n
- #135: \n
- #136: \n
- #137: \n
- #138: \n
- #139: \n
- #140: \n
- #141: \n
- #142: \n
- #143: \n
- #144: \n
- #145: \n
- #146: \n
- #147: \n
- #148: \n
- #149: \n
- #150: \n
- #151: \n
- #152: \n
- #153: \n