Puppet Camp Paris 2015: Power of Puppet 4 (Beginner)
3 likes1,382 views
Puppet 4 introduces several new features and changes including improved performance, scalability, measurability and flexibility. It features a new Puppet Server based on Clojure and Trapperkeeper, packaging changes, improved environment handling, r10k for managing environments from git, new language features like lambdas and EPP templates, improved data binding and overriding, stronger typing support, and various deprecations around node inheritance, hyphens in names, and other changes. Upgrading requires testing modules against the new version and addressing any compatibility issues.
![Config environments
Static puppet.conf
[production]
modulepath = /etc/puppet/production/modules
manifests = /etc/puppet/production/manifests/site.pp
!
[test]
modulepath = /etc/puppet/test/modules
manifests = /etc/puppet/test/manifests/site.pp](https://image.slidesharecdn.com/powerofpuppet4puppetcampparis-150611184813-lva1-app6891/85/Puppet-Camp-Paris-2015-Power-of-Puppet-4-Beginner-8-320.jpg)
![Config environments
Dynamic puppet.conf
[master]
modulepath = /etc/puppet/$environment/modules
manifests = /etc/puppet/$environment/manifests/site.pp
!](https://image.slidesharecdn.com/powerofpuppet4puppetcampparis-150611184813-lva1-app6891/85/Puppet-Camp-Paris-2015-Power-of-Puppet-4-Beginner-9-320.jpg)
![Directory environments
puppet.conf
[master]
environmentpath = /etc/puppet/environments
!
File system
/etc/puppet/environments/
production/
modules/
manifests/
environment.conf
test/
modules/
manifests/
Directory](https://image.slidesharecdn.com/powerofpuppet4puppetcampparis-150611184813-lva1-app6891/85/Puppet-Camp-Paris-2015-Power-of-Puppet-4-Beginner-10-320.jpg)
![Lambdas
Lambda
“a block of code that has parameters and can be invoked/called with arguments. A
single lambda can be passed to a function”
$a = [1,2,3]
each($a) |value| {notice $value }](https://image.slidesharecdn.com/powerofpuppet4puppetcampparis-150611184813-lva1-app6891/85/Puppet-Camp-Paris-2015-Power-of-Puppet-4-Beginner-14-320.jpg)
![We need types!
class ssh (
Boolean $server = true,
) {
if $server {
include ssh::server
}
}
!
!
class { ‘ssh’:
server => ‘false’,
}
!
Error 400 on SERVER: Expected parameter 'server' of
'Class[Ssh]' to have type Boolean, got String
!
!
!
!
!
!
!
!
!
We now get proper error messages.](https://image.slidesharecdn.com/powerofpuppet4puppetcampparis-150611184813-lva1-app6891/85/Puppet-Camp-Paris-2015-Power-of-Puppet-4-Beginner-30-320.jpg)
![We want types!
class users (
Hash $hash
) {
$userarray = keys($hash)
users::user_data { $userarray: }
}
!
define users::user_data (
String $gid = $users::hash[$title][gid],
String $home = $users::hash[$title][home],
Boolean $managehome = $users::hash[$title][managehome],
) {
}](https://image.slidesharecdn.com/powerofpuppet4puppetcampparis-150611184813-lva1-app6891/85/Puppet-Camp-Paris-2015-Power-of-Puppet-4-Beginner-31-320.jpg)
![Available Types
Integer[from, to]
Float[from,to]
Enum[*strings]
Pattern[*patterns]
Regexp[regexp]
Boolean
Array
Hash](https://image.slidesharecdn.com/powerofpuppet4puppetcampparis-150611184813-lva1-app6891/85/Puppet-Camp-Paris-2015-Power-of-Puppet-4-Beginner-32-320.jpg)
![Reference naming
Reference deprecation
capital letter on title
empty space between Type reference and title
!
Class [Ssh]
!
Class [‘ssh’]
!
Class[‘ssh’]
!
Deprecated capital title
!
Empty space
!
Working](https://image.slidesharecdn.com/powerofpuppet4puppetcampparis-150611184813-lva1-app6891/85/Puppet-Camp-Paris-2015-Power-of-Puppet-4-Beginner-40-320.jpg)
Puppet Camp Paris 2015: Power of Puppet 4 (Beginner)
- 1. The Power of Puppet 4 Martin Alfke ma@example42.com Image: http://praetoris01.deviantart.com/
- 2. Martin Alfke PL Training Partner Module Contributor ! ex-System Engineer Infrastructure Architect
- 3. Welcome to Puppet 4 April 15th 2015 https://puppetlabs.com/ blog/say-hello-open- source-puppet-4 http:// docs.puppetlabs.com/ puppet/4.0/reference/ index.html
- 4. Puppet Server & Packages
- 5. Puppet Server on JVM Clojure Trapperkeeper JMX & internal metrics (PE only)
- 6. Puppet Packaging AIO - like PE New package name New repository layout No automatic update
- 7. Environments
- 8. Config environments Static puppet.conf [production] modulepath = /etc/puppet/production/modules manifests = /etc/puppet/production/manifests/site.pp ! [test] modulepath = /etc/puppet/test/modules manifests = /etc/puppet/test/manifests/site.pp
- 9. Config environments Dynamic puppet.conf [master] modulepath = /etc/puppet/$environment/modules manifests = /etc/puppet/$environment/manifests/site.pp !
- 10. Directory environments puppet.conf [master] environmentpath = /etc/puppet/environments ! File system /etc/puppet/environments/ production/ modules/ manifests/ environment.conf test/ modules/ manifests/ Directory
- 11. Benefits All environments in one place Per environment configuration (environment.conf) config_version = '/usr/bin/git --git-dir /etc/puppet/environments/ $environment/.git rev-parse HEAD' Newly added environments are available immediately
- 12. r10k Robot 10000 Manage environment in git branches Puppetfile handles modules and versions
- 14. Lambdas Lambda “a block of code that has parameters and can be invoked/called with arguments. A single lambda can be passed to a function” $a = [1,2,3] each($a) |value| {notice $value }
- 15. Lambdas and functions each - iterating over an array map - transform an array or hash into a new array filter - filters an array or hash reduce - reduces an array or hash to a single value slice - slices an array or hash into chunks
- 16. Using functions Standard Puppet way: function_name(argument) - each($variable) Ruby way - chaining argument.function_name - $variable.each
- 17. EPP Template engine Use Puppet $var instead of Ruby ERB @var epp(filename) inline_epp(epp_string)
- 18. HEREDOC support Like Shell HEREDOC $multiline_text = @(EOF) # Managed by Puppet intended two spaces starting at beginning of line | intention starts at pipe sign EOF
- 19. HEREDOC control character - prevents a new line (like erb/epp) @(“EOF”) - variable substition @(EOF/tn) - enables char escapes availabe char escapes: t,s,r,n,u,L,$ Default to off
- 20. Puppet 4.0 Data Bindings New “hierarchy”: global data (hiera) data in environment (environment.conf) data in modules
- 21. Puppet 4.0 Data in Env environment.conf environment_data_provider = function <env-root>/lib/puppet/functions/environment/data.rb Puppet::Function.create_function(:’environment::data’) do def data () { ‘<class>::key’ => ‘value’, } end end $variable = environment::data(‘key’) or automatic data bindings
- 22. Puppet 4.0 Data in Modules <moduleroot>/lib/puppet/bindings/mymodule/default.rb Puppet::Bindings.newbindings(‘mymodule::default’) do … end <moduleroot>/lib/puppet/functions/mymodule/data.rb Puppet::Functions.create_function(:’mymodule::data’) do def data() { ‘mymodule::<class>::key’ => ‘value’, } end end ! $var = mymodule::data(‘key’) or automatic data bindings
- 23. Puppet 4.0 Data Overriding <env-root>/lib/puppet/functions/environment/data.rb Puppet::Functions.create_function(:’environment::data’) do def data() { ‘<module>::<class>::key’ => ‘value’, } end end ! used with automatic data bindings
- 25. Why do we need types? class ssh ( $server = true, ) { if $server { include ssh::server } } Parameterized class with parameter default
- 26. Why do we need types? class ssh ( $server = true, ) { if $server { include ssh::server } } ! ! class { ‘ssh’: server => ‘false’, } ! ! ! ! ! ! ! ! ! Usage of parameterised class. But: string instead of boolean !
- 27. Why do we need types? class ssh ( $server = true, ) { if validate_bool($server) { include ssh::server } } ! ! class { ‘ssh’: server => ‘false’, } Parameterized class with parameter default ! ! Now with data validation (from stdlib)
- 28. Why do we need types? users::hash: ‘tom’: gid: ‘123’ home: ‘/home/tom’ managehome: false ‘ben’: gid: ‘124’ home: /home/ben managehome: ‘true’ ‘tim’: gid: 0125 home: ‘home/tim’ managehome: ‘false’ But: how to deal with more complex data? ! ! ! ! ! ! Missing quotes String instead of bool ! Missing quotes and leading 0 Missing trailing slash String instead of bool
- 29. We need types! class ssh ( Boolean $server = true, ) { if $server { include ssh::server } } ! Types, Types, Types, Types
- 30. We need types! class ssh ( Boolean $server = true, ) { if $server { include ssh::server } } ! ! class { ‘ssh’: server => ‘false’, } ! Error 400 on SERVER: Expected parameter 'server' of 'Class[Ssh]' to have type Boolean, got String ! ! ! ! ! ! ! ! ! We now get proper error messages.
- 31. We want types! class users ( Hash $hash ) { $userarray = keys($hash) users::user_data { $userarray: } } ! define users::user_data ( String $gid = $users::hash[$title][gid], String $home = $users::hash[$title][home], Boolean $managehome = $users::hash[$title][managehome], ) { }
- 33. Deprecations
- 34. Node Inheritance node ‘basenode’ { include base include security } ! node ‘www.server.com’ inherits basenode { include webserver } # Dummy node as default ! ! ! ! # Real node inherits from basenode
- 35. Roles & Profiles node ‘www.server.com’ { include webserver } ! ! class basenode { include base include security } ! class webserver { include basenode } # No more node inheritance ! ! ! ! # Define a class instead
- 36. Empty string comparison An empty string compares to true instead of false
- 37. Empty string comparison $message = ‘’ ! if $message { notify { “Message: ${message}”: } } Empty string set as default ! Check for variable existing and having content
- 38. Empty string comparison $message = ‘’ ! if $message and $message != ‘’ { notify { “Message: ${message}”: } } Empty string set as default ! Check for variable existing and not empty string
- 39. Variable naming A variable may not start with a capital letter an underscore (well. yes. it may. but. it’s private.)
- 40. Reference naming Reference deprecation capital letter on title empty space between Type reference and title ! Class [Ssh] ! Class [‘ssh’] ! Class[‘ssh’] ! Deprecated capital title ! Empty space ! Working
- 41. Hyphens in names No more hyphens in module name class name define name
- 42. Hyphens in names ! <modulepath>/syslog-ng/ ! <modulepath>/syslog_ng ! class syslog-ng { … } ! class syslog_ng { … } ! Deprecated ! New name required ! Deprecated ! New name required (obious -> module/ class naming convention)
- 43. Ruby DSL Puppet Ticket #18876 Closed 02/04/2013 New Ruby DSL API was revamped: “the number and severity of issues that came up in exploratory testing led us to the conclusion that it was not supportable code” - Puppet Dev ML - 01/26/2013 hostclass ‘ssh’ do end
- 44. More deprecation Relative resolution of class names - the reason why you want to use double colon - include ::ssh Importing manifests Matching numbers with regexp Search function Mutating arrays and hashes
- 45. The 4 Powers of Puppet 4
- 46. Performance Request response times and catalog compile times ! !
- 47. Scalability Switch on/off functionality for multi master setup ! ! !
- 48. Measurability
- 49. Flexibility Dealing with complex data natively in Puppet DSL
- 50. Upgrading to Puppet 4 Breaks old style Puppet DSL code Read documentation carefully Run tests Proposed way: new master
- 51. Text Support all modules Write PR, file bug reports, fix issues
- 53. Text The Power of Puppet 4 Martin Alfke ma@example42.com Image: http://praetoris01.deviantart.com/