SlideShare a Scribd company logo
Automated Infrastructure Testing
Ranjib Dey
System Administrator, ThoughtWorks
Part 1
What we are building?
What you already know?
To Code (develop functionalities)
To Test (ensure if its working fine)
To Code (develop functionalities)
To Test (ensure if its working fine)
Automate
Enter DevOps/CD
To Code (develop functionalities)
To Test (ensure if its working fine)
To Deploy (ensure if it can be released)
To Code (develop functionalities)
To Test (ensure if its working fine)
To Deploy (ensure if it can be released)
Automate
To Code (develop functionalities)
To Test (ensure if its working fine)
To Deploy (ensure if it can be released)
Automate
Automate
To Code
To Test
To Deploy
Automate
Automate
CI
To Code
To Test
To Deploy
Automate
Automate
CI
CD
Part 2
How it is different?
Tested code
Deployed code
Automate
Tested code
Deployed code
Automate
Infrastructure
Tested code
Deployed code
Automate
Infrastructure
Operations
Tested code
Deployed code
Automate
Infrastructure
Operations
Data
Tested code
Deployed code
Automate
Infrastructure
Operations
Data
Compliance
Tested code
Deployed code
Automate
Infrastructure
Operations
Data
Compliance
End users
Tested code
Deployed code
Automate
Infrastructure
Operations
Data
Compliance
End users
Integrations
On infrastructure
To Code
To Test
To Deploy
Automate
Automate
To Code
To Test
To Deploy
Automate
Automate
Build infrastructure
To Code
To Test
To Deploy
Automate
Automate
Build infrastructure
Production
Infrastructure
Part 3
On testing
Tested code
Deployed code
Automate
Tested code
Deployed code
Automate
Infrastructure as Code
Tested code
Deployed code
Automate
Infrastructure as Code
Code
Automated Infrastructure Testing - Ranjib Dey
Tested code
Deployed code
Automate
Infrastructure as Code
Code
Test
Tested code
Deployed code
Automate
Infrastructure as Code
Code Test
Unit Testing
Automated Infrastructure Testing - Ranjib Dey
Tested code
Deployed code
Automate
Infrastructure as Code
Code Test
Unit Testing
Tested code
Deployed code
Automate
Infrastructure as Code
Code Test
Unit Testing
Functional Testing
Scenario: Nginx is running as a daemon
When I run "ps aux | grep nginx"
Then I should see “nginx:master" in the output
Tested code
Deployed code
Automate
Infrastructure as Code
Code Test
Unit Testing
Functional Testing
Tested code
Deployed code
Automate
Infrastructure as Code
Code Test
Unit Testing
Functional Testing
Integration Testing
describe_recipe 'nginx:configuration' do
it 'installs version 1.0.15' do
node[:nginx][:version].should == '1.0.15'
file("/etc/nginx/nginx.conf").must_have(:mode, "644")
package("nginx").must_be_installed
service("nginx").must_be_running
end
end
Tested code
Deployed code
Automate
Infrastructure as Code
Code Test
Unit Testing
Functional Testing
Integration Testing
Monitoring
• Monitoring
Tested code
Deployed code
Automate
Infrastructure as Code
Monitoring
Tests Mocks
Tested code
Deployed code
Automate
Infrastructure as Code
Monitoring
Tests Mocks
Analytics
Part 4
Cloud cometh
Cloud
Automated Infrastructure Testing - Ranjib Dey
I see more code
I see more code
I need more tests
Cloud
AWS
Cloud
AWSRackspace
GCE
HP
Joyent
Oh yeah
We love cross browser testing?
Part 5
Lessons learned
Health of infrastructure
Health of infrastructure
Battle tested code
Health of infrastructure
Battle tested code
Thorough Monitoring
• Remember to build feedback system .
– Test harness should publish metrics in the same
system where ops and project metrics are kept.
– Have analytics or trending system on top of the
metrics.
Collaborate more with
Ops.
Some advice
• Remember MIME types?
• World wont be fully automatic ever. Always
automate the most time consuming task first.
• No easy way out. The function domain
requires you to understand man pages, rfps
etc.
• Choose a text editor rather than an Window
manager based IDE.
References
• Infra-automation: http://www.opscode.com/chef/
• Monitoring: http://www.nagios.org/
• Lint tool: http://acrmp.github.com/foodcritic/
• Unit testing: https://github.com/acrmp/chefspec
• Functional testing: http://www.cucumber-chef.org/
• Integration testing:
https://github.com/calavera/minitest-chef-handler
@RanjibDey
http://ranjib.posterous.com
http://www.dzone.com/users/ranjibd
dey.ranjib@gmail.com

More Related Content

PPTX
Automated Infrastructure Testing
PDF
Compliance as Code
KEY
Testing with Jenkins, Selenium and Continuous Deployment
PDF
2013 10-28 php ug presentation - ci using phing and hudson
PDF
Automated android testing using jenkins ci
PPTX
Continuous Delivery concept overview. Continuous Integration Systems. DevOps ...
KEY
Continuous Delivery Using Jenkins
PDF
Automate Thyself
Automated Infrastructure Testing
Compliance as Code
Testing with Jenkins, Selenium and Continuous Deployment
2013 10-28 php ug presentation - ci using phing and hudson
Automated android testing using jenkins ci
Continuous Delivery concept overview. Continuous Integration Systems. DevOps ...
Continuous Delivery Using Jenkins
Automate Thyself

What's hot (20)

PPTX
Jenkins introduction
PDF
Cypress e2e automation testing - day1 intor by: Hassan Hameed
PDF
[English][Test Girls] Zero to Hero: Start Test automation with Cypress
PPTX
Building the Test Automation Framework - Jenkins for Testers
PDF
Jenkins.pptx
PDF
Continuous Integration (CI) - An effective development practice
PDF
Jenkins & Selenium
PPTX
Introduction to Integration Testing With Cypress
PDF
Nike popup compliance workshop
PPTX
Supermondays: Jenkins CI lightning talk
PPTX
Docker в автоматизации тестирования
PPTX
Ci jenkins maven svn
PPTX
Compliance Automation with Inspec Part 4
PPTX
Achieving DevOps Success with Chef Automate
PDF
Automation Testing
PPTX
Drupal Continuous Integration with Jenkins - The Basics
PPTX
Splunk: Forward me the REST of those shells
PPTX
Application Automation with Habitat
PPTX
Effective Testing with Ansible and InSpec
PDF
Rise of the Machines - Automate your Development
Jenkins introduction
Cypress e2e automation testing - day1 intor by: Hassan Hameed
[English][Test Girls] Zero to Hero: Start Test automation with Cypress
Building the Test Automation Framework - Jenkins for Testers
Jenkins.pptx
Continuous Integration (CI) - An effective development practice
Jenkins & Selenium
Introduction to Integration Testing With Cypress
Nike popup compliance workshop
Supermondays: Jenkins CI lightning talk
Docker в автоматизации тестирования
Ci jenkins maven svn
Compliance Automation with Inspec Part 4
Achieving DevOps Success with Chef Automate
Automation Testing
Drupal Continuous Integration with Jenkins - The Basics
Splunk: Forward me the REST of those shells
Application Automation with Habitat
Effective Testing with Ansible and InSpec
Rise of the Machines - Automate your Development
Ad

Viewers also liked (12)

PDF
Continuous infrastructure testing
PDF
Infrastructure testing with Jenkins, Puppet and Vagrant - Agile Testing Days ...
PPTX
Agile2013 Briefing Deck
PDF
Coaching opposing sides large scale lean program management
KEY
Coaching smells
PPTX
Ipma scrum keynote
PPTX
Active Portfolio Management
PPTX
The Product Wall Release Planning Workshop by Alan Dayley
PPTX
VMWare Lab For Training, Testing or Proof of Concept
PPTX
PDF
Stop Scaling Start Growing Agile
PPTX
Lean for leaders
Continuous infrastructure testing
Infrastructure testing with Jenkins, Puppet and Vagrant - Agile Testing Days ...
Agile2013 Briefing Deck
Coaching opposing sides large scale lean program management
Coaching smells
Ipma scrum keynote
Active Portfolio Management
The Product Wall Release Planning Workshop by Alan Dayley
VMWare Lab For Training, Testing or Proof of Concept
Stop Scaling Start Growing Agile
Lean for leaders
Ad

Similar to Automated Infrastructure Testing - Ranjib Dey (20)

PPTX
Automated infrastructure testing - by Ranjib Dey
PPTX
Testing for infra code using test-kitchen,docker,chef
PDF
A developers' journey into building automated tests for IT from the ground up
PDF
Meta Infrastructure as Code: How Capital One Automated Our Automation Tools w...
PDF
Infrastructure as Code
PPTX
Continuous Testing With Terraform
PDF
Infrastructure as code with test approach
PPTX
Continuous Integration and Delivery using TeamCity and Jenkins
PDF
Why modern cloud infrastructure require automation
PPTX
Will hall - Accelerating Infrastructure as Code and Configuration Management ...
PPTX
Accelerating Infrastructure as Code with CI in AWS.
PDF
NGINX Can Do That? Test Drive Your Config File!
PDF
Cloud infrastructure as code
PPTX
Test Driven Infrastructure with Serverspec and KitchenCI
PPTX
Testing configuration management code
PPTX
Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...
PDF
Implementing Infrastructure as Code ConfigMgtCamp 2017
PDF
DevOps Fest 2020. immutable infrastructure as code. True story.
PPTX
Infrastructure as Code for Network
Automated infrastructure testing - by Ranjib Dey
Testing for infra code using test-kitchen,docker,chef
A developers' journey into building automated tests for IT from the ground up
Meta Infrastructure as Code: How Capital One Automated Our Automation Tools w...
Infrastructure as Code
Continuous Testing With Terraform
Infrastructure as code with test approach
Continuous Integration and Delivery using TeamCity and Jenkins
Why modern cloud infrastructure require automation
Will hall - Accelerating Infrastructure as Code and Configuration Management ...
Accelerating Infrastructure as Code with CI in AWS.
NGINX Can Do That? Test Drive Your Config File!
Cloud infrastructure as code
Test Driven Infrastructure with Serverspec and KitchenCI
Testing configuration management code
Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...
Implementing Infrastructure as Code ConfigMgtCamp 2017
DevOps Fest 2020. immutable infrastructure as code. True story.
Infrastructure as Code for Network

More from Thoughtworks (20)

PDF
Design System as a Product
PDF
Designers, Developers & Dogs
PDF
Cloud-first for fast innovation
PDF
More impact with flexible teams
PDF
Culture of Innovation
PDF
Dual-Track Agile
PDF
Developer Experience
PDF
When we design together
PDF
Hardware is hard(er)
PDF
Customer-centric innovation enabled by cloud
PDF
Amazon's Culture of Innovation
PDF
When in doubt, go live
PDF
Don't cross the Rubicon
PDF
Error handling
PDF
Your test coverage is a lie!
PDF
Docker container security
PDF
Redefining the unit
PPTX
Technology Radar Webinar UK - Vol. 22
PDF
A Tribute to Turing
PDF
Rsa maths worked out
Design System as a Product
Designers, Developers & Dogs
Cloud-first for fast innovation
More impact with flexible teams
Culture of Innovation
Dual-Track Agile
Developer Experience
When we design together
Hardware is hard(er)
Customer-centric innovation enabled by cloud
Amazon's Culture of Innovation
When in doubt, go live
Don't cross the Rubicon
Error handling
Your test coverage is a lie!
Docker container security
Redefining the unit
Technology Radar Webinar UK - Vol. 22
A Tribute to Turing
Rsa maths worked out

Recently uploaded (20)

PPTX
Big Data Technologies - Introduction.pptx
PDF
Unlocking AI with Model Context Protocol (MCP)
PPTX
A Presentation on Artificial Intelligence
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
Cloud computing and distributed systems.
PDF
Empathic Computing: Creating Shared Understanding
PDF
Approach and Philosophy of On baking technology
Big Data Technologies - Introduction.pptx
Unlocking AI with Model Context Protocol (MCP)
A Presentation on Artificial Intelligence
Encapsulation_ Review paper, used for researhc scholars
Mobile App Security Testing_ A Comprehensive Guide.pdf
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Advanced methodologies resolving dimensionality complications for autism neur...
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
NewMind AI Monthly Chronicles - July 2025
Per capita expenditure prediction using model stacking based on satellite ima...
Diabetes mellitus diagnosis method based random forest with bat algorithm
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Digital-Transformation-Roadmap-for-Companies.pptx
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Network Security Unit 5.pdf for BCA BBA.
Cloud computing and distributed systems.
Empathic Computing: Creating Shared Understanding
Approach and Philosophy of On baking technology

Automated Infrastructure Testing - Ranjib Dey