SlideShare a Scribd company logo
Ian Kelly - @IanAKelly
My assumptions about you
• Incented to get software into production
My assumptions about you
• Incented to get software into production
• Progress Software through environments
based upon validation
My assumptions about you
• Incented to get software into production
• Progress Software through environments
based upon validation
• Have a mental model of what might be
acceptable and what might be a bad sign
The Problem
• Ourselves – Software – Our Budgets – Our
Boss – El Niño
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
View of validation is…
• Clean
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
View of validation is…
• Clean
• Defined
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
View of validation is…
• Clean
• Defined
• Manicured
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
Focus
• Each environment has a different focus and
field of view
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
Θ is the Problem
• Bayes Rule
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
Θ is the Problem
• Bayes Rule
• Nondeterministic
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
Θ is the Problem
• Bayes Rule
• Nondeterministic
• Deviation
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
We took the wrong pill
Production is…
• Complicated
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
So what can we do?
• Start with Everything
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
Create dials
• Make your interfaced adjustable
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation
Closing it out
• Put Production facsimiles into the hands of
your developers
Closing it out
• Put Production facsimiles into the hands of
your developers
• Add the maintenance of these interfaces to
your deployment process
Closing it out
• Put Production facsimiles into the hands of
your developers
• Add the maintenance of these interfaces to
your deployment process
• Understand your Θ
Closing it out
• Put Production facsimiles into the hands of
your developers
• Add the maintenance of these interfaces to
your deployment process
• Understand your Θ
• Incentivize boundary and extents testing
Closing it out
• Put Production facsimiles into the hands of
your developers
• Add the maintenance of these interfaces to
your deployment process
• Understand your Θ
• Incentivize boundary and extents testing
• Deliver business value for your function
Ian Kelly - @IanAKelly

More Related Content

PPTX
Bugtracking
PPTX
DevOps: Why Should We Care?
PPTX
Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...
PDF
Robert and Anne Sabourin: Gauging Software Health
PDF
Successful remote engineering, Software GR
PDF
BoS2015 Trish Khoo – Engineering Manager, Google
PDF
Successful remote engineering (sre con eu, may 2015)
PDF
2016 State of DevOps
Bugtracking
DevOps: Why Should We Care?
Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...
Robert and Anne Sabourin: Gauging Software Health
Successful remote engineering, Software GR
BoS2015 Trish Khoo – Engineering Manager, Google
Successful remote engineering (sre con eu, may 2015)
2016 State of DevOps

What's hot (19)

PDF
Aptage for complex projects
PPTX
Making disaster routine
PPTX
BoS2015 Jeff Szczepanski – COO, Stack Exchange - Stack Overflow. Scaling a Te...
PDF
iOS Testing With Appium at Gilt
PPTX
DOES16 San Francisco - David Blank-Edelman - Lessons Learned from a Parallel ...
PDF
The Data Behind DevOps: Becoming a High Performer
PDF
Handling Changes to Your Server-Side Data Model
PDF
How DevOps is Transforming IT, and What it Can Do for Academia
PPTX
Introduction to Puppet Enterprise 03-31-2016
PPTX
What Evidence Do You Have That Agile is Working?
PPTX
2016 velocity santa clara state of dev ops report deck final
PDF
Breaking Through to Flow
PDF
Continuous Delivery in a Legacy Shop—One Step at a Time
PDF
A Manager's Guide To Telecommuting
PPTX
Secrets and surprises of high performance: What the data says
PDF
Cleverbit - deliver the app your customers want
PDF
Workshop the business side of agile
PDF
Continuous Integration Is for Everyone—Especially DevOps
PDF
Shawn Wallace - Test automation in brownfield applications
Aptage for complex projects
Making disaster routine
BoS2015 Jeff Szczepanski – COO, Stack Exchange - Stack Overflow. Scaling a Te...
iOS Testing With Appium at Gilt
DOES16 San Francisco - David Blank-Edelman - Lessons Learned from a Parallel ...
The Data Behind DevOps: Becoming a High Performer
Handling Changes to Your Server-Side Data Model
How DevOps is Transforming IT, and What it Can Do for Academia
Introduction to Puppet Enterprise 03-31-2016
What Evidence Do You Have That Agile is Working?
2016 velocity santa clara state of dev ops report deck final
Breaking Through to Flow
Continuous Delivery in a Legacy Shop—One Step at a Time
A Manager's Guide To Telecommuting
Secrets and surprises of high performance: What the data says
Cleverbit - deliver the app your customers want
Workshop the business side of agile
Continuous Integration Is for Everyone—Especially DevOps
Shawn Wallace - Test automation in brownfield applications
Ad

Similar to DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation (20)

PPT
Money, Process, and Culture- Tech 20/20 June, 2012
PDF
Dev "Programming" Ops For DevOps Success
PDF
Introduction to Agile Software Development - Eric Wu - MBAX6360 New Product D...
PDF
Gartner starting and scaling dev ops
PPT
Real%20 world%20software%20testing%20white%20backgoround1
PDF
Navvia's DevOps journey
PDF
October 2018 Agile Connect Lisbon Meetup
PDF
Achieving Continuous Delivery with Puppet
PDF
Puppet Camp Paris 2014: Achieving Continuous Delivery and DevOps with Puppet
PDF
Cloud-Native Workshop - Santa Monica
PDF
Velocity Conference NYC 2014 - Real World DevOps
KEY
The business case for contributing code
PPTX
Zebulon Solutions
PDF
Software. Well... It's Complicated
PDF
How To (Not) Open Source - Javazone, Oslo 2014
PPT
Agile for Me- CodeStock 2009
PDF
SDLC & DevSecOps
PDF
The Agile BA (Business Analyst)
PDF
Development Process at Novatore Solutions
Money, Process, and Culture- Tech 20/20 June, 2012
Dev "Programming" Ops For DevOps Success
Introduction to Agile Software Development - Eric Wu - MBAX6360 New Product D...
Gartner starting and scaling dev ops
Real%20 world%20software%20testing%20white%20backgoround1
Navvia's DevOps journey
October 2018 Agile Connect Lisbon Meetup
Achieving Continuous Delivery with Puppet
Puppet Camp Paris 2014: Achieving Continuous Delivery and DevOps with Puppet
Cloud-Native Workshop - Santa Monica
Velocity Conference NYC 2014 - Real World DevOps
The business case for contributing code
Zebulon Solutions
Software. Well... It's Complicated
How To (Not) Open Source - Javazone, Oslo 2014
Agile for Me- CodeStock 2009
SDLC & DevSecOps
The Agile BA (Business Analyst)
Development Process at Novatore Solutions
Ad

More from Ian Kelly (8)

PPTX
CA World 2015 Using Docker and Containers to create Bespoke Systems Under Test
PPTX
Virtual API Cloud - CA World Launch
PPTX
New "State of the Art" for Mobile
PPTX
How do I test these new mobile applications, and how does CA Application Test...
PPT
Ei patterns
PPTX
Agile day
PDF
Rebirth of SOA
PPTX
Maximizing Internal and External Integration
CA World 2015 Using Docker and Containers to create Bespoke Systems Under Test
Virtual API Cloud - CA World Launch
New "State of the Art" for Mobile
How do I test these new mobile applications, and how does CA Application Test...
Ei patterns
Agile day
Rebirth of SOA
Maximizing Internal and External Integration

Recently uploaded (20)

PDF
WOOl fibre morphology and structure.pdf for textiles
PDF
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
PDF
Developing a website for English-speaking practice to English as a foreign la...
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
PDF
STKI Israel Market Study 2025 version august
PPT
Module 1.ppt Iot fundamentals and Architecture
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
2021 HotChips TSMC Packaging Technologies for Chiplets and 3D_0819 publish_pu...
PDF
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
PDF
Hindi spoken digit analysis for native and non-native speakers
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
Hybrid model detection and classification of lung cancer
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PDF
Enhancing emotion recognition model for a student engagement use case through...
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
observCloud-Native Containerability and monitoring.pptx
WOOl fibre morphology and structure.pdf for textiles
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
Developing a website for English-speaking practice to English as a foreign la...
gpt5_lecture_notes_comprehensive_20250812015547.pdf
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
STKI Israel Market Study 2025 version august
Module 1.ppt Iot fundamentals and Architecture
NewMind AI Weekly Chronicles - August'25-Week II
2021 HotChips TSMC Packaging Technologies for Chiplets and 3D_0819 publish_pu...
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
Hindi spoken digit analysis for native and non-native speakers
Assigned Numbers - 2025 - Bluetooth® Document
Hybrid model detection and classification of lung cancer
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
Enhancing emotion recognition model for a student engagement use case through...
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
observCloud-Native Containerability and monitoring.pptx

DevOps Summit 2014 Delivering your Applications without a Hitch using Automated Change Validation

  • 1. Ian Kelly - @IanAKelly
  • 2. My assumptions about you • Incented to get software into production
  • 3. My assumptions about you • Incented to get software into production • Progress Software through environments based upon validation
  • 4. My assumptions about you • Incented to get software into production • Progress Software through environments based upon validation • Have a mental model of what might be acceptable and what might be a bad sign
  • 5. The Problem • Ourselves – Software – Our Budgets – Our Boss – El Niño
  • 8. View of validation is… • Clean
  • 10. View of validation is… • Clean • Defined
  • 12. View of validation is… • Clean • Defined • Manicured
  • 14. Focus • Each environment has a different focus and field of view
  • 16. Θ is the Problem • Bayes Rule
  • 18. Θ is the Problem • Bayes Rule • Nondeterministic
  • 20. Θ is the Problem • Bayes Rule • Nondeterministic • Deviation
  • 22. We took the wrong pill
  • 25. So what can we do? • Start with Everything
  • 27. Create dials • Make your interfaced adjustable
  • 30. Closing it out • Put Production facsimiles into the hands of your developers
  • 31. Closing it out • Put Production facsimiles into the hands of your developers • Add the maintenance of these interfaces to your deployment process
  • 32. Closing it out • Put Production facsimiles into the hands of your developers • Add the maintenance of these interfaces to your deployment process • Understand your Θ
  • 33. Closing it out • Put Production facsimiles into the hands of your developers • Add the maintenance of these interfaces to your deployment process • Understand your Θ • Incentivize boundary and extents testing
  • 34. Closing it out • Put Production facsimiles into the hands of your developers • Add the maintenance of these interfaces to your deployment process • Understand your Θ • Incentivize boundary and extents testing • Deliver business value for your function
  • 35. Ian Kelly - @IanAKelly

Editor's Notes

  • #3: You have the goal or desire to deliver running software – that thing called business value. This may be a no brainer for you but seriously this may not be your role at your organization – some of you are human roadblocks, hired to mire, slow, and generally disrupt (also called control) releases.
  • #4: You have lower environments and originally the goal was to make them as close to reality as possible. This was never the goal of the folks who mandated this practice and they never really gave you the tools but, there you are…
  • #5: So if you have been somewhere long enough you learn these things – Oh that is always red, that never works because of XYZ in this environment If you do what you have always done, why do you complain when you get what you have always got… I am challenging you to make some new ventures into learning and exploring
  • #9: We test the functionality as the requirements state – we follow the flows to the letter, and we do it in environments that are so unique they may be termed antiseptic
  • #10: We treat QA or Maybe UAT environments like this clean room – nothing is added that is not first sanitized. So what does that mean? Our environments are sparse! Very Sparse!
  • #28: Bend them to your will
  • #29: Make them respond faster, slower, with the wrong data, with the right errors, with dirty state, with partial replied, with corrupt replies – With a 200 and no content, with a 404 and the right resource
  • #30: Interesting things occur when you can validate in these virtualized systems