SlideShare a Scribd company logo
DevOps Army of N
Jonathan Disher
- Senior Principal DevOps Engineer, ODC
EHLO jon
DevOps Army of N - Recovering From Being A Human SPOF
DevOps Army of N - Recovering From Being A Human SPOF
- Senior Principal DevOps Engineer, ODC
- I do love me some fountain pens
EHLO jon
DevOps Army of N - Recovering From Being A Human SPOF
- Senior Principal DevOps Engineer, ODC
- I do love me some fountain pens
- Still wrenching on the Miata
EHLO jon
Presentation Title
Author or Subtitle
Which way to the datacenter?!
Image by Dito Milan, GotBlueMilk Photography
- Senior Principal DevOps Engineer, ODC
- I do love me some fountain pens
- Still wrenching on the Miata
- Still putting Latin on business cards
EHLO jon
DevOps Army of N - Recovering From Being A Human SPOF
- Senior Principal DevOps Engineer, ODC
- I do love me some fountain pens
- Still wrenching on the Miata
- Still putting Latin on business cards
- Former Single Point of Failure
EHLO jon
At devopsdays SV in November, I gave a talk
about my experiences being a Human Single
Point of Failure.
Video and slides available on Youtube and
SlideShare!
DevOps Army of One
0
1.5
3
4.5
6
0
625
1250
1875
2500
11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15
Hosts Engineers
November 2015 - It was just me.
DevOps Army of N - Recovering From Being A Human SPOF
New Year brings Andrew!
0
1.5
3
4.5
6
0
625
1250
1875
2500
11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16
Hosts Engineers
DevOps Army of N - Recovering From Being A Human SPOF
Alex in March…
0
1.5
3
4.5
6
0
625
1250
1875
2500
11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16
Hosts Engineers
DevOps Army of N - Recovering From Being A Human SPOF
and Kimberly in May!
0
1.5
3
4.5
6
0
625
1250
1875
2500
11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16 5/16
Hosts Engineers
DevOps Army of N - Recovering From Being A Human SPOF
hopefully engineer #5 soon!
0
1.5
3
4.5
6
0
625
1250
1875
2500
11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16 5/16
Hosts Engineers
DevOps Army of N - Recovering From Being A Human SPOF
we’re hiring! DevOps, DBA, Big Data…
0
1.5
3
4.5
6
0
625
1250
1875
2500
11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16 5/16
Hosts Engineers
Return of the poll: How many of you are
now, or have previously, worked in
DevOps groups of size == 1?
(Specifically where the group was, at
one time, size > 1, and shrank to 1)
Return of the poll: How many of you are
now, or have previously, worked in
DevOps groups of size == 1?
(Specifically where the group was, at
one time, size > 1, and shrank to 1)
(In November, it was 15-20%)
Return of the poll: How many of you are
now, or have previously, worked in
DevOps groups of size == 1?
(Specifically where the group was, at
one time, size > 1, and shrank to 1)
(In November, it was 15-20%)
(ouch.)
So you’ve hired some people…
So you’ve hired some people… now what?
DevOps Army of N - Recovering From Being A Human SPOF
- I’ve forgotten how to teach other engineers
Being solo had some bad side effects…
- I’ve forgotten how to teach other engineers
- Too many doc sources still say “Go talk to Jon”
Being solo had some bad side effects…
- I’ve forgotten how to teach other engineers
- Too many doc sources still say “Go talk to Jon”
- Too accustomed to not delegating tasks
Being solo had some bad side effects…
- I’ve forgotten how to teach other engineers
- Too many doc sources still say “Go talk to Jon”
- Too accustomed to not delegating tasks
- People got used to everything being P1
Being solo had some bad side effects…
- I’ve forgotten how to teach other engineers
- Too many doc sources still say “Go talk to Jon”
- Too accustomed to not delegating tasks
- People got used to everything being P1
- Quality, complete documentation
Being solo had some bad side effects…
- I’ve forgotten how to teach other engineers
- Too many doc sources still say “Go talk to Jon”
- Too accustomed to not delegating tasks
- People got used to everything being P1
- Quality, complete documentation
- Sometimes I still feel like I’m in solo crisis mode
Being solo had some bad side effects…
DevOps Army of N - Recovering From Being A Human SPOF
- Spread the knowledge
[GREEN] DevOps Service Recovering…
DevOps Army of N - Recovering From Being A Human SPOF
- Spread the knowledge
- Written docs, info sessions, camp out at my desk
[GREEN] DevOps Service Recovering…
- Spread the knowledge
- Written docs, info sessions, camp out at my desk
- We have a team, now, so use it!
[GREEN] DevOps Service Recovering…
- Spread the knowledge
- Written docs, info sessions, camp out at my desk
- We have a team, now, so use it!
- Make sure the entire team is in the loop
[GREEN] DevOps Service Recovering…
- Spread the knowledge
- Written docs, info sessions, camp out at my desk
- We have a team, now, so use it!
- Make sure the entire team is in the loop
- Review what was built and change as needed
[GREEN] DevOps Service Recovering…
So we sat down and did a thorough review
of our environment.
DevOps Army of N - Recovering From Being A Human SPOF
So we sat down and did a thorough review
of our environment.
We were brutally honest.
And we’re going to burn a lot down.
Phoenix Rising
- We’re rebuilding large portions of
infrastructure.
Phoenix Rising
DevOps Army of N - Recovering From Being A Human SPOF
- We’re rebuilding large portions of
infrastructure.
- Along the way we will build it better, with
more review and more modern ideas.
Phoenix Rising
DevOps Army of N - Recovering From Being A Human SPOF
Just kidding, Jennifer.
DevOps Army of N - Recovering From Being A Human SPOF
DevOps Army of N - Recovering From Being A Human SPOF
- We will be rebuilding large portions of
infrastructure.
- And along the way we will build it better, with
more review and more modern ideas.
- EMPHASIS ON WE - since it’s not just me,
information gets shared!
Phoenix Rising
We don’t want angry panda.
- Periodic cross-team architecture review
How can we keep this from happening again?
DevOps Army of N - Recovering From Being A Human SPOF
- Periodic cross-team architecture review.
- Write good documentation, keep it current.
How can we keep this from happening again?
- Periodic cross-team architecture review.
- Write good documentation, keep it current.
- Keep hiring people. Keep training people.
How can we keep this from happening again?
- Periodic cross-team architecture review.
- Write good documentation, keep it current.
- Keep hiring people. Keep training people.
- Remember saying no? Thats still allowed.
How can we keep this from happening again?
- Periodic cross-team architecture review.
- Write good documentation, keep it current.
- Keep hiring people. Keep training people.
- Remember saying no? Thats still allowed.
- Take a vacation. Stay fresh!
How can we keep this from happening again?
Don’t let this be you.
And we don’t want Phoenix Re-Rising 2020
Coming Soon!
Coming Soon!
(devopsdays SV 2018?)
Coming Soon!
DevOps Army of N+1
(devopsdays SV 2018?)
Coming Soon!
DevOps Army of N+1
Achievement Unlocked: Team Redundancy!
(devopsdays SV 2018?)
Twitter: @funjon
jon.disher@oracle.com

More Related Content

PDF
Why an Engineer should be "human" too
PDF
Sand pit for Biodiversity at Cep II quarry, Czech Republic
PDF
Online Assignment
PDF
Script
PPTX
грязная сторона мыла чем опасен триклозан
DOC
Lesson four genre
PDF
Maina_aGST in ALF_2016
PPTX
Curriculum vitae
Why an Engineer should be "human" too
Sand pit for Biodiversity at Cep II quarry, Czech Republic
Online Assignment
Script
грязная сторона мыла чем опасен триклозан
Lesson four genre
Maina_aGST in ALF_2016
Curriculum vitae

Viewers also liked (16)

PDF
Icsi treatment
PDF
Maina_aGST in ALF_2016
PPTX
Urbani studio ecommerce
PPTX
POWERPOINT PRESENTATION
DOCX
Investigacion
PPTX
POWERPOINT PRESENTATION
DOCX
ASSIGNMENT
PDF
Design and Development of Suitable Spawining Grounds for the Protection of Na...
DOCX
ONLINE ASSIGNMENT
PPTX
Hello everybody
PPT
English Glossary
PDF
ONLINE ASSIGNMENT
PDF
Ivf success rate
PPTX
Slide show
PPTX
POWERPOINT PRESENTATION
PPT
Museo comunale Vincenzo Passarello
Icsi treatment
Maina_aGST in ALF_2016
Urbani studio ecommerce
POWERPOINT PRESENTATION
Investigacion
POWERPOINT PRESENTATION
ASSIGNMENT
Design and Development of Suitable Spawining Grounds for the Protection of Na...
ONLINE ASSIGNMENT
Hello everybody
English Glossary
ONLINE ASSIGNMENT
Ivf success rate
Slide show
POWERPOINT PRESENTATION
Museo comunale Vincenzo Passarello
Ad

Similar to DevOps Army of N - Recovering From Being A Human SPOF (20)

PPTX
Culteral impediments to DevOps
PDF
Devops -- LKFR14
PDF
DevOps for Managers
PDF
Tickets Make Ops Unnecessarily Miserable: The Journey to Self-Service
PDF
DevOps: The Future is Already Here — It’s Just Unevenly Distributed
PDF
The Changing Role of Release Engineering in a DevOps World
PPTX
'10 Great but now Overlooked Tools' by Graham Thomas
PDF
We hear you!. Collecting and processing user feedback, for real!
PDF
Wait A Moment? How High Workload Kills Efficiency! - Roman Pickl
PPTX
Cute Autumn Interactive Lesson Plan for Elementary Presentation.pptx
PPTX
Interns What Is DevOps
PDF
Zero Adoption: Lessons Learned From Failing at Open Source
PDF
PPTX
Cute Autumn Interactive Lesson Plan for Elementary Presentation.pptx
PDF
Deploy First, Develop Later
PDF
PPT
DevOps Transition Strategies
PDF
Self-Service Operations: Because Ops Still Happens
PDF
There and-back-again-med-res
PDF
Planning and Managing Drupal Projects
Culteral impediments to DevOps
Devops -- LKFR14
DevOps for Managers
Tickets Make Ops Unnecessarily Miserable: The Journey to Self-Service
DevOps: The Future is Already Here — It’s Just Unevenly Distributed
The Changing Role of Release Engineering in a DevOps World
'10 Great but now Overlooked Tools' by Graham Thomas
We hear you!. Collecting and processing user feedback, for real!
Wait A Moment? How High Workload Kills Efficiency! - Roman Pickl
Cute Autumn Interactive Lesson Plan for Elementary Presentation.pptx
Interns What Is DevOps
Zero Adoption: Lessons Learned From Failing at Open Source
Cute Autumn Interactive Lesson Plan for Elementary Presentation.pptx
Deploy First, Develop Later
DevOps Transition Strategies
Self-Service Operations: Because Ops Still Happens
There and-back-again-med-res
Planning and Managing Drupal Projects
Ad

Recently uploaded (20)

PDF
WOOl fibre morphology and structure.pdf for textiles
PPTX
OMC Textile Division Presentation 2021.pptx
PDF
STKI Israel Market Study 2025 version august
PDF
Enhancing emotion recognition model for a student engagement use case through...
PPTX
Modernising the Digital Integration Hub
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PDF
NewMind AI Weekly Chronicles – August ’25 Week III
PPTX
Tartificialntelligence_presentation.pptx
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
August Patch Tuesday
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
Getting started with AI Agents and Multi-Agent Systems
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PDF
DP Operators-handbook-extract for the Mautical Institute
PDF
A contest of sentiment analysis: k-nearest neighbor versus neural network
PPTX
The various Industrial Revolutions .pptx
WOOl fibre morphology and structure.pdf for textiles
OMC Textile Division Presentation 2021.pptx
STKI Israel Market Study 2025 version august
Enhancing emotion recognition model for a student engagement use case through...
Modernising the Digital Integration Hub
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
NewMind AI Weekly Chronicles – August ’25 Week III
Tartificialntelligence_presentation.pptx
Zenith AI: Advanced Artificial Intelligence
A comparative study of natural language inference in Swahili using monolingua...
August Patch Tuesday
NewMind AI Weekly Chronicles - August'25-Week II
Group 1 Presentation -Planning and Decision Making .pptx
Assigned Numbers - 2025 - Bluetooth® Document
Getting started with AI Agents and Multi-Agent Systems
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
DP Operators-handbook-extract for the Mautical Institute
A contest of sentiment analysis: k-nearest neighbor versus neural network
The various Industrial Revolutions .pptx

DevOps Army of N - Recovering From Being A Human SPOF

  • 1. DevOps Army of N Jonathan Disher
  • 2. - Senior Principal DevOps Engineer, ODC EHLO jon
  • 5. - Senior Principal DevOps Engineer, ODC - I do love me some fountain pens EHLO jon
  • 7. - Senior Principal DevOps Engineer, ODC - I do love me some fountain pens - Still wrenching on the Miata EHLO jon
  • 8. Presentation Title Author or Subtitle Which way to the datacenter?! Image by Dito Milan, GotBlueMilk Photography
  • 9. - Senior Principal DevOps Engineer, ODC - I do love me some fountain pens - Still wrenching on the Miata - Still putting Latin on business cards EHLO jon
  • 11. - Senior Principal DevOps Engineer, ODC - I do love me some fountain pens - Still wrenching on the Miata - Still putting Latin on business cards - Former Single Point of Failure EHLO jon
  • 12. At devopsdays SV in November, I gave a talk about my experiences being a Human Single Point of Failure. Video and slides available on Youtube and SlideShare! DevOps Army of One
  • 13. 0 1.5 3 4.5 6 0 625 1250 1875 2500 11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 Hosts Engineers November 2015 - It was just me.
  • 15. New Year brings Andrew! 0 1.5 3 4.5 6 0 625 1250 1875 2500 11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16 Hosts Engineers
  • 17. Alex in March… 0 1.5 3 4.5 6 0 625 1250 1875 2500 11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16 Hosts Engineers
  • 19. and Kimberly in May! 0 1.5 3 4.5 6 0 625 1250 1875 2500 11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16 5/16 Hosts Engineers
  • 21. hopefully engineer #5 soon! 0 1.5 3 4.5 6 0 625 1250 1875 2500 11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16 5/16 Hosts Engineers
  • 23. we’re hiring! DevOps, DBA, Big Data… 0 1.5 3 4.5 6 0 625 1250 1875 2500 11/12 2/13 5/13 8/13 11/13 2/14 5/14 8/14 11/14 2/15 5/15 8/15 11/15 2/16 5/16 Hosts Engineers
  • 24. Return of the poll: How many of you are now, or have previously, worked in DevOps groups of size == 1? (Specifically where the group was, at one time, size > 1, and shrank to 1)
  • 25. Return of the poll: How many of you are now, or have previously, worked in DevOps groups of size == 1? (Specifically where the group was, at one time, size > 1, and shrank to 1) (In November, it was 15-20%)
  • 26. Return of the poll: How many of you are now, or have previously, worked in DevOps groups of size == 1? (Specifically where the group was, at one time, size > 1, and shrank to 1) (In November, it was 15-20%) (ouch.)
  • 27. So you’ve hired some people…
  • 28. So you’ve hired some people… now what?
  • 30. - I’ve forgotten how to teach other engineers Being solo had some bad side effects…
  • 31. - I’ve forgotten how to teach other engineers - Too many doc sources still say “Go talk to Jon” Being solo had some bad side effects…
  • 32. - I’ve forgotten how to teach other engineers - Too many doc sources still say “Go talk to Jon” - Too accustomed to not delegating tasks Being solo had some bad side effects…
  • 33. - I’ve forgotten how to teach other engineers - Too many doc sources still say “Go talk to Jon” - Too accustomed to not delegating tasks - People got used to everything being P1 Being solo had some bad side effects…
  • 34. - I’ve forgotten how to teach other engineers - Too many doc sources still say “Go talk to Jon” - Too accustomed to not delegating tasks - People got used to everything being P1 - Quality, complete documentation Being solo had some bad side effects…
  • 35. - I’ve forgotten how to teach other engineers - Too many doc sources still say “Go talk to Jon” - Too accustomed to not delegating tasks - People got used to everything being P1 - Quality, complete documentation - Sometimes I still feel like I’m in solo crisis mode Being solo had some bad side effects…
  • 37. - Spread the knowledge [GREEN] DevOps Service Recovering…
  • 39. - Spread the knowledge - Written docs, info sessions, camp out at my desk [GREEN] DevOps Service Recovering…
  • 40. - Spread the knowledge - Written docs, info sessions, camp out at my desk - We have a team, now, so use it! [GREEN] DevOps Service Recovering…
  • 41. - Spread the knowledge - Written docs, info sessions, camp out at my desk - We have a team, now, so use it! - Make sure the entire team is in the loop [GREEN] DevOps Service Recovering…
  • 42. - Spread the knowledge - Written docs, info sessions, camp out at my desk - We have a team, now, so use it! - Make sure the entire team is in the loop - Review what was built and change as needed [GREEN] DevOps Service Recovering…
  • 43. So we sat down and did a thorough review of our environment.
  • 45. So we sat down and did a thorough review of our environment. We were brutally honest.
  • 46. And we’re going to burn a lot down.
  • 48. - We’re rebuilding large portions of infrastructure. Phoenix Rising
  • 50. - We’re rebuilding large portions of infrastructure. - Along the way we will build it better, with more review and more modern ideas. Phoenix Rising
  • 55. - We will be rebuilding large portions of infrastructure. - And along the way we will build it better, with more review and more modern ideas. - EMPHASIS ON WE - since it’s not just me, information gets shared! Phoenix Rising
  • 56. We don’t want angry panda.
  • 57. - Periodic cross-team architecture review How can we keep this from happening again?
  • 59. - Periodic cross-team architecture review. - Write good documentation, keep it current. How can we keep this from happening again?
  • 60. - Periodic cross-team architecture review. - Write good documentation, keep it current. - Keep hiring people. Keep training people. How can we keep this from happening again?
  • 61. - Periodic cross-team architecture review. - Write good documentation, keep it current. - Keep hiring people. Keep training people. - Remember saying no? Thats still allowed. How can we keep this from happening again?
  • 62. - Periodic cross-team architecture review. - Write good documentation, keep it current. - Keep hiring people. Keep training people. - Remember saying no? Thats still allowed. - Take a vacation. Stay fresh! How can we keep this from happening again?
  • 63. Don’t let this be you.
  • 64. And we don’t want Phoenix Re-Rising 2020
  • 67. Coming Soon! DevOps Army of N+1 (devopsdays SV 2018?)
  • 68. Coming Soon! DevOps Army of N+1 Achievement Unlocked: Team Redundancy! (devopsdays SV 2018?)