Confluence of Broken Windows JavaOne 2016
1 like412 views
Vincent Kok, a development manager at Atlassian, discusses challenges related to managing a software development pipeline, highlighting key issues such as complexity, ownership, testing, and release cycles. He emphasizes the importance of early results, clear goals, and maintaining good practices like measuring visibility and automating processes. The presentation includes various statistics and anecdotes to illustrate the impact and relevance of these challenges in a software development environment.
Confluence of Broken Windows JavaOne 2016
- 1. VINCENT KOK • DEVELOPMENT MANAGER • ATLASSIAN • @VINCENTKOK Repairing a Confluence of broken windows
- 2. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Monolith https://flic.kr/p/nA4S49
- 3. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Cool stories
- 5. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Got issues? https://flic.kr/p/fSopv4
- 6. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Journey https://flic.kr/p/8WQutt
- 7. CONFLUENCE PIPELINE MICROSERVICE ENVY 4 PROBLEMS Agenda CULTURE
- 8. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Confluence Pipeline https://flic.kr/p/jus4Bt
- 9. Nr of daily master builds 286
- 11. Nr of build agents 800
- 12. Flakes NaN
- 13. Size of Pipeline team 3
- 15. Confluence Pipeline Publish Deploy ReleaseInner Outer A1 A2
- 16. True story Publish Deploy ReleaseInner Outer A1 A2 A1 A2 Manual release branch Development Env
- 17. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Not Great https://flic.kr/p/7D1D1N
- 18. < 1 hour
- 19. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Culture https://flic.kr/p/DsetEn
- 21. GreenDex
- 22. GreenDex
- 23. ResultsBeliefsExperience Actions The Oz Principle The way you’ve been shaped Beliefs are based on your experience You take actions based on your beliefs The outcome of our actions
- 24. Clear goal Early results Momentum Theory in real life
- 25. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Microservice Envy https://flic.kr/p/b7ak8e
- 26. Smaller Clear ownership Independent Lifecycle Microservice traits
- 27. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Monolith https://flic.kr/p/nA4S49
- 28. < 1 hour
- 29. Once a Day
- 31. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace #1: Complexity https://flic.kr/p/cFM3cd
- 32. Show me complexity Outer A1 A2 A1 A2 Manual release branch Development Env
- 33. Manual tasks Flawed model Late feedback Impact
- 34. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Fix the model https://flic.kr/p/8ykpkW
- 37. Inner loop Build times Build stability Iterate
- 38. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace #2: Ownership https://flic.kr/p/bfRuoX
- 39. Getting the model wrong
- 40. Fire fighting Broken windows No improvements Impact
- 41. Dev Speed Feedback loop MTTR Impact
- 42. Ownership Development Teams Synergy Site Reliability Engineering Pipeline
- 43. Early result
- 44. Visibility Measure everything Move the needle
- 45. Visibility Measure everything Move the needle
- 46. Visibility Measure everything Move the needle
- 47. Engagement Model Ownership Enforce by automation Iterate
- 48. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace #3: Testing https://flic.kr/p/cBbxuQ
- 49. Unit Service UI
- 50. Unit Service UI
- 52. Time Culture Broken windows The effect of flakes
- 53. Retries as a pain killer Automatic retries to relieve some pain. Remember this is a workaround Early result
- 54. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Fix the root cause https://flic.kr/p/J44Nm
- 55. Iterate Test strategy Flake policy
- 60. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace #4: Releases https://flic.kr/p/91MFkh
- 61. Release cycle
- 62. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Congestion https://flic.kr/p/bRgBZP
- 63. Dogfooding becomes hard Big bangEnds at master Cancellations Impact
- 64. For once a free lunch Fork and Join solved most of our problems already Early result
- 65. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Dogfooding https://flic.kr/p/dxpLTm
- 66. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Feedback https://flic.kr/p/dxaAdk
- 67. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Soak time https://flic.kr/p/fmfG2q
- 68. Decouple code and features Merge often One process Feature flags
- 69. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace One more time https://flic.kr/p/bsBaMn
- 70. < 1 hour
- 71. Once a Day
- 73. Clear goal Early results Momentum Experience & Beliefs
- 75. Thank you! VINCENT KOK • DEVELOPMENT MANAGER • ATLASSIAN • @VINCENTKOK