Accelerating the Developers' Road to the Cloud at Enterprise Scale
0 likes490 views
The document presents a case study on Fidelity Investments' journey towards enhancing cloud adoption and developer efficiency at an enterprise scale. It outlines key outcomes and challenges related to agility, engineering, and operational excellence, emphasizing a culture of ownership, accountability, and continuous improvement. Additionally, the document discusses strategies for overcoming obstacles, promoting a transparent and innovative mindset in technology and application development.
Accelerating the Developers' Road to the Cloud at Enterprise Scale
- 1. Accelerating the Developers’ Road to the Cloud at Enterprise Scale Nick Penston & Ger McMahon Fidelity Investments October 7–10, 2019 Austin Convention Center
- 2. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Disclaimer This presentation is a case study of the Fidelity Investments cloud experience. This is not an endorsement or recommendation of any vendor product or service.
- 3. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ First some context • Everyone embarking on the journey themselves across multiple clouds • Duplication in attempts to solve the same problems • Variety of speeds to production • Inconsistent approaches to compliance and security • Variance in team maturity and practices
- 4. FIDELITY ⎸ENTERPRISE CLOUD COMPUTING Delivery Excellence
- 5. Dx = Ax + Ex + Opx Delivery eXcellence Agility eXcellence Engineering eXcellence Operational eXcellence =
- 6. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Agility eXcellence
- 7. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 7 Outcomes • Outcome driven culture • Ownership and accountability • Fast iterative value stream • Fail fast • Customer focused
- 8. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 8 Challenges • Prescriptive vs loosely coupled practices • Transparency • Pivoting to feedback • Dependencies • Culture • Customer empathy
- 9. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Meeting the challenge • Create belief systems • Accelerate bias to action • Measure, Measure, Measure • Work out loud
- 10. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Working out loud • Transparency • Visual radiators • Workspace == culture • Open process
- 11. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Outcomes not outputs
- 13. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Engineering eXcellence
- 14. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Engineering eXcellence outcomes • Secure at high quality • Resilient, scalable applications • DRY • Accelerate value cadence • Best in class talent
- 15. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Challenges • Consistency • Standardization vs organic • Skills & knowledge • Caring about FinOps • No-one cares?
- 16. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Codified EngineeringX
- 17. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Ditto Ditto provides an extensible repository to generate quick- start projects. It provides a ready-to-deploy 12 factor reactive application that contains all the levels of testing (unit, integration, acceptance, CDC, etc.) a complete SDLC pipeline with built in quality, security & compliance gates. It deploys to multiple cloud targets with zero downtime, observability is built in with pre-configured SLO and SLI dashboards - among many other features.
- 19. Go local
- 21. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Operational eXcellence
- 22. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Outcomes • Customer focused metrics • Minimize time to repair • Remove developer toil • Resiliency & scale
- 23. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Noise
- 24. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ SLx focus Codify best practices The 3 pillars – logs, metrics & tracing Blameless postmortems Chaos engineering Meeting the challenge
- 25. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Above the value line
- 26. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Pipeline strategies
- 27. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 2 7 Be opinionated!
- 28. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 2 8 Pipeline Gates 28 Unit Test Code quality Gate Build Functional Validation Compliance Gate Build Verification Deploy Release Regression Testing Performance Testing Acceptance Testing Pipelines are an orchestration of stages to build, verify, release and deploy applications. Artifact Management Gate Detective Controls Audit Compliance Reports Operations & Monitoring Finger print Deploy Gate Chaos Eng Compliance Gate Deploy Strategies Dynamic Security Gate Static Analysis Security Gate Change mgmt Gate Continuous Integration Continuous Delivery Continuous Deployment Continuous Audit, Verification, Operation & Monitoring
- 29. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Outcomes • Accelerate adoption • Focus on transformation • Remove complexity • Maximize reuse • Measurement
- 30. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ • Narrow stack • Targets narrow cohort • Version control • Flexibility Challenges
- 31. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 3 1 I’m already there!
- 32. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 3 2 Pipeline Gates 32 Continuous Integration Continuous Delivery Continuous Deployment Unit Test Code quality Gate Build Functional Validation Compliance Gate Build Verification Deploy Release Regression Testing Performance Testing Acceptance Testing Pipelines are an orchestration of stages to build, verify, release and deploy applications. Continuous Audit, Verification, Operation & Monitoring Artifact Management Gate Detective Controls Audit Compliance Reports Operations & Monitoring Finger print Deploy Gate Chaos Eng Compliance Gate Deploy Strategies Dynamic Security Gate Static Analysis Security Gate Change mgmt Gate Focus
- 33. Challenges • Wide variety of workloads • End to end integration • Closing the gate
- 34. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Implementing automation for scale
- 35. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Mission Accelerate our automation the same way we accelerate application development
- 36. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Outcomes • High performance • Testable • Modern software architecture • Modern programming languages • Observable • Accelerated code reuse
- 37. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Scripting • Hard to test, debug • Scripts don’t scale • Poor SDLC support • Difficult to reuse • Fully opinionated approach
- 38. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Shared Library • Orchestrator dependent • monolithic-like • Difficult to version • Hand-written documentation • Complex to release
- 39. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ • Microservices-like approach • Accelerate reuse • Better performance • Versioning enhancements Evolution
- 40. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ API first • Orchestrator agnostic • Fully observable • Easy to scale • Testability • Auto-generated documentation
- 41. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Speed of Cloud
- 42. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Tech Stacks Tech stacks
- 43. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Freedom to Teams for Acceleration • Freedom and responsibility • Cultivate freedom within a framework • Self empowerment and autonomy within the enterprise blueprints • Built-in safety and security for scale
- 44. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Modern Application Development • Modern applications • Modern architectures • Modern platforms • Modern security
- 45. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Security Defensive Controls Detective ControlsPreventative Controls Automate, Automate & Automate
- 46. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Technology and innovation to drive and enable the business
- 47. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Technology Playground • Technology for technology’s sake • Focusing on the organization’s needs • Owning the cost • Finding the right balance • “Confirmation bias”
- 48. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Technology Sprawl & Complexity Just like urban sprawl makes travel less efficient technology sprawl makes speed of delivery less efficient Frictionless Ecosystem Commoditization & Centralization Inner-source Collaboration
- 49. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Technology Choice Tongue in Cheek
- 50. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Its not a technology problem “Not Invented Here Syndrome” “Let's Re-invent the Wheel Syndrome”
- 51. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Culture
- 52. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Cultural Transformation • Grasp the importance of speed and agility • Creating a culture of ownership • Innovation for increasing value
- 53. Building a culture of innovation Start with the customers and ultimately delight your customers Remove any obstacles that slow the process of building and releasing products Live and breathe innovation in all areas
- 54. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Challenges • Time • Never completing • Competing priorities • Innovation fatigue
- 55. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Continuous Improvement What’s Next? How to?
- 56. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
- 57. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ • Software engineeringX L&D program • Contextualized hands-on-labs • Code-a-thons • Learning days Culture of Continuous Learning & Improving
- 58. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Challenges • In work versus at Home • What and where to focus • Do I get to apply learning • Learning for the sake of learning
- 59. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ People Process Technology
- 60. Unless otherwise indicated, these slides are © 2013-2019 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Thank you