SlideShare a Scribd company logo
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure
Nicolas Brousse | Director of Engineering, Operations
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Increased Complexity and Faster Changes
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Immutable or Mutable?
3
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Tesla remotely extends range of vehicles for free in
Florida to help owners escape Hurricane Irma
4
Source: Electrek.co
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Tesla Over-The-Air Software Update
5
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Any connected device need to handle updates
6
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Connected Home gets more sophisticated
7
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Likewise Enterprises Infrastructure Complexity increase
8
β€’ IaaS / PaaS (AWS, Azure, GCP, IBM, Oracle…)
β€’ Cloud Productivity Apps (G Suite, Office 365, AWS...)
β€’ CRM
β€’ Private Cloud (OpenStack, VMware...)
β€’ Containers Orchestration (K8s, Mesos, Swarm, Nomad...)
β€’ Bare-metal servers, mainframes (IBM Z 2017)
β€’ Edge Computing
β€’ Quantum Annealer (D-Wave)
Next Quantum Computers?
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 9
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Patching (very) quickly matters
10
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
The Adobe Advertising Cloud
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Technical Challenges
12
Latency Requirement
<50ms @ 95th percentile
High Volume Traffic
+100 billions request a day
Huge Datasets
billions of object to store
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
> 6,000 servers
> 10,000 Puppet code deployments a year
> 40,000 Application deployments a year
1 Puppet Master
13
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 14
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Bare-metal Infrastructure Automation
Fully automated deployment
Rack-And-Roll Infrastructure
Puppet Hiera and eYAML
15
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Bare-metal Infrastructure Automation – Rack…
16
Buy Build
Burn
Test
ShipRack, Bolt, Powered onConnect to Network
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
And Roll…
17
Jenkins API TFTP PXE boot API puppet
Log centralization Monitoring and Metrics IdM & IDS
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Containers Environments
18
git jenkins
docker
terraform puppet K8s
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Cloud Bursting
19
git
jenkins
terraform
puppet
puppet
jenkins
Application DeploymentInfrastructure Deployment
git
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Final word
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Configuration Management is not dead
It’s complicated and diverse
21
Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Key Take Aways
Β§ Acknowledge the reality of complex infrastructure in the enterprise world
Β§ Understand your Infrastructures models
Β§ Strongly Immutable
Β§ Weakly Immutable
Β§ Mutable
Β§ Prevent and detect configuration drift + allow patching
Β§ Holistic understanding of your product lifecycle
Β§ Infrastructure As Code (multiple tools involved)
Β§ Feature Toggles
Β§ Beta Percentage Rollout
Β§ Blue / Green Deployments
Β§ Mean Time to Release Changes at scale
22
@AdobeAdCloud @orieg

More Related Content

PDF
NetApp Hybrid Cloud with OpenNebula
PPTX
DockerCon17 Recap
PDF
Big data on google cloud
PDF
Docker Seattle Meetup, May 2017
PPTX
Real World Modern Development Use Cases with RackHD and Adobe
PDF
Introduction to IAC and Terraform
PDF
Amazon EKS - Aws community day bengaluru 2019
PDF
Berlioz Introduction
NetApp Hybrid Cloud with OpenNebula
DockerCon17 Recap
Big data on google cloud
Docker Seattle Meetup, May 2017
Real World Modern Development Use Cases with RackHD and Adobe
Introduction to IAC and Terraform
Amazon EKS - Aws community day bengaluru 2019
Berlioz Introduction

What's hot (20)

PDF
Evolution of container orchestration in Alibaba Cloud
Β 
PPTX
Multicloud
PDF
AWS re:Invent 2016 Fast Forward
PDF
Getting Started with Google Cloud Platform
PDF
Replacing vCloud with OpenNebula
PDF
Ultimate kubernetes platform on aws with eks
PPTX
Global azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasad
PPTX
Crash Course in Cloud Computing
PDF
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
PPTX
AWS EKS Security Best Practices
PPTX
Application Centric DevOps
PDF
How we manage thousands of clusters with minimal effort
PPTX
Blue green deployment
PPTX
How to Architect AWS for Mission-Critical Applications
PDF
OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...
PPTX
Introduction to Cloudify for OpenStack users
PPTX
Cloud Computing - Why it is so popular
PPTX
Is Orchestration the Next Big Thing in DevOps
PDF
Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018
PPTX
Introduction to testing in Cloud / AWS
Evolution of container orchestration in Alibaba Cloud
Β 
Multicloud
AWS re:Invent 2016 Fast Forward
Getting Started with Google Cloud Platform
Replacing vCloud with OpenNebula
Ultimate kubernetes platform on aws with eks
Global azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasad
Crash Course in Cloud Computing
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
AWS EKS Security Best Practices
Application Centric DevOps
How we manage thousands of clusters with minimal effort
Blue green deployment
How to Architect AWS for Mission-Critical Applications
OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...
Introduction to Cloudify for OpenStack users
Cloud Computing - Why it is so popular
Is Orchestration the Next Big Thing in DevOps
Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018
Introduction to testing in Cloud / AWS
Ad

Similar to PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure (20)

PPTX
End User Computing with NetApp
Β 
PDF
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
PPTX
Innovations fueled by IoT and the Cloud
PDF
Microprofile at IBM with Liberty
PDF
Cisco Connect 2018 Singapore - Next generation hyperconverged infrastructure
PDF
Journey to the Modern App with Containers, Microservices and Big Data
PDF
Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...
PDF
DevOps@Scale- IBM Cloud and NetAp-Insight-Berlin
PPTX
Operating Kubernetes at Scale (Australia Presentation)
PDF
Cisco connect montreal 2018 vision mondiale analyse locale
PDF
Automated Software Modernization
PDF
Libera la potenza del Machine Learning
PPTX
AEM DataLayer IMMERSE 2017 Presentation by Dan Klco
PDF
S903 palla
PPTX
Bridging Your Business Across the Enterprise and Cloud with MongoDB and NetApp
PPTX
Instantaneous Replication of Build Artifacts with NetApp
Β 
PPTX
Cisco connect winnipeg 2018 we make it simple
PDF
Improving Adobe Experience Cloud Services Dependability with Machine Learning
PPTX
Webinar: End-to-End CI/CD with GitLab and DC/OS
PDF
[AWS Media Symposium 2019] Perfecting the Media Experience with AWS - Bhavik ...
End User Computing with NetApp
Β 
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Innovations fueled by IoT and the Cloud
Microprofile at IBM with Liberty
Cisco Connect 2018 Singapore - Next generation hyperconverged infrastructure
Journey to the Modern App with Containers, Microservices and Big Data
Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...
DevOps@Scale- IBM Cloud and NetAp-Insight-Berlin
Operating Kubernetes at Scale (Australia Presentation)
Cisco connect montreal 2018 vision mondiale analyse locale
Automated Software Modernization
Libera la potenza del Machine Learning
AEM DataLayer IMMERSE 2017 Presentation by Dan Klco
S903 palla
Bridging Your Business Across the Enterprise and Cloud with MongoDB and NetApp
Instantaneous Replication of Build Artifacts with NetApp
Β 
Cisco connect winnipeg 2018 we make it simple
Improving Adobe Experience Cloud Services Dependability with Machine Learning
Webinar: End-to-End CI/CD with GitLab and DC/OS
[AWS Media Symposium 2019] Perfecting the Media Experience with AWS - Bhavik ...
Ad

More from Nicolas Brousse (11)

PPTX
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
PDF
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
PDF
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
PDF
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
PDF
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
PPTX
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
PDF
Improving Operations Efficiency with Puppet
PDF
Scaling Bleeding Edge Technology in a Fast-paced Environment
PDF
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
PDF
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
PDF
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Improving Operations Efficiency with Puppet
Scaling Bleeding Edge Technology in a Fast-paced Environment
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...

Recently uploaded (20)

PDF
How to Ensure Data Integrity During Shopify Migration_ Best Practices for Sec...
PDF
Cloud-Scale Log Monitoring _ Datadog.pdf
PPTX
522797556-Unit-2-Temperature-measurement-1-1.pptx
PPTX
Internet___Basics___Styled_ presentation
PPTX
Funds Management Learning Material for Beg
PPTX
Introuction about ICD -10 and ICD-11 PPT.pptx
PPTX
Introduction to Information and Communication Technology
PDF
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
Β 
DOCX
Unit-3 cyber security network security of internet system
PPTX
June-4-Sermon-Powerpoint.pptx USE THIS FOR YOUR MOTIVATION
PPTX
Power Point - Lesson 3_2.pptx grad school presentation
Β 
PPTX
Digital Literacy And Online Safety on internet
PDF
πŸ’° π”πŠπ“πˆ πŠπ„πŒπ„ππ€ππ†π€π πŠπˆππ„π‘πŸ’πƒ π‡π€π‘πˆ 𝐈𝐍𝐈 πŸπŸŽπŸπŸ“ πŸ’°
Β 
PPTX
artificial intelligence overview of it and more
PDF
RPKI Status Update, presented by Makito Lay at IDNOG 10
Β 
PPT
Design_with_Watersergyerge45hrbgre4top (1).ppt
PDF
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
PDF
SASE Traffic Flow - ZTNA Connector-1.pdf
PDF
WebRTC in SignalWire - troubleshooting media negotiation
PPT
tcp ip networks nd ip layering assotred slides
How to Ensure Data Integrity During Shopify Migration_ Best Practices for Sec...
Cloud-Scale Log Monitoring _ Datadog.pdf
522797556-Unit-2-Temperature-measurement-1-1.pptx
Internet___Basics___Styled_ presentation
Funds Management Learning Material for Beg
Introuction about ICD -10 and ICD-11 PPT.pptx
Introduction to Information and Communication Technology
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
Β 
Unit-3 cyber security network security of internet system
June-4-Sermon-Powerpoint.pptx USE THIS FOR YOUR MOTIVATION
Power Point - Lesson 3_2.pptx grad school presentation
Β 
Digital Literacy And Online Safety on internet
πŸ’° π”πŠπ“πˆ πŠπ„πŒπ„ππ€ππ†π€π πŠπˆππ„π‘πŸ’πƒ π‡π€π‘πˆ 𝐈𝐍𝐈 πŸπŸŽπŸπŸ“ πŸ’°
Β 
artificial intelligence overview of it and more
RPKI Status Update, presented by Makito Lay at IDNOG 10
Β 
Design_with_Watersergyerge45hrbgre4top (1).ppt
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
SASE Traffic Flow - ZTNA Connector-1.pdf
WebRTC in SignalWire - troubleshooting media negotiation
tcp ip networks nd ip layering assotred slides

PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure

  • 1. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure Nicolas Brousse | Director of Engineering, Operations
  • 2. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Increased Complexity and Faster Changes
  • 3. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Immutable or Mutable? 3
  • 4. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Tesla remotely extends range of vehicles for free in Florida to help owners escape Hurricane Irma 4 Source: Electrek.co
  • 5. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Tesla Over-The-Air Software Update 5
  • 6. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Any connected device need to handle updates 6
  • 7. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Connected Home gets more sophisticated 7
  • 8. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Likewise Enterprises Infrastructure Complexity increase 8 β€’ IaaS / PaaS (AWS, Azure, GCP, IBM, Oracle…) β€’ Cloud Productivity Apps (G Suite, Office 365, AWS...) β€’ CRM β€’ Private Cloud (OpenStack, VMware...) β€’ Containers Orchestration (K8s, Mesos, Swarm, Nomad...) β€’ Bare-metal servers, mainframes (IBM Z 2017) β€’ Edge Computing β€’ Quantum Annealer (D-Wave) Next Quantum Computers?
  • 9. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 9
  • 10. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Patching (very) quickly matters 10
  • 11. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. The Adobe Advertising Cloud
  • 12. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Technical Challenges 12 Latency Requirement <50ms @ 95th percentile High Volume Traffic +100 billions request a day Huge Datasets billions of object to store
  • 13. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. > 6,000 servers > 10,000 Puppet code deployments a year > 40,000 Application deployments a year 1 Puppet Master 13
  • 14. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 14
  • 15. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Bare-metal Infrastructure Automation Fully automated deployment Rack-And-Roll Infrastructure Puppet Hiera and eYAML 15
  • 16. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Bare-metal Infrastructure Automation – Rack… 16 Buy Build Burn Test ShipRack, Bolt, Powered onConnect to Network
  • 17. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. And Roll… 17 Jenkins API TFTP PXE boot API puppet Log centralization Monitoring and Metrics IdM & IDS
  • 18. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Containers Environments 18 git jenkins docker terraform puppet K8s
  • 19. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Cloud Bursting 19 git jenkins terraform puppet puppet jenkins Application DeploymentInfrastructure Deployment git
  • 20. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Final word
  • 21. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Configuration Management is not dead It’s complicated and diverse 21
  • 22. Β© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Key Take Aways Β§ Acknowledge the reality of complex infrastructure in the enterprise world Β§ Understand your Infrastructures models Β§ Strongly Immutable Β§ Weakly Immutable Β§ Mutable Β§ Prevent and detect configuration drift + allow patching Β§ Holistic understanding of your product lifecycle Β§ Infrastructure As Code (multiple tools involved) Β§ Feature Toggles Β§ Beta Percentage Rollout Β§ Blue / Green Deployments Β§ Mean Time to Release Changes at scale 22