SlideShare a Scribd company logo
Putting the “DOT” in .NET
DOT = Dev, Ops and Test
Agenda
This is a tour – high level, introductions to options
What is DevOps?
Azure Virtual Machines & Web Sites
Team Rooms
Work Items
Source Control
Build & CI
Test Manager
Cloud Testing
AppInsights
Feedback Client
Release Management
Testers don’t hate me
In most orgs: testers currently sit under ops or dev
I am not ignoring you when I only mention on those two areas
Why DevOps?
Production
Backlog
Development
👯
👱
👷
👮
Production
Backlog
Development
👯
👱
👷
👮
Works on my
machine
We can only
simulate 1/10th
the load
We’ll have
servers next year
How do I deploy
this?
Can I log onto
production?
How do we turn
logs on?
No one touches
my servers
Logs?!
QA is just like
production BUT
It doesn’t work
OPS IS SLOWING
US DOWN
DEV IS
CONSTANTLY
BREAKING
THINGS
NO ONE IS
FIXING THESE
ISSUES
Isn’t agile
supposed make
us faster?
My crystal ball
tells me
customers want…
Top Predictors of IT Performance
Version Control All Production Artifacts
Continuous integration and deployment
Automated acceptance testing
Peer-review of production changes
High trust culture
Proactive monitoring of production environment
Win-Win relationship between dev & ops
High job satisfaction
Source: Puppet Labs State of DevOps
What is DevOps?
DevOps: the three stage conversation
What is DevOps?
“Second decade of agile” - Sam Guckenheimer
Requires: A shift in how we think about responsibilities, collaborations & a
single life cycle end to end & high trust culture
This is not single target – DevOps is a journey of constant build, measure,
learn
Production
Backlog
Development
👯
👱
👷
👮
Myths
This is for web only technologies & not for apps, desktop programs (.exe),
servers
Ops needs to learn to code for DevOps
Devs need to learn networks & servers
We need to hire DevOps/create a DevOps team
Our compliance (ITIL, PCI) or regulations will prevent this
Our dev is outsourced, so we can’t use it
DevOps can’t scale
DevOps means daily changes – our users will hate us
“DOT” + Azure
Hard to be agile with this…
Azure
Azure is MASSIVE & continuing to grow
Run your code
Store your data
Build virtual networks
Authenticate your users
Leverage our application services
Free ebook:
Microsoft Azure Essentials: Fundamentals of Azure
http://bit.ly/azureEssentials
1
SETTINGS
1
ADD-ONS2
2
ACTIVE DIRECTORY
0
MANAGEMENT SERVICES
0
TRAFFIC MANAGER
0
NETWORKS
1
SQL REPORTING
0
BIZTALK SERVICES
1
SERVICE BUS
1
MEDIA SERVICES
0
HDINSIGHT
9
STORAGE
11
SQL DATABASES
7
CLOUD SERVICES
10
MOBILE SERVICES
2
VIRTUAL MACHINES
7
WEB SITES
ALL ITEMS
Azure VM’s & Websites
Demo
Azure VM’s & Websites
Ability to easily run your code
WebJobs let you run headless code
Easy scale – scale & time to get up and running is really important for a
healthy DevOps culture
Providing the dashboards that DevOps teams need
Providing the ability automate the process (scripting, config)
Azure Pack: Similar functionality for your data centre
“DOT” + VSO
Team Rooms
Demo
Team Rooms
Enable communication & Foster collaboration
Used by entire team: Dev + Ops + Test
Build a history specific to your needs
Work Items
Demo
Work Items
Capture your work items in your way
Kanban style boards
Single version of the truth across the business
Source Control
Demo
Source Control
TFVC (client/server) & Git (DVCS)
Can edit online – great for a quick fix
Multiple Git repos – allowing everyone to use one project
Proper Git pull request support
Supports review workflow
Continuous Integration (CI)
One button from source to prod
Deployment is hard: if it is hard, DO IT MORE.
“Can’t deploy this month, Andrew is at another client”: The risk in having an
Andrew needs to be lowered
Quicker turn around
• Flickr 10x a day
• AppFactory turn around in 30min by intern
Build & CI
Demo
Build & CI
The longer time between deployments, the greater the risk of failure
Moving from hard to predictable
Removing dependencies & lowering risk
Configuration as a form of documentation
Putting the DOT in .NET - Dev/Ops/Test
Test Manager
Demo
Test Manager
Giving testers the tools they need
Feeding into the single version of the truth
Cloud Testing
Demo
Cloud Testing
Ability to build. Experiment & run locally
Run in the cloud for scale – great hybrid cloud scenario
AppInsights
Demo
Putting the DOT in .NET - Dev/Ops/Test
Putting the DOT in .NET - Dev/Ops/Test
Putting the DOT in .NET - Dev/Ops/Test
AppInsights
Enables: Build, measure, learn
AppInsights makes getting information easily
Stack traces & usage info
Role based access in portal
Works with JavaScript, ASP.NET, Java, Desktop, Store, Phone & Universal Apps
- everything
Feedback client
Demo
Putting the DOT in .NET - Dev/Ops/Test
Feedback client
The further the distance between the person requesting the work & the
person doing the work, the greater the risk of failure.
Ensure the iterative cycle is end to end
Single version of the truth
Actionable feedback
Putting the DOT in .NET - Dev/Ops/Test
Release Management
TFS Drop Location
RM DesktopRM Web
QA
DEV
RM Server
How it Works
Stage Stack
Wrapping up
Top Predictors of IT Performance
Version Control All Production Artifacts: VSO/TFS Version Control
Continuous integration and deployment: Build & CI, Virtualisation/Cloud
Automated acceptance testing: MTM, We/Load Test & Feedback Client, Cloud
Peer-review of production changes: Feedback Client, Version Control, Feedback Client
High trust culture: Work items (single view of the truth), team room, role based access
Proactive monitoring of production environment: AppInsights
Win-Win relationship between dev & ops: AppInsights, Cloud
High job satisfaction: Work with me 
Source: Puppet Labs State of DevOps
More?
DevOps Blog: http://aka.ms/DevOpsBlog
Improving your DevOps: http://aka.ms/DevOpsCapab
Me: @rmaclean | www.sadev.co.za

More Related Content

PPTX
LightSwitch
PPTX
PPTX
The state of testing @ Microsoft
PPTX
Visual Studio ❤ JavaScript
PPTX
Mercurial
PPTX
Windows Store Apps: Tips & Tricks
PPTX
Office Add-ins community call-June 2020
PPTX
What's new in ALM using Visual Studio 2013 and Team Foundation Service
LightSwitch
The state of testing @ Microsoft
Visual Studio ❤ JavaScript
Mercurial
Windows Store Apps: Tips & Tricks
Office Add-ins community call-June 2020
What's new in ALM using Visual Studio 2013 and Team Foundation Service

What's hot (19)

PPTX
Build 2017 - B8033 - Give your conversations superpowers: Building intelligen...
PPTX
ASP.NET 5 Overview for Apex Systems
PPTX
Build 2017 - B8083 - The future of Visual Studio
PPTX
PPTX
ASP.NET 5 & Unit Testing
PPTX
Test at Scale within your Internal Networks with BrowserStack Local Testing
PPTX
ASP.NET Core 1.0 Overview: Pre-RC2
PPTX
#SPSBrussels 2017 vincent biret #azure #functions microsoft #flow
PPTX
Capture the Cloud with Azure
PPTX
Introducing Visual Studio Online
PPTX
Visual studio 2017 - Launch Event Keynote
PPTX
Tech Days 2015 continuous delivery med azure och visual studio online
PPTX
Build 2017 - B8013 - Developing on Windows Server: Innovation for today and t...
PPTX
What's New at Microsoft?
PPTX
SenchaCon 2016: Cross-Platform Mobile App Development with Cordova and Visual...
PPTX
How to Win #BestMicrosoftHack with Azure
PPTX
What’s new in Visual Studio 2012 & .NET 4.5
PPTX
SharePoint Framework
PDF
Sexy React Stack
Build 2017 - B8033 - Give your conversations superpowers: Building intelligen...
ASP.NET 5 Overview for Apex Systems
Build 2017 - B8083 - The future of Visual Studio
ASP.NET 5 & Unit Testing
Test at Scale within your Internal Networks with BrowserStack Local Testing
ASP.NET Core 1.0 Overview: Pre-RC2
#SPSBrussels 2017 vincent biret #azure #functions microsoft #flow
Capture the Cloud with Azure
Introducing Visual Studio Online
Visual studio 2017 - Launch Event Keynote
Tech Days 2015 continuous delivery med azure och visual studio online
Build 2017 - B8013 - Developing on Windows Server: Innovation for today and t...
What's New at Microsoft?
SenchaCon 2016: Cross-Platform Mobile App Development with Cordova and Visual...
How to Win #BestMicrosoftHack with Azure
What’s new in Visual Studio 2012 & .NET 4.5
SharePoint Framework
Sexy React Stack
Ad

Viewers also liked (6)

PPTX
What is new in C# 6?
PPTX
DevConf Survival Guide
PPTX
Open Source Licensing
PPTX
JavaScript Toolkit
PPTX
Protection of Personal Information Bill (POPI)
PPTX
How to give a great presentation
What is new in C# 6?
DevConf Survival Guide
Open Source Licensing
JavaScript Toolkit
Protection of Personal Information Bill (POPI)
How to give a great presentation
Ad

Similar to Putting the DOT in .NET - Dev/Ops/Test (20)

PDF
Ontwikkelstraat in de Cloud: ALM en Azure een krachtige combinatie
PDF
Let's banish "it works on my machine"
PPTX
Visual Studio 2015 - Lançamento está próximo
PPTX
Demystifying Azure Compute
PPTX
Dockercon 2019 Developing Apps with Containers, Functions and Cloud Services
PDF
DCSF 19 Developing Apps with Containers, Functions and Cloud Services
PPTX
Capture the Cloud with Azure
PDF
AWS DevOps Guide and Best Practices Presentation.pdf
PPTX
MLOps with Azure DevOps
PPTX
FEDSPUG April 2014: Visual Studio 2013 for Application Lifecycle Management &...
PPTX
Scalable APIs with Azure Functions
PPTX
DevOps and Microservice
PPTX
Azure DevOps työkalut - Roundtable 14.3.2019
PPTX
Azure: PaaS or IaaS
PPTX
Serverless on Azure with Functions
PPTX
Business model driven cloud adoption - what NI is doing in the cloud
PPTX
Visual Studio | Lanzamiento VS2017 en Buenos Aires - 11/03/2017
PPTX
Microsoft DevOps Solution - DevOps
PDF
ALM on the shoulders of Giants - Visual Studio Online
PPTX
Serverless architecture with Azure
Ontwikkelstraat in de Cloud: ALM en Azure een krachtige combinatie
Let's banish "it works on my machine"
Visual Studio 2015 - Lançamento está próximo
Demystifying Azure Compute
Dockercon 2019 Developing Apps with Containers, Functions and Cloud Services
DCSF 19 Developing Apps with Containers, Functions and Cloud Services
Capture the Cloud with Azure
AWS DevOps Guide and Best Practices Presentation.pdf
MLOps with Azure DevOps
FEDSPUG April 2014: Visual Studio 2013 for Application Lifecycle Management &...
Scalable APIs with Azure Functions
DevOps and Microservice
Azure DevOps työkalut - Roundtable 14.3.2019
Azure: PaaS or IaaS
Serverless on Azure with Functions
Business model driven cloud adoption - what NI is doing in the cloud
Visual Studio | Lanzamiento VS2017 en Buenos Aires - 11/03/2017
Microsoft DevOps Solution - DevOps
ALM on the shoulders of Giants - Visual Studio Online
Serverless architecture with Azure

More from Robert MacLean (18)

PPTX
Deno ...................................
PPTX
14 things you need to be a successful software developer (v3)
PPTX
OWASP TOP 10
PPTX
Building a µservice with Kotlin, Micronaut & GCP
PPTX
Looking at the Vue
PPTX
Kotlin 101
PPTX
Features of Kotlin I find exciting
PPTX
JavaScript Gotchas
PPTX
A Developer Day 2014 - Durban
PPTX
Agile lessons learned in the Microsoft ALM Rangers
PPTX
Hour of code - Train the trainer
PPTX
Building services for apps on a shoestring budget
PPTX
3 things your app API is doing WRONG
PPTX
How to build a Mobile API or HTML 5 app in 5 minutes
PPTX
Visual Studio: The best tool for web developers.
PPTX
What’s new in LightSwitch 2013?
PPTX
Techdays 2012 - What is new in .NET 4.5 & Visual Studio 2012
Deno ...................................
14 things you need to be a successful software developer (v3)
OWASP TOP 10
Building a µservice with Kotlin, Micronaut & GCP
Looking at the Vue
Kotlin 101
Features of Kotlin I find exciting
JavaScript Gotchas
A Developer Day 2014 - Durban
Agile lessons learned in the Microsoft ALM Rangers
Hour of code - Train the trainer
Building services for apps on a shoestring budget
3 things your app API is doing WRONG
How to build a Mobile API or HTML 5 app in 5 minutes
Visual Studio: The best tool for web developers.
What’s new in LightSwitch 2013?
Techdays 2012 - What is new in .NET 4.5 & Visual Studio 2012

Recently uploaded (20)

PDF
Softaken Excel to vCard Converter Software.pdf
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 41
PPT
Introduction Database Management System for Course Database
PDF
PTS Company Brochure 2025 (1).pdf.......
PDF
How to Migrate SBCGlobal Email to Yahoo Easily
PPTX
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
PPTX
Transform Your Business with a Software ERP System
PDF
Odoo Companies in India – Driving Business Transformation.pdf
PDF
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
PPTX
L1 - Introduction to python Backend.pptx
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
PPTX
ai tools demonstartion for schools and inter college
PPTX
ISO 45001 Occupational Health and Safety Management System
PPTX
Online Work Permit System for Fast Permit Processing
PDF
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
PPTX
Operating system designcfffgfgggggggvggggggggg
PDF
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
PPTX
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
PPTX
history of c programming in notes for students .pptx
Softaken Excel to vCard Converter Software.pdf
Internet Downloader Manager (IDM) Crack 6.42 Build 41
Introduction Database Management System for Course Database
PTS Company Brochure 2025 (1).pdf.......
How to Migrate SBCGlobal Email to Yahoo Easily
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
Transform Your Business with a Software ERP System
Odoo Companies in India – Driving Business Transformation.pdf
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
VVF-Customer-Presentation2025-Ver1.9.pptx
L1 - Introduction to python Backend.pptx
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
ai tools demonstartion for schools and inter college
ISO 45001 Occupational Health and Safety Management System
Online Work Permit System for Fast Permit Processing
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
Operating system designcfffgfgggggggvggggggggg
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
history of c programming in notes for students .pptx

Putting the DOT in .NET - Dev/Ops/Test

  • 1. Putting the “DOT” in .NET DOT = Dev, Ops and Test
  • 2. Agenda This is a tour – high level, introductions to options What is DevOps? Azure Virtual Machines & Web Sites Team Rooms Work Items Source Control Build & CI Test Manager Cloud Testing AppInsights Feedback Client Release Management
  • 3. Testers don’t hate me In most orgs: testers currently sit under ops or dev I am not ignoring you when I only mention on those two areas
  • 6. Production Backlog Development 👯 👱 👷 👮 Works on my machine We can only simulate 1/10th the load We’ll have servers next year How do I deploy this? Can I log onto production? How do we turn logs on? No one touches my servers Logs?! QA is just like production BUT It doesn’t work OPS IS SLOWING US DOWN DEV IS CONSTANTLY BREAKING THINGS NO ONE IS FIXING THESE ISSUES Isn’t agile supposed make us faster? My crystal ball tells me customers want…
  • 7. Top Predictors of IT Performance Version Control All Production Artifacts Continuous integration and deployment Automated acceptance testing Peer-review of production changes High trust culture Proactive monitoring of production environment Win-Win relationship between dev & ops High job satisfaction Source: Puppet Labs State of DevOps
  • 9. DevOps: the three stage conversation
  • 10. What is DevOps? “Second decade of agile” - Sam Guckenheimer Requires: A shift in how we think about responsibilities, collaborations & a single life cycle end to end & high trust culture This is not single target – DevOps is a journey of constant build, measure, learn
  • 12. Myths This is for web only technologies & not for apps, desktop programs (.exe), servers Ops needs to learn to code for DevOps Devs need to learn networks & servers We need to hire DevOps/create a DevOps team Our compliance (ITIL, PCI) or regulations will prevent this Our dev is outsourced, so we can’t use it DevOps can’t scale DevOps means daily changes – our users will hate us
  • 14. Hard to be agile with this…
  • 15. Azure Azure is MASSIVE & continuing to grow Run your code Store your data Build virtual networks Authenticate your users Leverage our application services Free ebook: Microsoft Azure Essentials: Fundamentals of Azure http://bit.ly/azureEssentials 1 SETTINGS 1 ADD-ONS2 2 ACTIVE DIRECTORY 0 MANAGEMENT SERVICES 0 TRAFFIC MANAGER 0 NETWORKS 1 SQL REPORTING 0 BIZTALK SERVICES 1 SERVICE BUS 1 MEDIA SERVICES 0 HDINSIGHT 9 STORAGE 11 SQL DATABASES 7 CLOUD SERVICES 10 MOBILE SERVICES 2 VIRTUAL MACHINES 7 WEB SITES ALL ITEMS
  • 16. Azure VM’s & Websites Demo
  • 17. Azure VM’s & Websites Ability to easily run your code WebJobs let you run headless code Easy scale – scale & time to get up and running is really important for a healthy DevOps culture Providing the dashboards that DevOps teams need Providing the ability automate the process (scripting, config) Azure Pack: Similar functionality for your data centre
  • 20. Team Rooms Enable communication & Foster collaboration Used by entire team: Dev + Ops + Test Build a history specific to your needs
  • 22. Work Items Capture your work items in your way Kanban style boards Single version of the truth across the business
  • 24. Source Control TFVC (client/server) & Git (DVCS) Can edit online – great for a quick fix Multiple Git repos – allowing everyone to use one project Proper Git pull request support Supports review workflow
  • 25. Continuous Integration (CI) One button from source to prod Deployment is hard: if it is hard, DO IT MORE. “Can’t deploy this month, Andrew is at another client”: The risk in having an Andrew needs to be lowered Quicker turn around • Flickr 10x a day • AppFactory turn around in 30min by intern
  • 27. Build & CI The longer time between deployments, the greater the risk of failure Moving from hard to predictable Removing dependencies & lowering risk Configuration as a form of documentation
  • 30. Test Manager Giving testers the tools they need Feeding into the single version of the truth
  • 32. Cloud Testing Ability to build. Experiment & run locally Run in the cloud for scale – great hybrid cloud scenario
  • 37. AppInsights Enables: Build, measure, learn AppInsights makes getting information easily Stack traces & usage info Role based access in portal Works with JavaScript, ASP.NET, Java, Desktop, Store, Phone & Universal Apps - everything
  • 40. Feedback client The further the distance between the person requesting the work & the person doing the work, the greater the risk of failure. Ensure the iterative cycle is end to end Single version of the truth Actionable feedback
  • 43. TFS Drop Location RM DesktopRM Web QA DEV RM Server How it Works
  • 46. Top Predictors of IT Performance Version Control All Production Artifacts: VSO/TFS Version Control Continuous integration and deployment: Build & CI, Virtualisation/Cloud Automated acceptance testing: MTM, We/Load Test & Feedback Client, Cloud Peer-review of production changes: Feedback Client, Version Control, Feedback Client High trust culture: Work items (single view of the truth), team room, role based access Proactive monitoring of production environment: AppInsights Win-Win relationship between dev & ops: AppInsights, Cloud High job satisfaction: Work with me  Source: Puppet Labs State of DevOps
  • 47. More? DevOps Blog: http://aka.ms/DevOpsBlog Improving your DevOps: http://aka.ms/DevOpsCapab Me: @rmaclean | www.sadev.co.za

Editor's Notes

  • #6: What is driving DevOps? The agile methodologies are accelerating the construction process and creating a significant pressure to Operations teams to update their existing practices to make enable faster cadence, in other words changing and adopting existing process to not only be reliable but also support and agile cadence. In our internal teams and with some of our enterprise customers we noticed that once a team is able to accelerate the construction phase consistently. The next evolution process is to ensure such applications remind available and performing as expected. And when they aren’t having access to information and tools that allow both Operations and development teams to diagnostic and fix issues quickly. Then these teams become more sophisticated and mature and then they want to have access to customer usage information to use quantitative and qualitative data to help them determine the next set of investments and enable continuous learning.
  • #7: What is driving DevOps? The agile methodologies are accelerating the construction process and creating a significant pressure to Operations teams to update their existing practices to make enable faster cadence, in other words changing and adopting existing process to not only be reliable but also support and agile cadence. In our internal teams and with some of our enterprise customers we noticed that once a team is able to accelerate the construction phase consistently. The next evolution process is to ensure such applications remind available and performing as expected. And when they aren’t having access to information and tools that allow both Operations and development teams to diagnostic and fix issues quickly. Then these teams become more sophisticated and mature and then they want to have access to customer usage information to use quantitative and qualitative data to help them determine the next set of investments and enable continuous learning.
  • #10: People = Culture Fundamental attributes of successful cultures: Shared mission and incentives: infrastructure as code, apps as services, DevOps/all as teams You need to consider your hardware as a commodity, (don't give your servers names) , servers are like farm animals, it is just harder if you let theids name them Build deep instrumentation into services, push complexity up the stack Rally around agile, shared metrics, CI, service owners on call, etc. Changing the culture: any change takes time, changing culture is no exception and you can't do it alone, exploit compelling events to change culture: downtimes, cloud adoption, devops buzz PROCESS Definition and design, compliance, and continuous improvement PEOPLE Responsibilities, management, skills development, and discipline Products Tools and infrastructure
  • #12: What is driving DevOps? The agile methodologies are accelerating the construction process and creating a significant pressure to Operations teams to update their existing practices to make enable faster cadence, in other words changing and adopting existing process to not only be reliable but also support and agile cadence. In our internal teams and with some of our enterprise customers we noticed that once a team is able to accelerate the construction phase consistently. The next evolution process is to ensure such applications remind available and performing as expected. And when they aren’t having access to information and tools that allow both Operations and development teams to diagnostic and fix issues quickly. Then these teams become more sophisticated and mature and then they want to have access to customer usage information to use quantitative and qualitative data to help them determine the next set of investments and enable continuous learning.
  • #17: Virtual Machines + Puppet/chef Ops Dashboard
  • #40: mfbclients://awesomedemo.visualstudio.com/DefaultCollection/p:grumpylevel?rid=38%2C39
  • #44: InRelease does 4 main things: One- It automates deployments directly from TFS to all the environments, including production. Part of the deployment procedure may include things like taking back-ups, generating test data, provisioning Servers on Azure or executing your automated tests. Basically everything you need to start working on a given stage. InRelease ensures that all deployments are done the same way from the same binaries so that by the time you deploy your application to production, your deployment procedure has been tested over and over - removing a lot of those release related risks & headaches Two - InRelease automates the approval workflow through all the environments reducing delays and coordination issues to a minimum. Along the way, InRelease will provide tracking of each attempted release and provide complete traceability for diagnostic and audit purposes. You can actually set simple to complex deployment procedure in InRelease….
  • #45: Infrastructure Lab Manager InRelease – actions to trigger provisioning VMs Applications MS Tools – default behavior to publish to single environment, requires work to publish beyond that TfsDeployer – can leverage Build Quality in TFS to trigger moving parts to other environments, still requires custom scripts InRelease – can deploy applications using different approaches using built-in actions and tools Tests Microsoft Test Manager / Coded UI – helps define and execute automation of tests InRelease – can leverage existing tests for execution and can trigger test data creation via built-in actions and tools Approval InRelease – can manage governance, controls when and if deployments go into environments, notifies recipients of actions throughout the release process