SlideShare a Scribd company logo
BizDevOps:
Delivering Business Value Quickly at Scale
Our Last Webinar
Watch Now at QASymphony.com/resources
Our Last WebinarUpcoming Webinar Series
Kickstarting BDD: Scaling for the Enterprise
Sign up Today QASymphony.com/resources
About QASymphony
Test Management | Exploratory Testing | Test Analytics | BDD and more...
The Complete Testing Platform
STATE OF THE INDUSTRY
Organizations
practicing agile
development
Organizations have or
are planning a DevOps
initiative in their
company in the next
12 months
The difference in the
number of code
deployments between
high performing and
low performing IT
organizations
94% 71% 46x
The Pace of Software Development is
Moving Faster Than Ever
Source: V1 2016 State of Agile, Puppet 2016 State of DevOps
The Move to DevOps is Clear
1) Quicker time to customer value
2) Better alignment between businesses and
customers
3) Better ability to respond to customer input
DevTestOps
Business
+
Development
+
Operations
“Bringing the business stakeholders
into DevOps in order to confidently
validate that business processes
work end-to-end across single or
multiple applications.”
What is BizDevOps?
Testing in DevOps
Practices like behavior-driven
development (BDD) and test-
driven development (TDD)
are becoming more popular.
Source: V1 2016 and 2009 State of Agile
78%
Increase in Teams
doing BDD
Getting the Biz in DevOps
Dev
Product
Owner
Tester
Living
Documentation
Scenario: Buy Last Coffee
Given There are 1 Coffees left in the Machine
And I have deposited $5
And I previously have $100 in the bank
When I press the coffee button
Then I should be served a coffee
Feature: Serve Coffee
Coffee should not be served until paid for
Coffee should not be served until the button
has been pressed
If there is no coffee left, then the money
should be refunded
Three Amigos in BDD
01
02
03
04
05
5 Major Problems in DevOps Adoption
BizDevOps
Our Presenters
Kevin Dunne
VP of Strategy
Brandon Cipes
VP DevOps,
Bobby Smith
Director QAS Labs
01
02
03
04
05
01
LACK OF TEST
AUTOMATION COVERAGE
5 Major Problems in DevOps Adoption
“Functional testing is one of the most crucial, time-
consuming, and expensive steps in continuous testing —
so it’s necessary to automate this testing, and to
automate it at higher levels than most Agile teams
achieve today.”
– Forrester
Oh, no…
Freaking OutAcceptance
Tests
Integration
Tests
Unit Tests We for sure have this covered.
Super Confident
I think we got this covered
Semi-Confident
QA Risk When Scaling Automation
RISK LEVEL
BDD to the Rescue
Collaborate
Owner, Dev, Test, design acceptance criteria
Record
Document common syntax for all
Automate
Execute test scenarios that validate behavior
Full Traceability
Behavior Driven Development
01
02
03
04
05
02LACK OF VISIBILITY
MAKES TEST
AUTOMATION HARDER
5 Major Problems in DevOps Adoption
We wrote a bunch of
automated tests, but what
exactly do those tests cover?
INSERT PHOTO ON TOP
Festering Problems
Code
Code
Code
Automation Scripts
Code
Code
Code
Code
What Are
We Testing?
Automation Confusion
Automation frameworks without feature visibility create
business confusion around application coverage.
• Automation becomes pure code, without clear understanding
of test coverage
• QA doesn't know if test coverage is sufficient
Communication Breakdowns
Features and requirements change during Agile and DevOps
sprints. If automation is disconnected from these features, we
might be testing a changed feature set without know it.
• Changes are discovered after automation is completed
• Automation is never updated to reflect adequate coverage
01
02
03
04
05
03
MAINTAINING TEST
VERSIONS WITH CODE
5 Major Problems in DevOps Adoption
Are My Tests Connected with Code?
TESTING
VERSION
CONTROL
BUILD & UNIT TEST
AUTOMATED AND
MANUAL TEST
DEPLOY
Check In
TESTS FAIL
Typical CI Workflow
PLAN
DEV
Trigger
Trigger
FEED BACK
Check In
Trigger
Trigger
TEST PASS
PUSH TO PROD
FEEDBACK
01
02
03
04
05
04
MAINTAINING SINGLE
SOURCE OF TRUTH
IS A NIGHTMARE
5 Major Problems in DevOps Adoption
Siloed Teams
Traditional Software Development
Three Amigos
BDD Process
BDD in JIRA
01
02
03
04
05
WHAT IS THE BUSINESS
VALUE IN THE PIPELINE?
05
5 Major Problems in DevOps Adoption
DEVOPS MATURITY MODEL
PROCESS FOCUS
Define Plan Code Build Integrate Test Release Deploy Operate
AUTOMATION FOCUS
AGILE vs DEVOPS
DevOps, TDD/BDD,
Continuous Testing, CI,
CD, Data Driven,
Automated
Deployment
Scrum, Kanban,
Integration Planning,
Retrospective, Small
Integrations, Daily
Standups, Backlog
Planning
*Cloud Bees, Jenkins World 2016
AGILE UPSTREAM AGILE DOWNSTREAM
BizDevOps – Delivering Business Value Quickly at Scale
1) BDD – BDD can help with alignment and building automation
more efficiently
2) Technical Testing is Here – testing is increasingly
technical and should be treated as code
3) Atlassian Stack – provides the system of record for
“BizDevOps” pipeline and should be accessible to everyone
and built to provide visibility to C-Suite.
Key Takeaways
Questions?

More Related Content

PPTX
DevOps: A Value Proposition
PPTX
Past, Present and Future of DevOps Infrastructure
PPTX
The Power of Azure DevOps
PPTX
Introduction to DevOps
PPTX
Azure dev ops
PDF
DevOps - A Gentle Introduction
PPTX
0 to hero with Azure DevOps
PPTX
Azure DevOps Best Practices Webinar
DevOps: A Value Proposition
Past, Present and Future of DevOps Infrastructure
The Power of Azure DevOps
Introduction to DevOps
Azure dev ops
DevOps - A Gentle Introduction
0 to hero with Azure DevOps
Azure DevOps Best Practices Webinar

What's hot (20)

PPTX
Azure DevOps for Developers
PDF
Cloud Native In-Depth
PPTX
Power of Azure Devops
PPTX
DevOps without DevOps Tools
PDF
[JAZUG Tohoku Azure DevOps] Azure DevOps
PDF
Azure DevOps Tutorial | Developing CI/ CD Pipelines On Azure | Edureka
PPTX
Data Mesh in Azure using Cloud Scale Analytics (WAF)
PDF
MicroService Architecture
PPTX
Azure DevOps CI/CD For Beginners
PPTX
Document management in Atlassian Confluence and Jira
PDF
Cloud Native Application Development
PPTX
CI/CD on AWS
PDF
Structured Approach to Solution Architecture
PPTX
Transforming Organizations with CI/CD
PDF
Deployment Automation & Self-Healing with Dynatrace & Ansible
PDF
Platform Engineering
PDF
Cloud Native Applications Maturity Model
PPTX
Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...
PDF
Microsoft-Office-365-Brochure
PDF
ArchiMate application and data architecture layer - Simplify the models
Azure DevOps for Developers
Cloud Native In-Depth
Power of Azure Devops
DevOps without DevOps Tools
[JAZUG Tohoku Azure DevOps] Azure DevOps
Azure DevOps Tutorial | Developing CI/ CD Pipelines On Azure | Edureka
Data Mesh in Azure using Cloud Scale Analytics (WAF)
MicroService Architecture
Azure DevOps CI/CD For Beginners
Document management in Atlassian Confluence and Jira
Cloud Native Application Development
CI/CD on AWS
Structured Approach to Solution Architecture
Transforming Organizations with CI/CD
Deployment Automation & Self-Healing with Dynatrace & Ansible
Platform Engineering
Cloud Native Applications Maturity Model
Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...
Microsoft-Office-365-Brochure
ArchiMate application and data architecture layer - Simplify the models

Similar to BizDevOps – Delivering Business Value Quickly at Scale (20)

PPTX
Agile & DevOps - It's all about project success
PPTX
ATAGTR2017 Testing in DevOps Culture
PDF
Scaling Test first for the Enterprise
PDF
6 Resons To Implememnt DevOps In Your Business
PDF
Continuous Testing: A Key to DevOps Success
PDF
Agile testing
PPTX
What is DevOps? How can it impact my Customers and my Business
PDF
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
PPTX
Quality Jam: BDD, TDD and ATDD for the Enterprise
PDF
Boast the Potential of DevOps with CI CD
PDF
Devoxx BE 2015 - Swimming upstream in the container revolution
PDF
EuregJUG 2016-01-07 - Swimming upstream in the container revolution
PDF
JavaOne 2015 - Swimming upstream in the container revolution
PPTX
Measure and Accelerate Your Software Delivery
PPTX
A Roadmap to Enterprise Quality
PPTX
#SPSNewEngland Improving #DevOps using #Microsoft business productivity tools...
PDF
Geecon Microservices 2015 - Swimming upstream in the container revolution
PDF
Java Forum Nord 2015 - Swimming upstream in the container revolution
PDF
iSQI Certification Days DASA – DevOps & ISTQB Frank Frambach
PPTX
Starting and Scaling DevOps
Agile & DevOps - It's all about project success
ATAGTR2017 Testing in DevOps Culture
Scaling Test first for the Enterprise
6 Resons To Implememnt DevOps In Your Business
Continuous Testing: A Key to DevOps Success
Agile testing
What is DevOps? How can it impact my Customers and my Business
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
Quality Jam: BDD, TDD and ATDD for the Enterprise
Boast the Potential of DevOps with CI CD
Devoxx BE 2015 - Swimming upstream in the container revolution
EuregJUG 2016-01-07 - Swimming upstream in the container revolution
JavaOne 2015 - Swimming upstream in the container revolution
Measure and Accelerate Your Software Delivery
A Roadmap to Enterprise Quality
#SPSNewEngland Improving #DevOps using #Microsoft business productivity tools...
Geecon Microservices 2015 - Swimming upstream in the container revolution
Java Forum Nord 2015 - Swimming upstream in the container revolution
iSQI Certification Days DASA – DevOps & ISTQB Frank Frambach
Starting and Scaling DevOps

More from QASymphony (20)

PDF
Saying Goodbye to Quality Center
PPTX
Building Better Collaboration Between Development and Testing in a DevOps World
PPTX
QASymphony Atlanta Customer User Group Fall 2017
PPTX
Manual Testing is Dead. Long Live Manual Testing
PPTX
Knowing Where to Tap
PPTX
Moving QA from Reactive to Proactive with qTest
PPTX
Debugging Your Testing Team
PPTX
Succeeding as an Introvert
PPTX
TUI & qTest: Why, How and Where Next
PPTX
Diving into the World of Test Automation The Approach and the Technologies
PPTX
Modernizing Your Testing Tools
PPTX
RESTful API Testing using Postman, Newman, and Jenkins
PPTX
Whitebox Testing for Blackbox Testers: Simplifying API Testing
PPTX
Kick-Starting BDD for Your Organization
PPTX
Making the Switch from HP Quality Center to qTest
PDF
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
PDF
Quality Jam 2017: Jesse Reed & Kyle McMeekin "Test Case Management & Explorat...
PDF
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"
PDF
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
PDF
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
Saying Goodbye to Quality Center
Building Better Collaboration Between Development and Testing in a DevOps World
QASymphony Atlanta Customer User Group Fall 2017
Manual Testing is Dead. Long Live Manual Testing
Knowing Where to Tap
Moving QA from Reactive to Proactive with qTest
Debugging Your Testing Team
Succeeding as an Introvert
TUI & qTest: Why, How and Where Next
Diving into the World of Test Automation The Approach and the Technologies
Modernizing Your Testing Tools
RESTful API Testing using Postman, Newman, and Jenkins
Whitebox Testing for Blackbox Testers: Simplifying API Testing
Kick-Starting BDD for Your Organization
Making the Switch from HP Quality Center to qTest
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Jesse Reed & Kyle McMeekin "Test Case Management & Explorat...
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"

Recently uploaded (20)

PDF
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
PDF
Navsoft: AI-Powered Business Solutions & Custom Software Development
PDF
Design an Analysis of Algorithms I-SECS-1021-03
PDF
medical staffing services at VALiNTRY
PDF
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
PDF
System and Network Administration Chapter 2
PDF
Wondershare Filmora 15 Crack With Activation Key [2025
PDF
Softaken Excel to vCard Converter Software.pdf
PDF
AI in Product Development-omnex systems
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
PDF
Which alternative to Crystal Reports is best for small or large businesses.pdf
PPTX
L1 - Introduction to python Backend.pptx
PPTX
Introduction to Artificial Intelligence
PDF
2025 Textile ERP Trends: SAP, Odoo & Oracle
PPT
Introduction Database Management System for Course Database
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
PDF
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
PPTX
Transform Your Business with a Software ERP System
PDF
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
PDF
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
Navsoft: AI-Powered Business Solutions & Custom Software Development
Design an Analysis of Algorithms I-SECS-1021-03
medical staffing services at VALiNTRY
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
System and Network Administration Chapter 2
Wondershare Filmora 15 Crack With Activation Key [2025
Softaken Excel to vCard Converter Software.pdf
AI in Product Development-omnex systems
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
Which alternative to Crystal Reports is best for small or large businesses.pdf
L1 - Introduction to python Backend.pptx
Introduction to Artificial Intelligence
2025 Textile ERP Trends: SAP, Odoo & Oracle
Introduction Database Management System for Course Database
VVF-Customer-Presentation2025-Ver1.9.pptx
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
Transform Your Business with a Software ERP System
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)

BizDevOps – Delivering Business Value Quickly at Scale

  • 2. Our Last Webinar Watch Now at QASymphony.com/resources
  • 3. Our Last WebinarUpcoming Webinar Series Kickstarting BDD: Scaling for the Enterprise Sign up Today QASymphony.com/resources
  • 4. About QASymphony Test Management | Exploratory Testing | Test Analytics | BDD and more... The Complete Testing Platform
  • 5. STATE OF THE INDUSTRY
  • 6. Organizations practicing agile development Organizations have or are planning a DevOps initiative in their company in the next 12 months The difference in the number of code deployments between high performing and low performing IT organizations 94% 71% 46x The Pace of Software Development is Moving Faster Than Ever Source: V1 2016 State of Agile, Puppet 2016 State of DevOps
  • 7. The Move to DevOps is Clear 1) Quicker time to customer value 2) Better alignment between businesses and customers 3) Better ability to respond to customer input
  • 9. Business + Development + Operations “Bringing the business stakeholders into DevOps in order to confidently validate that business processes work end-to-end across single or multiple applications.” What is BizDevOps?
  • 10. Testing in DevOps Practices like behavior-driven development (BDD) and test- driven development (TDD) are becoming more popular. Source: V1 2016 and 2009 State of Agile 78% Increase in Teams doing BDD
  • 11. Getting the Biz in DevOps Dev Product Owner Tester Living Documentation Scenario: Buy Last Coffee Given There are 1 Coffees left in the Machine And I have deposited $5 And I previously have $100 in the bank When I press the coffee button Then I should be served a coffee Feature: Serve Coffee Coffee should not be served until paid for Coffee should not be served until the button has been pressed If there is no coffee left, then the money should be refunded Three Amigos in BDD
  • 12. 01 02 03 04 05 5 Major Problems in DevOps Adoption BizDevOps
  • 13. Our Presenters Kevin Dunne VP of Strategy Brandon Cipes VP DevOps, Bobby Smith Director QAS Labs
  • 14. 01 02 03 04 05 01 LACK OF TEST AUTOMATION COVERAGE 5 Major Problems in DevOps Adoption
  • 15. “Functional testing is one of the most crucial, time- consuming, and expensive steps in continuous testing — so it’s necessary to automate this testing, and to automate it at higher levels than most Agile teams achieve today.” – Forrester
  • 16. Oh, no… Freaking OutAcceptance Tests Integration Tests Unit Tests We for sure have this covered. Super Confident I think we got this covered Semi-Confident QA Risk When Scaling Automation RISK LEVEL
  • 17. BDD to the Rescue Collaborate Owner, Dev, Test, design acceptance criteria Record Document common syntax for all Automate Execute test scenarios that validate behavior Full Traceability Behavior Driven Development
  • 18. 01 02 03 04 05 02LACK OF VISIBILITY MAKES TEST AUTOMATION HARDER 5 Major Problems in DevOps Adoption
  • 19. We wrote a bunch of automated tests, but what exactly do those tests cover?
  • 20. INSERT PHOTO ON TOP Festering Problems Code Code Code Automation Scripts Code Code Code Code What Are We Testing? Automation Confusion Automation frameworks without feature visibility create business confusion around application coverage. • Automation becomes pure code, without clear understanding of test coverage • QA doesn't know if test coverage is sufficient Communication Breakdowns Features and requirements change during Agile and DevOps sprints. If automation is disconnected from these features, we might be testing a changed feature set without know it. • Changes are discovered after automation is completed • Automation is never updated to reflect adequate coverage
  • 21. 01 02 03 04 05 03 MAINTAINING TEST VERSIONS WITH CODE 5 Major Problems in DevOps Adoption
  • 22. Are My Tests Connected with Code? TESTING
  • 23. VERSION CONTROL BUILD & UNIT TEST AUTOMATED AND MANUAL TEST DEPLOY Check In TESTS FAIL Typical CI Workflow PLAN DEV Trigger Trigger FEED BACK Check In Trigger Trigger TEST PASS PUSH TO PROD FEEDBACK
  • 24. 01 02 03 04 05 04 MAINTAINING SINGLE SOURCE OF TRUTH IS A NIGHTMARE 5 Major Problems in DevOps Adoption
  • 28. 01 02 03 04 05 WHAT IS THE BUSINESS VALUE IN THE PIPELINE? 05 5 Major Problems in DevOps Adoption
  • 29. DEVOPS MATURITY MODEL PROCESS FOCUS Define Plan Code Build Integrate Test Release Deploy Operate AUTOMATION FOCUS AGILE vs DEVOPS DevOps, TDD/BDD, Continuous Testing, CI, CD, Data Driven, Automated Deployment Scrum, Kanban, Integration Planning, Retrospective, Small Integrations, Daily Standups, Backlog Planning *Cloud Bees, Jenkins World 2016 AGILE UPSTREAM AGILE DOWNSTREAM
  • 31. 1) BDD – BDD can help with alignment and building automation more efficiently 2) Technical Testing is Here – testing is increasingly technical and should be treated as code 3) Atlassian Stack – provides the system of record for “BizDevOps” pipeline and should be accessible to everyone and built to provide visibility to C-Suite. Key Takeaways

Editor's Notes

  • #14: Brandon – - Head up devops group, test automation – Good automation strategy for their devops practices - good code coverage - not automated, don’t have chance in hell
  • #17: - Kill Animations -
  • #18: Enter BDD to the rescue. BDD allows the developer, tester, and product owner to collaborate, record, and automate from a living specification. https://cucumber.io/blog/2017/05/15/intro-to-bdd-and-tdd
  • #20: You also run into the trouble of having a bunch of tests that are automated, yet you don’t know what areas, or features these tests case covering….
  • #21: - Flaky Tests - Reliable Tests – Green Builds - What happens when they fail?
  • #24: Static image as well.
  • #26: In support of the bimodal nature of many customers today, QASymphony has expanded the qTest Platform with qTest Pulse, a solution that is tuned and designed for Agile and DevOps teams scaling their Enterprise BDD processes. qTest Pulse integrates with JIRA in real-time to begin their BDD process, and teams to easily share assets and report across projects whether they are using Pulse or Manager.
  • #27: In support of the bimodal nature of many customers today, QASymphony has expanded the qTest Platform with qTest Pulse, a solution that is tuned and designed for Agile and DevOps teams scaling their Enterprise BDD processes. qTest Pulse integrates with JIRA in real-time to begin their BDD process, and teams to easily share assets and report across projects whether they are using Pulse or Manager. Fullfills requirement and testing (DEV)
  • #28: In support of the bimodal nature of many customers today, QASymphony has expanded the qTest Platform with qTest Pulse, a solution that is tuned and designed for Agile and DevOps teams scaling their Enterprise BDD processes. qTest Pulse integrates with JIRA in real-time to begin their BDD process, and teams to easily share assets and report across projects whether they are using Pulse or Manager. Fullfills requirement and testing (DEV)
  • #32: Notes: Instead of struggling to do new things that your tools won’t let you do, you’ve got to have a solution that supports all the latest thinking in development and testing – like DevOps, shift-left, exploratory, and more.