SlideShare a Scribd company logo
Panoramic
Quality
Brendan Connolly
@theBConnolly || http://brendanconnolly.net
Sr. Quality Engineer, Procore Technologies, Santa Barbara CA
@theBConnolly
Panoramic
Quality
Brendan Connolly
@theBConnolly || http://brendanconnolly.net
Sr. Quality Engineer, Procore Technologies, Santa Barbara CA
What’s So Different?
@theBConnolly
@theBConnolly
SPEED
Orders of Magnitude
Risk / Release Inversion
Continuous
@theBConnolly
Delivery TestingIntegration
@theBConnolly
OWNERSHIP
Developers Devour All
@theBConnolly
Our Landscape
Is Changing
Core Responsibilities
@theBConnolly
Protect VerifyKnow
Regions of
Responsibility
@theBConnolly
@theBConnolly
Customer
@theBConnolly
Know => Customer
Application & Audience
=> Application Expertise
=> Persona / Permission Boundaries
=> Interactions & Motivations
@theBConnolly
Protect => Customer
Feature Corruption
- When adding functionality for one group
of users affects others NEGATIVELY
- Not a regression because it’s a new/
additive change.
@theBConnolly
Protect => Customer
Feature Flags
=> You need it in production does your
customer?
=> Do all of your customers?
@theBConnolly
Protect => Customer
Change Tolerance
=> Instability is indistinguishable from rapid
change
@theBConnolly
Verify => Customer
Test In Production
If a bug is production but no customers can
access it, is it still a bug?
@theBConnolly
Verify => Customer
User Analytics
=> It’s not just about catching errors
=> Instrument to measure effects and
usage
@theBConnolly
Architecture
@theBConnolly
Know => Architecture
The Geography of Software
=> How it’s built / deployed
=> Where it’s running
=> How it solves your customers
problems
@theBConnolly
Know => Architecture
Environmental Impact
=> Local, Staging, Production
=> What Works Where?
=> What Doesn’t?
@theBConnolly
Protect => Architecture
Boundaries of Risk
=> Boundaries of components can be
borders between developers
@theBConnolly
Verify => Architecture
Minimum Viable Environment
=> Work as close to home as you can
=> Take the Developers local changes
=> Identify tests
@theBConnolly
Verify => Architecture
Health & Wellness
=> Monitoring
=> Surfacing information
@theBConnolly
Code
@theBConnolly
Know =>Code
Topography
=> how the pieces fit together
=> how data flows
@theBConnolly
Know =>Code
Streets & Neighborhoods
=> Find your way around
=> Know the Rough Areas
=> Where “stuff” goes down
@theBConnolly
Know =>Code
Talk Me Thru Your Changes
=> Know the story behind the code
=> Be a the sounding board
=> How do unit tests reflect the change?
@theBConnolly
Protect =>Code
Code is Protected by Tests
Not Testers
=> Unit Tests are a foundation for quality
@theBConnolly
Verify =>Code
Influencer vs. Influenced
=> When Works as Designed doesn’t work?
=> Who’s saying the tests are built right?
@theBConnolly
PAUSE
Embracing
Ownership
@theBConnolly
@theBConnolly
Let Go of Testing
https://danashby.co.uk/2016/10/19/continuous-testing-in-devops/
@theBConnolly
Quality Ownership
@theBConnolly
Product Ownership
- Define the product backlog
- Groom and prioritize the backlog
- Ensure completed user stories fulfills the
acceptance criteria
https://medium.com/@melissaperri
@theBConnolly
Product Ownership
Focused On:
- Features, Market, Schedule
Goes Deep On:
- Domain, Competition, Planning
@theBConnolly
Quality Ownership
Focused On:
- Features, Value, Safety
Goes Deep On:
- Application, Customers, Planning
@theBConnolly
Quality Ownership
Support ObserveSteward
@theBConnolly
Quality Ownership
Stewardship:
- An ethic that embodies the responsible
planning and management of resources.
- the responsible overseeing and protection
of something considered worth caring
for and preserving
@theBConnolly
Quality Owner => Steward
Product => steward of what will be
built
Quality => steward of what has been
built
@theBConnolly
Quality Owner => Stewardship
Quality is in Your “Charge”
Responsibility for controlling or caring
for something
A formal statement accusing someone
of committing a crime
@theBConnolly
Quality Ownership=> Support
Open Source your Mindset
=> Be an #ALLY for testing
=> Enable & Mentor Quality
=> Infuse Quality into automation
@theBConnolly
Quality Ownership=> Support
Supporting Quality
Testing
@theBConnolly
Quality Ownership=> Support
Avoid Pyramid
Obsession
=> Pyramids aren’t models
of efficiency
=> Quality isn’t in layers
@theBConnolly
Quality Ownership=> Support
Testing Cathedral
=> Your app is central
=> Counter-balance risk
with efficient supports
@theBConnolly
Quality Ownership
Observability:
- measure of how well internal states of a
system can be inferred from knowledge
of its external outputs
@theBConnolly
Quality Ownership=> Observe
Continuous
Feedback
Virtuous cycle of
better observability Source: https://medium.com/@copyconstruct
@theBConnolly
Quality Ownership=> Observe
Continuous Collaboration
=> Build skills to break down barriers to
collaboration
Quality Ownership
Hands on Code
Hands on Customer
Supporting a pipeline of
Quality from pull request
to production
Be Well, Connect,
Share
http://bit.ly/own-quality
Connect With Me
Twitter / LinkedIn : @theBConnolly
49

More Related Content

PDF
Manual Regression Testing Manifesto
PDF
Test Driven Testing
PPTX
Regress to Impress
PDF
SXSW 2016 - Everything you think about A/B testing is wrong
PDF
4 Steps Toward Scientific A/B Testing
PDF
A/B Testing - In data we trust
PPTX
DOES15 - Aaron Volkmann - Busting Silos & Red Tape: DevOps in Federal Government
PPTX
NRG101speech
Manual Regression Testing Manifesto
Test Driven Testing
Regress to Impress
SXSW 2016 - Everything you think about A/B testing is wrong
4 Steps Toward Scientific A/B Testing
A/B Testing - In data we trust
DOES15 - Aaron Volkmann - Busting Silos & Red Tape: DevOps in Federal Government
NRG101speech

Similar to Panoramic Quality: Fellowship of Testing in DevOps AgileTDUSA2019 (20)

PDF
Panoramic Quality: The Fellowship of Testing in DevOps
PDF
Panoramic Quality by Brendan Connolly
PDF
Software Quality and Test Strategies for Ruby and Rails Applications
PDF
Architecting A Testing Strategy
PDF
Tricks for Isolated Architecture in Ruby - Sergey Kukunin
PPTX
20150620 Meetup U-Qasar - Obtaining an integrated and objective overview of t...
PDF
End-to-End Quality Approach: 14 Levels of Testing
PDF
The Speed to Cool: Agile Testing & Building Quality In
PDF
Agile A to Z Chapter 4 Feedback Loop Part 2 DevOps
PPT
CISQ and Software Quality Measurement - Software Assurance Forum (March 2010)
PDF
What CS Class Didn't Teach About Testing
PDF
Continuous delivery is more than dev ops
PDF
Software Testing and Quality Assurance Assignment 3
PPTX
Fundamentals of Testing Section 1/6
PPTX
Software Quality Management.pptx
PDF
Better Software East 2016: Evolving Automated to Continuous
PPTX
Software Development and Quality
PPTX
Pushing the Bottleneck: Predicting and Addressing the Next, Next Thing
PDF
Reduce Time to Value: Focus First on Configuration Management Debt
PPTX
QA is not quality
Panoramic Quality: The Fellowship of Testing in DevOps
Panoramic Quality by Brendan Connolly
Software Quality and Test Strategies for Ruby and Rails Applications
Architecting A Testing Strategy
Tricks for Isolated Architecture in Ruby - Sergey Kukunin
20150620 Meetup U-Qasar - Obtaining an integrated and objective overview of t...
End-to-End Quality Approach: 14 Levels of Testing
The Speed to Cool: Agile Testing & Building Quality In
Agile A to Z Chapter 4 Feedback Loop Part 2 DevOps
CISQ and Software Quality Measurement - Software Assurance Forum (March 2010)
What CS Class Didn't Teach About Testing
Continuous delivery is more than dev ops
Software Testing and Quality Assurance Assignment 3
Fundamentals of Testing Section 1/6
Software Quality Management.pptx
Better Software East 2016: Evolving Automated to Continuous
Software Development and Quality
Pushing the Bottleneck: Predicting and Addressing the Next, Next Thing
Reduce Time to Value: Focus First on Configuration Management Debt
QA is not quality
Ad

More from Brendan Connolly (7)

PDF
Exploratory Testing As Code
PDF
Exploratory Testing As Code Eurostar23
PDF
Automation Maturity Heuristic
PPTX
Test Driven Testing
PPTX
Building a Crypto Bot with Node.js
PDF
Leading by Example
PPTX
Frisby.js - Give it a Toss
Exploratory Testing As Code
Exploratory Testing As Code Eurostar23
Automation Maturity Heuristic
Test Driven Testing
Building a Crypto Bot with Node.js
Leading by Example
Frisby.js - Give it a Toss
Ad

Recently uploaded (20)

PDF
PTS Company Brochure 2025 (1).pdf.......
PDF
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
PPT
Introduction Database Management System for Course Database
PDF
Nekopoi APK 2025 free lastest update
PDF
Designing Intelligence for the Shop Floor.pdf
PDF
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
PDF
EN-Survey-Report-SAP-LeanIX-EA-Insights-2025.pdf
PPTX
Operating system designcfffgfgggggggvggggggggg
PDF
Navsoft: AI-Powered Business Solutions & Custom Software Development
PPTX
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
PPTX
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
PPTX
Computer Software and OS of computer science of grade 11.pptx
PPTX
history of c programming in notes for students .pptx
PDF
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
PPTX
ai tools demonstartion for schools and inter college
PPTX
L1 - Introduction to python Backend.pptx
PPTX
CHAPTER 2 - PM Management and IT Context
PDF
Odoo Companies in India – Driving Business Transformation.pdf
PTS Company Brochure 2025 (1).pdf.......
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
Introduction Database Management System for Course Database
Nekopoi APK 2025 free lastest update
Designing Intelligence for the Shop Floor.pdf
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
EN-Survey-Report-SAP-LeanIX-EA-Insights-2025.pdf
Operating system designcfffgfgggggggvggggggggg
Navsoft: AI-Powered Business Solutions & Custom Software Development
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
Computer Software and OS of computer science of grade 11.pptx
history of c programming in notes for students .pptx
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
VVF-Customer-Presentation2025-Ver1.9.pptx
ai tools demonstartion for schools and inter college
L1 - Introduction to python Backend.pptx
CHAPTER 2 - PM Management and IT Context
Odoo Companies in India – Driving Business Transformation.pdf

Panoramic Quality: Fellowship of Testing in DevOps AgileTDUSA2019