SlideShare a Scribd company logo
Measuring Consumer Quality
The Missing Feedback Loop
@BagmarAnand
Anand Bagmar
Software Quality Evangelist
Essence Of Testing
About Me
EssenceOfTesting.com
@BagmarAnand
What do you expect
from this session?
@BagmarAnand
Which roles is this topic
relevant to?
@BagmarAnand
QA as a Gatekeeper
QA as an Advocate / Enabler
@BagmarAnand
QA IS NOT a Scavenger
QA IS an Enabler
@BagmarAnand
QA IS NOT a Scavenger
QA IS an Enabler
Collaboration (Communication)
@BagmarAnand
QA IS NOT a Scavenger
QA IS an Enabler
Collaboration (Communication)
Questioning
@BagmarAnand
QA IS NOT a Scavenger
QA IS an Enabler
Collaboration (Communication)
Questioning
Risk Identification & Mitigation
@BagmarAnand
QA IS NOT a Scavenger
QA IS an Enabler
Collaboration (Communication)
Questioning
Risk Identification & Mitigation
Preventing Defects
@BagmarAnand
https://pxhere.com/en/photo/1175227
@BagmarAnand
The Feedback Loop
@BagmarAnand
Build
Features
@BagmarAnand
Build
Measure
Metrics
Features
@BagmarAnand
Build
Measure
Metrics
Baseline
Features
@BagmarAnand
Build
Measure
Metrics
Baseline
Analyze
Features
@BagmarAnand
Build
MeasureLearn
MetricsPivot / Preserve
Baseline
Analyze
Features
@BagmarAnand
Build
MeasureLearn
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis
Features
@BagmarAnand
Build
MeasureLearn
Experiments
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis
@BagmarAnand
Build
MeasureLearn
Experiments
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis The
Feedback
Loop
@BagmarAnand
Build
MeasureLearn
Experiments
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis The
Feedback
Loop
@BagmarAnand
Some examples
@BagmarAnand
Product
@BagmarAnand
How well do you know your Product?
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
@BagmarAnand
Know your Product
Intent
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
@BagmarAnand
Intent Use cases
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
Know your Product
@BagmarAnand
Intent Use cases
Value
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
Know your Product
@BagmarAnand
Intent Use cases
Value On-Track?
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
Know your Product
@BagmarAnand
Users
@BagmarAnand
Who are your Product’s Users?
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand
Understand your Users
Profile
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand
Profile Location
Understand your Users
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand
Profile
Culture
Languages
Location
Understand your Users
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand
Profile
Culture
Languages
Location
Hobbies
Habits
Understand your Users
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand
Measure & Learn
@BagmarAnand
Measure
@BagmarAnand
Measure
Analytics
@BagmarAnand
Measure
Analytics
Crashes (Client / Server-side)
@BagmarAnand
Measure
Analytics
Crashes (Client / Server-side)
Reviews / Ratings
@BagmarAnand
Measure
Analytics
Crashes (Client / Server-side)
Reviews / Ratings
Errors / Logs
@BagmarAnand
Learn
@BagmarAnand
Learn
Infer (with context)
@BagmarAnand
Learn
Infer (with context)
Pivot / Preserve
@BagmarAnand
Predict!
@BagmarAnand
Predict!
Is your learning and understanding deep
enough to make predictions of outcomes?
@BagmarAnand
Understanding, Measuring and Building Consumer Quality
https://essenceoftesting.blogspot.com/2017/12/understanding-
measuring-and-building.html
Reference
@BagmarAnand
Thank you!
EssenceOfTesting.com
@BagmarAnand

More Related Content

PDF
Visual Validation - The Missing Tip of the Automation Pyramid
PDF
Visual Validation - The missing tip of the automation pyramid @AgileIndia2020
PDF
Getting started with Visual Testing using Applitools - @TPC, Feb2020
PDF
Measuring Coverage From E2E Tests
PDF
What is Agile Testing? How does Automation help?
PDF
Rewrite vs Refactor (AgileIndia 2021)
PDF
Eradicate Flaky Tests - AppiumConf 2021
PDF
Selenium Deep Dive
Visual Validation - The Missing Tip of the Automation Pyramid
Visual Validation - The missing tip of the automation pyramid @AgileIndia2020
Getting started with Visual Testing using Applitools - @TPC, Feb2020
Measuring Coverage From E2E Tests
What is Agile Testing? How does Automation help?
Rewrite vs Refactor (AgileIndia 2021)
Eradicate Flaky Tests - AppiumConf 2021
Selenium Deep Dive

What's hot (20)

PDF
Next Generation Functional & Visual Testing powered by AI
PDF
Say NO To (More) Selenium Tests
PDF
Build the "right" regression suite using Behavior Driven Testing (BDT)
PDF
Getting started with Appium 2.0
PDF
Build the "right" regression suite using Behavior Driven Testing (BDT)
PDF
Does your functional automation really add value?
PDF
Sharing (less) Pain of using Protractor & WebDriver
PDF
Automating Web Analytics
PDF
Enabling CD in Enterprises with Testing
PDF
To Deploy or Not-To-Deploy - decide using TTA's Trend & Failure Analysis
PDF
Role of Automation in Testing
PDF
Perils of Page-Object Pattern
PDF
Visual AI Testing Using Applitools
PDF
Client-Side Performance Testing
PPTX
Appium vs Appium with Perfecto
PDF
The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)
PDF
Visual validation - The missing tip of the automation pyramid @ QA Symposium
PDF
Patterns in Test Automation
PDF
Test Data - Food for your Test Automation Framework
PDF
Client-Side Performance Testing
Next Generation Functional & Visual Testing powered by AI
Say NO To (More) Selenium Tests
Build the "right" regression suite using Behavior Driven Testing (BDT)
Getting started with Appium 2.0
Build the "right" regression suite using Behavior Driven Testing (BDT)
Does your functional automation really add value?
Sharing (less) Pain of using Protractor & WebDriver
Automating Web Analytics
Enabling CD in Enterprises with Testing
To Deploy or Not-To-Deploy - decide using TTA's Trend & Failure Analysis
Role of Automation in Testing
Perils of Page-Object Pattern
Visual AI Testing Using Applitools
Client-Side Performance Testing
Appium vs Appium with Perfecto
The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)
Visual validation - The missing tip of the automation pyramid @ QA Symposium
Patterns in Test Automation
Test Data - Food for your Test Automation Framework
Client-Side Performance Testing
Ad

More from Anand Bagmar (14)

PDF
The Path to Autonomous Testing - Anand Bagmar
PDF
My Journey With Appium @AppiumConf Sept 2024
PDF
Streamlining End-to-End Testing Automation
PDF
Eradicate Flaky Tests
PDF
Automating the real-user scenarios across multi-apps, and multi-devices
PDF
Visual Validation - The missing tip of the automation pyramid @GoT2022
PDF
Design Patterns in Automation
PDF
Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
PDF
The Best Test Automation Framework is...
PDF
Collaboration - A Taboo!
PDF
The What, Why and How of Analytics Testing
PDF
Patterns of a “good” test automation framework
PDF
Sharing the pain using Protractor
PDF
Test Automation - Principles and Practices
The Path to Autonomous Testing - Anand Bagmar
My Journey With Appium @AppiumConf Sept 2024
Streamlining End-to-End Testing Automation
Eradicate Flaky Tests
Automating the real-user scenarios across multi-apps, and multi-devices
Visual Validation - The missing tip of the automation pyramid @GoT2022
Design Patterns in Automation
Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
The Best Test Automation Framework is...
Collaboration - A Taboo!
The What, Why and How of Analytics Testing
Patterns of a “good” test automation framework
Sharing the pain using Protractor
Test Automation - Principles and Practices
Ad

Recently uploaded (20)

PDF
Nekopoi APK 2025 free lastest update
PPTX
Odoo POS Development Services by CandidRoot Solutions
PPTX
L1 - Introduction to python Backend.pptx
PDF
System and Network Administration Chapter 2
PDF
Softaken Excel to vCard Converter Software.pdf
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
PDF
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
PPTX
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 41
PDF
Navsoft: AI-Powered Business Solutions & Custom Software Development
PPTX
history of c programming in notes for students .pptx
PPT
Introduction Database Management System for Course Database
PDF
Odoo Companies in India – Driving Business Transformation.pdf
PDF
medical staffing services at VALiNTRY
PDF
Digital Strategies for Manufacturing Companies
PPTX
Operating system designcfffgfgggggggvggggggggg
PPTX
Introduction to Artificial Intelligence
PPTX
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
PDF
2025 Textile ERP Trends: SAP, Odoo & Oracle
PPTX
ManageIQ - Sprint 268 Review - Slide Deck
Nekopoi APK 2025 free lastest update
Odoo POS Development Services by CandidRoot Solutions
L1 - Introduction to python Backend.pptx
System and Network Administration Chapter 2
Softaken Excel to vCard Converter Software.pdf
Adobe Illustrator 28.6 Crack My Vision of Vector Design
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
Internet Downloader Manager (IDM) Crack 6.42 Build 41
Navsoft: AI-Powered Business Solutions & Custom Software Development
history of c programming in notes for students .pptx
Introduction Database Management System for Course Database
Odoo Companies in India – Driving Business Transformation.pdf
medical staffing services at VALiNTRY
Digital Strategies for Manufacturing Companies
Operating system designcfffgfgggggggvggggggggg
Introduction to Artificial Intelligence
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
2025 Textile ERP Trends: SAP, Odoo & Oracle
ManageIQ - Sprint 268 Review - Slide Deck

Measuring Consumer Quality - The Missing Feedback Loop