SlideShare a Scribd company logo
Mike Lyles , Jay Philips and
Rex Black

The Good, The Bad and
The Metrics
About XBOSoft
•

Founded in 2006

•

Dedicated to software quality
• Software QA consulting
• Software testing services

•

Offices in San Francisco, Beijing, Oslo
and Amsterdam
From XBOSoft
• Amy

• Jan
Housekeeping
• Everyone except the speakers is muted
• Questions via the gotowebinar control on the right side of your
screen
• Questions can be asked throughout the webinar, we’ll try to fit
them in when appropriate
• General Q & A at the end of the webinar

• You will receive info on recording after the webinar
An XBOSoft Webinar
with

Mike Lyles, Jay Philips, & Rex Black
December 17, 2013
11am-12pm EST
Rex Black - President of RBCS.

His popular first book, Managing
the Testing Process, has sold over
50,000 copies around the
world, and is now in its third
edition. His ten other books on
testing have also sold tens of
thousands of copies. Rex is the
past President of the
International Software Testing
Qualifications Board and of the
American Software Testing
Qualifications Board.

Jay Philips - CEO & President of
Project Realms, Inc. an IT
consulting firm focusing on
software quality. Jay is also the
CEO & President of
TeamQualityPro, which is a realtime integrated dashboard
platform used to evaluate the
entire ecosystem of application
projects and resources.
TeamQualityPro is code agnostic
so all organizations can
implement a real-time executive
dashboard system.

Mike Lyles - Sr. QA Manager

with 20+ years of IT
experience. His current role is
over Performance
testing, Automation testing, and
Service Virtualization for all
business communities within
his organization. Mike enjoys
teaching others in the testing
profession. He has spoken at
multiple conferences on
testing, and has written multiple
published articles.
Has your organization ever considered replacing
a tester that did not write, for example, 15 test
cases per day?
Is the testing team blamed if defect leakage is
greater than 5% into production?
What drives decisions like these? The common
thread in these examples is “Test Metrics”
Everyone has an opinion…
 Some believe they are the most valuable way to
communicate the results of testing




Some think that they are useless, misleading, and
damaging to the communication of test results
Some believe that without measurement you are
not managing the effort. And some believe that
bad metrics are worse than no metrics at all.
Is your team aligned? Do you agree with the team?
Do you use a reporting process for test results?
Are you forced to report on metrics you don't believe
are valuable?
Do you have dozens of metrics that you are reporting
periodically that no one looks at, and when they do
look at them, there is room for misinterpretation?
1.

Top metrics that are misused or
misunderstood

2.

Best metrics that everyone should use

3.

Worst metrics that you should avoid or
remove

4.

Tools and processes that can help your
organization better measure your testing
What metrics do you see in the
industry that are predominantly
being misused or misunderstood
by organizations?
The good, the bad, and the metrics webinar hosted by xbo soft
What are the top metrics that you
would suggest for any
organization to use? What are the
most common?
The good, the bad, and the metrics webinar hosted by xbo soft
What are metrics that
organizations should avoid
and/or discontinue using?
The good, the bad, and the metrics webinar hosted by xbo soft
What tools and/or processes can
best assist organizations in
delivering
meaningful, accurate, and quality
metrics?
The good, the bad, and the metrics webinar hosted by xbo soft
The good, the bad, and the metrics webinar hosted by xbo soft
The good, the bad, and the metrics webinar hosted by xbo soft
Rex Black
http://www.rbcs-us.com
@RBCS

Jay Philips
http://www.projectrealms.com
http://teamqualitypro.com
@jayphilips, @ProjectRealms,
@TeamQualityPro

Mike Lyles
http://www.mikewlyles.com
@mikelyles
Thank you for attending

Follow us: @XBOSoft
Questions : services@xbosoft.com

More Related Content

KEY
Five whys summary
PPTX
Testing for everyone agile yorkshire
PPTX
5 why analysis training presentaion
PPTX
Automation vs. intelligence - "follow me if you want to live"
PDF
Worst practices in software testing by the Testing troll
PDF
JIT Feedback — what Experienced Developers like about Static Analysis (icpc2018)
PPTX
Root cause analysis using 5 whys
PPTX
"Worst" practices of software testing
Five whys summary
Testing for everyone agile yorkshire
5 why analysis training presentaion
Automation vs. intelligence - "follow me if you want to live"
Worst practices in software testing by the Testing troll
JIT Feedback — what Experienced Developers like about Static Analysis (icpc2018)
Root cause analysis using 5 whys
"Worst" practices of software testing

What's hot (20)

PDF
Test automation – the bitter truth
PPT
Quality in an_agile_world
PPTX
Machine Learning Vital Signs
PPTX
Testing for cognitive bias in ai systems
PPTX
Hindsight lessons about API testing
PDF
Testing in production
PDF
Testing for everyone
ODP
Let's test
PPTX
5 why analysis
PPTX
Break to build - the mindset of the modern day tester
PPTX
Root Cause Analysis and Corrective Actions
PDF
Renat Gilmanov "Visual search results validation or where is my ninja turtles?"
PDF
Agile Testers: Becoming a key asset for your team
PPTX
Agile Practices
PPTX
6 Guidelines for A/B Testing
PDF
Pdf analytics-and-witch-doctoring -why-executives-succumb-to-the-black-box-me...
PPT
Building Teams For Success
PPT
Implementing Continous Deployment
PDF
Root Cause Analysis (RCA) Tools
Test automation – the bitter truth
Quality in an_agile_world
Machine Learning Vital Signs
Testing for cognitive bias in ai systems
Hindsight lessons about API testing
Testing in production
Testing for everyone
Let's test
5 why analysis
Break to build - the mindset of the modern day tester
Root Cause Analysis and Corrective Actions
Renat Gilmanov "Visual search results validation or where is my ninja turtles?"
Agile Testers: Becoming a key asset for your team
Agile Practices
6 Guidelines for A/B Testing
Pdf analytics-and-witch-doctoring -why-executives-succumb-to-the-black-box-me...
Building Teams For Success
Implementing Continous Deployment
Root Cause Analysis (RCA) Tools
Ad

Viewers also liked (8)

PPTX
Testistanbul 2016 - Keynote: "Performance Testing of Big Data" by Roland Leusden
PDF
Browser-level testing
PPTX
The Business of Social Media
PPTX
10 Steps of Project Management in Digital Agencies
PDF
PDF
Lost in Cultural Translation
PDF
The hottest analysis tools for startups
PPTX
All About Beer
Testistanbul 2016 - Keynote: "Performance Testing of Big Data" by Roland Leusden
Browser-level testing
The Business of Social Media
10 Steps of Project Management in Digital Agencies
Lost in Cultural Translation
The hottest analysis tools for startups
All About Beer
Ad

Similar to The good, the bad, and the metrics webinar hosted by xbo soft (20)

PPTX
Are You Making These 7 'Testing Metric' Mistakes? Webinar - Mark Bentsen, Phi...
PPT
The Good, The Bad, and The Metrics
PDF
Mobile testing trends webinar PPT
PDF
Software Quality Metrics Do's and Don'ts - QAI-Quest 1 Hour Presentation
PDF
Top Agile Metrics
PDF
Agile Metrics - ASTQB Workshop by Philip Lew - XBOSoft
PDF
Using JMeter and Google Analytics for Software Performance Testing
PPT
Testing Metrics
PDF
Winning strategies in Test Automation
PDF
Metrics That Matter
PPTX
Testing Metrics: Project, Product, Process
PPTX
Testing Metrics and Tools, Analyse de tests
PPTX
Day 2 meet shilpa - measuring software quality-are you up-to-date on what an...
PDF
So You Think You Can Write a Test Case - XBOSoft Webinar
PPTX
Top 10 Agile Metrics
PPT
Are you in control of Testing, or does Testing control you?
PDF
Verification audit
PPTX
Software testing metrics | David Tzemach
PDF
Agile Product and User-Centered Design Methodologies Webinar - XBOSoft
PDF
How Metrics Programs Can Destroy Your Soul
Are You Making These 7 'Testing Metric' Mistakes? Webinar - Mark Bentsen, Phi...
The Good, The Bad, and The Metrics
Mobile testing trends webinar PPT
Software Quality Metrics Do's and Don'ts - QAI-Quest 1 Hour Presentation
Top Agile Metrics
Agile Metrics - ASTQB Workshop by Philip Lew - XBOSoft
Using JMeter and Google Analytics for Software Performance Testing
Testing Metrics
Winning strategies in Test Automation
Metrics That Matter
Testing Metrics: Project, Product, Process
Testing Metrics and Tools, Analyse de tests
Day 2 meet shilpa - measuring software quality-are you up-to-date on what an...
So You Think You Can Write a Test Case - XBOSoft Webinar
Top 10 Agile Metrics
Are you in control of Testing, or does Testing control you?
Verification audit
Software testing metrics | David Tzemach
Agile Product and User-Centered Design Methodologies Webinar - XBOSoft
How Metrics Programs Can Destroy Your Soul

More from XBOSoft (20)

PDF
Agile Metrics to Boost Software Quality improvement
PDF
Agile Test Management Using Jira and Zephyr
PDF
AI Based Test Automation Without AI
PDF
What Aircrews Can Teach Software Testing Teams - XBOSoft Webinar w/Peter Varhol
PDF
Agile User Acceptance Testing - Incorporating UAT into Agile
PDF
Challenges in Using Big Data for Software QA
PDF
Defect Patterns Analysis for Agile and Waterfall - XBOSoft Webinar with Micha...
PDF
Proactive SQA™ Shifting Left w/Proactive Software Quality Practices
PDF
Mobile Testing Challenges and Solutions XBOSoft Webinar
PDF
Heidi Araya - XBOSoft Webinar Guest Speaker - Working with Remote Agile Teams
PDF
XBOSoft webinar - How Did I Miss That Bug - Cognitive Biases in Software Testing
PDF
PSQT Keynote: Quality Challenges in the Internet of Things Era
PDF
7 Habits of Highly Effective Agile Testing - Test Istanbul
PDF
Managing Agile Software Projects With Risk and Uncertainty
PDF
Top IOT Testing Challenges Webinar with Jon Hagar
PDF
Testing in Agile with Coaching Agile Journeys and XBOSoft
PDF
Storytelling: Discover the Big Picture for Agile Efforts Webinar - Tom Cagley...
PDF
ASTQB w/ XBOSoft CEO Phil Lew: Agile and Waterfall - What Do Testers Do Diffe...
PPT
When Agile is a Quality Game Changer Webinar - Michael Mah, Philip Lew
PPTX
Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...
Agile Metrics to Boost Software Quality improvement
Agile Test Management Using Jira and Zephyr
AI Based Test Automation Without AI
What Aircrews Can Teach Software Testing Teams - XBOSoft Webinar w/Peter Varhol
Agile User Acceptance Testing - Incorporating UAT into Agile
Challenges in Using Big Data for Software QA
Defect Patterns Analysis for Agile and Waterfall - XBOSoft Webinar with Micha...
Proactive SQA™ Shifting Left w/Proactive Software Quality Practices
Mobile Testing Challenges and Solutions XBOSoft Webinar
Heidi Araya - XBOSoft Webinar Guest Speaker - Working with Remote Agile Teams
XBOSoft webinar - How Did I Miss That Bug - Cognitive Biases in Software Testing
PSQT Keynote: Quality Challenges in the Internet of Things Era
7 Habits of Highly Effective Agile Testing - Test Istanbul
Managing Agile Software Projects With Risk and Uncertainty
Top IOT Testing Challenges Webinar with Jon Hagar
Testing in Agile with Coaching Agile Journeys and XBOSoft
Storytelling: Discover the Big Picture for Agile Efforts Webinar - Tom Cagley...
ASTQB w/ XBOSoft CEO Phil Lew: Agile and Waterfall - What Do Testers Do Diffe...
When Agile is a Quality Game Changer Webinar - Michael Mah, Philip Lew
Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...

Recently uploaded (20)

PPTX
breach-and-attack-simulation-cybersecurity-india-chennai-defenderrabbit-2025....
PDF
Advanced Soft Computing BINUS July 2025.pdf
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Empathic Computing: Creating Shared Understanding
PDF
Advanced IT Governance
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
MYSQL Presentation for SQL database connectivity
PDF
GDG Cloud Iasi [PUBLIC] Florian Blaga - Unveiling the Evolution of Cybersecur...
DOCX
The AUB Centre for AI in Media Proposal.docx
breach-and-attack-simulation-cybersecurity-india-chennai-defenderrabbit-2025....
Advanced Soft Computing BINUS July 2025.pdf
Advanced methodologies resolving dimensionality complications for autism neur...
Understanding_Digital_Forensics_Presentation.pptx
NewMind AI Weekly Chronicles - August'25 Week I
NewMind AI Monthly Chronicles - July 2025
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Unlocking AI with Model Context Protocol (MCP)
Review of recent advances in non-invasive hemoglobin estimation
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Spectral efficient network and resource selection model in 5G networks
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Empathic Computing: Creating Shared Understanding
Advanced IT Governance
Diabetes mellitus diagnosis method based random forest with bat algorithm
The Rise and Fall of 3GPP – Time for a Sabbatical?
MYSQL Presentation for SQL database connectivity
GDG Cloud Iasi [PUBLIC] Florian Blaga - Unveiling the Evolution of Cybersecur...
The AUB Centre for AI in Media Proposal.docx

The good, the bad, and the metrics webinar hosted by xbo soft

  • 1. Mike Lyles , Jay Philips and Rex Black The Good, The Bad and The Metrics
  • 2. About XBOSoft • Founded in 2006 • Dedicated to software quality • Software QA consulting • Software testing services • Offices in San Francisco, Beijing, Oslo and Amsterdam
  • 4. Housekeeping • Everyone except the speakers is muted • Questions via the gotowebinar control on the right side of your screen • Questions can be asked throughout the webinar, we’ll try to fit them in when appropriate • General Q & A at the end of the webinar • You will receive info on recording after the webinar
  • 5. An XBOSoft Webinar with Mike Lyles, Jay Philips, & Rex Black December 17, 2013 11am-12pm EST
  • 6. Rex Black - President of RBCS. His popular first book, Managing the Testing Process, has sold over 50,000 copies around the world, and is now in its third edition. His ten other books on testing have also sold tens of thousands of copies. Rex is the past President of the International Software Testing Qualifications Board and of the American Software Testing Qualifications Board. Jay Philips - CEO & President of Project Realms, Inc. an IT consulting firm focusing on software quality. Jay is also the CEO & President of TeamQualityPro, which is a realtime integrated dashboard platform used to evaluate the entire ecosystem of application projects and resources. TeamQualityPro is code agnostic so all organizations can implement a real-time executive dashboard system. Mike Lyles - Sr. QA Manager with 20+ years of IT experience. His current role is over Performance testing, Automation testing, and Service Virtualization for all business communities within his organization. Mike enjoys teaching others in the testing profession. He has spoken at multiple conferences on testing, and has written multiple published articles.
  • 7. Has your organization ever considered replacing a tester that did not write, for example, 15 test cases per day? Is the testing team blamed if defect leakage is greater than 5% into production? What drives decisions like these? The common thread in these examples is “Test Metrics”
  • 8. Everyone has an opinion…  Some believe they are the most valuable way to communicate the results of testing   Some think that they are useless, misleading, and damaging to the communication of test results Some believe that without measurement you are not managing the effort. And some believe that bad metrics are worse than no metrics at all.
  • 9. Is your team aligned? Do you agree with the team? Do you use a reporting process for test results? Are you forced to report on metrics you don't believe are valuable? Do you have dozens of metrics that you are reporting periodically that no one looks at, and when they do look at them, there is room for misinterpretation?
  • 10. 1. Top metrics that are misused or misunderstood 2. Best metrics that everyone should use 3. Worst metrics that you should avoid or remove 4. Tools and processes that can help your organization better measure your testing
  • 11. What metrics do you see in the industry that are predominantly being misused or misunderstood by organizations?
  • 13. What are the top metrics that you would suggest for any organization to use? What are the most common?
  • 15. What are metrics that organizations should avoid and/or discontinue using?
  • 17. What tools and/or processes can best assist organizations in delivering meaningful, accurate, and quality metrics?
  • 22. Thank you for attending Follow us: @XBOSoft Questions : services@xbosoft.com