Usability Testing
Adding A New Level To Your Toolbox
About Me
•  Working in the field of User Experience since 2010
•  Secretary for the User Experience Professionals
Association (UXPA), DC Chapter
•  Certified Usability Analyst (CUA)
•  Technical Business Analyst background
Agenda
• 
• 
• 
• 
• 
• 
• 

What Is Usability Testing?
Why Usability Testing Is Important to a Business Analyst
Components of Usability Testing
Types of Usability Tests
When to Conduct a Usability Test
Usability Test Exercises
Questions
What Is Usability?
People being able to successfully use a product, system, or
service and how they expect it to work.

Great usability is invisible.
Bad usability…you know it when you see it.
Usability Testing - Adding a New Level to Your Toolbox
Image Credit: http://www.flickr.com/photos/paulhagon/
Identifying Usability Issues
• 
• 
• 
• 
• 

High number of errors
Significant time-on-task
Low customer satisfaction scores
Lots of help desk calls / tickets
High abandonment rates
Usability Testing - Adding a New Level to Your Toolbox
Usability Testing - Adding a New Level to Your Toolbox
What Is Good Usability?
• 
• 
• 
• 
• 

Simple
Easy to understand
Recognizable
Clear purpose
Learnable
Usability Testing - Adding a New Level to Your Toolbox
Usability Testing - Adding a New Level to Your Toolbox
The 5 E’s

• 
• 
• 
• 
• 

Effective
Efficient
Engaging
Error Tolerant
Easy to Learn

http://www.wqusability.com/articles/getting-started.html

Image Credit: http://www.flickr.com/photos/whatwhat/
Why Do Usability Testing?
•  Aligns the customer’s goals with the
business goals
•  Ignoring small issues can turn into big
problems
•  If the user is not happy, everyone is
unhappy
Usability Testing vs. UAT
•  User Acceptance
Testing:
o  Process of verifying that the
deliverable meets the
requirements
o  Conducted at the end of the
development cycle
o  Quality control

•  Usability Testing:
o  Verifies whether an
implementation approach
meets the user needs
o  Conducted at any time
during the development
cycle
o  Does not serve as quality
control
o  Increases the quality of
UAT outputs
Buying A Suit Online
Buying A Suit Online
UAT verifies that I can select a suit
style, size, and complete my purchase
online.
Buying A Suit Online
UAT verifies that I can select a suit style,
size, and complete my purchase online.
Usability Testing can verify:
•  How quickly I can purchase a suit
online
•  How satisfied I am with the online
purchase process
•  The intuitiveness of the purchase
process is for me
•  How much the online purchase
process will help me recover from an
error
•  What unforeseen issues I will
encounter in the purchase process
What is Success?
•  Reduction in hidden downstream maintenance costs
(developer time)
•  Reduction in training time
•  Reduction in help desk support
•  Higher task completion rates
Most Importantly…
More satisfied users!
When Should You Test?

Research

Brainstorm
Ideas

Prototype

Test

Usability Testing Process

Implement
Usability Testing Cycle
Develop
Tasks

Create a
More Usable
Product

Watch Your
Users

Report
Findings
Components
•  What will you test?
•  Where will you test?
•  Who will you test with?
•  How will you test?
Testing Materials
• 
• 
• 
• 
• 
• 
• 

Wireframes
Data Entry Form
Screenshots
HTML prototype
Live or staging site
Mobile Apps
Competitor’s site
Where Will You Test?

•  What is the product?
•  What is the context of use?
Image Credit: http://www.flickr.com/photos/nestle/
How Will You Test?
Single Usability Test
o Laboratory Test
o Remote Test
o Hallway Test
Usability Testing - Adding a New Level to Your Toolbox
Laboratory Test

•  Traditional type of usability test
•  Scheduling participants to meet
you at a predetermined location
•  Takes course over several days
•  Average time: 60 minutes per
user
Usability Testing - Adding a New Level to Your Toolbox
Remote Test
•  Virtual meeting held over the
phone and a computer
•  Scheduling participants to call
you on a conference line
•  Takes course over several days
•  Average time: 60 minutes per
user
Usability Testing - Adding a New Level to Your Toolbox
Image Credit: http://www.flickr.com/photos/oreocookies/
Hallway Test

•  Attract people in a high
pedestrian traffic area
•  Can be completed in one day
•  Least Expensive
•  Average time: Up to 20
minutes per user
Image Credit: http://www.flickr.com/photos/oreocookies/
Key Players
•  Facilitator – Person who conducts a usability test
•  Observer – Person who records notes during a usability
test
•  Participant – Person who is testing the website
Designing a Usability Test
• 
• 
• 
• 

Open with easy intro questions
Ask open ended questions when possible
Questions can ask a user to accomplish a task
Questions can ask a user to provide their perspective
Qualitative Testing
•  Looking for common themes and specific insights from
your users
•  Testing five users per user type
o 
o 
o 
o 

Who are your users?
Doctors vs Patients
Buyers vs Sellers
Federal vs. Non-Federal
How Many Participants?
“The answer is five…except when it’s not.”
Nielsen Norman Group, June 4, 2012

http://www.nngroup.com/articles/how-many-test-users/
Discuss Your Findings
Document Your Findings!
Image Credit: http://www.flickr.com/photos/juhansonin
Usability
Test
Exercise
Put Your Participant At Ease

Image Credit: http://www.flickr.com/photos/lukeydargons/
Be An Active
Listener

Image Credit: http://www.flickr.com/photos/brizzlebornandbred/
Be Unbiased!

Image Credit: http://seniorhousingforum.net/blog/2014/01/09/you-be-the-judge-cool-or-scary/
Don’t Lead Your Participant
Image Credit: http://www.flickr.com/photos/johnragai/
Let the
Participant Fail
Thank Your Participant
Facilitator Best Practices
1. 
2. 
3. 
4. 
5. 
6. 

Put your participant at ease
Be an active listener
Be unbiased
Avoid leading your participant
Let the participant fail
Thank your participant

Prompts:
•  Can you tell me what you are thinking?
•  Do you have any additional thoughts?
Wrap Up

More Related Content

PPTX
Agile Pushback
PPTX
Modeling Requirements Using Examples
PPTX
Techniques for Keeping Distributed Retrospectives Effective and Fun
PDF
Product is Hard - Marty Cagan
PDF
How Autodesk creates better digital experiences with UserTesting
PDF
Marty Cagan - Customer Inspired; Technology Enabled
PPTX
Soni Meckam and Geeta Wilson Presentation
PDF
How to Run Research in Agile Sprints by Democratizing It Across Teams
Agile Pushback
Modeling Requirements Using Examples
Techniques for Keeping Distributed Retrospectives Effective and Fun
Product is Hard - Marty Cagan
How Autodesk creates better digital experiences with UserTesting
Marty Cagan - Customer Inspired; Technology Enabled
Soni Meckam and Geeta Wilson Presentation
How to Run Research in Agile Sprints by Democratizing It Across Teams

What's hot (18)

PDF
Overcome the 6 Traps of Agile
PDF
Marty cagan built to learn - ux
PDF
Telling Your UX Metrics Story - The 21st Century Metrics Model
PPTX
Lean and agile 2011 04 15
PPTX
Startup Product Development
PPTX
Eric Ries Lean Startup Schematic View Of Agile Development And Customer Devel...
PPTX
Best of scrum and lean startup for product development
PPTX
Requirements are hypotheses: My experiences with Lean UX
PDF
Journey from Business Analyst to Product Owner
PPTX
1430 jeff gothelf - the ladders case study - sll-conf_2011_gothelf
PDF
PPTX
Gateway to Agile: Product Discovery - Lean UX and Design Sprints
ODP
2008 09 06 Eric Ries Haas Columbia Customer Development Engineering
PDF
Minimum Viable Product
PPTX
You keep using the word agile, i do not think it means what you think it means
PDF
Build the "right" regression suite using Behavior Driven Testing (BDT)
PDF
There's No Customer Engagement Without User Adoption
PPTX
Agily unifying theory - Path to Agility 2019
Overcome the 6 Traps of Agile
Marty cagan built to learn - ux
Telling Your UX Metrics Story - The 21st Century Metrics Model
Lean and agile 2011 04 15
Startup Product Development
Eric Ries Lean Startup Schematic View Of Agile Development And Customer Devel...
Best of scrum and lean startup for product development
Requirements are hypotheses: My experiences with Lean UX
Journey from Business Analyst to Product Owner
1430 jeff gothelf - the ladders case study - sll-conf_2011_gothelf
Gateway to Agile: Product Discovery - Lean UX and Design Sprints
2008 09 06 Eric Ries Haas Columbia Customer Development Engineering
Minimum Viable Product
You keep using the word agile, i do not think it means what you think it means
Build the "right" regression suite using Behavior Driven Testing (BDT)
There's No Customer Engagement Without User Adoption
Agily unifying theory - Path to Agility 2019
Ad

Viewers also liked (9)

PPTX
Usability session @ SEI Universidade do Minho
PPT
8 Critical Usability Tips
PPTX
Mobile Apps Usability - Intro
PDF
Tour of Mobile usability testing apps and services
PPT
Usability Introduction slide
PPTX
Mobile Usability: Why Great UX Matters More Than Ever
PPTX
Mobile Usability
PDF
Evaluation methods
PDF
User centered design in mobile app development
Usability session @ SEI Universidade do Minho
8 Critical Usability Tips
Mobile Apps Usability - Intro
Tour of Mobile usability testing apps and services
Usability Introduction slide
Mobile Usability: Why Great UX Matters More Than Ever
Mobile Usability
Evaluation methods
User centered design in mobile app development
Ad

Similar to Usability Testing - Adding a New Level to Your Toolbox (20)

PPTX
Conducting usability test
PPT
How to do usability testing and eye tracking
PDF
Usability Testing and QA 12 11-15
PDF
Module 10: Usability Testing
PPTX
A comprehensive guide on advantages, methods, and process of Usability Testin...
PPTX
Hands on Usability Testing (Jonathan Rubin)
PDF
Usability Testing and QA 7-18-14
PDF
Usability Testing 101 - an introduction
PDF
Boost SharePoint User Adoption Through DIY Usability Testing [workshop] Share...
PDF
AAM 2014 Tech Tutorial: User Testing on a Shoestring
PPT
Remote v Moderated Usability Testing - by Paul Rouke from PRWD
PPTX
Notes on usability testing
PPTX
Simple Ways of Planning, Designing and Testing Usability of a Software Produc...
PPTX
Usability in product development
PDF
Uxpin guide to_usability_testing
PDF
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
PDF
Reduce Product Failures While Boosting Conversion Rates
PDF
Prototyping and Usability Testing your designs
PDF
Art Center Interactive Design 4 - #4 Usability Testing
PDF
8220 sad inquiry
Conducting usability test
How to do usability testing and eye tracking
Usability Testing and QA 12 11-15
Module 10: Usability Testing
A comprehensive guide on advantages, methods, and process of Usability Testin...
Hands on Usability Testing (Jonathan Rubin)
Usability Testing and QA 7-18-14
Usability Testing 101 - an introduction
Boost SharePoint User Adoption Through DIY Usability Testing [workshop] Share...
AAM 2014 Tech Tutorial: User Testing on a Shoestring
Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Notes on usability testing
Simple Ways of Planning, Designing and Testing Usability of a Software Produc...
Usability in product development
Uxpin guide to_usability_testing
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Reduce Product Failures While Boosting Conversion Rates
Prototyping and Usability Testing your designs
Art Center Interactive Design 4 - #4 Usability Testing
8220 sad inquiry

More from Excella (20)

PDF
DCSUG - What's Really Going On? Observer Worksheet
PDF
DCSUG - We Are The Leaders We Have Been Waiting For by Lyssa Adkins
PDF
DCSUG - Servant Leadership Handout
PDF
DCSUG - Servant Leadership
PDF
DCSUG - Applying Analysis in an Agile World
PDF
DCSUG - The Art and Practice of the Agile Leader
PPTX
DCSUG - Finding Lean in Agile
PDF
DCSUG - Impact Mapping
PDF
DCSUG - Happiness: A Key Component of Agile
PPTX
The Awkward Teenager of Testing
PDF
Let's Sharpen Your Agile Ax, It's Story Splitting Time
PDF
Managing for Happiness by Jurgen Appelo at DCSUG on 8/9/2016
PDF
The 7 Secrets of Highly Effective Retrospectives (DCSUG)
PPTX
Get Your Productivity Game On!!
PPTX
How to Structure Multi Team Organizations
PPTX
Tactics to Kickstart Your Journey Toward DevOps
PPTX
Intro to Mocking - DjangoCon 2015
PPTX
Tactics to Kickstart Your Journey Toward Continuous Delivery
PPTX
Using ansible vault to protect your secrets
PDF
Using Lean Thinking to Increase the Value of Agile
DCSUG - What's Really Going On? Observer Worksheet
DCSUG - We Are The Leaders We Have Been Waiting For by Lyssa Adkins
DCSUG - Servant Leadership Handout
DCSUG - Servant Leadership
DCSUG - Applying Analysis in an Agile World
DCSUG - The Art and Practice of the Agile Leader
DCSUG - Finding Lean in Agile
DCSUG - Impact Mapping
DCSUG - Happiness: A Key Component of Agile
The Awkward Teenager of Testing
Let's Sharpen Your Agile Ax, It's Story Splitting Time
Managing for Happiness by Jurgen Appelo at DCSUG on 8/9/2016
The 7 Secrets of Highly Effective Retrospectives (DCSUG)
Get Your Productivity Game On!!
How to Structure Multi Team Organizations
Tactics to Kickstart Your Journey Toward DevOps
Intro to Mocking - DjangoCon 2015
Tactics to Kickstart Your Journey Toward Continuous Delivery
Using ansible vault to protect your secrets
Using Lean Thinking to Increase the Value of Agile

Recently uploaded (20)

PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PDF
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
DOCX
search engine optimization ppt fir known well about this
PDF
CloudStack 4.21: First Look Webinar slides
PDF
Unlock new opportunities with location data.pdf
PPTX
Web Crawler for Trend Tracking Gen Z Insights.pptx
PDF
STKI Israel Market Study 2025 version august
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
DP Operators-handbook-extract for the Mautical Institute
PDF
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
PDF
Five Habits of High-Impact Board Members
PDF
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
PDF
1 - Historical Antecedents, Social Consideration.pdf
PDF
Getting Started with Data Integration: FME Form 101
PPTX
Tartificialntelligence_presentation.pptx
PPTX
Benefits of Physical activity for teenagers.pptx
PPT
Geologic Time for studying geology for geologist
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
PDF
Enhancing emotion recognition model for a student engagement use case through...
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
search engine optimization ppt fir known well about this
CloudStack 4.21: First Look Webinar slides
Unlock new opportunities with location data.pdf
Web Crawler for Trend Tracking Gen Z Insights.pptx
STKI Israel Market Study 2025 version august
Assigned Numbers - 2025 - Bluetooth® Document
DP Operators-handbook-extract for the Mautical Institute
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
Five Habits of High-Impact Board Members
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
1 - Historical Antecedents, Social Consideration.pdf
Getting Started with Data Integration: FME Form 101
Tartificialntelligence_presentation.pptx
Benefits of Physical activity for teenagers.pptx
Geologic Time for studying geology for geologist
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
Enhancing emotion recognition model for a student engagement use case through...

Usability Testing - Adding a New Level to Your Toolbox