SlideShare a Scribd company logo
Usability Testing Foundation
DesignDojo
February, 2016
Usability Testing Foundation
Founded in 2010 with offices
across the globe
More than 1b words
subtitled in 200+ languages
35m+ active users, 8m+
registered users
18,000+ hours of premium
video
Usability Testing
What is Usability Testing?
Participant
Think Aloud
Set of tasksObservation
Measuring:
Efficiency
Effectiveness
Satisfaction
TYPES OF
USABILITY TESTING
Moderated In-Person
● Probe participant to delve deeper
● Observe body language and
reaction
● Keep participant on track
● Able to clarify confusions
Moderated Remote
● Reach out to participants who are
geographically dispersed
● Participants interact with the
website comfortably at their home
or own location
● Time saving
● Internet connection may be unstable
● Know your tools well on yours and
participants’ end
● No show rates are higher
Unmoderated Remote
● Participants interact with the
website comfortably at their home
or own location
● No need to schedule
● Simultaneous testing
● Time saving
● Cannot probe or follow-up
● No real-time support for participant
● Participants are “pro users”
1. PLAN
What are your business goals?
What are your users’ top tasks?
What do users do most often on your site?
How to find Top Tasks?
Identify top search terms
Identify most visited pages
Speak to Customer Service team
Examine competitor’s site
Get users to rank list of tasks
Writing Tasks into Task Scenarios
Task:
“Search for a horror show from Japan”
Task Scenario:
Must represent realistic user goal
“It is the Halloween holiday and you invited a group of friends to your
place. You plan to watch a horror show with them. Find a Japanese horror
show.
Tips for writing good task scenarios
Task is unambiguous and easy to understand.
There is a clear end point to determine if task is a success or failure
Avoid hidden clues
Not biased
Avoid stacked tasks
Make the task neutral
Don’t be funny or assume about what users will find funny
Your friend recommended you a new show
that is still airing on TV. Find information
about the new show.
What’s wrong?
2. RECRUIT
Recruit
Know your end users. Demographic/gender/age?
What form of testing? (in-person/remote)
External recruiting agency or recruit by yourself?
Screening users
Screen users’ behavior instead of their frequency of use (ex. “What things do you do
online?” (list activities with frequency) instead of “Are you a frequent internet user?”)
Users who work in certain companies (competitors)
Users whose job are related to research
Other specific criteria, etc.
How many users should I test?
else
5 is enough
(to capture usability problems)
*iterative process
*not for quantitative studies
As many as possible
Write 3 Task Scenarios
10 mins
Activity 1:
3. MODERATE
Roles to play as a moderator
1. Give instructions
2. Inform users to think aloud and remind them
3. Inform them that there’s no right or wrong answer
4. Reflect what you heard and check your understanding
6. Ask open-ended questions
5. Do not assist them in the tasks
7. Take notes, but don’t write all the time
8. Ask for consent: videotaping permission, non-disclosure and give
participant rights
Types of activities
1st impressions
(What’s the first thought that comes to your mind? Can you tell me what does this
page do for you?)
Exploratory
(What would you expect to see if you click on this? What does this label mean? I
noticed that you …., what’s going on your mind right now?)
Directive tasks
( ....Find the working hours of the restaurant for Sunday)
Types of activities
Wrapping up
(On a scale of 1- 10, how would you rate the ease of use for this website? What should
we do to make it 10 out of 10? Do you have any questions or feedback?)
Post-site questionnaire
- System Usability Scale
- Post-site word choice
Run a usability testing
20 mins (10 mins per individual)
Activity 2:
Success Rates
TASK SCENARIOS USER 1 USER 2 USER 3 USER 4 USER 5 Success
Rate
1. 1 0 1 1 1 80%
2. 1 0 0 0 0 20%
3. 1 1 1 0 0 60%
0= fail 1= success
Reflection
Usability Testing books to pick up
Thank You!
@RVikiDesign
on Twitter and Facebook
@borryshasian @choongchingteo @estherfanLL

More Related Content

PDF
Usability Testing Moderator
PDF
Product camp sprint presentation
PDF
Conducting Lean User Studies
PPTX
Django BarCamp SF 2014: Technical Interviews for Beginners
PDF
Games User Research by Valen
PDF
Design Sprint - Day 2
PDF
FMP Proposal
PDF
Exploratory Testing with the Team_ATDNL
Usability Testing Moderator
Product camp sprint presentation
Conducting Lean User Studies
Django BarCamp SF 2014: Technical Interviews for Beginners
Games User Research by Valen
Design Sprint - Day 2
FMP Proposal
Exploratory Testing with the Team_ATDNL

What's hot (12)

PPTX
7 steps to being a bad boss
DOC
Strategies for doing well on the exam
PDF
The best testing ever!
PDF
The Panda Hat of Doom
PDF
Guerilla usability testing
PPTX
Gerry Geek Wisdom
PDF
How to run 1-to-1 usability testing (with life scientists)
PPTX
Does my bum look big in this v2
PPTX
Steve Bromley - Running User Tests for VR Games
PPTX
Geek Quotes
PPTX
Creativity Workshop - a few fun exercises to stretch your brain
PDF
12. do's and don’ts of training
7 steps to being a bad boss
Strategies for doing well on the exam
The best testing ever!
The Panda Hat of Doom
Guerilla usability testing
Gerry Geek Wisdom
How to run 1-to-1 usability testing (with life scientists)
Does my bum look big in this v2
Steve Bromley - Running User Tests for VR Games
Geek Quotes
Creativity Workshop - a few fun exercises to stretch your brain
12. do's and don’ts of training
Ad

Similar to Usability Testing Foundation (20)

PDF
Usability Testing On A Digital Product
PPTX
Intro to Lean UX with UserTesting
PDF
Usability Techniques for Startups
PDF
Usability Testing and QA 12 11-15
PPT
How to do usability testing and eye tracking
PDF
Usability testing - have fun and improve your work
PDF
Art Center Interactive Design 4 - #4 Usability Testing
PPTX
Don't Fear the User
PDF
DrupalCon Austin: UX Bootcamp workshop
PPTX
User Experience Basics for Product Management
KEY
SkillSwap Weekend - Usability Testing
PDF
speed-testing advice @UXCoop Paris
PDF
Introduction to Lean UX Methods - General Assembly
PPTX
L7 Usability testing lecture of usability
PPTX
Uxss san francisco2014_juliebooth (1)
PPTX
User recruitment: What doesn't bring you joy
 should be automated
PPTX
Usability Testing Basics: What's it All About? at Web SIG Cleveland
PDF
Usability Testing Nearsoft Workshop
PDF
User Research for Startups
PDF
Rapid usability testing
Usability Testing On A Digital Product
Intro to Lean UX with UserTesting
Usability Techniques for Startups
Usability Testing and QA 12 11-15
How to do usability testing and eye tracking
Usability testing - have fun and improve your work
Art Center Interactive Design 4 - #4 Usability Testing
Don't Fear the User
DrupalCon Austin: UX Bootcamp workshop
User Experience Basics for Product Management
SkillSwap Weekend - Usability Testing
speed-testing advice @UXCoop Paris
Introduction to Lean UX Methods - General Assembly
L7 Usability testing lecture of usability
Uxss san francisco2014_juliebooth (1)
User recruitment: What doesn't bring you joy
 should be automated
Usability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Testing Nearsoft Workshop
User Research for Startups
Rapid usability testing
Ad

Recently uploaded (20)

PDF
SEVA- Fashion designing-Presentation.pdf
PDF
Key Trends in Website Development 2025 | B3AITS - Bow & 3 Arrows IT Solutions
PPTX
artificialintelligencedata driven analytics23.pptx
PDF
Design Thinking - Module 1 - Introduction To Design Thinking - Dr. Rohan Dasg...
PPT
EGWHermeneuticsffgggggggggggggggggggggggggggggggg.ppt
PPTX
ANATOMY OF ANTERIOR CHAMBER ANGLE AND GONIOSCOPY.pptx
PDF
Trusted Executive Protection Services in Ontario — Discreet & Professional.pdf
PDF
Interior Structure and Construction A1 NGYANQI
PPT
UNIT I- Yarn, types, explanation, process
PPT
Package Design Design Kit 20100009 PWM IC by Bee Technologies
PPTX
Tenders & Contracts Works _ Services Afzal.pptx
PPTX
YV PROFILE PROJECTS PROFILE PRES. DESIGN
PDF
High-frequency high-voltage transformer outline drawing
PDF
Phone away, tabs closed: No multitasking
PPTX
Complete Guide to Microsoft PowerPoint 2019 – Features, Tools, and Tips"
PDF
UNIT 1 Introduction fnfbbfhfhfbdhdbdto Java.pptx.pdf
PDF
Urban Design Final Project-Context
PDF
GREEN BUILDING MATERIALS FOR SUISTAINABLE ARCHITECTURE AND BUILDING STUDY
PDF
BRANDBOOK-Presidential Award Scheme-Kenya-2023
PDF
The Advantages of Working With a Design-Build Studio
SEVA- Fashion designing-Presentation.pdf
Key Trends in Website Development 2025 | B3AITS - Bow & 3 Arrows IT Solutions
artificialintelligencedata driven analytics23.pptx
Design Thinking - Module 1 - Introduction To Design Thinking - Dr. Rohan Dasg...
EGWHermeneuticsffgggggggggggggggggggggggggggggggg.ppt
ANATOMY OF ANTERIOR CHAMBER ANGLE AND GONIOSCOPY.pptx
Trusted Executive Protection Services in Ontario — Discreet & Professional.pdf
Interior Structure and Construction A1 NGYANQI
UNIT I- Yarn, types, explanation, process
Package Design Design Kit 20100009 PWM IC by Bee Technologies
Tenders & Contracts Works _ Services Afzal.pptx
YV PROFILE PROJECTS PROFILE PRES. DESIGN
High-frequency high-voltage transformer outline drawing
Phone away, tabs closed: No multitasking
Complete Guide to Microsoft PowerPoint 2019 – Features, Tools, and Tips"
UNIT 1 Introduction fnfbbfhfhfbdhdbdto Java.pptx.pdf
Urban Design Final Project-Context
GREEN BUILDING MATERIALS FOR SUISTAINABLE ARCHITECTURE AND BUILDING STUDY
BRANDBOOK-Presidential Award Scheme-Kenya-2023
The Advantages of Working With a Design-Build Studio

Usability Testing Foundation

  • 3. Founded in 2010 with offices across the globe More than 1b words subtitled in 200+ languages 35m+ active users, 8m+ registered users 18,000+ hours of premium video
  • 5. What is Usability Testing? Participant Think Aloud Set of tasksObservation Measuring: Efficiency Effectiveness Satisfaction
  • 7. Moderated In-Person ● Probe participant to delve deeper ● Observe body language and reaction ● Keep participant on track ● Able to clarify confusions
  • 8. Moderated Remote ● Reach out to participants who are geographically dispersed ● Participants interact with the website comfortably at their home or own location ● Time saving ● Internet connection may be unstable ● Know your tools well on yours and participants’ end ● No show rates are higher
  • 9. Unmoderated Remote ● Participants interact with the website comfortably at their home or own location ● No need to schedule ● Simultaneous testing ● Time saving ● Cannot probe or follow-up ● No real-time support for participant ● Participants are “pro users”
  • 11. What are your business goals? What are your users’ top tasks? What do users do most often on your site?
  • 12. How to find Top Tasks? Identify top search terms Identify most visited pages Speak to Customer Service team Examine competitor’s site Get users to rank list of tasks
  • 13. Writing Tasks into Task Scenarios Task: “Search for a horror show from Japan” Task Scenario: Must represent realistic user goal “It is the Halloween holiday and you invited a group of friends to your place. You plan to watch a horror show with them. Find a Japanese horror show.
  • 14. Tips for writing good task scenarios Task is unambiguous and easy to understand. There is a clear end point to determine if task is a success or failure Avoid hidden clues Not biased Avoid stacked tasks Make the task neutral Don’t be funny or assume about what users will find funny
  • 15. Your friend recommended you a new show that is still airing on TV. Find information about the new show. What’s wrong?
  • 17. Recruit Know your end users. Demographic/gender/age? What form of testing? (in-person/remote) External recruiting agency or recruit by yourself?
  • 18. Screening users Screen users’ behavior instead of their frequency of use (ex. “What things do you do online?” (list activities with frequency) instead of “Are you a frequent internet user?”) Users who work in certain companies (competitors) Users whose job are related to research Other specific criteria, etc.
  • 19. How many users should I test? else 5 is enough (to capture usability problems) *iterative process *not for quantitative studies As many as possible
  • 20. Write 3 Task Scenarios 10 mins Activity 1:
  • 22. Roles to play as a moderator 1. Give instructions 2. Inform users to think aloud and remind them 3. Inform them that there’s no right or wrong answer 4. Reflect what you heard and check your understanding 6. Ask open-ended questions 5. Do not assist them in the tasks 7. Take notes, but don’t write all the time 8. Ask for consent: videotaping permission, non-disclosure and give participant rights
  • 23. Types of activities 1st impressions (What’s the first thought that comes to your mind? Can you tell me what does this page do for you?) Exploratory (What would you expect to see if you click on this? What does this label mean? I noticed that you …., what’s going on your mind right now?) Directive tasks ( ....Find the working hours of the restaurant for Sunday)
  • 24. Types of activities Wrapping up (On a scale of 1- 10, how would you rate the ease of use for this website? What should we do to make it 10 out of 10? Do you have any questions or feedback?) Post-site questionnaire - System Usability Scale - Post-site word choice
  • 25. Run a usability testing 20 mins (10 mins per individual) Activity 2:
  • 26. Success Rates TASK SCENARIOS USER 1 USER 2 USER 3 USER 4 USER 5 Success Rate 1. 1 0 1 1 1 80% 2. 1 0 0 0 0 20% 3. 1 1 1 0 0 60% 0= fail 1= success
  • 29. Thank You! @RVikiDesign on Twitter and Facebook @borryshasian @choongchingteo @estherfanLL