SlideShare a Scribd company logo
User Research and Usability Methods
workshop

Jon-Eric Steinbomer, Director of Research
Jessica Sears Steinbomer, Principal
!1
Our Agenda

!

9-10 Research Methods!
10-10:30 Recruiting Participants!
coffee <br>!
10:45-11:15 Study Plans & Moderator
Guides!
11:15-12:00 Moderate!!
12:00-1:00 Lunch & Presenting
Research
!2 | © 2013 Progress UX LLC
UX Research

!3 | © 2013 Progress UX LLC
!4 | © 2013 Progress UX LLC
UX Research

!

What people do!
!

How people use!
!

Small sample size - usually 8-12
people per study!
....but great depth

!5 | © 2013 Progress UX LLC
Key UX Research Principals



•
•
•
•

Test early - with prototypes whenever possible.!

•

Focus on behaviors

Evidence is more important than deliverables.!
Iterate on the design during the research phase.!
Collaboration with design & development.!
rather opinions.

“Individuals and interactions over
processes and tools” -Agile Manifesto
!6 | © 2013 Progress UX LLC
Methods

!7 | © 2013 Progress UX LLC
Structure Common! to All Methods
Study Planning!
Recruiting!
Study Sessions!
Analysis and Reporting!

!8 | © 2013 Progress UX LLC
Study Planning

•
•
•
•
•

!

What are the goals?!
What are the research questions?!
Who are the users?!
Which context is appropriate?!
Which research method is
appropriate?!

!9 | © 2013 Progress UX LLC
Study Plans Contain !

•
•
•
•
•
•

Research Goals!
Research Questions!
Participants!
Method!
Measures!
Specific Tasks and Questions!

!10 | © 2013 Progress UX LLC
Contexts

•
•
•

!

Usability Lab!
Remote !
On Location (ethnography)

!11 | © 2013 Progress UX LLC
Usability Lab
Behind the glass
Moderator communicates through microphone 

“voice of God”

!12 | © 2013 Progress UX LLC
Usability Lab Software

Morae ($1,995)

Silverback ($69.95)
!13 | © 2013 Progress UX LLC
Lab Best Practices

•
•
•
•

!

Participant Comfort!
Limit Distraction!
Just you and the participant!
Chat with observers/note-takers

!14 | © 2013 Progress UX LLC
Remote Research

Participant
Participant

Participant

Observers

Participant
Participant

Participant
Participant

Observers
Participant
Researchers

!15 | © 2013 Progress UX LLC

Participant
Ethnographic “bonus”
Participants are more comfortable as they speak

to us using their own OS, browser, resolution, etc.

!16 | © 2013 Progress UX LLC
Tools

!17 | © 2013 Progress UX LLC
Remote Case Study

!18 | © 2013 Progress UX LLC
Sweepstakes entry form

•

Too many abandons

!19 | © 2013 Progress UX LLC
18
Live Intercept

!20 | © 2013 Progress UX LLC
18
Recommendations sample

• Top-down design
• Validation before
human verify

• Better error
feedback

!21 | © 2013 Progress UX LLC
18
Remote UX Research Best Practices

•
•
•

Mind the time zones.!

•
•

Have a backup plan for the screen-share. !

One moderator per session.!
If time allows, start broad, then narrow down to your
subject (website, prototype, product).!
Test the screen share before the session.

!22 | © 2013 Progress UX LLC
18
Ethnography - Best Practices
!

•

Limit the number of
interviewers - 2 people if
possible!

•
•

Be nimble!

•

Note the environmental
factors!

•

Take lots of pictures and
video

Mind the background
noise!

!23 | © 2013 Progress UX LLC
18
Mobile Research

!24 | © 2013 Progress UX LLC
Mobile app/Hardware Research

!25 | © 2013 Progress UX LLC
18
Prototypes

!26 | © 2013 Progress UX LLC
Low-Fidelity Paper-based prototype

Full-Fidelity “clickable” prototype

Gesture prototype testing (Kinect)

Mid-fidelity Balsamiq prototype
!27 | © 2013 Progress UX LLC
Prototype Testing Best Practices

•
•
•
•

Flexibility when moderating is key!
Prototype should be easily modified!
Comfort with things breaking !
Make participant aware it’s a
prototype!

!28 | © 2013 Progress UX LLC
18
Moderating

!29 | © 2013 Progress UX LLC
Best Practices

•
•
•
•
•
•

Participant comfort!
It’s not about you (empathy)!
Place your participant as the expert!
Use their words!
Emphasize there is no right or wrong!
Don’t assume - ask!

!30 | © 2013 Progress UX LLC
18
Best Practices, cont.

•

Avoid asking leading questions or
“questioning with the target”!

•
•

Resist rescuing !

•

Introduce the goals and structure of
the session up-front

Let the participant lead as much as
possible!

!31 | © 2013 Progress UX LLC
18
Moderation Issues

•
•
•
•
•

Taking notes while moderating - takes practice!
Time management!
Talkers - interrupting gracefully!
Non-Talkers!
“Bad” Participants!
!

!32 | © 2013 Progress UX LLC
18
Recruiting Participants

!33 | © 2013 Progress UX LLC
Identify who you want to speak with
•
•
•
•

Personas
Marketing data
Call center data
Sales staff

!34 | © 2013 Progress UX LLC
Cast the net

Social media

Forums

Ethnio - Live Intercept
!35 | © 2013 Progress UX LLC
Recruiting - Ethnio Live Intercept

!36 | © 2013 Progress UX LLC
Collect the data

• Screening Survey

!37 | © 2013 Progress UX LLC
Scheduling

• Organization Tips

!38 | © 2013 Progress UX LLC
Make the Call

• Initial Contact
• Scheduling specifics
• Confirm
• Double Check

!39 | © 2013 Progress UX LLC
Bloopers and Out-takes

• No-shows- Oh No!
•

Recruit reserve participants

•

Make time in the schedule for reserves

• Mr. Wrong

!40 | © 2013 Progress UX LLC
Study Plans and Moderator Guides

!41 | © 2013 Progress UX LLC
Your turn!

!42 | © 2013 Progress UX LLC

More Related Content

PDF
Keeping your customers real
PDF
UX Designer's Toolkit - to design a better world
PDF
Measuring Visual Attentiveness: Eye Tracking on Wearable Devices
PPTX
Developing a Culture of UCD
PDF
Design Sprints Presentation at NoVA UX
PPTX
體驗劇場_1050308_W3_崑曲與使用者經驗_楊政達
PPTX
體驗劇場_1050524_W14_易用性測試_楊政達
PPTX
Usability Testing: Understanding End-Users through Observation
Keeping your customers real
UX Designer's Toolkit - to design a better world
Measuring Visual Attentiveness: Eye Tracking on Wearable Devices
Developing a Culture of UCD
Design Sprints Presentation at NoVA UX
體驗劇場_1050308_W3_崑曲與使用者經驗_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達
Usability Testing: Understanding End-Users through Observation

Viewers also liked (6)

PDF
Endouble Ux design
PDF
From Participants to Pixels: Making the transition from UX Researcher to UX D...
PPTX
40 things you didn’t know about UX recruitment and were too afraid to ask
PDF
Agile14 - Anatomy Of A UX Framework
PDF
Stakeholder involvement in ux research
PDF
User experience doesn't happen on a screen: It happens in the mind.
Endouble Ux design
From Participants to Pixels: Making the transition from UX Researcher to UX D...
40 things you didn’t know about UX recruitment and were too afraid to ask
Agile14 - Anatomy Of A UX Framework
Stakeholder involvement in ux research
User experience doesn't happen on a screen: It happens in the mind.
Ad

Similar to Progress UX - Research Methods Workshop - 11/2013 (20)

PPT
Usability Testing Basics: Remote and In-Person Studies
PDF
Jan Moons at WUD16
PPTX
Users, Usability & User Experience - at PodCamp Cleveland 2011
PPTX
The "Rocket Science" of Corporate Usability Testing - Boris Rudnik (CyberArk)
PDF
Lean_UX--TC.220134502
PDF
4YFN 2016 Guerrilla UX
PPTX
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
PDF
Lean User Research - UXPA 2013 Workshop
PDF
Guerrilla usability testing
PDF
When Qual Met UX
PDF
Rapid usability testing
PDF
Usability Testing Foundation
PDF
UX Research & PP projects @UXScotland 2014
PPTX
What we learned at EuroIA 2014
PPTX
Conducting User Research
PDF
Getting Started With User Research, Presented at Agile2010
PDF
ux flow and process
PDF
UsabilityMatters_Usability_Testing_Introduction_Workshop
PDF
User Testing: Adapt to Fit Your Needs
Usability Testing Basics: Remote and In-Person Studies
Jan Moons at WUD16
Users, Usability & User Experience - at PodCamp Cleveland 2011
The "Rocket Science" of Corporate Usability Testing - Boris Rudnik (CyberArk)
Lean_UX--TC.220134502
4YFN 2016 Guerrilla UX
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Lean User Research - UXPA 2013 Workshop
Guerrilla usability testing
When Qual Met UX
Rapid usability testing
Usability Testing Foundation
UX Research & PP projects @UXScotland 2014
What we learned at EuroIA 2014
Conducting User Research
Getting Started With User Research, Presented at Agile2010
ux flow and process
UsabilityMatters_Usability_Testing_Introduction_Workshop
User Testing: Adapt to Fit Your Needs
Ad

Recently uploaded (20)

PPTX
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
PDF
Trusted Executive Protection Services in Ontario — Discreet & Professional.pdf
PDF
YOW2022-BNE-MinimalViableArchitecture.pdf
PPTX
rapid fire quiz in your house is your india.pptx
PDF
UNIT 1 Introduction fnfbbfhfhfbdhdbdto Java.pptx.pdf
PPTX
CLASSIFICATION OF YARN- process, explanation
PPTX
mahatma gandhi bus terminal in india Case Study.pptx
PPTX
DOC-20250430-WA0014._20250714_235747_0000.pptx
PDF
GREEN BUILDING MATERIALS FOR SUISTAINABLE ARCHITECTURE AND BUILDING STUDY
PPTX
CLASS_11_BUSINESS_STUDIES_PPT_CHAPTER_1_Business_Trade_Commerce.pptx
PPTX
joggers park landscape assignment bandra
PDF
Integrated-2D-and-3D-Animation-Bridging-Dimensions-for-Impactful-Storytelling...
PPT
Machine printing techniques and plangi dyeing
PDF
Design Thinking - Module 1 - Introduction To Design Thinking - Dr. Rohan Dasg...
PPTX
YV PROFILE PROJECTS PROFILE PRES. DESIGN
PPTX
EDP Competencies-types, process, explanation
PPT
WHY_R12 Uaafafafpgradeaffafafafaffff.ppt
PDF
BRANDBOOK-Presidential Award Scheme-Kenya-2023
PPTX
Media And Information Literacy for Grade 12
PPTX
Implications Existing phase plan and its feasibility.pptx
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
Trusted Executive Protection Services in Ontario — Discreet & Professional.pdf
YOW2022-BNE-MinimalViableArchitecture.pdf
rapid fire quiz in your house is your india.pptx
UNIT 1 Introduction fnfbbfhfhfbdhdbdto Java.pptx.pdf
CLASSIFICATION OF YARN- process, explanation
mahatma gandhi bus terminal in india Case Study.pptx
DOC-20250430-WA0014._20250714_235747_0000.pptx
GREEN BUILDING MATERIALS FOR SUISTAINABLE ARCHITECTURE AND BUILDING STUDY
CLASS_11_BUSINESS_STUDIES_PPT_CHAPTER_1_Business_Trade_Commerce.pptx
joggers park landscape assignment bandra
Integrated-2D-and-3D-Animation-Bridging-Dimensions-for-Impactful-Storytelling...
Machine printing techniques and plangi dyeing
Design Thinking - Module 1 - Introduction To Design Thinking - Dr. Rohan Dasg...
YV PROFILE PROJECTS PROFILE PRES. DESIGN
EDP Competencies-types, process, explanation
WHY_R12 Uaafafafpgradeaffafafafaffff.ppt
BRANDBOOK-Presidential Award Scheme-Kenya-2023
Media And Information Literacy for Grade 12
Implications Existing phase plan and its feasibility.pptx

Progress UX - Research Methods Workshop - 11/2013