Reto Lämmler • UXCamp Hamburg 2015
@rlaemmler @testingtime
Blind Dates –
Or the right choice of test users
Why do I want to talk about this?
The UX industry still designs too
much based on assumptions.
Talking to a user is worth more
than a thousand assumptions.
• From Zurich, Switzerland
• Co-Founder & CEO of www.testingtime.com
• MAS Human Computer Interaction Design
• VP Product Management at Doodle.com
• BS Computer Science
About me
Test early, test often.
Why user testing?
Designer UI UserMental
Model
Blind Date
Blind Dates - Or the right choice of Test U sers
Test Subject
Collaboration platform for architects, naval engineers etc.
Blind Dates - Or the right choice of Test U sers
“There are some times when it’s important to test your
product with your exact market, and other times when
users from any demographic can give you the feedback
you need.”
Source: www.usertesting.com/blog/2015/02/09/demographics
Testing with Exact Demographics
When to Use Them and When to Lose Them
User Testing
Hallway Testing
Extreme User Interviews
IDEO Method Cards
What does Jacob think?
Jacob Nielsen
About simplified User Testing
The three main rules:
1. Get representative users
2. Ask them to perform representative tasks with the design
3. Shut up and let the users do the talking.
The last thing you want to hear during a usability study
session is a participant saying,
“I don’t use this kind of [system],” or “I never do that
[task] for my job.” That person cannot help you discover
the problems with that system or how well the system
supports users’ tasks.
Jacob Nielsen
About representative Users
Blind Dates - Or the right choice of Test U sers
The right choice of test users
Recruit Test Users by
Category
Test Users by Category
Consumers vs Experts
Consumers
• Shopping
• News
• Travel
• Social
• Entertainment
• …
Experts
• Medical
• Engineering
• Architecture
• Finance
• Legal
• …
Experts are also Consumers
But Consumers are not always Experts.
Expert
Consumer
Everyone can be potentially recruited to test a
consumer application.
E.g. A neuro scientist uses www.travel.ch
Only Experts from the field can be recruited to
test an Expert application.
E.g. A neuro scientist uses NemoDevices.
Blind Dates - Or the right choice of Test U sers
Blind Dates - Or the right choice of Test U sers
Blind Dates - Or the right choice of Test U sers
Recruit Test Users by
Personas & Scenarios
Test Users by Personas
Primary vs. Secondary vs. Other Personas
Primary Secondary
or
Supportive Non-
Personas
Blind Dates - Or the right choice of Test U sers
Primary and Secodary Personas
With some example scenarios in mind
Primary Personas
• Experienced Kiter who wants to purchase a new Kite
• Newbie Kiter who wants to find a beginners course
• …
Secondary Personas
• A worried parent who wants to learn about the sport
• Godfather who wants to find a gift for a godchild
• …
Supportive and Non-Personas
With some example scenarios in mind
Supportive
• Site Manager who maintains the inventory
• Human Resources maintaining job listings
• …
Non-Personas
• …?
Recruit Test Users by
Test Object
Website, App, Documentation
Test objects
Website /
App
Navigation
Content
Accessibility
Task Completion
Blind Dates - Or the right choice of Test U sers
…
…
Devices
Packaging, Food, Devices
Test objects
Food
…
Packaging
…
Recruiting service for UX people
Blind Dates - Or the right choice of Test U sers
Blind Dates - Or the right choice of Test U sers
Blind Dates - Or the right choice of Test U sers
DACH Panel
20‘000 +
When do you blind date and
when do you choose carefully?
My Learnings
And recommendations
• It’s still better to test with anyone, than no testing at all
There is always something you can learn.
• Choose smaller tests over extensive studies
But iterate as often as necessary
• UX is not a project, it’s an ongoing process
So don’t excuse it with «I’m not ready yet.»
Blind Dates - Or the right choice of Test U sers
Test early.
Test often.
reto@testingtime.com
@rlaemmler @testingtime

More Related Content

PPTX
Design Centred User: A reality check on UCD
PPTX
Blind Dates - Or the right choice of Test Users.
PPTX
Micro Feedback – Maximum Insights? UX Camp Europe 2015, Berlin, #uxce15
PDF
How UX Research Fits Into an Agile Development Process
PDF
Intro to Prototyping
PDF
Paper Prototyping
PDF
UXPA DC UX 101 - User Research
PPTX
Neverstop
Design Centred User: A reality check on UCD
Blind Dates - Or the right choice of Test Users.
Micro Feedback – Maximum Insights? UX Camp Europe 2015, Berlin, #uxce15
How UX Research Fits Into an Agile Development Process
Intro to Prototyping
Paper Prototyping
UXPA DC UX 101 - User Research
Neverstop

What's hot (20)

PDF
THE UX INTERVIEW – 3 Quick Questions. 3 Short Answers.
PPTX
Importance of the Usability of a website
PPTX
Remote Fieldwork: How observational studies elevated usability at AutoTrader.com
PDF
UI/UX Foundations - Research
PPT
Conducting Usability Research with a Team of One [Revised: October 2009]
PDF
Paper Prototyping Rakuten Osaka
PDF
TWS 2014 – Testing paper prototypes
PPTX
Usability and User Experience Training Seminar
PDF
Usability Testing
PDF
UX Tools for Agile Teams – Design Mission
PPTX
99 Problem, But is this issue one?
PDF
Introduction to UX Design Workshop | CodingGirls
PDF
How To Break Into UX: What Is a UX Design Hiring Manager Thinking & Looking For?
PDF
Intro to User Centered Design Workshop
PDF
Rocket-Powered Bicycles: Avoiding Over and Under Engineering Your Product
PDF
5 things you need to know about ux webcamp kl
PPTX
NUX Leeds: Enemies of UX
PDF
User Experience 101 - A Practical Guide
PDF
Workshop guerrilla testing methods @ ux bristol 2011 by valsplat
PDF
UX Strategy OneSheet
THE UX INTERVIEW – 3 Quick Questions. 3 Short Answers.
Importance of the Usability of a website
Remote Fieldwork: How observational studies elevated usability at AutoTrader.com
UI/UX Foundations - Research
Conducting Usability Research with a Team of One [Revised: October 2009]
Paper Prototyping Rakuten Osaka
TWS 2014 – Testing paper prototypes
Usability and User Experience Training Seminar
Usability Testing
UX Tools for Agile Teams – Design Mission
99 Problem, But is this issue one?
Introduction to UX Design Workshop | CodingGirls
How To Break Into UX: What Is a UX Design Hiring Manager Thinking & Looking For?
Intro to User Centered Design Workshop
Rocket-Powered Bicycles: Avoiding Over and Under Engineering Your Product
5 things you need to know about ux webcamp kl
NUX Leeds: Enemies of UX
User Experience 101 - A Practical Guide
Workshop guerrilla testing methods @ ux bristol 2011 by valsplat
UX Strategy OneSheet
Ad

Viewers also liked (6)

PPTX
Google / IFJ Startup Workshop
PPTX
PPTX
Doodle Yahoo Calendar integration
PPTX
Chat roulette for user research
PPTX
Über das U im UX
PPTX
Blitzschnell an echtes Nutzerfeedback - UX Day Mannheim 2016
Google / IFJ Startup Workshop
Doodle Yahoo Calendar integration
Chat roulette for user research
Über das U im UX
Blitzschnell an echtes Nutzerfeedback - UX Day Mannheim 2016
Ad

Similar to Blind Dates - Or the right choice of Test U sers (20)

PDF
Website Usability & User Experience: Veel bezoekers, weinig klanten?
PDF
VIGC Academy
PDF
Rapid Prototyping for XR: Lecture 1 Introduction to Prototyping
PPT
UI For Alien Cowboys
PDF
​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...
PPTX
User Research When You Can't Reach Your Users 20141016
KEY
Designing the mobile experience
PDF
Europython how to make it recruiting suck less?
PDF
UX Bootcamp - August 2016
PPTX
Prototyping and Piloting
PDF
User Experience Design: an Overview
PPTX
Design Thinking: A Common Sense Process
PPTX
User Research When You Can't Reach Your Users 20140802
PPTX
User research when you can’t reach your users
PPTX
User Research When You Can’t Reach Your Users NERD 20140913
PDF
Designing the user experience
PPTX
Introduction & Course Overview: Design Thinking for User Experience Design, P...
PPTX
Introduction to Advanced Industrial Design.pptx
PPTX
Usability Workshop, 11-8-2012
PPT
Usability in Virtual Worlds (Metaverse08)
Website Usability & User Experience: Veel bezoekers, weinig klanten?
VIGC Academy
Rapid Prototyping for XR: Lecture 1 Introduction to Prototyping
UI For Alien Cowboys
​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...
User Research When You Can't Reach Your Users 20141016
Designing the mobile experience
Europython how to make it recruiting suck less?
UX Bootcamp - August 2016
Prototyping and Piloting
User Experience Design: an Overview
Design Thinking: A Common Sense Process
User Research When You Can't Reach Your Users 20140802
User research when you can’t reach your users
User Research When You Can’t Reach Your Users NERD 20140913
Designing the user experience
Introduction & Course Overview: Design Thinking for User Experience Design, P...
Introduction to Advanced Industrial Design.pptx
Usability Workshop, 11-8-2012
Usability in Virtual Worlds (Metaverse08)

More from Reto Laemmler (15)

PDF
Same same but different
PPTX
From 0 to 1 Million using the lean startup approach
PPTX
Trends in user research methods - WIAD17
PPTX
UX Berlin about Movie Her and the future of Voice Interfaces
PPTX
Speed dating with your users
PPTX
UX Camp Berlin 2013 - Hands-on UX
PPTX
Startimpuls at Microsoft w/ IFJ
PPTX
Startupcamp Basel: Rapid Prototyping & User Testing
PPTX
RememberTheName WebMonday Zürich
PPT
RememberTheName - Appcampus.fi
PPT
UX Berlin 2012: RememberTheName
PPTX
Doodle Redesign 2011 - Presentation UXCamp Berlin 2011
PPTX
Doodle Widget For Lotus Notes
PPTX
Google Calendar integration with Doodle
PPTX
Kiss @ Doodle
Same same but different
From 0 to 1 Million using the lean startup approach
Trends in user research methods - WIAD17
UX Berlin about Movie Her and the future of Voice Interfaces
Speed dating with your users
UX Camp Berlin 2013 - Hands-on UX
Startimpuls at Microsoft w/ IFJ
Startupcamp Basel: Rapid Prototyping & User Testing
RememberTheName WebMonday Zürich
RememberTheName - Appcampus.fi
UX Berlin 2012: RememberTheName
Doodle Redesign 2011 - Presentation UXCamp Berlin 2011
Doodle Widget For Lotus Notes
Google Calendar integration with Doodle
Kiss @ Doodle

Recently uploaded (20)

PPTX
Necrosgwjskdnbsjdmdndmkdndndnmdndndkdmdndkdkndmdmis.pptx
PPT
Introduction to Research Methods - Lecture.ppt
PPTX
WHY UPLOADING IS IMPORTANT TO DOWNLOAD SLIDES.pptx
PDF
Humans do not die they live happily without
PDF
IARG - ICTC ANALOG RESEARCH GROUP - GROUP 1 - CHAPTER 2.pdf
PPTX
22CDH01-V3-UNIT-I INTRODUCITON TO EXTENDED REALITY
PPTX
Project_Presentation Bitcoin Price Prediction
PPTX
ACL English Introductionadsfsfadf 20200612.pptx
PDF
Designing Through Complexity - Four Perspectives.pdf
PPTX
Presentation1.pptxnmnmnmnjhjhkjkjkkjkjjk
PPTX
ENG4-Q2-W5-PPT (1).pptx nhdedhhehejjedheh
PPTX
Presentation.pptx anemia in pregnancy in
PPTX
URBAN FINANCEnhynhynnnytnynnnynynyynynynyn
PPTX
Introduction to Building Information Modeling
PPT
Unit I Preparatory process of dyeing in textiles
PDF
Control and coordination isdorjdmdndjke
PPTX
a group casestudy on architectural aesthetic and beauty
PDF
This presentation is made for a design foundation class at Avantika Universit...
PPTX
22CDO02-IMGD-UNIT-I-MOBILE GAME DESIGN PROCESS
PDF
Social Media USAGE .............................................................
Necrosgwjskdnbsjdmdndmkdndndnmdndndkdmdndkdkndmdmis.pptx
Introduction to Research Methods - Lecture.ppt
WHY UPLOADING IS IMPORTANT TO DOWNLOAD SLIDES.pptx
Humans do not die they live happily without
IARG - ICTC ANALOG RESEARCH GROUP - GROUP 1 - CHAPTER 2.pdf
22CDH01-V3-UNIT-I INTRODUCITON TO EXTENDED REALITY
Project_Presentation Bitcoin Price Prediction
ACL English Introductionadsfsfadf 20200612.pptx
Designing Through Complexity - Four Perspectives.pdf
Presentation1.pptxnmnmnmnjhjhkjkjkkjkjjk
ENG4-Q2-W5-PPT (1).pptx nhdedhhehejjedheh
Presentation.pptx anemia in pregnancy in
URBAN FINANCEnhynhynnnytnynnnynynyynynynyn
Introduction to Building Information Modeling
Unit I Preparatory process of dyeing in textiles
Control and coordination isdorjdmdndjke
a group casestudy on architectural aesthetic and beauty
This presentation is made for a design foundation class at Avantika Universit...
22CDO02-IMGD-UNIT-I-MOBILE GAME DESIGN PROCESS
Social Media USAGE .............................................................

Blind Dates - Or the right choice of Test U sers

  • 1. Reto Lämmler • UXCamp Hamburg 2015 @rlaemmler @testingtime Blind Dates – Or the right choice of test users
  • 2. Why do I want to talk about this?
  • 3. The UX industry still designs too much based on assumptions.
  • 4. Talking to a user is worth more than a thousand assumptions.
  • 5. • From Zurich, Switzerland • Co-Founder & CEO of www.testingtime.com • MAS Human Computer Interaction Design • VP Product Management at Doodle.com • BS Computer Science About me Test early, test often.
  • 10. Test Subject Collaboration platform for architects, naval engineers etc.
  • 12. “There are some times when it’s important to test your product with your exact market, and other times when users from any demographic can give you the feedback you need.” Source: www.usertesting.com/blog/2015/02/09/demographics Testing with Exact Demographics When to Use Them and When to Lose Them
  • 16. What does Jacob think?
  • 17. Jacob Nielsen About simplified User Testing The three main rules: 1. Get representative users 2. Ask them to perform representative tasks with the design 3. Shut up and let the users do the talking.
  • 18. The last thing you want to hear during a usability study session is a participant saying, “I don’t use this kind of [system],” or “I never do that [task] for my job.” That person cannot help you discover the problems with that system or how well the system supports users’ tasks. Jacob Nielsen About representative Users
  • 20. The right choice of test users
  • 21. Recruit Test Users by Category
  • 22. Test Users by Category Consumers vs Experts Consumers • Shopping • News • Travel • Social • Entertainment • … Experts • Medical • Engineering • Architecture • Finance • Legal • …
  • 23. Experts are also Consumers But Consumers are not always Experts. Expert Consumer Everyone can be potentially recruited to test a consumer application. E.g. A neuro scientist uses www.travel.ch Only Experts from the field can be recruited to test an Expert application. E.g. A neuro scientist uses NemoDevices.
  • 27. Recruit Test Users by Personas & Scenarios
  • 28. Test Users by Personas Primary vs. Secondary vs. Other Personas Primary Secondary or Supportive Non- Personas
  • 30. Primary and Secodary Personas With some example scenarios in mind Primary Personas • Experienced Kiter who wants to purchase a new Kite • Newbie Kiter who wants to find a beginners course • … Secondary Personas • A worried parent who wants to learn about the sport • Godfather who wants to find a gift for a godchild • …
  • 31. Supportive and Non-Personas With some example scenarios in mind Supportive • Site Manager who maintains the inventory • Human Resources maintaining job listings • … Non-Personas • …?
  • 32. Recruit Test Users by Test Object
  • 33. Website, App, Documentation Test objects Website / App Navigation Content Accessibility Task Completion
  • 35. … … Devices Packaging, Food, Devices Test objects Food … Packaging …
  • 41. When do you blind date and when do you choose carefully?
  • 42. My Learnings And recommendations • It’s still better to test with anyone, than no testing at all There is always something you can learn. • Choose smaller tests over extensive studies But iterate as often as necessary • UX is not a project, it’s an ongoing process So don’t excuse it with «I’m not ready yet.»

Editor's Notes

  • #3: Ziel: Öfter Testen
  • #7: Ziel: Öfter Testen
  • #8: User Testing ist hierfür eine der besten Methoden.
  • #38: Ziel: Öfter Testen
  • #42: - Ab CHF 50 pro Testperson - Agiles Testen
  • #44: Ziel: Öfter Testen