SlideShare a Scribd company logo
HI, LET’S
TALK ABOUT
USABILITY
TESTING
@quiffboy
@hyperisland
15 July 2015
Leisa is Head of User Research
@ GDS, GOV.UK
@quiffboy
“…testing with
customers…”
Customers have a monetary value
@quiffboy
Or
@quiffboy
Hola!
@quiffboy
@quiffboy
@quiffboy
https://twitter.com/ladyxtel/status/483439786967838720
@quiffboy
Northern User Experience
Manchester ~ Leeds ~ Newcastle ~ Liverpool
nuxuk.org ~ @nuxuk
@quiffboy
1. Moderated lab testing
2. Remote testing
3. Eye tracking
4. Guerrilla testing
4 common types of
usability testing
@quiffboy
“Observe people using the product to discover…how
well test subjects respond in four areas: efficiency,
accuracy, recall, and emotional response.” -
Wikipedia
1. Moderated lab testing
@quiffboy
@quiffboy
@quiffboy
2. Remote usability testing
@quiffboy
“Eye tracking is the process of measuring either the point of gaze
(where one is looking) or the motion of an eye relative to the head.”
- Wikipedia
3. Eye tracking
@quiffboy
Not so scary anymore…
Complex & intrusive hardware, right?
@quiffboy
Generate lots of complex graphs and diagrams
Needs experience to interpret results
Can be time consuming & expensive
Eye tracking: findings are still scary though
@quiffboy
You should test your
stuff with real people
But it’s a
no brainer,
right?
@quiffboy
http://econsultancy.com/uk/
reports/user-experience-
survey-report
http://nuxuk.org/
2013/09/05/ux-challenge-
choose-right-approach-
guest-blog-ian-franklin-
freelance-ux-consultant/
User Experience Survey 2013
@quiffboy
Why test?
@quiffboy
@quiffboy
Why test?
Improve
decision
making
Remove
guesswork
Remove
experience
bias
So why don’t we always test?
@quiffboy
@quiffboy
So why don’t we always test?
Too
expensive
Time or
resource

consuming
Not a
primary 

concern
“But recruiting
people is tricky…”
@quiffboy
http://www.petbucket.com/blog/61984/scaredy-cat-how-to-handle-a-frightened-feline.html
@quiffboy
5 users ≈ 85% problems
@quiffboy
tinyurl.com/mhr8emm
Caveats, caveats, caveats
Summary: The answer is 5, except when it's not.
Most arguments for using more test participants
are wrong, but some tests should be bigger and
some smaller.
@quiffboy
.com
@quiffboy
£15 for
15 minutes!!
HOW IT WORKS:
We ask you to carry out a couple of simple tasks using a new website, and we learn if we've
designed it correctly. It will take no more than 15 minutes of your time and as a thank you we'll
give you £15 cash.
WHEN:
Monday 17th November // Time slots available 12-1.30pm and 2.30-4pm
WHERE:
Amaze, 1st Floor, Royal Liver Building
We're looking for a few people to help us test a new website.
INTERESTED?
Participants must be female and use a smartphone to browse the internet.
Email b.briggs@amaze.com with your current make of smartphone, and preferred testing slot.
@quiffboy
http://businessupperhand.com/how-to-open-a-coffee-shop/
@quiffboy
Ask
nicely
@quiffboy
Consent
forms
Loads of templates
available on the web
Download one and
tweak accordingly
@quiffboy
I will do this for you
You will film me, and I'm ok with that
I won’t tell anyone what I've seen
You won’t put this on youtube or
(publicly) laugh about it later
You’ll give me some stuff* to say thanks
All consent forms cover the same basic areas:
@quiffboy
* Exact nature of stuff may vary
Participant signs & dates it,
you put it in a drawer…
forever.
@quiffboy
Tell them if
anyone’s watching
or listening
@quiffboy
@quiffboy
“But writing
the report
takes ages…”
@quiffboy
@quiffboy
1) Make it a
one-pager
@quiffboy
2) Bullet-point list,
not reams of copy
@quiffboy
3) Structure the report
by task/user journey
@quiffboy
4) Make your
findings actionable
@quiffboy
5) Do highlight when
a test passes…
@quiffboy
6) …but focus on the
things you can fix
@quiffboy
Keep it brief
Make your report a one-pager
Bullet-point list not reams of copy
Structured by task/user journey
Make findings actionable
Highlight when a test passes
Focus on the things you can fix
@quiffboy
@quiffboy
A few tips…
@quiffboy
1) Avoid
recruiting experts
@quiffboy
2) Test small, 

test early,

test often
@quiffboy
3) If you can, test in
real environments
@quiffboy
4) Focus on what needs
fixing (or refining)
@quiffboy
5) Set tasks,
don’t give instructions
@quiffboy
6) Rotate order of tasks
@quiffboy
7) Your prototype’s
fidelity matters,
but it’s not critical
@quiffboy
8) Five people’s opinions
are not conclusive proof
@quiffboy
9) People say the
darndest things
@quiffboy
10) “Testing with 1 person
is 100% better than testing
with none”
@quiffboy
Steve Krug: Rocket Surgery Made Easy
Anyone Can Usability Test, Part 1: On a Shoestring

Chris Atherton
How Many Test Users in a Usability Study?

Jakob Nielson
The Art of Guerrilla Usability Testing

UX Booth
New to Usability Testing? You’re not alone!

Jennifer Aldrich
User Experience Survey 2013

Econsultancy & WhatUsersDo
UX Challenge: how to choose the right approach to user research

WhatUsersDo & Ian Franklin
“Don’t make me think” & “Rocket Surgery Made Easy” and more…

Steve Krug
@quiffboy
“But you should probably read more” Tony Wilson
HI, ANY
QUESTIONS?
@quiffboy
@hyperisland
15 July 2015

More Related Content

PDF
Inheriting iOS code
PDF
Nhu Viet Nguyen "Why C++ is Becoming a Necessity for QA Automation"
PDF
LightningUX 3
PDF
7 ways you are doing your A/B testing wrong by Côme Courteault
PDF
How to Become a Thought Leader in Your Niche
PDF
Mobile first. Luke Wroblewski
PDF
Reduce Product Failures While Boosting Conversion Rates
PPTX
Don't Fear the User
Inheriting iOS code
Nhu Viet Nguyen "Why C++ is Becoming a Necessity for QA Automation"
LightningUX 3
7 ways you are doing your A/B testing wrong by Côme Courteault
How to Become a Thought Leader in Your Niche
Mobile first. Luke Wroblewski
Reduce Product Failures While Boosting Conversion Rates
Don't Fear the User

Similar to Hyper Island teaching notes: usability testing (20)

PDF
8 steps to great UX by Damian Rees
PDF
Get it right the first time through cheap and easy DIY usability testing
PDF
Get it right the first time through cheap and easy DIY usability testing
PPTX
Notes on usability testing
PDF
Better Software Through User Research
PDF
Usability Testing for Developers with No Budget
PDF
UserZoom & UXPA Present a Webinar: Build a Better Experience
PPTX
Easy & Effective Usability Testing at CodeMash 2012
PDF
start-up-institute-class.key
PDF
Uxpin guide to_usability_testing
PDF
Lean UX Secrets: 5 UX Hacks to Build Better Experiences, Faster
PDF
UX Lean & Mean (Internet Summit 2015)
PDF
More Than Usability
PPTX
Intro to Lean UX with UserTesting
PDF
Get It Right the First Time Through Cheap and Easy DIY Usability Testing - Dr...
PPTX
Eye Tracking the User Experience of Mobile: What You Need to Know
PDF
Human Experience Design (Digital Summit Workshop)
PDF
4YFN 2016 Guerrilla UX
PPTX
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
PDF
UX Research Workshop
8 steps to great UX by Damian Rees
Get it right the first time through cheap and easy DIY usability testing
Get it right the first time through cheap and easy DIY usability testing
Notes on usability testing
Better Software Through User Research
Usability Testing for Developers with No Budget
UserZoom & UXPA Present a Webinar: Build a Better Experience
Easy & Effective Usability Testing at CodeMash 2012
start-up-institute-class.key
Uxpin guide to_usability_testing
Lean UX Secrets: 5 UX Hacks to Build Better Experiences, Faster
UX Lean & Mean (Internet Summit 2015)
More Than Usability
Intro to Lean UX with UserTesting
Get It Right the First Time Through Cheap and Easy DIY Usability Testing - Dr...
Eye Tracking the User Experience of Mobile: What You Need to Know
Human Experience Design (Digital Summit Workshop)
4YFN 2016 Guerrilla UX
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
UX Research Workshop
Ad

Recently uploaded (20)

PDF
Sims 4 Historia para lo sims 4 para jugar
PPT
isotopes_sddsadsaadasdasdasdasdsa1213.ppt
PPTX
artificial intelligence overview of it and more
PPTX
presentation_pfe-universite-molay-seltan.pptx
PPT
Ethics in Information System - Management Information System
PDF
SASE Traffic Flow - ZTNA Connector-1.pdf
PDF
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
PPTX
INTERNET------BASICS-------UPDATED PPT PRESENTATION
PDF
Introduction to the IoT system, how the IoT system works
PDF
The Ikigai Template _ Recalibrate How You Spend Your Time.pdf
PPTX
E -tech empowerment technologies PowerPoint
PDF
Unit-1 introduction to cyber security discuss about how to secure a system
DOCX
Unit-3 cyber security network security of internet system
PPTX
Database Information System - Management Information System
PPTX
Funds Management Learning Material for Beg
PPTX
Digital Literacy And Online Safety on internet
PDF
Smart Home Technology for Health Monitoring (www.kiu.ac.ug)
PDF
Exploring VPS Hosting Trends for SMBs in 2025
PPTX
t_and_OpenAI_Combined_two_pressentations
PPT
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
Sims 4 Historia para lo sims 4 para jugar
isotopes_sddsadsaadasdasdasdasdsa1213.ppt
artificial intelligence overview of it and more
presentation_pfe-universite-molay-seltan.pptx
Ethics in Information System - Management Information System
SASE Traffic Flow - ZTNA Connector-1.pdf
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
INTERNET------BASICS-------UPDATED PPT PRESENTATION
Introduction to the IoT system, how the IoT system works
The Ikigai Template _ Recalibrate How You Spend Your Time.pdf
E -tech empowerment technologies PowerPoint
Unit-1 introduction to cyber security discuss about how to secure a system
Unit-3 cyber security network security of internet system
Database Information System - Management Information System
Funds Management Learning Material for Beg
Digital Literacy And Online Safety on internet
Smart Home Technology for Health Monitoring (www.kiu.ac.ug)
Exploring VPS Hosting Trends for SMBs in 2025
t_and_OpenAI_Combined_two_pressentations
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
Ad

Hyper Island teaching notes: usability testing