SlideShare a Scribd company logo
Organizing Your First
Website Usability Test
WP Campus 2016 • #WPCampus • @anthonydpaul
Why do we conduct
usability tests?
usability test
user test
Organizing Your First Website Usability Test - WP Campus 2016
why test
1. User focus is best practice (our fault, not theirs)
2. Validate our assumptions
3. Inform our design decisions (to debate the team)
4. Show success over time
5. Grow as a practitioner (e.g., hamburger icon)
But I’m not a researcher
Where do I start?
Anthony D Paul
Director of User Experience
@anthonydpaul
what you need
Project Goal A reason to test, to be translated
into research goals
Test Strategy When to test and what type of test(s)
Prototype Or, other artifact
Test Facility Hardware, software, or physical space
Participants Demographics, if relevant
Project Goal(s)
Why are we even working on this project?
goals come in all shapes and sizes
University Prospects to easily find degree info
e-Store Reduce shopping cart abandonment
Non-Profit Drive donations
goals shouldn’t be prescriptive
Good Allow visitors to quickly find
specific degree program(s) of interest.
Bad List all degree options on the homepage.
ok to have multiple goals (but prioritize)
1. Communicate the school brand and
a positive student experience.
2. Allow prospects to quickly determine if the
school has their program(s) of interest.
3. Drive prospects toward contacting the school
to inquire about a program and its cost.
Test Strategy
What tests should we run and when?
Project Constraints
+
Hairiest Problems (priorities)
=
Maximum Benefit .
project constraints (type)
What’s our test budget?
How many sets of tests can we run? (usually 8–12 ppl per)
Who’s in charge of recruitment?
Do we have demographic requirements?
Are participants local?
focus on hairiest problems (when)
Too much content. (early)
Test info architecture or interactive menu concepts.
vs.
Brand perception is important. (late)
Test design concepts, photography, and copywriting.
testing options
Moderated vs. Unmoderated
In-person vs. Remote
Desktop vs. Mobile
Example Time
University
constraints hairiest problems
1 test (8–12 participants)
Participants not local
Automated recruitment
Too much content;
hard to find things
constraints hairiest problems
1 test (8–12 participants)
Participants not local
Automated recruitment
Too much content;
hard to find things
Use online system,
unmoderated
constraints hairiest problems
1 test (8–12 participants)
Participants not local
Automated recruitment
Too much content;
hard to find things
Use online system,
unmoderated
Test early prototype,
perhaps wireframes
decision
Unmoderated remote test
Use TryMyUI for recruitment and recording
Run test on early designs or wireframes
Use InVision to assemble prototype
InVisionApp.com
InVisionApp.com
InVisionApp.com
Test Script
Project goals to user tasks
goals
1. Communicate the school brand and
a positive student experience.
2. Allow prospects to quickly determine if the
school has their program(s) of interest.
3. Drive prospects toward contacting the school
to inquire about a program and its cost.
goals ~> research questions
1. Can users find the main menu?
2. Do users understand how the menu works?
3. Does the program finder behave as expected?
4. Can users find specific details about a program?
goals ~> research questions ~> tasks
1. Without clicking on anything, where would you
expect to find information about a degree in nursing?
2. Find information about a nursing degree.
3. Return to the homepage. Use the program finder to
find information about a degree in physics.
assemble script
Weave in multiple goals
+
Find preferences first,
then test tools
pilot test
Pilot test with a friend to
get a sense of timing
Setup
Web applications
Organizing Your First Website Usability Test - WP Campus 2016
Organizing Your First Website Usability Test - WP Campus 2016
Organizing Your First Website Usability Test - WP Campus 2016
Organizing Your First Website Usability Test - WP Campus 2016
Organizing Your First Website Usability Test - WP Campus 2016
Organizing Your First Website Usability Test - WP Campus 2016
Closing
Why do we conduct usability tests?
The price of light is less
than the cost of darkness.
Arthur C. Nielsen, Market Researcher
Organizing Your First Website Usability Test - WP Campus 2016
InVision
http://invisionapp.com
TryMyUI
http://trymyui.com
(my talks and blog)
http://adp.rocks or http:// .ws or http:// .ws
Thank you
@anthonydpaul

More Related Content

PDF
Organizing Your First Website Usability Test - WordCamp Boston 2016
PDF
InnovatED: An Approach to Blended PD
PDF
Usability testing
PPTX
Introduction to Usability Testing for Survey Research
PPTX
Usability
PPT
Ispi presentation script 920
PPTX
Usability test
PPTX
Assignment 3
Organizing Your First Website Usability Test - WordCamp Boston 2016
InnovatED: An Approach to Blended PD
Usability testing
Introduction to Usability Testing for Survey Research
Usability
Ispi presentation script 920
Usability test
Assignment 3

What's hot (20)

PPTX
Why You Need to Do a Pilot - Mitch Weisburgh, Founder, Games4Ed & Scott Brews...
ODP
Usability
PPTX
User research independent study
PPTX
Gerhardt Software Evaluation
PPTX
03 bad usability kills
PPTX
Pros and Cons of A/B Testing (UX Camp Brighton 2013)
PPTX
You should test that: How to use A/B testing in product design
PPTX
Usability testing
PDF
Evaluation and User Study in HCI
PPT
iSMAR model
PPTX
Usability Testing
PPT
Liane Bryson, Katie Hughes & James Towner Rhetoric & Writing
PPTX
Conducting usability test
PDF
usability testing - usability metrics and wea
PPTX
Cgt 256 course review
PPTX
Using the Test Centre Tool: an opportunity to inform learning and teaching
PPTX
Cognitive Walkthrough
PPTX
Amazing Makeover Health Edition: Role-Playing for Behavior Change
PPTX
The Design and Evaluation of Beahvior Change Tech
PDF
Usability testing
Why You Need to Do a Pilot - Mitch Weisburgh, Founder, Games4Ed & Scott Brews...
Usability
User research independent study
Gerhardt Software Evaluation
03 bad usability kills
Pros and Cons of A/B Testing (UX Camp Brighton 2013)
You should test that: How to use A/B testing in product design
Usability testing
Evaluation and User Study in HCI
iSMAR model
Usability Testing
Liane Bryson, Katie Hughes & James Towner Rhetoric & Writing
Conducting usability test
usability testing - usability metrics and wea
Cgt 256 course review
Using the Test Centre Tool: an opportunity to inform learning and teaching
Cognitive Walkthrough
Amazing Makeover Health Edition: Role-Playing for Behavior Change
The Design and Evaluation of Beahvior Change Tech
Usability testing
Ad

Viewers also liked (20)

PPTX
Getting to WordPress
PDF
Becoming a WordPress Coding Master
PDF
A gamification framework for native Arabic speaking countries
PDF
WordCamp Baltimore - Ready Set... Engage!
PDF
PDF
EdNET15_- Jenny Munn - condensed
PDF
Getting Comfortable with Child Themes
PPTX
Making - It's Not Just a 3D Printer
PPT
Mis Dibujos Y Pinturas2
PDF
The Short and the Long of Web Science
PDF
An Introduction to PHP Classes
PDF
The Zombie Cure: Content Strategy for Better Websites
PDF
Designing for Community David Colby Reed, Foossa
PPT
Investor allstars award for charity of the year 2016
PPTX
Building a WordPress Sandbox
PPTX
Varying wordpressdevelopmentenvironment wp-campus2016
PDF
Helping Faculty Figure Out Where WordPress Fits
PDF
Classification of seam, sewing method and use
PPTX
Webinar: You Are Too Cheap!
PDF
Connecting Content Silos: One CMS, Many Sites With The WordPress REST API
Getting to WordPress
Becoming a WordPress Coding Master
A gamification framework for native Arabic speaking countries
WordCamp Baltimore - Ready Set... Engage!
EdNET15_- Jenny Munn - condensed
Getting Comfortable with Child Themes
Making - It's Not Just a 3D Printer
Mis Dibujos Y Pinturas2
The Short and the Long of Web Science
An Introduction to PHP Classes
The Zombie Cure: Content Strategy for Better Websites
Designing for Community David Colby Reed, Foossa
Investor allstars award for charity of the year 2016
Building a WordPress Sandbox
Varying wordpressdevelopmentenvironment wp-campus2016
Helping Faculty Figure Out Where WordPress Fits
Classification of seam, sewing method and use
Webinar: You Are Too Cheap!
Connecting Content Silos: One CMS, Many Sites With The WordPress REST API
Ad

Similar to Organizing Your First Website Usability Test - WP Campus 2016 (20)

PDF
Organizing Your First Website Usability Test - WordCamp Lancaster 2016
PDF
Organizing Your First Website Usability Test - WordCamp Toronto 2016
PDF
Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4
PDF
Testing, Testing, 1-2-3: Gathering and Leveraging Audience Usability Data in ...
PPT
Conducting Usability Research with a Team of One [Revised: October 2009]
PDF
AAM 2014 Tech Tutorial: User Testing on a Shoestring
PDF
Usability Testing 101 - an introduction
PDF
Usability Testing and QA 12 11-15
PDF
Art Center Interactive Design 4 - #4 Usability Testing
PPTX
Intro to Lean UX with UserTesting
PDF
Usability Testing and QA 7-18-14
PPTX
Notes on usability testing
PPT
User Testing Whirlwind Tour
PDF
Module 10: Usability Testing
PPTX
Hands on Usability Testing (Jonathan Rubin)
PPTX
User Experience Basics for Product Management
PDF
Prototyping and Usability Testing your designs
PDF
Boost SharePoint User Adoption Through DIY Usability Testing [workshop] Share...
PDF
Uxpin guide to_usability_testing
PDF
Usability Testing How To's - EventHandler, London Jan 22nd 2014
Organizing Your First Website Usability Test - WordCamp Lancaster 2016
Organizing Your First Website Usability Test - WordCamp Toronto 2016
Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4
Testing, Testing, 1-2-3: Gathering and Leveraging Audience Usability Data in ...
Conducting Usability Research with a Team of One [Revised: October 2009]
AAM 2014 Tech Tutorial: User Testing on a Shoestring
Usability Testing 101 - an introduction
Usability Testing and QA 12 11-15
Art Center Interactive Design 4 - #4 Usability Testing
Intro to Lean UX with UserTesting
Usability Testing and QA 7-18-14
Notes on usability testing
User Testing Whirlwind Tour
Module 10: Usability Testing
Hands on Usability Testing (Jonathan Rubin)
User Experience Basics for Product Management
Prototyping and Usability Testing your designs
Boost SharePoint User Adoption Through DIY Usability Testing [workshop] Share...
Uxpin guide to_usability_testing
Usability Testing How To's - EventHandler, London Jan 22nd 2014

More from Anthony D. Paul (20)

PDF
Designing Multi-Partner Transformations from Democratized Polytopias Into Act...
PDF
Primer19 NYC - Envisioning Our Demise to Prevent Our Extinction - Future of F...
PDF
IxDA Interaction19 Seattle - Envisioning Our Demise to Prevent Our Extinction...
PPTX
Advancing Atlanta’s Futures With IoT, A Strategic Foresight Workshop for Prac...
PDF
Intro to User Journey Maps for Building Better Websites - WordCamp Minneapoli...
PDF
Envisioning the Future with Teams Bogged in the Past - anthonydpaul - UXD Chi...
PDF
Sneaking in Good User Experience Without a UX Budget - anthonydpaul - WordCam...
PDF
Sneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaul
PDF
How to Speak at a WordCamp and Look Like a Pro - WordPress DC Meetup April 2017
PDF
Responsive Prototyping with WordPress and Atomic UI Libraries - anthonydpaul ...
PDF
Sneaking in Good UX Without a UX Budget - WordCamp Lancaster 2017 - anthonydpaul
PDF
10 Ways to Think Like a Political Strategist to Drive Institutional Change - ...
PDF
Responsive Prototyping with WordPress and Atomic UI Libraries - anthonydpaul ...
PDF
Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...
PDF
Bringing Order to a Content Hoarder - Cornell Drupal Camp 2016 - part 3
PDF
Intro to User Journey Maps for Building Better Websites - Cornell Drupal Camp...
PDF
Lean Requirements Without Skimping on the Meat - Cornell Drupal Camp 2016 - p...
PDF
Bringing Order to a Content Hoarder (an Information Architecture primer) - Wo...
PDF
Intro to User Journey Mapping for Building Better Websites - WordCamp Ottawa...
PDF
Rapid Prototyping with WordPress Page Builders - WordCamp Asheville 2016 - an...
Designing Multi-Partner Transformations from Democratized Polytopias Into Act...
Primer19 NYC - Envisioning Our Demise to Prevent Our Extinction - Future of F...
IxDA Interaction19 Seattle - Envisioning Our Demise to Prevent Our Extinction...
Advancing Atlanta’s Futures With IoT, A Strategic Foresight Workshop for Prac...
Intro to User Journey Maps for Building Better Websites - WordCamp Minneapoli...
Envisioning the Future with Teams Bogged in the Past - anthonydpaul - UXD Chi...
Sneaking in Good User Experience Without a UX Budget - anthonydpaul - WordCam...
Sneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaul
How to Speak at a WordCamp and Look Like a Pro - WordPress DC Meetup April 2017
Responsive Prototyping with WordPress and Atomic UI Libraries - anthonydpaul ...
Sneaking in Good UX Without a UX Budget - WordCamp Lancaster 2017 - anthonydpaul
10 Ways to Think Like a Political Strategist to Drive Institutional Change - ...
Responsive Prototyping with WordPress and Atomic UI Libraries - anthonydpaul ...
Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...
Bringing Order to a Content Hoarder - Cornell Drupal Camp 2016 - part 3
Intro to User Journey Maps for Building Better Websites - Cornell Drupal Camp...
Lean Requirements Without Skimping on the Meat - Cornell Drupal Camp 2016 - p...
Bringing Order to a Content Hoarder (an Information Architecture primer) - Wo...
Intro to User Journey Mapping for Building Better Websites - WordCamp Ottawa...
Rapid Prototyping with WordPress Page Builders - WordCamp Asheville 2016 - an...

Recently uploaded (20)

PPT
EthicsNotesSTUDENTCOPYfghhnmncssssx sjsjsj
PDF
intro_to_rust.pptx_123456789012446789.pdf
PPTX
VERNACULAR_DESIGN_PPT FINAL WITH PROPOSED PLAN.pptx
PPT
aksharma-dfs.pptgfgfgdfgdgdfgdfgdgdrgdgdgdgdgdgadgdgd
PDF
Interior Structure and Construction A1 NGYANQI
PDF
321 LIBRARY DESIGN.pdf43354445t6556t5656
PDF
THEORY OF ID MODULE (Interior Design Subject)
PDF
UNIT 1 Introduction fnfbbfhfhfbdhdbdto Java.pptx.pdf
PPTX
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
PDF
Test slideshare presentation for blog post
PDF
2025CategoryRanking of technology university
PPTX
DOC-20250430-WA0014._20250714_235747_0000.pptx
PPTX
UNIT III - GRAPHICS AND AUDIO FOR MOBILE
PPTX
Presentation.pptx anemia in pregnancy in
PPT
pump pump is a mechanism that is used to transfer a liquid from one place to ...
PDF
GSH-Vicky1-Complete-Plans on Housing.pdf
PPTX
22CDH01-V3-UNIT III-UX-UI for Immersive Design
PDF
Skskkxiixijsjsnwkwkaksixindndndjdjdjsjjssk
PDF
ART & DESIGN HISTORY OF VEDIC CIVILISATION.pdf
PDF
SOUND-NOTE-ARCHITECT-MOHIUDDIN AKHAND SMUCT
EthicsNotesSTUDENTCOPYfghhnmncssssx sjsjsj
intro_to_rust.pptx_123456789012446789.pdf
VERNACULAR_DESIGN_PPT FINAL WITH PROPOSED PLAN.pptx
aksharma-dfs.pptgfgfgdfgdgdfgdfgdgdrgdgdgdgdgdgadgdgd
Interior Structure and Construction A1 NGYANQI
321 LIBRARY DESIGN.pdf43354445t6556t5656
THEORY OF ID MODULE (Interior Design Subject)
UNIT 1 Introduction fnfbbfhfhfbdhdbdto Java.pptx.pdf
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
Test slideshare presentation for blog post
2025CategoryRanking of technology university
DOC-20250430-WA0014._20250714_235747_0000.pptx
UNIT III - GRAPHICS AND AUDIO FOR MOBILE
Presentation.pptx anemia in pregnancy in
pump pump is a mechanism that is used to transfer a liquid from one place to ...
GSH-Vicky1-Complete-Plans on Housing.pdf
22CDH01-V3-UNIT III-UX-UI for Immersive Design
Skskkxiixijsjsnwkwkaksixindndndjdjdjsjjssk
ART & DESIGN HISTORY OF VEDIC CIVILISATION.pdf
SOUND-NOTE-ARCHITECT-MOHIUDDIN AKHAND SMUCT

Organizing Your First Website Usability Test - WP Campus 2016