SlideShare a Scribd company logo
U X D E S I G N T R A C K : : T Z K - D E S I G N . C O M : : @ D A N I G R R L
COLLABORATIVE
USABILITY TESTING
for lean and agile teams
D A N I N O R D I N
Senior UX Designer, Harvard Business Review
Hi. I’m Dani.
Senior UX Designer,
Harvard Business
Review Group
Co-Organizer, Design 4
Drupal Camp Boston
Author, Drupal for
Designers (O’Reilly,
2012)
danigrrl on Twitter/D.o
Hi. I’m Dani.
LET’S TALK ABOUT
USABILITY TESTING
WHY DO YOU NEED TO TEST?
Learn how real people use
the product
Determine where to focus
effort on improvements
Make sure what you’re
building actually solves a
problem for its users
ASSUMPTIONS CAN BE
DANGEROUS
Lean collaborative test plans
Lean collaborative test plans
https://youtu.be/WTYet-qf1jo
Lean collaborative test plans
http://www.windowscentral.com/video-unreleased-windows-10-build-10114-shows-
changes-start-menu-and-more
TEST PLANNING
W O R K I N G W I T H Y O U R T E A M
ANATOMY OF A TEST PLAN
Research goals
Participant characteristics
What will be tested
Study logistics
Tech Details
• Create ownership
• Align on business and
user goals
• Help them learn the
language of testing and
research
INVOLVE STAKEHOLDERS EARLY
Test Planning, Video Features
• Moderated testing
• Unmoderated testing
• First-Click tests
• Interviews
• Card Sorts
Tools:
• Zurb’s Verify
• UserTesting.com (or
UsabilityHub)
• Optimal Workshop
• Join.Me/WebEx
HAVE MULTIPLE METHODS
• Helps with buy-in
• Ensures “representative-
ness” of users
• Don’t “go to Starbucks”
unless THAT IS
WHERE YOUR USERS
ACTUALLY ARE
Tools:
• Survey Monkey
• Google Forms
SCREEN PARTICIPANTS CAREFULLY
• Logistics are the
hardest part
• Participants need frequent
reminders
Tools:
• Reservio.com
• Join.me
• Scheduled Google
Hangouts
• Google Calendar with
Reminders
AUTOMATE SCHEDULING
CASE STUDY
BENCHMARKING STUDY: SEARCH AND BROWSE
UNMODERATED STUDY (USERTESTING.COM)
Lean collaborative test plans
TEST DESIGN: USERTESTING.COM
Lean collaborative test plans
Lean collaborative test plans
TEST REPORTING AS MEMO
CASE STUDY
GENERATIVE RESEARCH: MyLibrary/Account Features
REMOTE MODERATED STUDY
Lean collaborative test plans
Lean collaborative test plans
Lean collaborative test plans
Lean collaborative test plans
Lean collaborative test plans
Lean collaborative test plans
Lean collaborative test plans
ANALOG
ORGANIZED
READITFORME
DIGITAL
CHAOTIC
SHAREWITHCOLLEAGUES
HBRTRIBES HOW THEYFINDCONTENT
AmbitiousLearner
StrategyImplementer
ABOUT CHARACTERISTICS
PRIMARYDEVICES
GOALS
Get her point acrossto people who may
not understand her industry or approach
Keep track of thingsshe’sread so she can
f nd them easily when she needsthem
Lauren is in a high-level position that generally in-
volves managing up and across, rather than down.
She scours many dif erent sources for industry
trends and leadership adv ice, and is often tasked
with doing research on a specif c topic for her boss.
When sharing, she is more likely to give her per-
spective on the article, along with reference to a
point made earlier. She w ill also share entire read-
ing lists as a reference for a topic.
I don’t use the Library feature. I put them
in an L Drive on my computer... it would
probably be better to do it your way.
QUESTIONS
Wherewasthat articleI read about [topic] that
time?I need to shareit with [colleague].
“Let mecolor codethat so I don’t loseit.”
How do I organizethismess?
RELATIONSHIPWITH HBR
Non-subscriber or lapsed.
Finds content almost exclu-
sively through third parties,
e.g. social, email, RSS
HBRTRIBES:
StrategyImplementer
IdeasTrader
HOW WECAN HELPLAUREN
1. Make library searchable.
2. Allow export of lists to other applications,
such as Pocket or Instapaper.
3. Make lists more visible and sortable f rom w ithin “ My
Saves”
4. Make it easy to save PDFs from a reading list.
HABITS&BEHAVIORS
1. Tends to save articles as a PDF w ithin a dedicated
folder
2. Collects information from multiple sources, and
wants a cohesive solution
3. Will send articles or lists t o colleagues as a way to
back up a point or start dialogue
4. Depends on the ability to search their “ library” and
spends time tagging/organizing the list when they
remember
Lauren (OfficeThought Leader)
HOW THEYFINDCONTENT
Lean collaborative test plans
CASE STUDY
STUDY: RED BAR LOCATION
UNMODERATED STUDY (Verify.com)
Lean collaborative test plans
Lean collaborative test plans
Lean collaborative test plans
WRAPPING UP
• Start with the research goal
• Involve stakeholders early
• Use a variety of methods
• Automate as much as possible
Takeaways:
THANK YOU!
EVALUATE THIS SESSION - LOSANGELES2015.DRUPAL.ORG/SCHEDULE
TWI TTER: @ DANI G RRL
DESI G N4DRUPAL. O RG

More Related Content

PPTX
D4d talkingtoclients
PPTX
The Glue: How to Stick a Drupal Project with Project Management
PPT
Project Management for Drupal - AB Drupal Camp
PPT
Internet librarian v9
PPT
User Research on a Shoestring
PDF
BuddyPress Tips: How We Built chekmrk
PDF
Lean Startup Customer Discovery Tips
D4d talkingtoclients
The Glue: How to Stick a Drupal Project with Project Management
Project Management for Drupal - AB Drupal Camp
Internet librarian v9
User Research on a Shoestring
BuddyPress Tips: How We Built chekmrk
Lean Startup Customer Discovery Tips

What's hot (8)

PDF
DCBADD2015 modernizing the ba role
PPTX
Prototyping for web and mobile workshop
PPTX
Speaker Training Workshop for WordCamps and Meetups
PDF
Real World SharePoint Branding - SharePoint Online - SharePoint Saturday Sess...
PDF
"Empathy Behind the Algorithms" by Chris Corak - Now What? Conference 2017
PPTX
Office 365 branding webinar
PDF
Creating a stellar portfolio
PDF
“Why Content Projects Fail” by Deane Barker - Now What? Conference 2017
DCBADD2015 modernizing the ba role
Prototyping for web and mobile workshop
Speaker Training Workshop for WordCamps and Meetups
Real World SharePoint Branding - SharePoint Online - SharePoint Saturday Sess...
"Empathy Behind the Algorithms" by Chris Corak - Now What? Conference 2017
Office 365 branding webinar
Creating a stellar portfolio
“Why Content Projects Fail” by Deane Barker - Now What? Conference 2017
Ad

Viewers also liked (19)

PPTX
Documenting design patterns
PDF
User research full fat to lean
PDF
Idean_LeanResearch_Jan2014_FINAL
PDF
UX Design for Content Management Systems
PDF
Brain secrets every UXer needs to know
PDF
Design Scripts: Designing (inter)actions with intentions (version 2.0)
PPTX
HubSpot + Evergage - Context Marketing for the eCommerce Shopper
PDF
A Guide to User Research (for People Who Don't Like Talking to Other People)
PPTX
Mapping Mind & Method: The Buyer's Journey in the Age of Inbound Commerce
PDF
Creating a Core Strategy with the UX Strategy Blueprint
PDF
Here's Everything You Need To Know About Sending The Perfect Email
PDF
Documentation avoidance for developers
PDF
UX in an agile environment, 6 December 2016, Copenhagen
PDF
Workshop 12 - GDS user research
PPT
BUS40 User Research Introduction
PPTX
Adopting IA Heuristics and Iterative UX Reviews: A USPS.com Case Study
PPTX
Lean UX i Agila Team
PDF
Design Scripts: Designing (inter)action with intent
PDF
User Research at GDS
Documenting design patterns
User research full fat to lean
Idean_LeanResearch_Jan2014_FINAL
UX Design for Content Management Systems
Brain secrets every UXer needs to know
Design Scripts: Designing (inter)actions with intentions (version 2.0)
HubSpot + Evergage - Context Marketing for the eCommerce Shopper
A Guide to User Research (for People Who Don't Like Talking to Other People)
Mapping Mind & Method: The Buyer's Journey in the Age of Inbound Commerce
Creating a Core Strategy with the UX Strategy Blueprint
Here's Everything You Need To Know About Sending The Perfect Email
Documentation avoidance for developers
UX in an agile environment, 6 December 2016, Copenhagen
Workshop 12 - GDS user research
BUS40 User Research Introduction
Adopting IA Heuristics and Iterative UX Reviews: A USPS.com Case Study
Lean UX i Agila Team
Design Scripts: Designing (inter)action with intent
User Research at GDS
Ad

Similar to Lean collaborative test plans (20)

PDF
Designing to save lives: Government technical documentation
PDF
Concept to Launch: The Ultimate Confluence Guide for Software Teams
PDF
Requirements Engineering for the Humanities
PDF
UX Design with Limited Resources
KEY
Turning Passion Into Words
PDF
Design Process | Tool 02: Scenario - Tool 03: Wireframe
PDF
Sourcei | New Age Sourcing Model !!
PPTX
Personal design thinking guide veronica
PPTX
User Testing your Drupal Administration Process
PPT
Social Media in Research Dissemination
PDF
See to believe: capturing insights using contextual inquiry
PPTX
Conducting User Research
PPTX
When To Use What In Office 365 - SPSVancouver
PDF
Design process
PPTX
DevRel Salon - Writing Decent Documentation, a learning journey with plenty o...
PDF
Becoming A User Advocate
PDF
UX Prototyping and Personas 9-5-14
PPT
Social media and product dev process
PPTX
Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe...
PDF
Stronger together: how to build your cross-team content engine
Designing to save lives: Government technical documentation
Concept to Launch: The Ultimate Confluence Guide for Software Teams
Requirements Engineering for the Humanities
UX Design with Limited Resources
Turning Passion Into Words
Design Process | Tool 02: Scenario - Tool 03: Wireframe
Sourcei | New Age Sourcing Model !!
Personal design thinking guide veronica
User Testing your Drupal Administration Process
Social Media in Research Dissemination
See to believe: capturing insights using contextual inquiry
Conducting User Research
When To Use What In Office 365 - SPSVancouver
Design process
DevRel Salon - Writing Decent Documentation, a learning journey with plenty o...
Becoming A User Advocate
UX Prototyping and Personas 9-5-14
Social media and product dev process
Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe...
Stronger together: how to build your cross-team content engine

More from Dani Nordin (13)

PDF
Increasing Design Influence by adapting your voice to your organization's dec...
PDF
Storytelling as a UX Superpower
PPTX
Mapping medication management to increase cross-product alignment
PPTX
Politics of design systems
PDF
Engaging design contributors in Drupal
PDF
Empathy in the enterprise
PPTX
User Research for the Web and Applications
PDF
Visual Design for Content Management Systems
PPTX
Things to Budget for When Planning a Drupal Implementation
PPTX
User Research for the Web and Applications
PPTX
Strategic UX for Drupal projects
PPT
Social Media and You: How you can use LinkedIn, Twitter, and Facebook to buil...
PPT
What Makes Design "Sustainable?"
Increasing Design Influence by adapting your voice to your organization's dec...
Storytelling as a UX Superpower
Mapping medication management to increase cross-product alignment
Politics of design systems
Engaging design contributors in Drupal
Empathy in the enterprise
User Research for the Web and Applications
Visual Design for Content Management Systems
Things to Budget for When Planning a Drupal Implementation
User Research for the Web and Applications
Strategic UX for Drupal projects
Social Media and You: How you can use LinkedIn, Twitter, and Facebook to buil...
What Makes Design "Sustainable?"

Recently uploaded (20)

DOCX
actividad 20% informatica microsoft project
PDF
YOW2022-BNE-MinimalViableArchitecture.pdf
PPTX
mahatma gandhi bus terminal in india Case Study.pptx
PDF
Wio LTE JP Version v1.3b- 4G, Cat.1, Espruino Compatible\202001935, PCBA;Wio ...
PPTX
YV PROFILE PROJECTS PROFILE PRES. DESIGN
PPTX
12. Community Pharmacy and How to organize it
PPT
Machine printing techniques and plangi dyeing
PDF
Trusted Executive Protection Services in Ontario — Discreet & Professional.pdf
PPTX
Wisp Textiles: Where Comfort Meets Everyday Style
PPT
UNIT I- Yarn, types, explanation, process
PPTX
6- Architecture design complete (1).pptx
DOCX
The story of the first moon landing.docx
PPTX
BSCS lesson 3.pptxnbbjbb mnbkjbkbbkbbkjb
PDF
Interior Structure and Construction A1 NGYANQI
PDF
High-frequency high-voltage transformer outline drawing
PPT
Package Design Design Kit 20100009 PWM IC by Bee Technologies
PPTX
Tenders & Contracts Works _ Services Afzal.pptx
PDF
Urban Design Final Project-Site Analysis
PDF
Design Thinking - Module 1 - Introduction To Design Thinking - Dr. Rohan Dasg...
PPTX
Causes of Flooding by Slidesgo sdnl;asnjdl;asj.pptx
actividad 20% informatica microsoft project
YOW2022-BNE-MinimalViableArchitecture.pdf
mahatma gandhi bus terminal in india Case Study.pptx
Wio LTE JP Version v1.3b- 4G, Cat.1, Espruino Compatible\202001935, PCBA;Wio ...
YV PROFILE PROJECTS PROFILE PRES. DESIGN
12. Community Pharmacy and How to organize it
Machine printing techniques and plangi dyeing
Trusted Executive Protection Services in Ontario — Discreet & Professional.pdf
Wisp Textiles: Where Comfort Meets Everyday Style
UNIT I- Yarn, types, explanation, process
6- Architecture design complete (1).pptx
The story of the first moon landing.docx
BSCS lesson 3.pptxnbbjbb mnbkjbkbbkbbkjb
Interior Structure and Construction A1 NGYANQI
High-frequency high-voltage transformer outline drawing
Package Design Design Kit 20100009 PWM IC by Bee Technologies
Tenders & Contracts Works _ Services Afzal.pptx
Urban Design Final Project-Site Analysis
Design Thinking - Module 1 - Introduction To Design Thinking - Dr. Rohan Dasg...
Causes of Flooding by Slidesgo sdnl;asnjdl;asj.pptx

Lean collaborative test plans

  • 1. U X D E S I G N T R A C K : : T Z K - D E S I G N . C O M : : @ D A N I G R R L COLLABORATIVE USABILITY TESTING for lean and agile teams D A N I N O R D I N Senior UX Designer, Harvard Business Review
  • 2. Hi. I’m Dani. Senior UX Designer, Harvard Business Review Group Co-Organizer, Design 4 Drupal Camp Boston Author, Drupal for Designers (O’Reilly, 2012) danigrrl on Twitter/D.o Hi. I’m Dani.
  • 4. WHY DO YOU NEED TO TEST? Learn how real people use the product Determine where to focus effort on improvements Make sure what you’re building actually solves a problem for its users
  • 11. TEST PLANNING W O R K I N G W I T H Y O U R T E A M
  • 12. ANATOMY OF A TEST PLAN Research goals Participant characteristics What will be tested Study logistics Tech Details
  • 13. • Create ownership • Align on business and user goals • Help them learn the language of testing and research INVOLVE STAKEHOLDERS EARLY Test Planning, Video Features
  • 14. • Moderated testing • Unmoderated testing • First-Click tests • Interviews • Card Sorts Tools: • Zurb’s Verify • UserTesting.com (or UsabilityHub) • Optimal Workshop • Join.Me/WebEx HAVE MULTIPLE METHODS
  • 15. • Helps with buy-in • Ensures “representative- ness” of users • Don’t “go to Starbucks” unless THAT IS WHERE YOUR USERS ACTUALLY ARE Tools: • Survey Monkey • Google Forms SCREEN PARTICIPANTS CAREFULLY
  • 16. • Logistics are the hardest part • Participants need frequent reminders Tools: • Reservio.com • Join.me • Scheduled Google Hangouts • Google Calendar with Reminders AUTOMATE SCHEDULING
  • 17. CASE STUDY BENCHMARKING STUDY: SEARCH AND BROWSE UNMODERATED STUDY (USERTESTING.COM)
  • 23. CASE STUDY GENERATIVE RESEARCH: MyLibrary/Account Features REMOTE MODERATED STUDY
  • 31. ANALOG ORGANIZED READITFORME DIGITAL CHAOTIC SHAREWITHCOLLEAGUES HBRTRIBES HOW THEYFINDCONTENT AmbitiousLearner StrategyImplementer ABOUT CHARACTERISTICS PRIMARYDEVICES GOALS Get her point acrossto people who may not understand her industry or approach Keep track of thingsshe’sread so she can f nd them easily when she needsthem Lauren is in a high-level position that generally in- volves managing up and across, rather than down. She scours many dif erent sources for industry trends and leadership adv ice, and is often tasked with doing research on a specif c topic for her boss. When sharing, she is more likely to give her per- spective on the article, along with reference to a point made earlier. She w ill also share entire read- ing lists as a reference for a topic. I don’t use the Library feature. I put them in an L Drive on my computer... it would probably be better to do it your way. QUESTIONS Wherewasthat articleI read about [topic] that time?I need to shareit with [colleague]. “Let mecolor codethat so I don’t loseit.” How do I organizethismess? RELATIONSHIPWITH HBR Non-subscriber or lapsed. Finds content almost exclu- sively through third parties, e.g. social, email, RSS HBRTRIBES: StrategyImplementer IdeasTrader HOW WECAN HELPLAUREN 1. Make library searchable. 2. Allow export of lists to other applications, such as Pocket or Instapaper. 3. Make lists more visible and sortable f rom w ithin “ My Saves” 4. Make it easy to save PDFs from a reading list. HABITS&BEHAVIORS 1. Tends to save articles as a PDF w ithin a dedicated folder 2. Collects information from multiple sources, and wants a cohesive solution 3. Will send articles or lists t o colleagues as a way to back up a point or start dialogue 4. Depends on the ability to search their “ library” and spends time tagging/organizing the list when they remember Lauren (OfficeThought Leader) HOW THEYFINDCONTENT
  • 33. CASE STUDY STUDY: RED BAR LOCATION UNMODERATED STUDY (Verify.com)
  • 38. • Start with the research goal • Involve stakeholders early • Use a variety of methods • Automate as much as possible Takeaways:
  • 39. THANK YOU! EVALUATE THIS SESSION - LOSANGELES2015.DRUPAL.ORG/SCHEDULE TWI TTER: @ DANI G RRL DESI G N4DRUPAL. O RG