SlideShare a Scribd company logo
MASTER
CLASS
WASHINGTON D.C. ~ JULY 6 - 7, 2023
DIGIMARCONWASHINGTONDC.COM | #DigiMarConWashingtonDC
Dr. Catherine Lada
PRESIDENT
LADA CONSULTING
Get Deep Insights
with Only 5 Users:
UX Crash Course
Get Deep Insights
with only 5 Users:
A UX Crash Course
Catherine A. Lada, D.Sc., CAE
Agenda
I. Introduction
II. Why do we need user insights?
III. How do we get user insights?
IV. What is the think-aloud protocol?
V. How can you set up your own usability interviews?
VI. Summary
3
Introduction
Certified Association Executive
Doctor of Science in Information Systems and Communications
Marketer for nearly 20 years
Adjunct professor for the graduate program in marketing at West
Virginia University
4
Primary goal:
annual revenue
growth
Your website is your brand – is it dry and
unappealing?
Or engaging and welcoming?
Do people find what they’re looking for?
Think-aloud protocol
In a thinking aloud test, you ask test
participants to use the system while
continuously thinking out loud — that is, simply
verbalizing their thoughts as they move through
the user interface.
Website
Member
Journey
Before and After
www.aaha.org
We are goal-oriented beings
AAHA interview.mp4
Insights
Insights
1. Brand promise is unclear – no idea if need to be accredited to join.
2. It’s too difficult to find answers about accreditation on the website.
3. Users have unspoken (usually) questions they are trying to answer –
your site needs to literally speak their language.
4. The member benefits guide is not user-friendly. (scrolling, color)
5. It’s not clear what the member benefits are soon enough.
6. It’s not clear how many standards there are.
7. Users can’t even see a preview to know what the standards are.
8. You will have to continually prompt them to talk during the interview.
https://www.aaha.org/membership/about-membership/
Before
Combined accreditation and membership section with no
clear journey path, resulting in high bounce rates, a lack
of conversions, and misperceptions about the differences
between membership and accreditation.
After
After reviewing the data and conducting usability interviews with
members, I drafted a new information architecture separating
membership and accreditation and creating a clear path from an
introduction to joining. Bounce rates have dropped, but the data is not in
yet for conversions.
The new accreditation menu
New content page
New page
The old website didn’t have a
page devoted to membership –
only one devoted to accreditation
(which is only one of three types
of membership).
The new pages have a member
value proposition and make it
clear that there are three types of
membership, how much each
costs, and what benefits are
accessible.
Most pages also have multi-
media storytelling elements such
as this video on why to join as an
accredited practice. A plan is in
place to create storytelling
elements on every page.
Where to get the questions?
Sales Team
Common questions
asked during sales
process
Marketing
FAQs on the website
Brand questions
Analytics
High bounce rates
Top content
Content that should
be top but isn’t
Focus Groups
Small groups talk
about using the
website – why, when,
how often,
satisfaction
Surveys
Popup survey on the
website – why are
you here? Find what
you’re looking for?
How satisfied are
you?
1 2 3 4 5
Recruiting participants
“Regular” users
No super-users
No board members
No staff or volunteers
Representative sample
Incentivize
$25 company or Amazon
gift card
Keep the invitation simple
Convenient times
Early AM and evenings
Keep it brief – 30 minutes
Welcome the participant
Welcome the user and thank them. Introduce yourself and your
role as it relates to the company/association. Ask if it is ok to
record the session so that your colleagues can also view the
sessions, for research purposes. Hit record (I’ve never had
someone refuse).
Show them a short video clip that demonstrates the think-aloud
protocol: https://www.youtube.com/watch?v=YwcggHAbnNg
Orient the user to the exercise
Tell them something like “You’re going to complete several tasks in the
allotted 30 minutes and I am going to record, observe, and take notes
about how you’re feeling and the types of thoughts you’re verbalizing.
I’m not an expert on the site or its content so I cannot provide advice or
guidance – but that’s ok. In the real world, you’d be on your own, too!”
No right or wrong
Emphasize: “there is no right or wrong here – we’re NOT testing
YOUR ability, we’re testing the ability of the WEBSITE to get users like
you to where they need to go to answer their questions.”
Constantly prompt them to think aloud – you’ll
likely have to give an example and likely have
to repeat this – a lot!
What to record
20
Task User
Establish
ed or YP?
Comple
ted
Task?
Notes
Were issues
Minor or
Major?
Time to
Complet
ion
Task
Satisfactio
n
How [condition] affects water
workers
L.
Smith
Establish
ed Y
Hard to find stuff on the site. Start at
News. Look for [topic]. Nothing there.
Search button. Finds fact sheet –
[association] experts on [topic]. Trying
every link they find. 404 error. Not
unusual for association. Minor 2:36Satisfied
Price for [publication]
L.
Smith
Establish
ed Y
Publications & news. Checked quick links.
Go to Shop. Login. Search publication.
94.99. N/A 1:13Satisfied
Register for CE
L.
Smith
Establish
ed N
Couldn't find a webcast she wanted to
register for. Was on [association
microsite] couldn’t get back (didn't see
wasn't on the main site). Uses filter for
"last 90 days" even though we are in
March. She wanted to find a webcast but
didn't see any coming up. Checked a
conference but it still says pending CE,
she won't register for it unless it offers
CE. Major 5:34
Very
Unsatisfied
Data Analysis
How satisfied were they?
Is there a pattern across
users on particular parts of
the site?
Did they complete the
task? How long did it take?
(1-3 minutes is the goal)
Sentiment Task Completion
Record significant thoughts
“I thought this was odd”
“I thought that button was
the bottom of the page, I
didn’t realize there was
more.”
“I thought the membership
page would have the dues
on it.”
“I use the site search, not
the menus.”
Verbatims
Thank you
Cathy Lada, D.Sc., CAE
President, Lada Consulting
cathy@cathylada.com
www.CathyLada.com
Download a free UX guide and these slides:
https://cathylada.com/digimarcon-resources
Get Deep Insights with Only 5 Users: UX Crash Course - Dr. Catherine Lada, Lada Consulting

More Related Content

PDF
Inked Voices
PPTX
Tap Chapters as a Member Engagement Channel
PPT
Community Marketing: Using Customer & Peer Endorsement to Lift Conversions, G...
PPT
Social Networking For Hospitals
PPTX
Users, Usability & User Experience - at PodCamp Cleveland 2011
PPTX
Membership Growth Online Summit 2017 - Day 2: The Digital Education Tools Tha...
PDF
6 critical-mistakes-association-managers-make
PDF
Break Up With Your Homepage, 'Cause I'm Bored: Moving Beyond the Universal Un...
Inked Voices
Tap Chapters as a Member Engagement Channel
Community Marketing: Using Customer & Peer Endorsement to Lift Conversions, G...
Social Networking For Hospitals
Users, Usability & User Experience - at PodCamp Cleveland 2011
Membership Growth Online Summit 2017 - Day 2: The Digital Education Tools Tha...
6 critical-mistakes-association-managers-make
Break Up With Your Homepage, 'Cause I'm Bored: Moving Beyond the Universal Un...

Similar to Get Deep Insights with Only 5 Users: UX Crash Course - Dr. Catherine Lada, Lada Consulting (20)

DOC
Welcome letter from smartvt
PPT
Social Media For Small Business
PPT
Social Networking For Event Marketing Professionals
PDF
Advancing Research: Double Your Mileage
PPT
How Lawyers Can Harness the Power of Social Media
PPT
Planning for growth – Essential research for developing your member recruitme...
DOCX
Hi Wilfred,Dont forget that we have a lunch scheduled on Friday
PDF
Sergii Alekseev: How to create community and use its power to improve a produ...
PPT
Sustainable Technology in a 2.0 World
PDF
User research: Uncovering compelling insights through interviews
PPT
LinkedIn Primer
PPTX
Social Media and Realtor Associations
PDF
"Open" includes users - Leverage their input
PDF
How to win over your colleagues and make life easier iwmw 2017
PPT
Ninja networking training
PPT
Ninja networking training
PPT
Smart social for_business
PDF
Metrics that Matter
PPTX
How to Design an Irresistible Website that Attracts the Right Members
Welcome letter from smartvt
Social Media For Small Business
Social Networking For Event Marketing Professionals
Advancing Research: Double Your Mileage
How Lawyers Can Harness the Power of Social Media
Planning for growth – Essential research for developing your member recruitme...
Hi Wilfred,Dont forget that we have a lunch scheduled on Friday
Sergii Alekseev: How to create community and use its power to improve a produ...
Sustainable Technology in a 2.0 World
User research: Uncovering compelling insights through interviews
LinkedIn Primer
Social Media and Realtor Associations
"Open" includes users - Leverage their input
How to win over your colleagues and make life easier iwmw 2017
Ninja networking training
Ninja networking training
Smart social for_business
Metrics that Matter
How to Design an Irresistible Website that Attracts the Right Members
Ad

More from DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions (20)

PDF
AI & Automation: The Future of Marketing or the End of Creativity - Matthew W...
PDF
Digital Marketing in the Age of AI: What CEOs Need to Know - Jennifer Apy, Ch...
PDF
Prove and Prioritize Profitability in Every Marketing Campaign - Zach Sherrod...
PDF
PDF
Modernizing IT for the age of AI - Jason Aloia, Freshworks
PDF
The Intuition Behind the Application of LLMs in Marketing - Mario Vinasco, Un...
PDF
How the Minnesota Vikings Used Community to Drive 170% Growth and Acquire 34K...
PDF
Strategic Sales Plays: How Marketing and Sales Teams Win Together - Megan Hal...
PDF
Societal Sync: Driving KPIs With Brand x Cultural Alignment - Julius Giron, S...
PDF
AI-Powered Influence: Igniting the B2B Funnel from Demand Gen to Advocacy - A...
PDF
Unlocking Future Growth: Attract Customers with Automation & Fresh Strategies...
PDF
Digital Marketing Trends: Expert Insights on Gaining a Competitive Edge - Nik...
PDF
Digital Transformation - Albert Donaldson, Golf Away Tampa Bay
PDF
Relationship Currency: The Key to Purpose Drive Success - Rocio (Rosie) Pauls...
PDF
Mastering the Art of the Prompt - Brantley Smith, HomePro Marketing
PDF
The Value of Content Marketing in a Cluttered Space - Mike Sedita, 16W Media ...
PDF
AI & Automation: The Future of Marketing or the End of Creativity - Eric Ritt...
PDF
Reinvention in the Digital Age: Leading with Authenticity to Build a Magnetic...
PDF
The Skill AI Can’t Replace And How to Start Mastering It Before Everyone Else...
AI & Automation: The Future of Marketing or the End of Creativity - Matthew W...
Digital Marketing in the Age of AI: What CEOs Need to Know - Jennifer Apy, Ch...
Prove and Prioritize Profitability in Every Marketing Campaign - Zach Sherrod...
Modernizing IT for the age of AI - Jason Aloia, Freshworks
The Intuition Behind the Application of LLMs in Marketing - Mario Vinasco, Un...
How the Minnesota Vikings Used Community to Drive 170% Growth and Acquire 34K...
Strategic Sales Plays: How Marketing and Sales Teams Win Together - Megan Hal...
Societal Sync: Driving KPIs With Brand x Cultural Alignment - Julius Giron, S...
AI-Powered Influence: Igniting the B2B Funnel from Demand Gen to Advocacy - A...
Unlocking Future Growth: Attract Customers with Automation & Fresh Strategies...
Digital Marketing Trends: Expert Insights on Gaining a Competitive Edge - Nik...
Digital Transformation - Albert Donaldson, Golf Away Tampa Bay
Relationship Currency: The Key to Purpose Drive Success - Rocio (Rosie) Pauls...
Mastering the Art of the Prompt - Brantley Smith, HomePro Marketing
The Value of Content Marketing in a Cluttered Space - Mike Sedita, 16W Media ...
AI & Automation: The Future of Marketing or the End of Creativity - Eric Ritt...
Reinvention in the Digital Age: Leading with Authenticity to Build a Magnetic...
The Skill AI Can’t Replace And How to Start Mastering It Before Everyone Else...
Ad

Recently uploaded (20)

PPT
Market Segmentation and Positioning(3).ppt
PPTX
Best Digital marketing service provider in Chandigarh.pptx
PPTX
"Best Healthcare Digital Marketing Ideas
PDF
Mastering Bulk Email Campaign Optimization for 2025
PPTX
CH 1 AN INTRODUCTION OF INTEGRATED MARKETING COMMUNICATION (COMBINE)
PPTX
SaaS intelligence platform for B2B founders and marketers - Toksta
PDF
Missing skill for SEO in AI Era eSkydecode.pdf
PPTX
Tea and different types of tea in India
PDF
UNIT 2 - 5 DISTRIBUTION IN RURAL MARKETS.pdf
PDF
E_Book_Customer_Relation_Management_0.pdf
PDF
DigiBrandX: Crafting Identities That Resonate
PDF
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
PDF
You Need SEO for Your Business. Here’s Why..pdf
PDF
Dream Powell - Project and Portfolio 3: Marketing
PDF
Digital Marketing Agency vs Freelancers and VAs: Which Should You Hire in 2025
PDF
RC 14001 Certification: Enhancing ISO 14001 with EHS & Security Standards
PDF
Digital Marketing - clear pictire of marketing
PDF
SEO vs. AEO: Optimizing for Google vs AI-Powered Search Assistants
PPT
Introduction to consumer behavior(1).PPT
PPTX
Fixing-AI-Hallucinations-The-NeuroRanktm-Approach.pptx
Market Segmentation and Positioning(3).ppt
Best Digital marketing service provider in Chandigarh.pptx
"Best Healthcare Digital Marketing Ideas
Mastering Bulk Email Campaign Optimization for 2025
CH 1 AN INTRODUCTION OF INTEGRATED MARKETING COMMUNICATION (COMBINE)
SaaS intelligence platform for B2B founders and marketers - Toksta
Missing skill for SEO in AI Era eSkydecode.pdf
Tea and different types of tea in India
UNIT 2 - 5 DISTRIBUTION IN RURAL MARKETS.pdf
E_Book_Customer_Relation_Management_0.pdf
DigiBrandX: Crafting Identities That Resonate
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
You Need SEO for Your Business. Here’s Why..pdf
Dream Powell - Project and Portfolio 3: Marketing
Digital Marketing Agency vs Freelancers and VAs: Which Should You Hire in 2025
RC 14001 Certification: Enhancing ISO 14001 with EHS & Security Standards
Digital Marketing - clear pictire of marketing
SEO vs. AEO: Optimizing for Google vs AI-Powered Search Assistants
Introduction to consumer behavior(1).PPT
Fixing-AI-Hallucinations-The-NeuroRanktm-Approach.pptx

Get Deep Insights with Only 5 Users: UX Crash Course - Dr. Catherine Lada, Lada Consulting

  • 1. MASTER CLASS WASHINGTON D.C. ~ JULY 6 - 7, 2023 DIGIMARCONWASHINGTONDC.COM | #DigiMarConWashingtonDC Dr. Catherine Lada PRESIDENT LADA CONSULTING Get Deep Insights with Only 5 Users: UX Crash Course
  • 2. Get Deep Insights with only 5 Users: A UX Crash Course Catherine A. Lada, D.Sc., CAE
  • 3. Agenda I. Introduction II. Why do we need user insights? III. How do we get user insights? IV. What is the think-aloud protocol? V. How can you set up your own usability interviews? VI. Summary 3
  • 4. Introduction Certified Association Executive Doctor of Science in Information Systems and Communications Marketer for nearly 20 years Adjunct professor for the graduate program in marketing at West Virginia University 4
  • 5. Primary goal: annual revenue growth Your website is your brand – is it dry and unappealing? Or engaging and welcoming? Do people find what they’re looking for?
  • 6. Think-aloud protocol In a thinking aloud test, you ask test participants to use the system while continuously thinking out loud — that is, simply verbalizing their thoughts as they move through the user interface.
  • 8. We are goal-oriented beings AAHA interview.mp4
  • 10. Insights 1. Brand promise is unclear – no idea if need to be accredited to join. 2. It’s too difficult to find answers about accreditation on the website. 3. Users have unspoken (usually) questions they are trying to answer – your site needs to literally speak their language. 4. The member benefits guide is not user-friendly. (scrolling, color) 5. It’s not clear what the member benefits are soon enough. 6. It’s not clear how many standards there are. 7. Users can’t even see a preview to know what the standards are. 8. You will have to continually prompt them to talk during the interview.
  • 11. https://www.aaha.org/membership/about-membership/ Before Combined accreditation and membership section with no clear journey path, resulting in high bounce rates, a lack of conversions, and misperceptions about the differences between membership and accreditation. After After reviewing the data and conducting usability interviews with members, I drafted a new information architecture separating membership and accreditation and creating a clear path from an introduction to joining. Bounce rates have dropped, but the data is not in yet for conversions.
  • 13. New content page New page The old website didn’t have a page devoted to membership – only one devoted to accreditation (which is only one of three types of membership). The new pages have a member value proposition and make it clear that there are three types of membership, how much each costs, and what benefits are accessible. Most pages also have multi- media storytelling elements such as this video on why to join as an accredited practice. A plan is in place to create storytelling elements on every page.
  • 14. Where to get the questions? Sales Team Common questions asked during sales process Marketing FAQs on the website Brand questions Analytics High bounce rates Top content Content that should be top but isn’t Focus Groups Small groups talk about using the website – why, when, how often, satisfaction Surveys Popup survey on the website – why are you here? Find what you’re looking for? How satisfied are you? 1 2 3 4 5
  • 15. Recruiting participants “Regular” users No super-users No board members No staff or volunteers Representative sample Incentivize $25 company or Amazon gift card Keep the invitation simple Convenient times Early AM and evenings Keep it brief – 30 minutes
  • 16. Welcome the participant Welcome the user and thank them. Introduce yourself and your role as it relates to the company/association. Ask if it is ok to record the session so that your colleagues can also view the sessions, for research purposes. Hit record (I’ve never had someone refuse). Show them a short video clip that demonstrates the think-aloud protocol: https://www.youtube.com/watch?v=YwcggHAbnNg
  • 17. Orient the user to the exercise Tell them something like “You’re going to complete several tasks in the allotted 30 minutes and I am going to record, observe, and take notes about how you’re feeling and the types of thoughts you’re verbalizing. I’m not an expert on the site or its content so I cannot provide advice or guidance – but that’s ok. In the real world, you’d be on your own, too!”
  • 18. No right or wrong Emphasize: “there is no right or wrong here – we’re NOT testing YOUR ability, we’re testing the ability of the WEBSITE to get users like you to where they need to go to answer their questions.”
  • 19. Constantly prompt them to think aloud – you’ll likely have to give an example and likely have to repeat this – a lot!
  • 20. What to record 20 Task User Establish ed or YP? Comple ted Task? Notes Were issues Minor or Major? Time to Complet ion Task Satisfactio n How [condition] affects water workers L. Smith Establish ed Y Hard to find stuff on the site. Start at News. Look for [topic]. Nothing there. Search button. Finds fact sheet – [association] experts on [topic]. Trying every link they find. 404 error. Not unusual for association. Minor 2:36Satisfied Price for [publication] L. Smith Establish ed Y Publications & news. Checked quick links. Go to Shop. Login. Search publication. 94.99. N/A 1:13Satisfied Register for CE L. Smith Establish ed N Couldn't find a webcast she wanted to register for. Was on [association microsite] couldn’t get back (didn't see wasn't on the main site). Uses filter for "last 90 days" even though we are in March. She wanted to find a webcast but didn't see any coming up. Checked a conference but it still says pending CE, she won't register for it unless it offers CE. Major 5:34 Very Unsatisfied
  • 21. Data Analysis How satisfied were they? Is there a pattern across users on particular parts of the site? Did they complete the task? How long did it take? (1-3 minutes is the goal) Sentiment Task Completion Record significant thoughts “I thought this was odd” “I thought that button was the bottom of the page, I didn’t realize there was more.” “I thought the membership page would have the dues on it.” “I use the site search, not the menus.” Verbatims
  • 22. Thank you Cathy Lada, D.Sc., CAE President, Lada Consulting cathy@cathylada.com www.CathyLada.com Download a free UX guide and these slides: https://cathylada.com/digimarcon-resources