SlideShare a Scribd company logo
24-hour Days, 4 Languages:
Challenges of International
Usability Testing
•Founded 1967: Ann Arbor, Rochester NY, Palo Alto
•Early practitioners of user research
Contributed to the development of early usability
testing methodologies that are standard today
•More than 150 clients; close to 2,000 projects
•Apps, websites, devices, other products for B2C/B2B
TecEd IUE 2015
What makes a good localized
app?
•When do salespeople want materials in English,
and when in their local language?
•When do they search using English,
and when in their local language?
6
1 1
6
1
4
2 10
2
4
6
8
10
12
14
16
18
20
22
English Local
language
Other
response
NumberofParticipants
Favored Language
Favored Search Language
Do you prefer to search using English or
[language]?
French Speakers
Mandarin Speakers
Spanish Speakers
•Engaged bilingual partner researchers in France,
Chile, and China
•Coordinated with our client’s participant recruiters
•Created translation-ready research protocol in English
•Had the protocol translated into French, Spanish,
and Chinese
•Created data-logging template
•Had our partner researchers conduct pilot-test sessions in
the local language
Here’s What We Did
•Reviewed pilot session results with our client,
then adjusted the protocol
•Had our partner researchers conduct 7 or 8 sessions in the
local language
•Collected data logs in English from our partner researchers
•Arranged for translation of the session recordings into
English
•Wrote results report for presentation to our client, with
partner researcher input
More Details
Engaging Research Partners
• User research skills and experience
• Bilingual communication facility
• Availability for desired schedule
Coordinating Participant
Recruiting
 Salespeople: sensitive
recruiting
 Indirect access and
communication
 Unexpected outcomes
 Content similar to U.S. research projects
 Needed to be foolproof
 No U.S. slang, no ambiguities
Data-Logging Templates
 Consistent reporting from
researchers using 3 different
languages
 Sessions in native language, but
English data logs
 Structured logs facilitated data
analysis
Pilot-Test Sessions
 One in each language
 Observed by client stakeholders
over WebEx
 Each followed by debrief in English
with the partner researcher
At Last, the Sessions
 7 – 8 sessions in each language
 Over 15 time zones
 Just-in-time recruiting
 Arranged to translate all session
recordings into English
 5 cycles of report deliverables
 15 graphs of participant preferences
 Hundreds of participant quotations
 Project management for a multiple-
language usability test is hugely complex
 Maintaining consistency of methodology in
multiple countries is another challenge
 International holidays differ and can impact
schedules
 A project in 5 time zones spanning 15 hours
means you are never off-duty
Thank you!
Stephanie Rosenbaum
stephanie@teced.com
Larry Rusinsky
larry@teced.com

More Related Content

PDF
Slides That Rock
PDF
Gentex Reimagining the PLM Experience
PDF
The Quick And Dirty Guide To Creating Blog Posts That Your Audience Craves
PDF
SlideShare 101
PDF
STOP! VIEW THIS! 10-Step Checklist When Uploading to Slideshare
PDF
Masters of SlideShare
PDF
What Makes Great Infographics
PDF
10 Ways to Win at SlideShare SEO & Presentation Optimization
Slides That Rock
Gentex Reimagining the PLM Experience
The Quick And Dirty Guide To Creating Blog Posts That Your Audience Craves
SlideShare 101
STOP! VIEW THIS! 10-Step Checklist When Uploading to Slideshare
Masters of SlideShare
What Makes Great Infographics
10 Ways to Win at SlideShare SEO & Presentation Optimization

Similar to TecEd IUE 2015 (20)

PPTX
Boston Mini Upa2011: Localization Research Presentation by Jennifer Fabrizi a...
PDF
Pre-Conference Course: Cross-Cultural User Experience Design - Aaron Marcus
PDF
Cross Cultural UX research - Best practices for international insights
PPTX
The Impact of Reaching out to
PPTX
Fast & Cheap UX Research
PPTX
International Business User Research: Methods and Tools
PPTX
Going Global: Tips for Successful International Insights
PDF
How User Testing Can Inform Content - 03/19/12 Content Strategy - Minneapolis...
PPTX
Models and Methods for Global User Research
PDF
Building an Effective International Software QA Test Strategy
PPTX
Introduction of globalization testing
PDF
Usability Testing and QA 7-18-14
PPT
Website Testing Project
PDF
What is Internationalization & Localization Testing?
PPTX
Localisation Testing using UI automation
PDF
Usability Testing and QA 12 11-15
PPTX
UX Research in an Agile World
PPTX
Conducting User Research
PPTX
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
PPTX
Notes on usability testing
Boston Mini Upa2011: Localization Research Presentation by Jennifer Fabrizi a...
Pre-Conference Course: Cross-Cultural User Experience Design - Aaron Marcus
Cross Cultural UX research - Best practices for international insights
The Impact of Reaching out to
Fast & Cheap UX Research
International Business User Research: Methods and Tools
Going Global: Tips for Successful International Insights
How User Testing Can Inform Content - 03/19/12 Content Strategy - Minneapolis...
Models and Methods for Global User Research
Building an Effective International Software QA Test Strategy
Introduction of globalization testing
Usability Testing and QA 7-18-14
Website Testing Project
What is Internationalization & Localization Testing?
Localisation Testing using UI automation
Usability Testing and QA 12 11-15
UX Research in an Agile World
Conducting User Research
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Notes on usability testing
Ad

Recently uploaded (20)

PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
observCloud-Native Containerability and monitoring.pptx
PPT
Module 1.ppt Iot fundamentals and Architecture
PDF
Architecture types and enterprise applications.pdf
PDF
WOOl fibre morphology and structure.pdf for textiles
PDF
Hindi spoken digit analysis for native and non-native speakers
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PPTX
1. Introduction to Computer Programming.pptx
PDF
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
PPTX
Modernising the Digital Integration Hub
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
PDF
NewMind AI Weekly Chronicles – August ’25 Week III
PDF
Web App vs Mobile App What Should You Build First.pdf
PDF
Getting Started with Data Integration: FME Form 101
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
observCloud-Native Containerability and monitoring.pptx
Module 1.ppt Iot fundamentals and Architecture
Architecture types and enterprise applications.pdf
WOOl fibre morphology and structure.pdf for textiles
Hindi spoken digit analysis for native and non-native speakers
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
1. Introduction to Computer Programming.pptx
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
Modernising the Digital Integration Hub
A comparative study of natural language inference in Swahili using monolingua...
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
NewMind AI Weekly Chronicles – August ’25 Week III
Web App vs Mobile App What Should You Build First.pdf
Getting Started with Data Integration: FME Form 101
Programs and apps: productivity, graphics, security and other tools
Assigned Numbers - 2025 - Bluetooth® Document
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Ad

TecEd IUE 2015

  • 1. 24-hour Days, 4 Languages: Challenges of International Usability Testing
  • 2. •Founded 1967: Ann Arbor, Rochester NY, Palo Alto •Early practitioners of user research Contributed to the development of early usability testing methodologies that are standard today •More than 150 clients; close to 2,000 projects •Apps, websites, devices, other products for B2C/B2B
  • 4. What makes a good localized app? •When do salespeople want materials in English, and when in their local language? •When do they search using English, and when in their local language? 6 1 1 6 1 4 2 10 2 4 6 8 10 12 14 16 18 20 22 English Local language Other response NumberofParticipants Favored Language Favored Search Language Do you prefer to search using English or [language]? French Speakers Mandarin Speakers Spanish Speakers
  • 5. •Engaged bilingual partner researchers in France, Chile, and China •Coordinated with our client’s participant recruiters •Created translation-ready research protocol in English •Had the protocol translated into French, Spanish, and Chinese •Created data-logging template •Had our partner researchers conduct pilot-test sessions in the local language Here’s What We Did
  • 6. •Reviewed pilot session results with our client, then adjusted the protocol •Had our partner researchers conduct 7 or 8 sessions in the local language •Collected data logs in English from our partner researchers •Arranged for translation of the session recordings into English •Wrote results report for presentation to our client, with partner researcher input More Details
  • 7. Engaging Research Partners • User research skills and experience • Bilingual communication facility • Availability for desired schedule
  • 8. Coordinating Participant Recruiting  Salespeople: sensitive recruiting  Indirect access and communication  Unexpected outcomes
  • 9.  Content similar to U.S. research projects  Needed to be foolproof  No U.S. slang, no ambiguities
  • 10. Data-Logging Templates  Consistent reporting from researchers using 3 different languages  Sessions in native language, but English data logs  Structured logs facilitated data analysis
  • 11. Pilot-Test Sessions  One in each language  Observed by client stakeholders over WebEx  Each followed by debrief in English with the partner researcher
  • 12. At Last, the Sessions  7 – 8 sessions in each language  Over 15 time zones  Just-in-time recruiting
  • 13.  Arranged to translate all session recordings into English  5 cycles of report deliverables  15 graphs of participant preferences  Hundreds of participant quotations
  • 14.  Project management for a multiple- language usability test is hugely complex  Maintaining consistency of methodology in multiple countries is another challenge  International holidays differ and can impact schedules  A project in 5 time zones spanning 15 hours means you are never off-duty