User Research Techniques Vikram Rao  STC India UX Session - Bangalore 25 th  June 2011
Agenda Context around User Research  User Research Techniques  Evaluate  some  User Research Techniques Pros and Cons of the Techniques Choosing a User Research Technique
Context around  User Research
Fact of the matter… What are the problem we discover almost every time we analyze a project going awry? Badly Define Requirements We don’t know much about our users and their needs  Poor Communications  Stakeholder politics  etc.
“ Knowing  and  caring  about users and their lives is absolutely at the core of user-centered design.” What/Why?  How?
Summarizing User Research Knowing the User well  enough >> User Research
User Research Techniques
User Research Techniques Data Mining / Analysis  Data mining is the process of  extracting hidden patterns  from data.  As more data is gathered, with the amount of data doubling every three years, data mining is becoming an increasingly important tool to transform this data into information.
User Research Techniques Pros of using Data Mining / Analysis  Leveraging existing sources (internal or external) of information Cons of using Data Mining / Analysis Very time consuming  The raw data needs to be scanned, sorted and analyzed – for which we need skilled UX Researchers or Analysts to perform the exercise
User Research Techniques User Trip   A User Trip is a technique where  you  take a ‘trip’ through the whole process  of using a particular product or system, making yourself a critical observant user.
User Research Techniques Pros of using User Trip  It would help us gain a good understanding of the requirements and provide suggestions towards additional features in the proposed application.  Detailed review of the UI would help us to understand the pain points with the existing scenario/ application. We can preempt a lot of issues with the UI Cons of using User Trip  The environment or situation in which the actual user is likely to perform the task cannot be simulated. If the exact user profile is not considered during simulation by the person who is conducting the user trip, it might not be effective.
User Research Techniques Observation Exercise An observation Exercise is a technique where  you ‘observe’ actual users or representative users through the whole process  of using a particular product or system.
User Research Techniques Pros of using Observation Exercise  Collection of detailed, descriptive narrative data about the user’s profile, product usage, etc.  Can be referred to throughout the year; useful for instructional planning.  Cons of using Observation Exercise  Needs to be conducted in classroom or work environment which may its own limitations / distractions Scheduling the sessions (time required, when to observe) is a challenge  Great deal of expertise and objectivity required.
User Research Techniques User Interviews   User Interviews  help us in better understanding the user’s ‘goals’ and ‘needs’  by actually talking to them.  The information would help us make better decisions in further improving the user experience and capabilities of the product or system.
User Research Techniques Pros of using User Interviews  Interviews are a great way to find in-depth information about your users.  They're fairly easy to organize. Typically need very little facilities / tools and can also be done remotely . Cons of using User Interviews Laborious process if done with many users Getting the right users that match the persona could be a challenge.
User Research Techniques Contextual Inquiry   Contextual inquiry involves collecting detailed information about customer work practice by  ‘observing’ and ‘interviewing’ the user  while they actually work.  The researcher should stay in the background and let the user lead the situation as much as possible.
User Research Techniques Pros of using Contextual Inquiry  A chance to see what really happens and also clarify in context Provides data about environmental factors Critical source of information for Persona and scenario development. Cons of using Contextual Inquiry Analysis relies on the capabilities of the observer Possibility of no follow-up or probing means it's possible to make wrong inferences Only provides data on the observed work tasks and environment.
User Research Techniques Split A/B Testing Split A/B testing is a technique of  finding out which changes or options help your users' performance .  It provides a controlled method of measuring the effectiveness (or not) of alterations to your site, product or system.
User Research Techniques Pros of using Split A / B Testing  Low risk approach  Cheaper than other methods such as focus groups  Provides proof  Great way to do 'test run' new designs before full roll-out (to avoid negative surprises on the launch day)  Can solve internal disputes Cons of using Split A / B Testing New designs might have to 'wear in' before you can measure their real performance (visitors' initial response might be negative because they're used to the old solution)  You can only compare 2 versions with a single factor that differentiates both designs (for more factors / variations you need to deploy multivariate testing which is more difficult to analyze)  It takes technical know-how to set up and analyze the results  You're testing in a live environment so external factors might have an impact on the outcome  If your site / system is really in bad shape, this technique does not help as you'll still need to do a proper overhaul.
User Research Techniques Diary Study Diary Study is a technique where  participants collect data about events on site as they happen . Researcher would have to define templates to be handed out to systematically collect data.
User Research Techniques Pros of using Diary Study  Need very little time to plan and organize Can be done parallely with other ongoing tasks and research activities  Cons of using Diary Study Highly dependant on the users recording the right information  Users need to be motivated to record activities and pass it along
User Research Techniques Focus Groups  A focus group could be defined as a group of interacting individuals having some common interest or characteristics, brought together by a moderator, who uses the group and its interaction as a way to  gain information about a specific or focused issue .
User Research Techniques Pros of using Focus Groups  Collection of detailed, descriptive narrative data about the user’s profile, product usage experience, etc.  Very cost effective in terms of gathering primary data and are very much time efficient  Cons of using Focus Groups It is difficult to gather users together for this exercise Opinions might get biased based on comments from other participating members
User Research Techniques User Surveys / Questionnaires   User Survey is an offline means of finding out how the software or web site is likely to be used by a specific set of users, some of usability pain points and other generic information. 
User Research Techniques Pros of using User Surveys and Questionnaires  Need very little time to plan and organize A cheap and effective way of capturing information.  Cons of using User Surveys and Questionnaires It is a one sided. We typically get answers to the questions that we have – we not actually listening to the user. You can only have a limited set of questions as surveys and questionnaires cannot be very long.
Choosing a User Research Technique
Choosing a technique You need to consider the following when choosing a user research technique: Goals : Why you’re doing the research? Information Required : Qualitative vs Quantitative? Schedule : When to do the research? Budget : How much it’s going to cost?
Choosing a technique X X X X New  Product or  System X X User Surveys / Questionnaires X X X Focus Groups  X Diary Study  X X X Split A / B Testing X X X X X Contextual Inquiry  X X X User Interviews X X X Observation Exercise  X User Trip X Data Mining / Analysis Need  Qualitative  Data Access to  Users High Budget  Availability Have Time  on Hand Obtain Specific  Results User Research  Technique
Questions… You can also reach me at:  [email_address]  | 9845694979

More Related Content

PPT
Research & Development - Medical Device Innovation
DOCX
HCI Part 6 - Prototype and Evaluation Plan
PPT
Streamlined Product Evaluation
PPTX
The UX Research Methodology
PDF
Producing design solutions II
PDF
Usability Testing Methods
PPTX
Determining Requirements In System Analysis And Dsign
DOCX
ECE695DVisualAnalyticsprojectproposal (2)
Research & Development - Medical Device Innovation
HCI Part 6 - Prototype and Evaluation Plan
Streamlined Product Evaluation
The UX Research Methodology
Producing design solutions II
Usability Testing Methods
Determining Requirements In System Analysis And Dsign
ECE695DVisualAnalyticsprojectproposal (2)

What's hot (14)

PPTX
Usability
PDF
Determining Requirements Complexity - White Paper
PPTX
Magic or myth
PDF
A New Approach of Analysis of Student Results by using MapReduce
PDF
Leveraging Eye-gaze and Time-series Features to Predict User Interests and Bu...
PDF
IRJET- Searching an Optimal Algorithm for Movie Recommendation System
PPT
User Zoom Webinar Monster Aug09 Vf
PDF
Whitepaper: Does Image Quality Matter?
PDF
IRJET- Hybrid Book Recommendation System
PPT
Requirement Determination Process
PDF
Recommender Systems
PPTX
User-centred Development of a Clinical Decision-support System for Breast Can...
PPTX
Crowdsourcing Software Evaluation
Usability
Determining Requirements Complexity - White Paper
Magic or myth
A New Approach of Analysis of Student Results by using MapReduce
Leveraging Eye-gaze and Time-series Features to Predict User Interests and Bu...
IRJET- Searching an Optimal Algorithm for Movie Recommendation System
User Zoom Webinar Monster Aug09 Vf
Whitepaper: Does Image Quality Matter?
IRJET- Hybrid Book Recommendation System
Requirement Determination Process
Recommender Systems
User-centred Development of a Clinical Decision-support System for Breast Can...
Crowdsourcing Software Evaluation
Ad

Similar to User Research Techniques by Vikram Rao, RSA (20)

PPT
classmar2.ppt
PPTX
Usability Testing Basics: What's it All About? at Web SIG Cleveland
PPTX
Usability Primer
PPTX
Chapter 7 - Evaluation Tekhnique
PDF
ilide.info-course-2-start-the-ux-design-process-pr_058625d4638e3a4266b4ff0085...
PPT
UCD Workshop - Shad MUN 2008
PPT
Ucd Techniques - Shad MUN 2008
PDF
Basics of-usability-testing
PPS
Topic 7 Product Evaluation
PPTX
SAD _ Fact Finding Techniques.pptx
PPTX
User Research Tools: Don't just do it, do it well
PPTX
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
PDF
What is User Centered Design?
PPTX
11 - Evaluating Framework in Interaction Design_new.pptx
PPTX
Chapter 3
PPT
HCI 3e - Ch 9: Evaluation techniques
PPTX
Usability methods to improve EMRs
PPTX
Usability in product development
PPTX
Using Automated Testing Tools to Empower Your User Research
PPTX
Webinar: How to Conduct Unmoderated Remote Usability Testing
classmar2.ppt
Usability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Primer
Chapter 7 - Evaluation Tekhnique
ilide.info-course-2-start-the-ux-design-process-pr_058625d4638e3a4266b4ff0085...
UCD Workshop - Shad MUN 2008
Ucd Techniques - Shad MUN 2008
Basics of-usability-testing
Topic 7 Product Evaluation
SAD _ Fact Finding Techniques.pptx
User Research Tools: Don't just do it, do it well
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
What is User Centered Design?
11 - Evaluating Framework in Interaction Design_new.pptx
Chapter 3
HCI 3e - Ch 9: Evaluation techniques
Usability methods to improve EMRs
Usability in product development
Using Automated Testing Tools to Empower Your User Research
Webinar: How to Conduct Unmoderated Remote Usability Testing
Ad

More from STC India UX SIG (20)

PDF
Designing for Multiple Devices - Sarit Arora
PDF
Designing for Handhelds - Aashish Solanki
PDF
Social Trends and Innovation - Patrick Roupin
PDF
Co-creating the User Experience - Kshitiz Anand
PDF
Defining and Evaluating the Usability of CMS - Saurabh Kudesia
PDF
Creating a Positive Experience through Design - Sudhindra. V
PDF
Emerging Markets and User Research - Apala Chavan
PDF
UX on Agile - Pradeep Joseph
PDF
Aiming for Delightful Experiences - Kaushik T. Ghosh
PDF
Content 3.0 by Suraj Hattangadi, FUSEBO
PDF
Effective Content Writing by Sudhindra.V, Sapient
PDF
Documentation Deliverables for UX by Xavier Roy, Bally Technologies
PDF
Content Strategy – Integrating Content in User Experience Design by Neha Sing...
PDF
Usability Testing by Rajdeep Gupta, Misys
PDF
Usability - The Art of Writing by Mohan Krishnaraj, Wipro
PDF
Web analytics in technical documentation by Jigesh T.V
PDF
HCI research methods by Sanjay Tripathi, ABB
PDF
Usability heuristics for documentation by Anupama Gummaraju
PDF
Out-of-the-Box Experience (Designing for First-time Use) by Amit Patil, IBM
PDF
Business Impact of Accessibility by Srinivasu Chakravarthula, Yahoo!
Designing for Multiple Devices - Sarit Arora
Designing for Handhelds - Aashish Solanki
Social Trends and Innovation - Patrick Roupin
Co-creating the User Experience - Kshitiz Anand
Defining and Evaluating the Usability of CMS - Saurabh Kudesia
Creating a Positive Experience through Design - Sudhindra. V
Emerging Markets and User Research - Apala Chavan
UX on Agile - Pradeep Joseph
Aiming for Delightful Experiences - Kaushik T. Ghosh
Content 3.0 by Suraj Hattangadi, FUSEBO
Effective Content Writing by Sudhindra.V, Sapient
Documentation Deliverables for UX by Xavier Roy, Bally Technologies
Content Strategy – Integrating Content in User Experience Design by Neha Sing...
Usability Testing by Rajdeep Gupta, Misys
Usability - The Art of Writing by Mohan Krishnaraj, Wipro
Web analytics in technical documentation by Jigesh T.V
HCI research methods by Sanjay Tripathi, ABB
Usability heuristics for documentation by Anupama Gummaraju
Out-of-the-Box Experience (Designing for First-time Use) by Amit Patil, IBM
Business Impact of Accessibility by Srinivasu Chakravarthula, Yahoo!

Recently uploaded (20)

PPTX
a group casestudy on architectural aesthetic and beauty
PPTX
timber basics in structure mechanics (dos)
PDF
GSH-Vicky1-Complete-Plans on Housing.pdf
PPTX
Necrosgwjskdnbsjdmdndmkdndndnmdndndkdmdndkdkndmdmis.pptx
PDF
How Animation is Used by Sports Teams and Leagues
PPTX
PROPOSAL tentang PLN di metode pelaksanaan.pptx
PPTX
Drafting equipment and its care for interior design
PPTX
lecture-8-entropy-and-the-second-law-of-thermodynamics.pptx
PPTX
Bitcoin predictor project presentation
PDF
Test slideshare presentation for blog post
PDF
Trends That Shape Graphic Design Services
PPT
EthicsNotesSTUDENTCOPYfghhnmncssssx sjsjsj
PDF
trenching-standard-drawings procedure rev
PPTX
2. Competency Based Interviewing - September'16.pptx
PPTX
SOBALAJE WORK.pptxe4544556y8878998yy6555y5
PDF
Social Media USAGE .............................................................
PPT
robotS AND ROBOTICSOF HUMANS AND MACHINES
PDF
The Complete Guide to Buying Verified Stripe Accounts 2025.pdf
PDF
Architecture Design Portfolio- VICTOR OKUTU
PPTX
URBAN FINANCEnhynhynnnytnynnnynynyynynynyn
a group casestudy on architectural aesthetic and beauty
timber basics in structure mechanics (dos)
GSH-Vicky1-Complete-Plans on Housing.pdf
Necrosgwjskdnbsjdmdndmkdndndnmdndndkdmdndkdkndmdmis.pptx
How Animation is Used by Sports Teams and Leagues
PROPOSAL tentang PLN di metode pelaksanaan.pptx
Drafting equipment and its care for interior design
lecture-8-entropy-and-the-second-law-of-thermodynamics.pptx
Bitcoin predictor project presentation
Test slideshare presentation for blog post
Trends That Shape Graphic Design Services
EthicsNotesSTUDENTCOPYfghhnmncssssx sjsjsj
trenching-standard-drawings procedure rev
2. Competency Based Interviewing - September'16.pptx
SOBALAJE WORK.pptxe4544556y8878998yy6555y5
Social Media USAGE .............................................................
robotS AND ROBOTICSOF HUMANS AND MACHINES
The Complete Guide to Buying Verified Stripe Accounts 2025.pdf
Architecture Design Portfolio- VICTOR OKUTU
URBAN FINANCEnhynhynnnytnynnnynynyynynynyn

User Research Techniques by Vikram Rao, RSA

  • 1. User Research Techniques Vikram Rao STC India UX Session - Bangalore 25 th June 2011
  • 2. Agenda Context around User Research User Research Techniques Evaluate some User Research Techniques Pros and Cons of the Techniques Choosing a User Research Technique
  • 3. Context around User Research
  • 4. Fact of the matter… What are the problem we discover almost every time we analyze a project going awry? Badly Define Requirements We don’t know much about our users and their needs Poor Communications Stakeholder politics etc.
  • 5. “ Knowing and caring about users and their lives is absolutely at the core of user-centered design.” What/Why? How?
  • 6. Summarizing User Research Knowing the User well enough >> User Research
  • 8. User Research Techniques Data Mining / Analysis Data mining is the process of extracting hidden patterns from data. As more data is gathered, with the amount of data doubling every three years, data mining is becoming an increasingly important tool to transform this data into information.
  • 9. User Research Techniques Pros of using Data Mining / Analysis Leveraging existing sources (internal or external) of information Cons of using Data Mining / Analysis Very time consuming The raw data needs to be scanned, sorted and analyzed – for which we need skilled UX Researchers or Analysts to perform the exercise
  • 10. User Research Techniques User Trip A User Trip is a technique where you take a ‘trip’ through the whole process of using a particular product or system, making yourself a critical observant user.
  • 11. User Research Techniques Pros of using User Trip It would help us gain a good understanding of the requirements and provide suggestions towards additional features in the proposed application. Detailed review of the UI would help us to understand the pain points with the existing scenario/ application. We can preempt a lot of issues with the UI Cons of using User Trip The environment or situation in which the actual user is likely to perform the task cannot be simulated. If the exact user profile is not considered during simulation by the person who is conducting the user trip, it might not be effective.
  • 12. User Research Techniques Observation Exercise An observation Exercise is a technique where you ‘observe’ actual users or representative users through the whole process of using a particular product or system.
  • 13. User Research Techniques Pros of using Observation Exercise Collection of detailed, descriptive narrative data about the user’s profile, product usage, etc. Can be referred to throughout the year; useful for instructional planning. Cons of using Observation Exercise Needs to be conducted in classroom or work environment which may its own limitations / distractions Scheduling the sessions (time required, when to observe) is a challenge Great deal of expertise and objectivity required.
  • 14. User Research Techniques User Interviews User Interviews help us in better understanding the user’s ‘goals’ and ‘needs’ by actually talking to them. The information would help us make better decisions in further improving the user experience and capabilities of the product or system.
  • 15. User Research Techniques Pros of using User Interviews Interviews are a great way to find in-depth information about your users. They're fairly easy to organize. Typically need very little facilities / tools and can also be done remotely . Cons of using User Interviews Laborious process if done with many users Getting the right users that match the persona could be a challenge.
  • 16. User Research Techniques Contextual Inquiry Contextual inquiry involves collecting detailed information about customer work practice by ‘observing’ and ‘interviewing’ the user while they actually work. The researcher should stay in the background and let the user lead the situation as much as possible.
  • 17. User Research Techniques Pros of using Contextual Inquiry A chance to see what really happens and also clarify in context Provides data about environmental factors Critical source of information for Persona and scenario development. Cons of using Contextual Inquiry Analysis relies on the capabilities of the observer Possibility of no follow-up or probing means it's possible to make wrong inferences Only provides data on the observed work tasks and environment.
  • 18. User Research Techniques Split A/B Testing Split A/B testing is a technique of finding out which changes or options help your users' performance . It provides a controlled method of measuring the effectiveness (or not) of alterations to your site, product or system.
  • 19. User Research Techniques Pros of using Split A / B Testing Low risk approach Cheaper than other methods such as focus groups Provides proof Great way to do 'test run' new designs before full roll-out (to avoid negative surprises on the launch day) Can solve internal disputes Cons of using Split A / B Testing New designs might have to 'wear in' before you can measure their real performance (visitors' initial response might be negative because they're used to the old solution) You can only compare 2 versions with a single factor that differentiates both designs (for more factors / variations you need to deploy multivariate testing which is more difficult to analyze) It takes technical know-how to set up and analyze the results You're testing in a live environment so external factors might have an impact on the outcome If your site / system is really in bad shape, this technique does not help as you'll still need to do a proper overhaul.
  • 20. User Research Techniques Diary Study Diary Study is a technique where participants collect data about events on site as they happen . Researcher would have to define templates to be handed out to systematically collect data.
  • 21. User Research Techniques Pros of using Diary Study Need very little time to plan and organize Can be done parallely with other ongoing tasks and research activities Cons of using Diary Study Highly dependant on the users recording the right information Users need to be motivated to record activities and pass it along
  • 22. User Research Techniques Focus Groups A focus group could be defined as a group of interacting individuals having some common interest or characteristics, brought together by a moderator, who uses the group and its interaction as a way to gain information about a specific or focused issue .
  • 23. User Research Techniques Pros of using Focus Groups Collection of detailed, descriptive narrative data about the user’s profile, product usage experience, etc. Very cost effective in terms of gathering primary data and are very much time efficient Cons of using Focus Groups It is difficult to gather users together for this exercise Opinions might get biased based on comments from other participating members
  • 24. User Research Techniques User Surveys / Questionnaires User Survey is an offline means of finding out how the software or web site is likely to be used by a specific set of users, some of usability pain points and other generic information. 
  • 25. User Research Techniques Pros of using User Surveys and Questionnaires Need very little time to plan and organize A cheap and effective way of capturing information. Cons of using User Surveys and Questionnaires It is a one sided. We typically get answers to the questions that we have – we not actually listening to the user. You can only have a limited set of questions as surveys and questionnaires cannot be very long.
  • 26. Choosing a User Research Technique
  • 27. Choosing a technique You need to consider the following when choosing a user research technique: Goals : Why you’re doing the research? Information Required : Qualitative vs Quantitative? Schedule : When to do the research? Budget : How much it’s going to cost?
  • 28. Choosing a technique X X X X New Product or System X X User Surveys / Questionnaires X X X Focus Groups X Diary Study X X X Split A / B Testing X X X X X Contextual Inquiry X X X User Interviews X X X Observation Exercise X User Trip X Data Mining / Analysis Need Qualitative Data Access to Users High Budget Availability Have Time on Hand Obtain Specific Results User Research Technique
  • 29. Questions… You can also reach me at: [email_address] | 9845694979