Junior UX Crunch: How To Avoid UX Usability Mistakes and Unleash Your Power
0 likes187 views
The document focuses on essential skills for UX design, usability testing methods, and the importance of translating usability results into business objectives. It emphasizes that general usability tests are inadequate for specific problems and highlights common errors in testing. Ultimately, designers should be competent in key skills and investigate unique user group issues to effectively influence design change.
Junior UX Crunch: How To Avoid UX Usability Mistakes and Unleash Your Power
- 1. Unleashing Your Power Dr Christopher J. Parker
- 2. Topics • The key skills you need to stand out in UX Design • Avoiding common error running usability tests • Driving design change from your usability testing
- 4. –Huawei “We want a lightweight, simple usability test to give all of our design departments. What is it?”
- 6. What Do UX Designer’s Care About?
- 8. “Choose up to 5 tasks/ descriptions (from the list below) that are the MOST IMPORTANT to you when running usability tests.”
- 11. Employability Skills • Essential Skills (31%) • Think Aloud • Interview • Task Success • Competence (the next 20%) • Observation • A/B Testing • Task Time Expert 49% Competance 20% Essential 31%
- 12. How Does The UX Field Design ‘Good’ Usability?
- 13. Designs are good* when users: • Say it is good • Think Aloud and Interview • Achieve their task ‘better’ than previous design • Task Success and A/B Testing • They act in a clear way • Observation • Complete their task fast • Task Time *based on 51% of all important tasks
- 14. What Are We Missing?
- 15. Think Aloud Protocol 11% Interviews 10% Task Success 10% Observation 7% A/B Testing 7% Task Time 6% Screen Recording 6% Errors (number of errors) 6% Google Analytics 3% USE Questionnaire (Usefulness Satisfaction and Ease of Use Questionnaire) 3% Neilsen's Heuristics 3% Eye Tracking 3% SUS 3% Web Guidelines (following website best practice) 3% Simplicity 2% Lostness 2% Learnability (Repeat testing over time) 2% Expectation Measure 2% Environment simulation (stimulus simulation) 2% ASQ: After-Scenario Questionnaire 2% WCAG 2.1 1% Forum answers (asking forums) 1% TAM Satisfaction Questionnaire 1% Fun Questionnaire (Afke Donker) 1% Diary/ Camera Studies 1% EEG 0% PUTQ: Purdue Usability Testing Questionnaire 0% Heart Rate 0% Galvanic Skin Conductance 0% GAQ: Geneva Appraisal Questionnaire 0% WEBLEI Scale IV: Information structure and design activities 0% Superpowers Competence Skills Essential Skills
- 16. Example: Accessibility • 1% of respondents value Accessibility • WCAG 2.1 • Poor Accessibility = Disabled and elderly users cannot use product
- 17. General tests describe general usability You need specific tests to describe specific problems (E.g. SUS)
- 19. Is your focus ease of use? Is your focus performance? Qualitative Quantitative Yes No No Yes
- 20. Qualitative
- 21. Qualitative: You Only Need 5 Users? Nielsen, J. (2000), “Why You Only Need to Test with 5 Users”, Neilsen Norman Group, available at: https://measuringu.com/five-users/ (accessed 1 April 2019).
- 22. International Users are Dissimilar • Functional shopping motivations influence Western consumers more than Chinese consumers. • Parker, C.J. and Wenyu, L. (2019), “What influences Chinese fashion retail? Shopping motivations, demographics and spending”, Journal of Fashion Marketing and Management: An International Journal, Vol. 23 No. 2, pp. 158–175.
- 23. You must investigate each user group to find unique problems
- 24. Quantitative
- 25. 51% of UX Designer Focus on Statistics Think Aloud Protocol 11% Interviews 10% Task Success 10% Observation 7% A/B Testing 7% Task Time 6% Screen Recording 6% Errors (number of errors) 6% Google Analytics 3% USE Questionnaire (Usefulness Satisfaction and Ease of Use Questionnaire) 3% Neilsen's Heuristics 3% Eye Tracking 3% SUS 3% Web Guidelines (following website best practice) 3% Simplicity 2% Lostness 2% Learnability (Repeat testing over time) 2% Expectation Measure 2% Environment simulation (stimulus simulation) 2% ASQ: After-Scenario Questionnaire 2% WCAG 2.1 1% Forum answers (asking forums) 1% TAM Satisfaction Questionnaire 1% Fun Questionnaire (Afke Donker) 1% Diary/ Camera Studies 1% EEG 0% PUTQ: Purdue Usability Testing Questionnaire 0% Heart Rate 0% Galvanic Skin Conductance 0% GAQ: Geneva Appraisal Questionnaire 0% WEBLEI Scale IV: Information structure and design activities 0%
- 26. Common Junior UX Interpretations https://ux.stackexchange.com/questions/125597/what-to-do-if-sus-scores-contradict-qualitative-feedback
- 27. Example SUS results A paired samples t-test was conducted on the difference between students' SUS scores for the Yale Art School (W1) and University of the Arts London (W2) websites. There was a statistically significant increase in SUS scores between W1 (M= 37.5, SD= 19.3) to W2 (M= 74.5, SD= 14.7),t(20) = 6.23, p= <.000 (two tailed). The mean difference in SUS scores was -37.02. The eta squared statistic (.660) indicated a large effect size. A power of .98 was achieved. 0 10 20 30 40 50 60 70 80 90 100 Group 1 Group 2 SUS Test Results Series1 Series2
- 28. Boxplots Tell Truths, Means Lie
- 29. Sample Size and Errors • T-test (two independent groups) • Minimum 210 users (total) • effect size = medium, alpha = .05, power = 80% • Do multiple tests? • Chance of a Type II Error (fast positive) increases • 20 tests = 64% chance of an error
- 30. Why is Power Important? • Prevents Type II errors • (believing a difference exists, when no difference really exists) • “time-reversing” well-established psychological effects so that the individual's responses are obtained before the putatively causal stimulus events occur • Future Events Influence Our Past • Statistics abuse leads to errors • View more: https://youtu.be/ xfFpqtGBRhc
- 32. Statistics is performance’s language. Speaking it will allow deeper meaning into specific design issues and unique problems
- 33. Driving Design Change With Outcomes
- 34. Business Cares About Five Things: • Increase profits • Reducing costs • Increasing number of new users • Increasing existing users’ expenditure • Increasing stakeholder value
- 35. Businesses don’t care about your report They care about the five business objectives Interpret your results into business objectives to drive design change
- 36. Key Points • You must be competent at just six skills • General tests describe general usability • You need specific tests to describe specific problems (E.g. SUS) • You must investigate each user group to find unique problems • Businesses don’t care about your report • They care about the five business objectives • Interpret your results into business objectives to drive design change
- 37. Connect With Me • YouTube • Design eLearning Tutorials • Podcast • The UX Usability Podcast • Twitter • @UserGenDesign