Unmoderated Remote Usability Testing
Download as PPTX, PDF3 likes928 views
The document discusses unmoderated remote usability testing. It notes that this allows testing large groups of users in their own environments, reducing costs. However, there are also drawbacks like not being able to interact with users or verify their responses. The document provides tips for choosing the right remote testing tools and discusses when unmoderated remote user testing is most appropriate to use.
Unmoderated Remote Usability Testing
- 1. Unmoderated remote user testing: Do’s and don’ts 2012 © Humix, all rights reserved
- 2. Remote User Testing 2012 © Humix, all rights reserved 2
- 3. Synchronous vs asynchronous 2012 © Humix, all rights reserved 3
- 4. Moderated vs unmoderated 2012 © Humix, all rights reserved 4
- 5. Moderated usability testing 2012 © Humix, all rights reserved 5
- 6. Unmoderated remote usability testing 2012 © Humix, all rights reserved 6
- 7. Figures Source: www.measuringusability.com/blog/ux-methods.php 2011 UPA Salary Survey (biennal) 2012 © Humix, all rights reserved 7
- 8. ADVANTAGES 2012 © Humix, all rights reserved 8
- 9. Test large groups 2012 © Humix, all rights reserved 9
- 10. Real environments 2012 © Humix, all rights reserved 10
- 11. Reduce costs 2012 © Humix, all rights reserved 11
- 12. Recruitment 2012 © Humix, all rights reserved 12
- 13. Organisation 2012 © Humix, all rights reserved 13
- 14. Fast results 2012 © Humix, all rights reserved 14
- 15. Quantitative & Qualitative 2012 © Humix, all rights reserved 15
- 16. Intercept users 2012 © Humix, all rights reserved 16
- 17. Self-reported feedback 2012 © Humix, all rights reserved 17
- 18. DRAWBACKS 2012 © Humix, all rights reserved 18
- 19. Gold diggers 2012 © Humix, all rights reserved 19
- 20. No interaction 2012 © Humix, all rights reserved 20
- 21. Only survey answers 2012 © Humix, all rights reserved 21
- 22. False positives 2012 © Humix, all rights reserved 22
- 23. Task time… 2012 © Humix, all rights reserved 23
- 24. TOOLS 2012 © Humix, all rights reserved 24
- 25. Choose the right tool Functionality of tools has a huge impact on the type of info you’re able to gather 2012 © Humix, all rights reserved 25
- 26. Choose the right tool • What is your budget? • What is your goal? • How much support do you need? • Will you be able to conduct competitive research? • Can you test prototypes? • Can you export findings? • How will the results be visualized? • Does it come in different languages? • Can you combine different methods using the same tool? • Are there integrated recruiting tools? 2012 © Humix, all rights reserved 26
- 27. Information Architecture tools Card sorting 2012 © Humix, all rights reserved 27
- 28. Information Architecture tools Tree testing 2012 © Humix, all rights reserved 28
- 29. Click based feedback Task & Interface testing 2012 © Humix, all rights reserved 29
- 30. Feedback gathering 2012 © Humix, all rights reserved 30
- 31. Unmoderated remote usability testing tools 2012 © Humix, all rights reserved 31
- 32. When to use URUT? • Not a replacement for moderated testing or research • Best used to complement your qualitative research 2012 © Humix, all rights reserved 32
- 33. Interesting reading • Remote Research: Real Users, Real Time, Real Research by Nate Bolt, Tony Tulathimutte, 2010 • Beyond the usability lab: Conducting Large-scale Online User Experience Studies, Bill Albert, Tom Tullis, Donna Tedesco, 2010 2012 © Humix, all rights reserved 33
- 34. www.humix.be Lonneke.Spinhof@humix.be @humix @lonnekespinhof 2012 © Humix, all rights reserved
Editor's Notes
- #3: Remote usability testingdenotes a situationwhere “the evaluators are separated in spaceand/or time from users”Thisdefinitionemphasizestwogeneral types of methods: synchronousandasynchronous.
- #12: Reducecosts, depending on the tool youuse
- #13: It is easierto get participantstovolunteerbecausethey do not have totravel.
- #14: Fewerlogisticsto manage and no needtoworryabout no-shows andgetting last minute replacements
- #15: Partial automated results faster resultsEasier to conduct multiple small tests
- #16: Both quantitativeand (some) qualitative dataQuantitative:Taks-completionrateTime on taskTime on pageClickstreampathsSatisfaction ratings or opinion rankingsQualitative:Most of these tools canalsocapturequalitative feedback as users complete theirtasks - such as users’ suggestionsandcomments
- #20: Someparticipantsmayonlybeinterested in earning the honorarium you’veprovided as an incentive.You have little or no contact and thus control over the motivation of participants
- #21: Nothing beats watchingparticipants in real time andbeingabletoaskprobingquestionsaboutwhatthey are doing as it’s happening.
- #22: Whatparticipants report on surveyscanbevery different in comparisontowhattheyactually do.
- #23: It’s possibleforparticipantstothinkthey’vesuccessfullycompleted a taskwhentheyhaven’t
- #24: Does it matter ifittooksomeonelongerto complete a task?