![www.learnovatecentre.org
Key points for User Testing success
• Structured & repeatable sessions, clear objectives
• Carefully selected questions
– Did you like the system? [vague, ambiguous]
– Was the login form easy to use? [specific but leading]
– Rate the login form on ease of use. Why did you give
that answer? J
• Test early, test often](https://image.slidesharecdn.com/20170628neilpeirce-learningtechireland2017v6-170703075329/85/Understanding-user-needs-in-a-corporate-setting-36-320.jpg)
Understanding user needs in a corporate setting
- 1. www.learnovatecentre.orgwww.learnovatecentre.org Dr Neil Peirce – Horizon 2020 Project Lead Understanding user needs in a corporate setting
- 2. www.learnovatecentre.org Horizon 2020 • EU’s main programme for research and innovation • 3 main pillars – Excellent Science – Industrial Leadership – Societal Challenges • €80 billion budget (2014-2020)
- 3. www.learnovatecentre.org 0% 5% 10% 15% 20% 25% 30% 35% 40% Other Public Bodies Research Organisations Private Sector Universities Horizon 2020 Participation by Organisation Type 2014, Source: https://ec.europa.eu/programmes/horizon2020/en/horizon-2020-statistics
- 4. www.learnovatecentre.org • Developing Careers through Social Networks and Transversal Competencies • €3M budget, Feb 2016 - Jan 2019
- 5. www.learnovatecentre.org Motivation • Increased working lives and longer careers1 • Changing labour markets with reduced job security2 • Growing demand for adaptable workers with increased mobility3 • Employees who are actively developing their careers also receive the least career guidance4 5 1. Joint Employment Report, Council of the EU, 2015, http://ec.europa.eu/social/BlobServlet?docId=9213&langId=en 2. Towards Common Principles of Flexicurity, European Commission, 2007. 3. Strategic framework for European cooperation in education and training (‘ET 2020’), European Council, 2009 4. Career Development at Work, Cedefop, 2008, http://www.cedefop.europa.eu/files/5183_en.pdf
- 6. www.learnovatecentre.org Our approach • Meta-cognitive and reflective learning tools on career development to inform and build awareness • A focus on transversal competencies such as leadership and collaboration • Work as a process of social interaction and the significance of social capital in career development • Relevance to both employees and companies 6
- 7. www.learnovatecentre.org Our challenges • Assessment of transversal competencies • Quantifying Social Capital • Highlighting realistic career paths • Data Privacy and career development • Career development + Talent Management 7
- 9. www.learnovatecentre.orgwww.learnovatecentre.org Design Thinking in DEVELOP Understanding User Needs
- 10. www.learnovatecentre.orgDesign Council’s Double Diamond, source: http://www.designcouncil.org.uk/news-opinion/design-process-what-double-diamond
- 11. www.learnovatecentre.org Who are our users? • Personas from our proposal – 1. Employees – 2. HR & Learning Development • Validate the personas with real users – Face-to-face structured interviews • Revised personas – 1. Employees – 2. Strategic HR – 3. People Managers
- 12. www.learnovatecentre.org Design Thinking Workshops • Engage with real users • Workshop objective – User stories: Identify concise statements of users, tasks, and goals • Small persona groups (3-5) with facilitators (1-2) • Process: – As-is – To-be – User Stories } Discover } Define
- 13. www.learnovatecentre.orgwww.learnovatecentre.org Discover: What are the pain points? As-is: The current situation
- 15. www.learnovatecentre.org User Task “Describe how you plan your career”
- 19. www.learnovatecentre.orgwww.learnovatecentre.org Discover: What could make it work? To-be: The ideal situation
- 23. www.learnovatecentre.org User Stories As a <type of user>, I want <some goal> so that <some result>.
- 25. www.learnovatecentre.org Key points for workshop success • Diversity is important • Plan for social barriers • Plan for social norms • Experts as facilitators • Allow for prep-time & documenting results
- 26. www.learnovatecentre.org Key challenges • Access to end-users • Facilitators become influencers • Low motivation and engagement • Limited or recurring themes
- 27. www.learnovatecentre.orgwww.learnovatecentre.org Define & Develop Requirements, Paper Prototypes, and Wireframes
- 31. www.learnovatecentre.org User Testing • Testing Methods – Concept Testing - Moderated - In Person – Usability Studies - Moderated - In Person or Remote – Usability Studies - Unmoderated - Remote – Usability Benchmarking - Unmoderated - Remote • Choose the method based on: – Project Stage – Attitudinal vs. Behavioural – Qualitative vs. Quantitative
- 32. www.learnovatecentre.org User Testing Methods Attitudinal Behavioural Qualitative Quantitative Concept Testing Moderated – In Person Usability Studies Moderated – In Person or Remote Unmoderated - Remote Usability Benchmarking Unmoderated - Remote
- 33. www.learnovatecentre.org Concept Testing – Moderated – In Person • When To Use – New feature/product, visually conceptualised to a basic level – Goal: gauging usefulness • Remember – Features are basic, interaction is limited – Findings are qualitative & attitudinal – Very time intensive! • Think Aloud Sessions
- 36. www.learnovatecentre.org Key points for User Testing success • Structured & repeatable sessions, clear objectives • Carefully selected questions – Did you like the system? [vague, ambiguous] – Was the login form easy to use? [specific but leading] – Rate the login form on ease of use. Why did you give that answer? J • Test early, test often
- 37. www.learnovatecentre.org Key challenges • Homogeneous user sample • Not actual users • Leading questions & confirmation bias • Testing too late – Polished UIs & politeness • Poor note taking – Screen recording can help
- 39. www.learnovatecentre.org Next Steps • Usability Studies & Benchmarking • Unsurfaced user needs – Privacy & Ethical Impact Assessments – General Data Protection Regulation (GDPR) • Employees as a high risk category • Not free to give consent due to contractual obligations
- 40. www.learnovatecentre.org Thanks • Fiona McAndrew – UI/UX Lead on DEVELOP • DEVELOP partners www.develop-project.eu @Develop_eu This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688127