SlideShare a Scribd company logo
David Geerts Research Manager Centre for User Experience Research (CUO) K.U.Leuven Creative methods for designing and evaluating user experiences
Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods  / 50
Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods  / 50
First wave HCI (70’s-80’s) Cognitive approach Human as information processor Interaction between single user and computer “ Human factors” Disciplines Cognitive psychology, computer science Methods Rigid guidelines, controlled experiments, formal methods, user modelling, … Theories GOMS (Goals Operators Methods Selection rules), KLM (Keystroke Level Model), Fitt’s law, Hick’s law, …  / 50
Second wave HCI (80’s-90’s) Social context Groups working with collection of applications Work settings and communities of practice “ Human actors” Disciplines Social sciences, anthropology Methods Ethnographic observations, participatory design, prototyping, contextual inquiry, … Theories Activity theory, situated action, distributed cognition, …  / 50
Third wave HCI (90’s-00’s) User experience Private and public environments The home, everyday lives Culture, emotion and experience Non-work, non-purposeful, non-rational Disciplines Design research, cultural studies Methods Exploratory methods, cultural probes, narratives, experience prototyping, … Theories Emotional design, four pleasures, threads of experience, …  / 50
Designing the user experience? Avoid negative emotions vs. produce positive emotions Making products challenging, seductive, playful, surprising, memorable, moody, enjoyable, … It is not possible to design the user experience, you can only design  for  the user experience Exploit design solutions that evoke or intensify certain feelings A holistic view on designing products  / 50
User Experience Models  / 50
User Experience Models  / 50
A model of user experience  (Hassenzahl)  / 50
User Experience Models  / 50
Emotional design (Norman)  / 50
User Experience Models  / 50
User-product interactions and experience  / 50 ( Forlizzi and Battarbee)
Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods  / 50
Cultural probes Collections of evocative tasks meant to elicit inspirational responses from people Package with e.g. postcards, maps, camera, diaries, … with assignments, often provocative or ambiguous Materials are returned one by one during a short period Fragmentary clues about users’ lives and thoughts Inspiration, not information Stimulate imaginations rather than defining problems Openly subjective and playful Use ambiguity, absurdity and mystery Recognizes and embraces the notion that knowledge has its limits Values uncertainty, play, exploration and subjective interpretation ‘ Unscientific’ approach, a subversion of traditional HCI methods  / 50
 / 50
Dante’s Hell  / 50
Advantages of cultural probes Provide opportunities to discover new pleasures, new forms of sociability and new cultural forms Not designing solutions to user needs Offer possibilities for surprising results Doesn’t focus on an ‘average’ user Reduce distance between researchers and users Formal, geographic and cultural distance Through its design and communication, the designers make their intentions clear Gives a deep sense of familiarity and engagement with the people you design products for  / 50
From probes to design Probes are not meant to be rigorously analysed Serve as inspiration for reflecting Don’t directly lead to designs Making you aware of the detailed richness of an environment Embraces subjectivity, uncontrolledness and personality Prevent from believing you can look into people’s heads Impossible to arrive at comfortable conclusions Understand their responses empathetically Make the strange familiar, and the familiar strange Probes are only one source for designing product Some design decisions directly based on probe returns Create a relationship with users, like designing for a friend  / 50
Example cultural probe results  / 50
Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods  / 50
Extreme characters  (Djajadiningrat) Fictional users with exaggerated emotional attitudes Take another perspective To highlight cultural issues Complementary method, not replacing personas Advantages Character traits can be exposed which normally remain hidden because they are antisocial or in conflict with a person’s status. Disadvantages It is not your user, not based on data How many extreme characters? Which extreme characters?  / 50
Example extreme character for agenda planner The drug dealer Information is very sensitive, cannot fall in the wrong hands He does not plan far ahead since dealers come and go  / 50
 / 50
 / 50
Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods  / 50
Experience prototyping  (Buchenau and Suri) “ A  form of prototyping that enables design team members, users and clients to gain first-hand appreciation of existing or future conditions through active engagement with prototypes” What are the contextual, physical, temporal, sensory, social and cognitive factors we must consider for our design? What is the essence of the existing user experience? What are essential factors that our design should preserve? Example: experience of a heart patient Designers were given a pager for a weekend When the pager went off, this simulated a defibrillating shock Designers had to record their current experience Closely related to role playing  / 50
Examples of experience prototyping  / 50
Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods  / 50
UX evaluation methods Most amount of new methods in this category A lot of research in this area New methods or variations are being discussed at several conferences (e.g. see  http://www.allaboutux.org/ )  Different classifications possible, based on Verbal or non-verbal measurement Quantitative or qualitative results Phase in the design process General type of evaluation (lab, field, survey, …) Analysis, design or evaluation? Some methods could be used in several stages Only evaluation when interaction with product is the focus  / 50
Verbal vs. non-verbal methods Non-verbal observation methods (‘objective’) Language independent, unobtrusive, more objective Limited set of basic emotions, no combination of emotions Psycho-physiological measurement, facereading, emotion heuristics Verbal self-report methods (‘subjective’) Subjective feelings measured through self-report Can represent any set of emotions, can measure combinations of emotions Difficult to apply between cultures Questionnaires, rating scales, laddering Non-verbal self-report methods (‘subjective’) Subjective feelings, distinct or combinations of emotions Does not require subjects to verbalize emotions Self-Assessment Manikin (SAM), Product Emotion Measurement Instrument (PrEmo), Emocards  / 50
Means End Theory A theory to understand how specific features or attributes (means) of a product relate to personal values (ends) People choose a product because it has attributes (the means) that provide consequences and fulfilling personal values (the ends)
 
Examples Attributes colour, taste, design, … Consequences Functional: price, quality, user-friendliness, … Psycho-social: habits, reliability, … Values Health, security, fun, social power, …  / 50
Glass => transparent, see what is in it => make sure it is  healthy => my children deserve the best => I am a good mom Glass => can be cleaned and reused => environmentally friendly => save the planet Plastic => light => easily disposible => practical => more time for more important things => you have to be productive and get ahead in life Example:  Yoghurt packaging
One particular method for researching means-end chains Not the only one but the most popular in consumer research because it proved to be superior Entails both a  qualitative  technique (which ladders) How to interview quantitative technique  (which are dominant) How to analyze  data and generalize from it Laddering
Graphs the dominant links in a hierarchical value map (HVM) association network meaningful couplings between attributes, consequences and values.  (reynolds and Gutman, 1988) Hierarchical Value Map
How to perform laddering One-to-one in-depth interviews Researcher asks question ‘what do you like about [product x]’ After first answer, question is reformulated to ‘what do you like about [answer]’ Reveals the relation between  Product attributes (A) Product consequences (C) User’s values (V) Results in means-end chain  / 50
Example of laddering interview  / 50 Researcher: I forgot again, which one did you like most? Child stands up and points at the bird Oh yes, the bird, can you tell me why? "Because I like it"  Ah, because you like it, and can you tell me why? "The tumbling it makes” [A] Ah, the tumbling it makes, and why is that nice? "Because that is so funny” [C] Ah, and why do you like it when it is funny? "Because it is really cool that it can make a looping" [A] Ah, and why do you like that it makes a looping? "Because sometimes they fall on their bum and they do funny"[A-C] Ah, and why do you like that it is funny? "That they fall on their bum" [A]
Example means-end chain  / 50
Example means-end chain  / 50
AttrakDiff evaluation (Hassenzahl)  / 50
AttrakDiff results  / 50
Emocards  (Desmet)  / 50
Example analysis emocards  (Wimmer e.a.)  / 50
Sensual Evaluation Instrument  (Isbister e.a.) A tool for self-assessment of affect while interacting with computer systems Subjective Real-time feedback Transcending language and cultural barriers No distortion through verbalization More fun for the user  / 50
Example analysis SEI  (Wimmer e.a.)  / 50
Example analysis SEI  (Wimmer e.a.)  / 50
Questions? [email_address]

More Related Content

PPTX
Session 2 Methods qualitative_quantitative
PPT
Information disclosure
PPT
Creative methods for designing and evaluating user experiences
PPTX
PPTX
Interviewing Users: Spinning Data Into Gold
PPTX
Design thinking for Education, AUW Session 1
PPTX
MG673 - Session 1
PPTX
A2 media g324 adanved portfolio in media - ledson 30-32 evaluation questions
Session 2 Methods qualitative_quantitative
Information disclosure
Creative methods for designing and evaluating user experiences
Interviewing Users: Spinning Data Into Gold
Design thinking for Education, AUW Session 1
MG673 - Session 1
A2 media g324 adanved portfolio in media - ledson 30-32 evaluation questions

Similar to Creative methods for designing and evaluating user experiences (20)

PPTX
Design Led Thinking WOrkshop
PPT
Usability Testing Basics: Remote and In-Person Studies
PPT
Workshop: Lesson plan through a critical thinking perspective
PPTX
2. Five Stages in Design Thinking_per 2.pptx
PPT
Chapter 9 id2e_slides
PPTX
Users, Usability & User Experience - at PodCamp Cleveland 2011
PPTX
Essential questions and enduring understandings of Visual Arts
PPTX
A2 g324 evaluation questions
PPT
Emotions and e-learning - UOC
PPT
MyUOC: A New Solution for Creating Versatile Learning Environments (presented...
PPTX
Overview of Evaluation Methods and Choices.pptx
PPTX
Pragmatics, Cognition, and Conceptual Modeling. Why Process Modelling and Pro...
PPTX
Expanding the User Centred Design Process to incorporate an Experience Evalua...
PDF
PPTX
User eXperience insights
PDF
HITD 201: Design Thinking - Lecture 2; Empathy and Understanding Users
PDF
Practicing Anthropology in Design and Business
PPT
DIY: Research on a shoestring budget
PDF
Harvesting user insights revolve conf v09
PPTX
Sociology methods and data analysis unit
Design Led Thinking WOrkshop
Usability Testing Basics: Remote and In-Person Studies
Workshop: Lesson plan through a critical thinking perspective
2. Five Stages in Design Thinking_per 2.pptx
Chapter 9 id2e_slides
Users, Usability & User Experience - at PodCamp Cleveland 2011
Essential questions and enduring understandings of Visual Arts
A2 g324 evaluation questions
Emotions and e-learning - UOC
MyUOC: A New Solution for Creating Versatile Learning Environments (presented...
Overview of Evaluation Methods and Choices.pptx
Pragmatics, Cognition, and Conceptual Modeling. Why Process Modelling and Pro...
Expanding the User Centred Design Process to incorporate an Experience Evalua...
User eXperience insights
HITD 201: Design Thinking - Lecture 2; Empathy and Understanding Users
Practicing Anthropology in Design and Business
DIY: Research on a shoestring budget
Harvesting user insights revolve conf v09
Sociology methods and data analysis unit
Ad

Recently uploaded (20)

PDF
KodekX | Application Modernization Development
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Encapsulation theory and applications.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Unlocking AI with Model Context Protocol (MCP)
PPTX
Big Data Technologies - Introduction.pptx
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Approach and Philosophy of On baking technology
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Spectral efficient network and resource selection model in 5G networks
KodekX | Application Modernization Development
The Rise and Fall of 3GPP – Time for a Sabbatical?
Encapsulation theory and applications.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Unlocking AI with Model Context Protocol (MCP)
Big Data Technologies - Introduction.pptx
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Network Security Unit 5.pdf for BCA BBA.
NewMind AI Weekly Chronicles - August'25 Week I
Per capita expenditure prediction using model stacking based on satellite ima...
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Digital-Transformation-Roadmap-for-Companies.pptx
The AUB Centre for AI in Media Proposal.docx
Approach and Philosophy of On baking technology
20250228 LYD VKU AI Blended-Learning.pptx
Understanding_Digital_Forensics_Presentation.pptx
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Advanced methodologies resolving dimensionality complications for autism neur...
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Spectral efficient network and resource selection model in 5G networks
Ad

Creative methods for designing and evaluating user experiences

  • 1. David Geerts Research Manager Centre for User Experience Research (CUO) K.U.Leuven Creative methods for designing and evaluating user experiences
  • 2. Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods / 50
  • 3. Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods / 50
  • 4. First wave HCI (70’s-80’s) Cognitive approach Human as information processor Interaction between single user and computer “ Human factors” Disciplines Cognitive psychology, computer science Methods Rigid guidelines, controlled experiments, formal methods, user modelling, … Theories GOMS (Goals Operators Methods Selection rules), KLM (Keystroke Level Model), Fitt’s law, Hick’s law, … / 50
  • 5. Second wave HCI (80’s-90’s) Social context Groups working with collection of applications Work settings and communities of practice “ Human actors” Disciplines Social sciences, anthropology Methods Ethnographic observations, participatory design, prototyping, contextual inquiry, … Theories Activity theory, situated action, distributed cognition, … / 50
  • 6. Third wave HCI (90’s-00’s) User experience Private and public environments The home, everyday lives Culture, emotion and experience Non-work, non-purposeful, non-rational Disciplines Design research, cultural studies Methods Exploratory methods, cultural probes, narratives, experience prototyping, … Theories Emotional design, four pleasures, threads of experience, … / 50
  • 7. Designing the user experience? Avoid negative emotions vs. produce positive emotions Making products challenging, seductive, playful, surprising, memorable, moody, enjoyable, … It is not possible to design the user experience, you can only design for the user experience Exploit design solutions that evoke or intensify certain feelings A holistic view on designing products / 50
  • 10. A model of user experience (Hassenzahl) / 50
  • 14. User-product interactions and experience / 50 ( Forlizzi and Battarbee)
  • 15. Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods / 50
  • 16. Cultural probes Collections of evocative tasks meant to elicit inspirational responses from people Package with e.g. postcards, maps, camera, diaries, … with assignments, often provocative or ambiguous Materials are returned one by one during a short period Fragmentary clues about users’ lives and thoughts Inspiration, not information Stimulate imaginations rather than defining problems Openly subjective and playful Use ambiguity, absurdity and mystery Recognizes and embraces the notion that knowledge has its limits Values uncertainty, play, exploration and subjective interpretation ‘ Unscientific’ approach, a subversion of traditional HCI methods / 50
  • 19. Advantages of cultural probes Provide opportunities to discover new pleasures, new forms of sociability and new cultural forms Not designing solutions to user needs Offer possibilities for surprising results Doesn’t focus on an ‘average’ user Reduce distance between researchers and users Formal, geographic and cultural distance Through its design and communication, the designers make their intentions clear Gives a deep sense of familiarity and engagement with the people you design products for / 50
  • 20. From probes to design Probes are not meant to be rigorously analysed Serve as inspiration for reflecting Don’t directly lead to designs Making you aware of the detailed richness of an environment Embraces subjectivity, uncontrolledness and personality Prevent from believing you can look into people’s heads Impossible to arrive at comfortable conclusions Understand their responses empathetically Make the strange familiar, and the familiar strange Probes are only one source for designing product Some design decisions directly based on probe returns Create a relationship with users, like designing for a friend / 50
  • 21. Example cultural probe results / 50
  • 22. Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods / 50
  • 23. Extreme characters (Djajadiningrat) Fictional users with exaggerated emotional attitudes Take another perspective To highlight cultural issues Complementary method, not replacing personas Advantages Character traits can be exposed which normally remain hidden because they are antisocial or in conflict with a person’s status. Disadvantages It is not your user, not based on data How many extreme characters? Which extreme characters? / 50
  • 24. Example extreme character for agenda planner The drug dealer Information is very sensitive, cannot fall in the wrong hands He does not plan far ahead since dealers come and go / 50
  • 27. Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods / 50
  • 28. Experience prototyping (Buchenau and Suri) “ A form of prototyping that enables design team members, users and clients to gain first-hand appreciation of existing or future conditions through active engagement with prototypes” What are the contextual, physical, temporal, sensory, social and cognitive factors we must consider for our design? What is the essence of the existing user experience? What are essential factors that our design should preserve? Example: experience of a heart patient Designers were given a pager for a weekend When the pager went off, this simulated a defibrillating shock Designers had to record their current experience Closely related to role playing / 50
  • 29. Examples of experience prototyping / 50
  • 30. Agenda The User Experience Analysis methods Requirements specification Design methods Evaluation methods / 50
  • 31. UX evaluation methods Most amount of new methods in this category A lot of research in this area New methods or variations are being discussed at several conferences (e.g. see http://www.allaboutux.org/ ) Different classifications possible, based on Verbal or non-verbal measurement Quantitative or qualitative results Phase in the design process General type of evaluation (lab, field, survey, …) Analysis, design or evaluation? Some methods could be used in several stages Only evaluation when interaction with product is the focus / 50
  • 32. Verbal vs. non-verbal methods Non-verbal observation methods (‘objective’) Language independent, unobtrusive, more objective Limited set of basic emotions, no combination of emotions Psycho-physiological measurement, facereading, emotion heuristics Verbal self-report methods (‘subjective’) Subjective feelings measured through self-report Can represent any set of emotions, can measure combinations of emotions Difficult to apply between cultures Questionnaires, rating scales, laddering Non-verbal self-report methods (‘subjective’) Subjective feelings, distinct or combinations of emotions Does not require subjects to verbalize emotions Self-Assessment Manikin (SAM), Product Emotion Measurement Instrument (PrEmo), Emocards / 50
  • 33. Means End Theory A theory to understand how specific features or attributes (means) of a product relate to personal values (ends) People choose a product because it has attributes (the means) that provide consequences and fulfilling personal values (the ends)
  • 34.  
  • 35. Examples Attributes colour, taste, design, … Consequences Functional: price, quality, user-friendliness, … Psycho-social: habits, reliability, … Values Health, security, fun, social power, … / 50
  • 36. Glass => transparent, see what is in it => make sure it is healthy => my children deserve the best => I am a good mom Glass => can be cleaned and reused => environmentally friendly => save the planet Plastic => light => easily disposible => practical => more time for more important things => you have to be productive and get ahead in life Example: Yoghurt packaging
  • 37. One particular method for researching means-end chains Not the only one but the most popular in consumer research because it proved to be superior Entails both a qualitative technique (which ladders) How to interview quantitative technique (which are dominant) How to analyze data and generalize from it Laddering
  • 38. Graphs the dominant links in a hierarchical value map (HVM) association network meaningful couplings between attributes, consequences and values. (reynolds and Gutman, 1988) Hierarchical Value Map
  • 39. How to perform laddering One-to-one in-depth interviews Researcher asks question ‘what do you like about [product x]’ After first answer, question is reformulated to ‘what do you like about [answer]’ Reveals the relation between Product attributes (A) Product consequences (C) User’s values (V) Results in means-end chain / 50
  • 40. Example of laddering interview / 50 Researcher: I forgot again, which one did you like most? Child stands up and points at the bird Oh yes, the bird, can you tell me why? "Because I like it" Ah, because you like it, and can you tell me why? "The tumbling it makes” [A] Ah, the tumbling it makes, and why is that nice? "Because that is so funny” [C] Ah, and why do you like it when it is funny? "Because it is really cool that it can make a looping" [A] Ah, and why do you like that it makes a looping? "Because sometimes they fall on their bum and they do funny"[A-C] Ah, and why do you like that it is funny? "That they fall on their bum" [A]
  • 46. Example analysis emocards (Wimmer e.a.) / 50
  • 47. Sensual Evaluation Instrument (Isbister e.a.) A tool for self-assessment of affect while interacting with computer systems Subjective Real-time feedback Transcending language and cultural barriers No distortion through verbalization More fun for the user / 50
  • 48. Example analysis SEI (Wimmer e.a.) / 50
  • 49. Example analysis SEI (Wimmer e.a.) / 50

Editor's Notes

  • #11: Appealing: able to trigger positive emotional reactions Satisfaction: being pleased if results matches expectations Pleasure: being pleased with unexpected desirable event Pragmatic attributes Fulfilment of individual’s behavioural goals Manipulation of the environment Hedonic attributes Individual’s psychological well-being Are strong potentials for pleasure “ outstanding”, “impressive”, “exciting”, “interesting”, … Provide stimulation, communicate identity and provoke valued memories Stimulation A product's perceived ability to surprise, to be novel Products should provide new impressions, opportunities and insight E.g. unused features you hope to use in the future Identification A product's ability to communicate a favorable identity relevant others Social function of self-expressivity Evocation The memories attached to a product A product that represents past events, relationships or important thoughts
  • #13: Visceral level Reaction to visual and other sensory aspects of a product Helps us make rapid decisions about what is good, bad, safe, or dangerous Behavioral level Lets us manage simple, everyday behaviors Functionality and usability Can enhance or inhibit both lower-level visceral reactions and higher-level reflective responses Reflective level Involves conscious consideration and reflection on past experiences Can enhance or inhibit behavioral processing, but has no direct access to visceral reactions Accessible only via memory, not through direct interaction or perception
  • #15: Fluent Automatic and skilled interactions with products Riding a bicycle Making the morning coffee Checking the calendar by glancing at the PDA Cognitive Interactions that focus on the product at hand Result in knowledge or confusion and error Trying to identify the flushing mechanism of a toilet in a foreign country Using online algebra tutor to solve a math problem Expressive Interactions that help the user form a relationship to the product Restoring a chair and painting it a different color Setting background images for mobile phones Creating workarounds in complex software Experience Constant stream of “self-talk” that happens when we interact with products Walking in a park Doing light housekeeping Using instant messaging systems An Experience Can be articulated or named Has a beginning and end Inspires behavioral and emotional change Going on a roller coaster ride Watching a movie Discovering an online community of interest Co-Experience Creating meaning and emotion together through product use Interacting with others with a museum exhibit Commenting on a friend’s remodeled kitchen Playing a mobile messaging game with friends
  • #18: Postcards Please tell us a piece of advice or insight that has been important to you What do you dislike about [your home town]? What place does art have in your life? Tell us about your favourite device Maps Where have you been in the world? If [your home town] would be New York, where would you put the statue of liberty, junkies, … Camera Take a picture of your home, what you will wear today, the first person you see today, something desirable, something boring, something red, … …