SlideShare a Scribd company logo
LECTURE 1: INTRODUCTION
COMP 4026 – Advanced HCI
Semester 5 - 2016
Mark Billinghurst
University of South Australia
Lecturer
•  Mark Billinghurst
•  PhD University of Washinton
•  Director of the Empathic Computing Lab
•  Expert in AR, 3D user interfaces
•  mark.billinghurst@unisa.edu.au
Class Logistics
•  Weekly lecture (2 hrs)
•  Thursday 11am – 1pm
•  Room D2-34
•  Assessment
•  Project Concept Design – 10%
•  Class participation/Design journal – 40%
•  HCI Project – 50%
•  What you will need
•  Design Journal/Sketch Book
HCI Project
• Pick an advanced interface technology
• Wearable, AR/VR, Bio sensor, Computer Vision
• Identify a user need that it addresses
• Product a concept design
• Develop an interactive prototype
• Conduct a user evaluation
• Write a research report
• 8-10 pages conference format
Project Technologies Available
What You Will Learn
•  History of HCI Trends
•  Interaction Design Fundamentals
•  Design Thinking Processes
•  Advanced Interface Technology
•  Wearable Computing
•  Augmented/Virtual Reality
•  Sensing systems
•  Experimental Design/Evaluation
•  Research Directions
TRENDS IN HCI
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
Processing Power
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
Courtesy Matt Rettig, CMU
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
SpaceWar Demo
•  http://www.masswerk.at/spacewar/
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
Doug Englebart Mouse (1968)
•  https://www.youtube.com/watch?v=1MPJZ6M52dI
COMP 4026 - Lecture 1
Ivan Sutherland Sketchpad Demo
•  https://www.youtube.com/watch?v=DWAIp3t6SLU
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
https://www.youtube.com/watch?v=2zfqw8nhUwA
Xerox Star
https://www.youtube.com/watch?v=zVw86emu-K0
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
Processing Power
Operate
Experience
Adapt
EXPERIENCE DESIGN
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
“The product is no longer the basis
of value.The experience is.”
Venkat Ramaswamy
The Future of Competition.
Experience Economy
experiences



services



products



components
Value
Sony CSL © 2004
Gilmore + Pine: Experience Economy
Function
Emotion
COMP 4026 - Lecture 1
Good Experience Design
• Reactrix
•  Top down projection
•  Camera based input
•  Reactive Graphics
•  No instructions
•  No training
Reactrix Demo – car race
Reactrix Demo – Coke interactive
How to improve experience of picking up rubbish?
World’s Deepest Rubbish Bin
• The Fun Theory – http://www.funtheory.com
• https://www.youtube.com/watch?v=tcrhp-IWK2w
Improve the experience of walking up stairs?
Musical Stairs
•  The Fun Theory – http://www.funtheory.com
•  https://www.youtube.com/watch?v=2lXh2n0aPyw
What to do?
• Imagine
• You re bringing a new product to market
• Your #2 competitor has been in the market for
over a year, selling millions of units
• Your #1 competitor launches the same month
• Your technology is slower than your competitors
• Your technology is older than your competitors
• Your last product failed in the market
• Do you compete on Price ?
• Do you compete on Technology ?
• Do you compete on Features ?
Wrong: Compete on user experience !
COMP 4026 - Lecture 1
NintendoWii
• Cheap - $500
• Unique game play
• Wireless 3 DOF controller
• Position and orientation sensing
• Aiming to broaden user base
• Can play previous games/downloads
COMP 4026 - Lecture 1
Sales to Sept 2011
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
Using the N-gage
SideTalking
•  www.sidetalkin.com
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
INTERACTION DESIGN
Interaction Design
Designing interactive products to support people
in their everyday and working lives		
	 	 	 	Preece, J., (2002). Interaction Design
•  Design of User Experience with Technology
Bill Verplank on Interaction Design
•  https://www.youtube.com/watch?v=Gk6XAmALOWI
• Interaction Design involves answering three questions:
•  What do you do? - How do you affect the world?
•  What do you feel? – What do you sense of the world?
•  What do you know? – What do you learn?
Bill Verplank
• Artist/Engineer:
• concerned with what’s on the screen
• Interface Designer:
• concerned with person in front of the screen
• often takes static view of interface
• Interaction Designer
•  Concerned with engaging with technology over time
•  Creating two way conversation with machine
COMP 4026 - Lecture 1
What is Interaction Design?
•  https://www.youtube.com/watch?v=OZPLCjrewj8
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
HCI and Interaction Design
Interaction Design Process
Evaluate
(Re)Design
Identify needs/
establish
requirements
Build an
interactive
version
Final Product
Develop alternative prototypes/concepts and compare them
And iterate, iterate, iterate....
DISCOVERY
Interaction Design Process
Evaluate
(Re)Design
Identify needs/
establish
requirements
Build an
interactive
version
Final Product
Develop alternative prototypes/concepts and compare them
And iterate, iterate, iterate....
Goal
Create a deep understanding of the
user and problem space
COMP 4026 - Lecture 1
Who are your Users?
Everyone!
Understanding Specific Needs
Designing for Everyone
Designing for Everyone pleases No one
Who REALLY are your Users/Stakeholders?
• Not as obvious as you think:
— those who interact directly with the product
— those who manage direct users
— those who receive output from the product
— those who make the purchasing decision
— those who use competitor’s products
• Three categories of user (Eason, 1987):
— primary: frequent hands-on
— secondary: occasional or via someone else
— tertiary: affected by its introduction, or will influence its purchase
Smart Shopping Cart
Smart Shopping Cart
•  https://www.youtube.com/watch?v=OeSqnLZXKM4
Who are the Stakeholders?
Check-out operators
CustomersManagers and owners
• Suppliers
• Local shop 

owners
99
What do we mean by ‘needs’?
•  Users rarely know what is possible
•  Users can’t tell you what they ‘need’ to achieve goals
•  Instead, look at existing tasks:
–  their context
–  what information do they require?
–  who collaborates to achieve the task?
–  why is the task achieved the way it is?
•  Envisioned tasks:
–  can be rooted in existing behaviour
–  can be described as future scenarios
Consider theWhole User
NeedsAnalysis Methods
Learn from
people
Learn from
analogous
settings
Learn from
Experts
Immersive
yourself in
context
Learn from People
• Who
•  Brainstorm interesting people to meet
•  Think of extremes
• How
•  Plan the interaction and logistics
•  Invite participants
•  Create a trusted atmosphere
• What
•  Pay attention to your environment
•  Capture your immediate observations
Interviewing
• Understanding people’s thoughts, emotions, motivations
• Understanding people’s choices and behaviours
• Key way to identify needs
Learn from Experts
• Experts have in-depth knowledge about topic
• Can give large amount of information in short time
• Choose Participants
• Expertise, radical opinion, etc
• Set up for productive conversation
• Plan, capture, document
Immersive yourself in Context
• Observing the problem space around you
• Plan observations
• What emotions do you experience?
• What challenges?
• Explore and take notes
• Sketches, notes, photos
• Capture what you have seen
• Reflections, post-it notes
Understanding the User
A day in the Life of.. Cultural Probes.. Role Playing..
Cultural Probes:Equator Domestic Probes
What? How?Why?
• Observation analysis
• Start from Concrete Observation
• What is the person doing?
• Move to Understanding
• How are they doing it?
• Finish with interpretation
• Why are they doing it?
COMP 4026 - Lecture 1
Seek Inspiration inAnalogous Setting
• Inspiration in different context than problem space
• Eg redesign library by going to Apple store
• Think of Analogies that connect with challenge
• Similar scenarios in different places
• Make arrangements for activities
• Logistics
• Absorb experience
• Observe, ask
Analogous Settings
•  Analogies provide way to get fresh perspective
•  Identify key aspects of problem space
•  Look for opportunities for analogies
Define the Problem
•  Expresses the problem you are addressing
• Defines your unique point of view
• Unique design vision based on needs analysis
• Two Goals
• Deep understanding of users and design space
• Actionable problem statement (point of view)
Stakeholder
• Identify key elements of target person
• Demographics
• Occupation
• Motivation
• Express as adjective description
• Develop typical persona
Personas
•  Personas are a design tool to help visualize who you are
designing for and imagine how person will use the product
•  A persona is an archetype that represents the behavior and
goals of a group of users
•  Based on insights and observations from customer research
•  Not real people, but synthesised from real user
characteristics
•  Bring them to life with a name, characteristics, goals,
background
•  Develop multiple personas
Persona
•  Capture elements relevant to problem
COMP 4026 - Lecture 1
Empathy Map
• Synthesize observations and draw out insight
• 4 quadrant layout
• SAY: What are some quotes and defining words your
user said?
• DO: What actions and behaviors did you notice?
• THINK: What might your user be thinking? What does
this tell you about his or her beliefs?
• FEEL: What emotions might your subject be feeling?
Empathy Map
•  https://www.youtube.com/watch?v=oyMqNFG1wgM
Example
Expressing the Problem
[User] needs [verb phrase] in a way that [way]
How might we [verb phrase] ?
Need
• Human emotional or physical necessities.
• Needs help define your design
• Needs are verbs not Nouns
• Verbs - (activities and desires)
• Nouns (solutions)
• Identify needs directly out of the user traits you
noted, or from contradictions between
• disconnect between what she says and what she does..
Insight
• A remarkable realization that you could leverage to
better respond to - a design challenge.
• Insights often grow from contradictions between two
user attributes
• either within a quadrant or two different quadrants
• Asking “Why?” when you notice strange behavior.
Problem Definition Creates Insight
User + Need = Insight
www.empathiccomputing.org
@marknb00
mark.billinghurst@unisa.edu.au

More Related Content

PDF
Lecture7 Example VR Applications
PDF
COMP 4010 Lecture 6: VR Applications
PDF
COMP 4010 - Lecture 5: Interaction Design for Virtual Reality
PDF
COMP 4010: Lecture 5 - Interaction Design for Virtual Reality
PDF
COMP 4010: Lecture 6 Example VR Applications
PDF
MHIT 603: Introduction to Interaction Design
PDF
UX workshop
PDF
Moving Beyond Questionnaires to Evaluate MR Experiences
Lecture7 Example VR Applications
COMP 4010 Lecture 6: VR Applications
COMP 4010 - Lecture 5: Interaction Design for Virtual Reality
COMP 4010: Lecture 5 - Interaction Design for Virtual Reality
COMP 4010: Lecture 6 Example VR Applications
MHIT 603: Introduction to Interaction Design
UX workshop
Moving Beyond Questionnaires to Evaluate MR Experiences

What's hot (20)

PDF
Designing Usable Interface
PDF
From Interaction to Empathy
PDF
Comp4010 lecture11 VR Applications
PDF
COMP 4010: Lecture 4 - 3D User Interfaces for VR
PDF
COMP 4010 Lecture9 AR Interaction
PDF
MHIT603: Lecture 4 - Experience Prototyping
PDF
COMP 4026 Lecture3 Prototyping and Evaluation
PDF
COMP 4026 Lecture2: Design and Prototype
PDF
Mobile AR lecture 9 - Mobile AR Interface Design
PDF
Rapid Prototyping For Augmented Reality
PDF
Designing Outstanding AR Experiences
PDF
Comp4010 lecture11 VR Applications
PDF
COMP 4010 - Lecture11 - AR Applications
PDF
Comp4010 Lecture5 Interaction and Prototyping
PDF
Comp4010 Lecture7 Designing AR Systems
PDF
COMP 4010: Lecture11 AR Interaction
PDF
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
PDF
COMP 4010 Lecture 9 AR Interaction
PDF
Lecture 2 Presence and Perception
PDF
COMP 4026 - Lecture1 introduction
Designing Usable Interface
From Interaction to Empathy
Comp4010 lecture11 VR Applications
COMP 4010: Lecture 4 - 3D User Interfaces for VR
COMP 4010 Lecture9 AR Interaction
MHIT603: Lecture 4 - Experience Prototyping
COMP 4026 Lecture3 Prototyping and Evaluation
COMP 4026 Lecture2: Design and Prototype
Mobile AR lecture 9 - Mobile AR Interface Design
Rapid Prototyping For Augmented Reality
Designing Outstanding AR Experiences
Comp4010 lecture11 VR Applications
COMP 4010 - Lecture11 - AR Applications
Comp4010 Lecture5 Interaction and Prototyping
Comp4010 Lecture7 Designing AR Systems
COMP 4010: Lecture11 AR Interaction
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 Lecture 9 AR Interaction
Lecture 2 Presence and Perception
COMP 4026 - Lecture1 introduction
Ad

Viewers also liked (20)

PDF
Mobile AR Lecture6 - Introduction to Unity 3D
PDF
COMP 4010 Lecture10: AR Tracking
PDF
COMP 4010 Lecture9 AR Displays
PDF
Building Usable AR Interfaces
PDF
2016 AR Summer School Lecture3
PDF
Building AR and VR Experiences
PPTX
Unity 3d Basics
PDF
COMP 4010 Lecture12 Research Directions in AR
PDF
COMP 4010 - Lecture 1: Introduction to Virtual Reality
PDF
Building VR Applications For Google Cardboard
PDF
ARE 2011 AR Authoring
PDF
Creating Immersive and Empathic Learning Experiences
PPTX
Getting Started with C/C# Game Development Part 1
PPTX
Introduction to wave engine
PDF
Unity L01 - Game Development
PPTX
EA: Optimization of mobile Unity application
PDF
Spatial Audio for Augmented Reality
KEY
Casual and Social Games with Unity
PDF
Developing VR in Unity
PPTX
Hands On with the Unity 5 Game Engine! - Andy Touch - Codemotion Roma 2015
Mobile AR Lecture6 - Introduction to Unity 3D
COMP 4010 Lecture10: AR Tracking
COMP 4010 Lecture9 AR Displays
Building Usable AR Interfaces
2016 AR Summer School Lecture3
Building AR and VR Experiences
Unity 3d Basics
COMP 4010 Lecture12 Research Directions in AR
COMP 4010 - Lecture 1: Introduction to Virtual Reality
Building VR Applications For Google Cardboard
ARE 2011 AR Authoring
Creating Immersive and Empathic Learning Experiences
Getting Started with C/C# Game Development Part 1
Introduction to wave engine
Unity L01 - Game Development
EA: Optimization of mobile Unity application
Spatial Audio for Augmented Reality
Casual and Social Games with Unity
Developing VR in Unity
Hands On with the Unity 5 Game Engine! - Andy Touch - Codemotion Roma 2015
Ad

Similar to COMP 4026 - Lecture 1 (20)

PDF
IxD Works Miniworkshop: Introduction
PDF
Introduction to Interaction Design
PDF
User experience design process
PPTX
Human Computer Interaction: Lecture 2: Interaction Design
PPT
Chapter6ID.ppt human computer interaction
PPT
Usability requirements
PPT
Introduction to HCI
PPT
Introduction To HCI
PPT
1.6- User-Centered Design - Introduction
PPTX
Designing Better Experiences
PPTX
Ux Overview
PDF
Personas, Scenarios, User Stories, Use Cases (IxDworks.com)
PDF
User Experience Design: A Primer for Marketers
PDF
thinkLA AdU: UX 2015 Presentation Slides
PPTX
Design process interaction design basics
PPTX
Introduction to HCI (UCC)
PPT
Discovery methods for HCI
PDF
TWS 2014 – Personas, scenarios, user stories
PDF
Introduction to User-Centered Design
PDF
UX Workshop at Startit@KBC
IxD Works Miniworkshop: Introduction
Introduction to Interaction Design
User experience design process
Human Computer Interaction: Lecture 2: Interaction Design
Chapter6ID.ppt human computer interaction
Usability requirements
Introduction to HCI
Introduction To HCI
1.6- User-Centered Design - Introduction
Designing Better Experiences
Ux Overview
Personas, Scenarios, User Stories, Use Cases (IxDworks.com)
User Experience Design: A Primer for Marketers
thinkLA AdU: UX 2015 Presentation Slides
Design process interaction design basics
Introduction to HCI (UCC)
Discovery methods for HCI
TWS 2014 – Personas, scenarios, user stories
Introduction to User-Centered Design
UX Workshop at Startit@KBC

More from Mark Billinghurst (20)

PDF
Empathic Computing: Creating Shared Understanding
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Rapid Prototyping for XR: Lecture 6 - AI for Prototyping and Research Directi...
PDF
Rapid Prototyping for XR: Lecture 5 - Cross Platform Development
PDF
Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
PDF
Rapid Prototyping for XR: Lecture 3 - Video and Paper Prototyping
PDF
Rapid Prototyping for XR: Lecture 2 - Low Fidelity Prototyping.
PDF
Rapid Prototyping for XR: Lecture 1 Introduction to Prototyping
PDF
Research Directions in Heads-Up Computing
PDF
IVE 2024 Short Course - Lecture18- Hacking Emotions in VR Collaboration.
PDF
IVE 2024 Short Course - Lecture13 - Neurotechnology for Enhanced Interaction ...
PDF
IVE 2024 Short Course Lecture15 - Measuring Cybersickness
PDF
IVE 2024 Short Course - Lecture14 - Evaluation
PDF
IVE 2024 Short Course - Lecture12 - OpenVibe Tutorial
PDF
IVE 2024 Short Course Lecture10 - Multimodal Emotion Recognition in Conversat...
PDF
IVE 2024 Short Course Lecture 9 - Empathic Computing in VR
PDF
IVE 2024 Short Course - Lecture 8 - Electroencephalography (EEG) Basics
PDF
IVE 2024 Short Course - Lecture16- Cognixion Axon-R
PDF
IVE 2024 Short Course - Lecture 2 - Fundamentals of Perception
PDF
Research Directions for Cross Reality Interfaces
Empathic Computing: Creating Shared Understanding
Reach Out and Touch Someone: Haptics and Empathic Computing
Rapid Prototyping for XR: Lecture 6 - AI for Prototyping and Research Directi...
Rapid Prototyping for XR: Lecture 5 - Cross Platform Development
Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
Rapid Prototyping for XR: Lecture 3 - Video and Paper Prototyping
Rapid Prototyping for XR: Lecture 2 - Low Fidelity Prototyping.
Rapid Prototyping for XR: Lecture 1 Introduction to Prototyping
Research Directions in Heads-Up Computing
IVE 2024 Short Course - Lecture18- Hacking Emotions in VR Collaboration.
IVE 2024 Short Course - Lecture13 - Neurotechnology for Enhanced Interaction ...
IVE 2024 Short Course Lecture15 - Measuring Cybersickness
IVE 2024 Short Course - Lecture14 - Evaluation
IVE 2024 Short Course - Lecture12 - OpenVibe Tutorial
IVE 2024 Short Course Lecture10 - Multimodal Emotion Recognition in Conversat...
IVE 2024 Short Course Lecture 9 - Empathic Computing in VR
IVE 2024 Short Course - Lecture 8 - Electroencephalography (EEG) Basics
IVE 2024 Short Course - Lecture16- Cognixion Axon-R
IVE 2024 Short Course - Lecture 2 - Fundamentals of Perception
Research Directions for Cross Reality Interfaces

Recently uploaded (20)

PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Modernizing your data center with Dell and AMD
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
A Presentation on Artificial Intelligence
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
cuic standard and advanced reporting.pdf
PPTX
Cloud computing and distributed systems.
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Electronic commerce courselecture one. Pdf
Advanced methodologies resolving dimensionality complications for autism neur...
MYSQL Presentation for SQL database connectivity
Modernizing your data center with Dell and AMD
Encapsulation_ Review paper, used for researhc scholars
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
The Rise and Fall of 3GPP – Time for a Sabbatical?
Unlocking AI with Model Context Protocol (MCP)
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Understanding_Digital_Forensics_Presentation.pptx
A Presentation on Artificial Intelligence
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
CIFDAQ's Market Insight: SEC Turns Pro Crypto
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
cuic standard and advanced reporting.pdf
Cloud computing and distributed systems.
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Electronic commerce courselecture one. Pdf

COMP 4026 - Lecture 1