SlideShare a Scribd company logo
Conceptual Foundations of Software Engineering
in Embodied Interaction Design:
Brain, Body and Bytes
Areej Al-Wabil, PhD
May 11, 2014
Algorithms | Mathematical Theories | Formal Notation | Architecture | Integration | QA
Human Senses
Metaphors and Blends
stories, metaphors, and blends
..software design has not kept pace with technological sophistication
Paradigm Shift
Ubiquitous Computing
Conceptual Blending
Users
Tasks
Contexts of Use
Conceptual Blending
Conceptual Foundations of Interaction
Navigation
Layers
Interaction ‘in the wild’
http://www.archaeologicalconservancy.org/Archaeology-Project-Tango.html
Co-located Interaction
CHICHI Child Computer-Human Interaction
Aging Population
Cognition |Physical Dexterity | Vision | Hearing
Inclusive Design
Inclusive Design: Different ‘Abilities’
Figure Source: http://access.ecs.soton.ac.uk/blog/training/universal-design/
Users
Tasks
Contexts of Use
Urban Models
Audi Urban Future Initiative
Public Spaces
Barneys, NY
Simulation
Ubiquitous Appliances
Marketing
KAUST Augmented Reality App Video
Entertainment
Brain-Computer Interfaces
Mindflex
Affective Computing
Emotiv Insight
games
Space
National Museum of Emerging Science and Innovation, Tokyo
Embodied Interaction
Blurring of Digital and Physical Space
Dominance of
digital media in
our lives demands
changes in HCI-SE
based on advances
in cognitive
science
Designing for Emerging Interaction
Embodied Interaction
Looking at new ways to make
technology more human
http://johnnyholland.org/2011/10/embodied-interactions-in-touch-with-the-digita
Embodied Interaction
“Computing is moving into the
social and the physical space”
Paul Dourish in “Where the Action is” 2010
Computer-Mediated Communication
CMC and CSCW
Embodied
Interaction
Blurring of Digital
and Physical Space
Vision-Driven Research in SKERG
Software and Knowledge Engineering
skerg.ksu.edu.sa
SKERG
skerg.ksu.edu.sa
SKERG
Insights from cognitive and
social sciences developed a
new literacy for well-
informed, sensitive software
design for complex systems
healthcare, education,
entertainment, engineering,
urban planning and
sustainable design domains.
skerg.ksu.edu.sa
skerg.ksu.edu.sa
Image: tobii.com
skerg.ksu.edu.sa
skerg.ksu.edu.sa
skerg.ksu.edu.sa
skerg.ksu.edu.sa
Ubiquitous Computing
Build on the richness of human senses and abilities
as well as the computational functionality enabled
by advances in technology
Algorithms | Mathematical Theories | Formal Notation | Architecture | Integration | QA
User Experience | Physical & Digital Boundaries | Embodiment | Cognition and Perception
Conceptual Foundations of Software Engineering
in Embodied Interaction Design:
Brain, Body and Bytes
Thank you

More Related Content

PDF
HCI Introduction
PDF
Ux:ui terminology
DOCX
A paper on HCI by Nalaemton and Mervin
DOCX
Human computer interaction by Atheer
PPTX
Interface Engineering for UX Professionals
PPT
Design Turn - Expanding Design Consciousness
PPTX
Designing User Interactions with AI: Servant, Master or Symbiosis.
DOCX
What is Deep Learning?
HCI Introduction
Ux:ui terminology
A paper on HCI by Nalaemton and Mervin
Human computer interaction by Atheer
Interface Engineering for UX Professionals
Design Turn - Expanding Design Consciousness
Designing User Interactions with AI: Servant, Master or Symbiosis.
What is Deep Learning?

Viewers also liked (19)

PDF
Human Factors in the Design and Evaluation of Bioinformatics Tools
PDF
Introduction to Rayz
PPTX
GoogleDay_17Apr2013
PPTX
Human Factors in the Design of Emotion-Aware Gaming
PDF
Usability Heuristics for the Design of Interactive Attention Assessment and R...
PPTX
Hearing by seeing: Can improving the visibility of the speaker's lips make yo...
PPTX
Balancing Priorities in the Academic Workplace
PPT
Dsc_5may2013
PPTX
PDF
Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction
PDF
تنافسية الابداع والابتكار - مهارات الوصول للعالمية
PDF
Social Innovations for Urban Sustainability: Towards Smarter Cities
PDF
Innovation in the Classroom: Keeping Digital Innovation Alive in Schools
PDF
Selecting Publication Venues in Computing Disciplines
PDF
Games To Explain Human Factors
PDF
Prototyping in Tangible Interfaces for Complex Systems
PPTX
A Study of the Challenges to Information and Communications Technology in Gir...
PDF
Brain, Body and Bytes: Designing Brain-Computer Interaction Beyond Medical ...
Human Factors in the Design and Evaluation of Bioinformatics Tools
Introduction to Rayz
GoogleDay_17Apr2013
Human Factors in the Design of Emotion-Aware Gaming
Usability Heuristics for the Design of Interactive Attention Assessment and R...
Hearing by seeing: Can improving the visibility of the speaker's lips make yo...
Balancing Priorities in the Academic Workplace
Dsc_5may2013
Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction
تنافسية الابداع والابتكار - مهارات الوصول للعالمية
Social Innovations for Urban Sustainability: Towards Smarter Cities
Innovation in the Classroom: Keeping Digital Innovation Alive in Schools
Selecting Publication Venues in Computing Disciplines
Games To Explain Human Factors
Prototyping in Tangible Interfaces for Complex Systems
A Study of the Challenges to Information and Communications Technology in Gir...
Brain, Body and Bytes: Designing Brain-Computer Interaction Beyond Medical ...
Ad

Similar to PSUCASE2014 (20)

PPT
Multimodal man machine interaction
PDF
Ana Amorim
PPT
Introduction to HCI
PPT
Introduction To HCI
PPT
Using user centered design from a gender perspective. in3
PDF
C0353018026
PPTX
物聯網產品體驗設計架構 | A Conceptual Framework for IoT Product Experience Design
PDF
Making Conversations Visible
PDF
Multimodal and Affective Human Computer Interaction - Abhinav Sharma
PDF
2013 Lecture 6: AR User Interface Design Guidelines
PPTX
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
PDF
Poster: Multimodal "Art"-Making Generative AIs
PPTX
Vivek Tripathi | Portfolio
PDF
User interface zeitgeist 2012
PPT
Importance of User eXperience
PDF
Pulkit Arora's Resume
PDF
Info design presentation-3
PDF
Info design presentation[1]
PDF
Info design presentation2
PDF
Multimodal man machine interaction
Ana Amorim
Introduction to HCI
Introduction To HCI
Using user centered design from a gender perspective. in3
C0353018026
物聯網產品體驗設計架構 | A Conceptual Framework for IoT Product Experience Design
Making Conversations Visible
Multimodal and Affective Human Computer Interaction - Abhinav Sharma
2013 Lecture 6: AR User Interface Design Guidelines
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
Poster: Multimodal "Art"-Making Generative AIs
Vivek Tripathi | Portfolio
User interface zeitgeist 2012
Importance of User eXperience
Pulkit Arora's Resume
Info design presentation-3
Info design presentation[1]
Info design presentation2
Ad

Recently uploaded (20)

PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PDF
My India Quiz Book_20210205121199924.pdf
PDF
Computing-Curriculum for Schools in Ghana
PPTX
Computer Architecture Input Output Memory.pptx
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PPTX
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
PPTX
Introduction to pro and eukaryotes and differences.pptx
PDF
Empowerment Technology for Senior High School Guide
PDF
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PPTX
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
PPTX
History, Philosophy and sociology of education (1).pptx
PDF
IGGE1 Understanding the Self1234567891011
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PDF
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
PDF
1_English_Language_Set_2.pdf probationary
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PPTX
Introduction to Building Materials
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
My India Quiz Book_20210205121199924.pdf
Computing-Curriculum for Schools in Ghana
Computer Architecture Input Output Memory.pptx
202450812 BayCHI UCSC-SV 20250812 v17.pptx
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
Introduction to pro and eukaryotes and differences.pptx
Empowerment Technology for Senior High School Guide
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
Chinmaya Tiranga quiz Grand Finale.pdf
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
History, Philosophy and sociology of education (1).pptx
IGGE1 Understanding the Self1234567891011
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
1_English_Language_Set_2.pdf probationary
A powerpoint presentation on the Revised K-10 Science Shaping Paper
Introduction to Building Materials

PSUCASE2014