SlideShare a Scribd company logo
Architecting Virtual and Physical Spaces
Architecting Virtual 

(and Physical) Spaces
Preston McCauley 

@uidesignguide
Immersive Design & Development
Strategist
Stephen P. Anderson
@stephenanderson
Head of Design, Innovation Garage
at Capital One
t t
ALPHA VERSION!
C O N T E X T
C O N T E X T
I’ve got digital
files scattered all
over my house!
I’ve got digital
files scattered all
over my house!
Spatial
arrangement of
information?
C O N T E X T
When our Bodies Enter
the Experience
When our Bodies Enter 

the Information Environment
Information Architecture for
Immersive Spaces
When our Bodies Enter 

the Information Environment
—OR—
Clicks Gestures!
Remember this transition?
Taps
Architecting Virtual and Physical Spaces
2D, flat rectangles Immersive 3D spaces
passive observer outside of the experience being immersed within a digital experience.
2D, flat rectangles Immersive 3D spaces
passive observer outside of the experience being immersed within a digital experience.
“New questions arise as the world and the Web intertwingle…
How do we rise to the new challenges of creating paths and 

places that bridge physical, digital, and cognitive spaces?”
–PETER MORVILLE
(from the foreward to Pervasive Information Architecture)
Cue up the Hype
Machine!
GETTING ON THE SAME PAGE
Architecting Virtual and Physical Spaces
Painting in space!
@madewithARKit
Draw & Dance
Pre-order, NOW!
2020? 

Hololens
Architecting Virtual and Physical Spaces
Architecting Virtual and Physical Spaces
Architecting Virtual and Physical Spaces
Architecting Virtual and Physical Spaces
VR Toolkits, finally!
VR Hallmark cards?!
Ready Player One
https://youtu.be/zNU4sN7MUNU
Holo Body Suit
Doom VFR
https://medium.com/super-ventures-blog/introducing-the-ar-landscape-5c08fe08c0ba
Architecting Virtual and Physical Spaces
“Are we solving real
problems, yet?”
GETTING ON THE SAME PAGE
https://youtu.be/nWcGhuX6N7w
@madewithARKit
Project Chalk: Vuforia
Architecting Virtual and Physical Spaces
Architecting Virtual and Physical Spaces
Architecting Virtual and Physical Spaces
Architecting Virtual and Physical Spaces
Architecting Virtual and Physical Spaces
Architecting Virtual and Physical Spaces
Using MR to assist
continuity in film?
Immersive Information
Visualization?
YES, lots of hype.
PERHAPS there’s
something here (this time)
BUT…
We should be thinking about this:
Learning from the Past
2D, flat rectangles Immersive 3D spaces
passive observer outside of the experience being immersed within a digital experience.
Clicks
Finger

Gestures
TapsMajor Change
in Interactions:
Clicks
Finger

Gestures
HUD
Taps
Spatial
Interfaces
GUI
Major Change
in Interactions:
Major Change in
Representations:
Pointer Whole body
gestures + MOREClicks/GesturesMajor Change
in Interactions:
Interactions via:
• Whole Body
Gestures
• Voice
• Facial Expressions
• Connected Devices
• Real World Objects
We should be thinking about this:
More than just VR/MR/AR
(Physical meets Digital)
https://youtu.be/kwticv9ai_Q
Interactive Light
Smart Dumb Things
https://youtu.be/87zIv7SL-5Q
The world's first multi-user hologram table is here, on sale in 2018
http://newatlas.com/hologram-tables-euclideon/50868/
RED’s Hydrogen One (Hologram?) Phone
https://youtu.be/z6qcmVgsmXA
Touchable Holograms?!
We should be thinking about this:
BECAUSE NONE OF US
WANT THIS FUTURE…
https://cnet4.cbsistatic.comhttps://cnet4.cbsistatic.com
Architecting Virtual and Physical Spaces
Inspired? Overwhelmed?
How do we make sense of all this?!
Hey,
do you
unders
tand
Hey
doyou
ndersta

nd
Architecting Virtual and Physical Spaces
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
REAL
REALITY
“Space” is composed
entirely of ATOMS
WHAT WE SEEWHATDEVICE(S)SEE
DEVICE HAS

NO

AWARENESS OF
ENVIRONMENT
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
WHAT WE SEEWHATDEVICE(S)SEE
REAL
REALITY
“Space” is composed
entirely of ATOMS
Altar Show: VR
DEVICE HAS A

SMART

AWARENESS OF
ENVIRONMENT
DEVICE HAS A

DUMB

AWARENESS OF
ENVIRONMENT
DEVICE HAS

NO

AWARENESS OF
ENVIRONMENT
AUGMENTED
REALITY
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
MIXED
REALITY
WHAT WE SEEWHATDEVICE(S)SEE
REAL
REALITY
“Space” is composed
entirely of ATOMS
Mixed RealityAugmented Reality
Augmented Reality Mixed Reality
Don’t focus on the hardware
(And don’t get too attached to
either of these terms!)
Augmented Reality Mixed Reality
Digital information
overlayed onto physical
the world
Device awareness of…
•Location
•Position
Digital information mixed into
Physical world with deep
spatial understanding.
Device awareness of…
•Location
•Position
•Object Recognition
•(Virtual) Object Permanence
•Context, in general (faces, etc.)
•Really, anything! (thanks to ML)
Test driving a new car?
Hololens / Mixed Reality
Mixed RealityAugmented Reality
DEVICE HAS

ARTIFICIAL
INTELLIGENCE
DEVICE HAS A

SMART

AWARENESS OF
ENVIRONMENT
DEVICE HAS A

DUMB

AWARENESS OF
ENVIRONMENT
DEVICE HAS

NO

AWARENESS OF
ENVIRONMENT
AUGMENTED
REALITY
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
MIXED
REALITY
WHAT WE SEEWHATDEVICE(S)SEE
REAL
REALITY
“Space” is composed
entirely of ATOMS
DEVICE HAS

ARTIFICIAL
INTELLIGENCE
DEVICE HAS A

SMART

AWARENESS OF
ENVIRONMENT
DEVICE HAS A

DUMB

AWARENESS OF
ENVIRONMENT
DEVICE HAS

NO

AWARENESS OF
ENVIRONMENT
AUGMENTED
REALITY
IMMERSIVE SPACES
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
MIXED
REALITY
DIGITAL INFORMATION IN THE REAL WORLD
EXTERNAL REPRESENTATIONS ARE 

CONSTRAINED BY PHYSICAL WORLD
EXTERNAL REPRESENTATIONS HAVE

NO PHYSICAL CONSTRAINTS
WHAT WE SEEWHATDEVICE(S)SEE
INTERNET OF
THINGS
REAL
REALITY
“Space” is composed
entirely of ATOMS
DEVICE HAS

ARTIFICIAL
INTELLIGENCE
DEVICE HAS A

SMART

AWARENESS OF
ENVIRONMENT
DEVICE HAS A

DUMB

AWARENESS OF
ENVIRONMENT
DEVICE HAS

NO

AWARENESS OF
ENVIRONMENT
AUGMENTED
REALITY
IMMERSIVE SPACES
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
MIXED
REALITY
DIGITAL INFORMATION IN THE REAL WORLD
EXTERNAL REPRESENTATIONS ARE 

CONSTRAINED BY PHYSICAL WORLD
EXTERNAL REPRESENTATIONS HAVE

NO PHYSICAL CONSTRAINTS
WHAT WE SEEWHATDEVICE(S)SEE
INTERNET OF
THINGS
REAL
REALITY
“Space” is composed
entirely of ATOMS
Architecting Virtual
(and Physical!) Spaces
With new mediums of VR/AR/MR, we need to rethink
basic patterns. We can:
• react to these challenges, or
✓approach them in a thoughtful, structured way
GOAL: Share a framework that critically examines
emerging mixed design patterns in light of the
timeless stuff we know about biology, cognition, and
how our bodies use physical space.
Architecting Virtual and Physical Spaces
Supernatural (& Physical)
Interactions Toolkit
A taxonomy identifying the
“supernatural” powers enabled
by an immersive environment
Multidimensional Interactions
Multidimensional Interactions
Constructs Of Virtual Experience (VEX)
Constructs Of Virtual Experience (VEX)
How we use space to hold and convey meaning
•on/off
•around
•top/bottom
•totheleft/totheright
•over/under
•above/below
•between
•inside/outside
•near/far
•nextto…beside
•through
•up/down
How we use space to hold and convey meaning
spatialpositioningand…
•linguistics
•effectsonmemory
•proximity
•dance
•architecture
•leveldesigningames
•etc.
A “Grand Unified Model” for Thinking
about Spatial Contexts
Architecting Virtual and Physical Spaces
Yes, to be continued…!
Thank You!
Preston McCauley 

@uidesignguide
Immersive Design & Development
Strategist
uxmodes.com
Stephen P. Anderson
@stephenanderson
Head of Design, Innovation Garage
at Capital One
www.poetpainter.com
t t

More Related Content

PPTX
Augmented Reality -A quick surface view
PDF
Empathic Computing
PDF
Interaction modalities, technologies and tools for interactive art
PDF
COMP 4026 Lecture 6 Wearable Computing
PPT
Virtual Reality - Get in the Game
PPTX
WeARHand
PDF
Comp 4010 2021 Lecture1-Introduction to XR
PDF
426 lecture1: Introduction to AR
Augmented Reality -A quick surface view
Empathic Computing
Interaction modalities, technologies and tools for interactive art
COMP 4026 Lecture 6 Wearable Computing
Virtual Reality - Get in the Game
WeARHand
Comp 4010 2021 Lecture1-Introduction to XR
426 lecture1: Introduction to AR

What's hot (18)

PDF
Augmented Reality: The Next 20 Years
PPT
Delta 3_ Presentation
PDF
A New Reality - Virtual Reality And Augmented Reality
PPTX
Multimodal, Crossmedia, Multi Platform
PPTX
AR: A view of the future with Microsoft technologies
PPTX
The UX of Mixed Reality
PDF
Beyond the Screen: Humans as Input and Output
PDF
AR in Education
PPTX
Introducing Immersive Technologies for Libraries
PDF
The Next Generation of Human Computer Interaction
PDF
Virtual Reality: History & State of the Art
PDF
Building AR and VR Experiences
PDF
COSC 426 Lect. 1 - Introduction to AR
PDF
Lecture1 introduction to VR
PDF
Tangible AR Interface
PDF
Mixed Reality met Microsoft HoloLens
PPTX
The INEVITABLE
PDF
Singularity-Proof Yourself by Sage Franch
Augmented Reality: The Next 20 Years
Delta 3_ Presentation
A New Reality - Virtual Reality And Augmented Reality
Multimodal, Crossmedia, Multi Platform
AR: A view of the future with Microsoft technologies
The UX of Mixed Reality
Beyond the Screen: Humans as Input and Output
AR in Education
Introducing Immersive Technologies for Libraries
The Next Generation of Human Computer Interaction
Virtual Reality: History & State of the Art
Building AR and VR Experiences
COSC 426 Lect. 1 - Introduction to AR
Lecture1 introduction to VR
Tangible AR Interface
Mixed Reality met Microsoft HoloLens
The INEVITABLE
Singularity-Proof Yourself by Sage Franch
Ad

Similar to Architecting Virtual and Physical Spaces (20)

PPTX
Alvaro Cassinelli / Meta Perception Group leader
PDF
2016 AR Summer School Lecture3
PDF
2022 COMP4010 Lecture1: Introduction to XR
PPT
E3 chap-20
PDF
The Metaverse: Are We There Yet?
PDF
ARI2132 lecture 8
PDF
Fifty Shades of Augmented Reality: Creating Connection Using AR
PDF
Research Directions in Transitional Interfaces
PDF
Designing Outstanding AR Experiences
PPT
e3-chap-20.ppt
PDF
Research Directions in Heads-Up Computing
PDF
Comp4010 Lecture12 Research Directions
PDF
UVR2011(icat2011)
PDF
Comp4010 2021 Lecture2-Perception
PDF
2022 COMP4010 Lecture2: Perception
PDF
Grand Challenges for Mixed Reality
PDF
Beyond Reality (2027): The Future of Virtual and Augmented Reality
PDF
ICS2208 lecture7
PDF
Comp4010 Lecture8 Introduction to VR
PPT
HCI 3e - Ch 20: Ubiquitous computing and augmented realities
Alvaro Cassinelli / Meta Perception Group leader
2016 AR Summer School Lecture3
2022 COMP4010 Lecture1: Introduction to XR
E3 chap-20
The Metaverse: Are We There Yet?
ARI2132 lecture 8
Fifty Shades of Augmented Reality: Creating Connection Using AR
Research Directions in Transitional Interfaces
Designing Outstanding AR Experiences
e3-chap-20.ppt
Research Directions in Heads-Up Computing
Comp4010 Lecture12 Research Directions
UVR2011(icat2011)
Comp4010 2021 Lecture2-Perception
2022 COMP4010 Lecture2: Perception
Grand Challenges for Mixed Reality
Beyond Reality (2027): The Future of Virtual and Augmented Reality
ICS2208 lecture7
Comp4010 Lecture8 Introduction to VR
HCI 3e - Ch 20: Ubiquitous computing and augmented realities
Ad

More from Preston McCauley (7)

PDF
Design For Digital and Physical Realities: Multi-Dimensional UX
PDF
Vuforia & HoloLens: Mixing Up Your Reality - Meetup
PDF
Getting To The Root Of UX - Clear Sight Designs 2017
PDF
MULTI-DIMENSIONAL UX: REALITY IS YOUR CANVAS
PPTX
Improving Workflows With Grunt.js - Big D Design 2014 - Dallas Texas
PDF
Conflicts & Conversations
PDF
Kickstart Your UX Design - From Concept To Prototype
Design For Digital and Physical Realities: Multi-Dimensional UX
Vuforia & HoloLens: Mixing Up Your Reality - Meetup
Getting To The Root Of UX - Clear Sight Designs 2017
MULTI-DIMENSIONAL UX: REALITY IS YOUR CANVAS
Improving Workflows With Grunt.js - Big D Design 2014 - Dallas Texas
Conflicts & Conversations
Kickstart Your UX Design - From Concept To Prototype

Recently uploaded (20)

PDF
How Animation is Used by Sports Teams and Leagues
PPT
EthicsNotesSTUDENTCOPYfghhnmncssssx sjsjsj
PDF
Chalkpiece Annual Report from 2019 To 2025
PPTX
CLASS_11_BUSINESS_STUDIES_PPT_CHAPTER_1_Business_Trade_Commerce.pptx
PDF
SOUND-NOTE-ARCHITECT-MOHIUDDIN AKHAND SMUCT
PPT
aksharma-dfs.pptgfgfgdfgdgdfgdfgdgdrgdgdgdgdgdgadgdgd
PPTX
Presentation.pptx anemia in pregnancy in
PPTX
22CDO02-IMGD-UNIT-I-MOBILE GAME DESIGN PROCESS
PPTX
PROPOSAL tentang PLN di metode pelaksanaan.pptx
PDF
Architecture Design Portfolio- VICTOR OKUTU
PPTX
timber basics in structure mechanics (dos)
PPTX
2. Competency Based Interviewing - September'16.pptx
PPTX
8086.pptx microprocessor and microcontroller
PDF
intro_to_rust.pptx_123456789012446789.pdf
PPTX
Bitcoin predictor project presentation
PPTX
Necrosgwjskdnbsjdmdndmkdndndnmdndndkdmdndkdkndmdmis.pptx
PPT
Fire_electrical_safety community 08.ppt
PPTX
URBAN FINANCEnhynhynnnytnynnnynynyynynynyn
PDF
The Complete Guide to Buying Verified Stripe Accounts 2025.pdf
PPTX
Acoustics new for. Sound insulation and absorber
How Animation is Used by Sports Teams and Leagues
EthicsNotesSTUDENTCOPYfghhnmncssssx sjsjsj
Chalkpiece Annual Report from 2019 To 2025
CLASS_11_BUSINESS_STUDIES_PPT_CHAPTER_1_Business_Trade_Commerce.pptx
SOUND-NOTE-ARCHITECT-MOHIUDDIN AKHAND SMUCT
aksharma-dfs.pptgfgfgdfgdgdfgdfgdgdrgdgdgdgdgdgadgdgd
Presentation.pptx anemia in pregnancy in
22CDO02-IMGD-UNIT-I-MOBILE GAME DESIGN PROCESS
PROPOSAL tentang PLN di metode pelaksanaan.pptx
Architecture Design Portfolio- VICTOR OKUTU
timber basics in structure mechanics (dos)
2. Competency Based Interviewing - September'16.pptx
8086.pptx microprocessor and microcontroller
intro_to_rust.pptx_123456789012446789.pdf
Bitcoin predictor project presentation
Necrosgwjskdnbsjdmdndmkdndndnmdndndkdmdndkdkndmdmis.pptx
Fire_electrical_safety community 08.ppt
URBAN FINANCEnhynhynnnytnynnnynynyynynynyn
The Complete Guide to Buying Verified Stripe Accounts 2025.pdf
Acoustics new for. Sound insulation and absorber

Architecting Virtual and Physical Spaces