Tangible Interfaces & Mixed Reality : A step toward digital augmented environments

http://www.flickr.com/photos/gregoirecliquet/5603411030/

Grégoire Cliquet / L’Ecole de design Nantes Atlantique / READi design lab
+ Tangible Interfaces & Mixed Reality :
A step toward digital augmented environments +
Universität für angewandte Kunst Wien
May, 6th 2011
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011

“datataquarium” / Laval Virtual 2009

Gregoire Cliquet
Director of the « READi interaction design lab »
L’Ecole de design Nantes Atlantique

 Phd. in Engineering Science
 Course leader in interaction design / H.M.I.
 Real-Time 3d developer / Information visualization

http://www.flickr.com/photos/lecolededesign/2320698239/in/set-72157604076710360/

Interaction design @lecolededesign ?
10 years ;)
 5 years curriculum : 1 Basics / 2 Undergraduate (Bachelor) / 2 Master’s program (Tangible Interfaces & Virtual Reality)
 Interacttion design : About 100 students + 25 masters degrees /year
 Prizes : Laval Virtual, Siggraph 2009 + IVRC 2009 & 2010
 Interaction design @lecolededesign.com : Contents + Interfaces (Ui) + Interaction (Ux) + Services


http://www.flickr.com/photos/loneyss/5546547889/sizes/l/in/set-72157626191918529/ Photo : L. Neyssensas
READi? Topics
 Tangible Interfaces
 Virtual Reality
 Visualizing and Sharing Knowledge


“leARn” / Victor Manselon 2011 / http://www.pimentsrouges.com/
READi ? Tangible interfaces
 From GUI to NUI the place & gestures as meanings of interaction
 The disappearance of graphic interfaces/embedding intelligence into day to day objects
 Natural User Interfaces for collaborative work
 DIY / FabLab : When mass production turns to home-made production


http://www.flickr.com/photos/gregoirecliquet/3264184500/in/set-72157613484076021

READi ? Virtual Reality
x2 diploma in partnership with Arts et Métiers ParisTech

 Virtual, Augmented and Mixed Reality to improve User Experiences
 New applications, gameplays, services built with AR
 Interactive and Immersive 3d as a universal language in the process of co-creation
 Representing and interacting with / within data.
Laboratoire Présence&innovation LAVAL


”IRS” / David Arenou / pfe 2010
Immersive Rail shooter / David Arenou 2010
Tangible Interfaces & Mixed Reality :
A step toward digital augmented environments
 1. Definitions
 2. Examples @READi
 3. New paradigm in computing
 4. Major design issues
 5. Conclusion / Discussion

http://www.flickr.com/photos/loneyss/3187497169/sizes/l/in/set-72157612394649393/ Photo : L. Neyssensas

1. Definitions: Virtual Reality?

 Jaron Lanier in 1985 for “computer-simulated environments”
 Virtual Reality (VR) aims by using special devices to simulate physical presence :
stereoscopic display, haptic feedbacks, IR tracking…
Human into the Computer

http://www.flickr.com/photos/loneyss/5187428975/sizes/l/in/set-72157625294610619 / ( L. Neyssensas)

1. Definitions: Virtual Reality (example)
http://www.youtube.com/watch?v=XECqdtdY-Gc

 VR4D “Virtual Reality For Design” / project (2010)
 demo (video)



1. Definitions: Augmented Reality?

 Thomas Caudell & David Mizellin 1990 to overlap digital information in real time above the real world
 Augmented Reality acts as a filter between real space and human to enrich their experiences

Digital Information Everywhere

http://www.layar.com

1. Definitions: Augmented Reality (example)

 Usefull to locate services and get extra information (context aware information) or even…
 …to create new experiences (gamification ?)


”Know How Augmented” / François Ballon 2011
1. Definitions: Mixed Reality?
 Paul Milgram and Fumio Kishino in 1994 defined mixed reality as the merging of real and virtual worlds to produce
new environments and visualisations where physical and digital objects co-exist and interact in real time
 Mixed Reality enables users to interact physically with augmented artefacts

Physical and Digital objects co-exist and interact in real time

http://rogiken.org/vr/english.html
1. Definitions: Mixed Reality (example)
http://www.youtube.com/watch?v=F63Iac2IIDo

 KOBITO / Virtual Brownies (Society for the Study of Robotics / 2004)
 demo (video)


1. Definitions: Mixed Reality (@READi)
http://www.visionaries777.com/project-1/

 SCOPE : Frantz Lasorne / 2009 / Objects (toys) mixed with video game / demo (video)
 Immersive Rail shooter : David Arenou / 2010 / Space mixed with video game / demo (video)

http://portfolio.davidarenou.com/video-game/immersive-rail-shooter/

Reality-Virtuality continuum according to Milgram, Takemura, Utsumi and Kishino (1994)


2. New paradigm in computing: VR / AR / MR ?

 Various Realitie(S) related to their relationships with the “real” (perceived) environment
 New paradigms in computing // Keyboard + Mouse + Screen = Obsolete !


Street Museum (London)
http://www.museumoflondon.org.uk/Resources/app/you-are-here-app/index.html

2. New paradigm in computing : Space & Time

 Virtual Reality : Generates spaces & objects (simulation / past-present-future)
 Augmented Reality : Enriches existing spaces & objects (extra information / past-present-future)
 Computers which are based on time to calculate are able to generate space (Time Generate Spaces)
 Time Shifted + Augmented Spaces = “another” reality / new means of expression (art)


3 major steps in the meanings of interaction

2. New paradigm in computing: meanings of interaction

 From Direct Manipulation (B. Schneiderman / 1982) to Natural User Interaction
 Follow the state of child’s evolution :
Mouse to Point and Click / Multi-Touch Surfaces / Tangible & Gesture interactions (manipulating & moving)
 Find new metaphors to describe gesture and natural interactions (implying the body)

”Stepping Garden” / P. Thebault / 2006
3. Major design issues : « Feel »
http://llllllllllllllll.org/stepping-garden/

 Virtual Reality : Reinforce the feeling of being immerged into a virtual space (sens + emotions)
by extending implied senses : Proprioception / Kinesthetic…
 Augmented Reality : How do I perceive that an environment, an object is augmented ?
 It’s often much more interesting to observe people’s reactions more than the disposal in itself !!

”Funny Planet” / l16.org (2007) / http://llllllllllllllll.org
3. Major design issues : « Understand »

 How users know that they can interact, “anyware” ?
 Affordance ? (Don. Norman) // How to these new Devices / Objects / Spaces will explain us their functioning ?
 New ways to design meaningful and usable “augmented” objects and spaces (tangible interfaces)


http://www.ted.com/talks/john_underkoffler_drive_3d_data_with_a_gesture.html
3. Major design issues : « Interact »

 Common Vocabulary / Grammar for this new means of interaction ? (From a device to another ?) / Obvious ?
 Look to point & click (cf. SCOPE) or access to “help” in Kinect ( left arm to 45°)
 Feedbacks ? Haptic ? (“Minority Report” is absolutely not an ergonomic experience !)
 Reality even “augmented” is an experience need to be shared (http://mixedreality.tumblr.com/post/177049282/place-a-la-realite-mixte)

International Civil Flight Traffic Mapping in 1999 (B. Gerard, L. Briceno, B.A. Bui The Thuong / 2011)

3. Major design issues : « Assimilate »

 Contextualize and adapt contents regarding to mobility
 Find more explicit ways to present contents (graphically, cartographically… avoid list mode !!)


http://www.chrisoakley.com/the_catalogue.html (2004)

3. Major design issues : « Privacy »
http://www.chrisoakley.com/the_catalogue.html

 How users can keep control on the system, on informations about their identity, life, habits ?
 Who owns the data ? (Facebook ? Google ?) / cf. P. K. Dick…


4. Conclusion

 The cyberspace is too large to fit into my screen… so…
 Expand it into the real World !

But… Would it be large enough ?

http://www.lowtech.org/press/gfx/raid.jpg
4. Conclusion

 The cyberspace offers new experiences that can’t be lived through screen, keyboard and mouse
 Explore new meanings and propose new metaphors of interaction


http://www.syfy.com/caprica/

4. Conclusion

 Augmented humanity ? considering the influence of environments on biological evolutions ?
 Interaction design as a temporary solution ? (regarding time of evolution) ?
Hardware / “cheap” devices previously dedicated to VR (Camera Vision / Wiimote / Kinect… => Hacking !)
Middleware : Visual Scripting Languages (blocks): Virtools / Unity / Open Spaces 3d…

Demo « Immersive Rail Shooter » David Arenou / (L. Neyssensas 2010)
Thank You
Questions ?
g.cliquet@lecolededesign.com
http://www.lecolededesign.com
http://readi.lecolededesign.com


Tangible Interfaces & Mixed Reality : A step toward digital augmented environments

More Related Content

Viewers also liked (20)

Similar to Tangible Interfaces & Mixed Reality : A step toward digital augmented environments (20)

More from lecolededesign (20)

Recently uploaded (20)

Tangible Interfaces & Mixed Reality : A step toward digital augmented environments