Mixed reality 101
0 likes328 views
This document provides an overview of mixed reality technologies and experiences. It discusses how mixed reality can blend digital and physical worlds in a way that is convincing to the human perception system. The challenges of mixed reality include matching focal and vergence distances to avoid eye strain. As technologies improve and tools become more intuitive, mixed reality will allow unprecedented interactive digital content that is difficult to distinguish from the physical world. The document emphasizes thoughtful, experience-driven design that considers societal impacts and enhances human experiences.
Mixed reality 101
- 1. Mixing Realities Mount Jefferson • Image: https://www.flickr.com/photos/nagarajan-kanna/15337821354 Unprecedented access to perception
- 2. Geographical & Professional Record of Paul Reynolds • 1975 - Present Over 16 years of interactive 3D software and experience development. Blast Off Inc Jellyvision Electronic Arts SolWorks Atari Magic Leap F**K YEAH PORTLAND! All kinds of other stuff too.
- 3. Magic Leap Headquarters • 2014 • Stirling Road, Fort Lauderdale, Florida, USA, Earth In 2014, I saw the future…in Florida?
- 4. Optical Engineer Eric Browy • Image: http://www.wired.com/2016/04/magic-leap-vr/ It was kind of like this. (But not this.)
- 5. “It’s cool... but your demos kinda’ suck.” Honesty • Transparency • Integrity
- 6. Reynolds Residence • 2014 • Alexandria Ave, Myrtle Beach, South Carolina, USA, Earth This company needs my help. We are moving to Florida.
- 7. Dragons in the room. (Sorry, no photos. Imagination required for this slide.) Photos Not Allowed • Imagination Required
- 8. “What did I just feel?” Powerful New Experiences • Image: https://www.flickr.com/photos/-akayphotography/12657383523
- 9. My theory on reality. Pioneer Square • Image: https://www.flickr.com/photos/adavey/8699673325
- 10. Sensory Overload • Image: https://www.flickr.com/photos/weeklydig/6146537969 Presence (Highly Simplified) Proprioception Sense of one’s own body Exteroception Sense of external stimuli Forces • Touch • Sound • Light
- 11. Digital Brain Rendering • Image: https://www.flickr.com/photos/healthblog/8384110298 Incoming signals are processed and our reality is modeled in our mind.
- 12. True mixed reality happens when the digital signals are sufficient enough to pass the checks and balances of the perception system. Image: https://www.flickr.com/photos/dianasch/15505299296
- 13. Vision is one of the most powerful input signals into our perception of reality. A Focus on Vision • Image: https://www.flickr.com/photos/23560963@N03/4509631223/
- 14. Step 1: Wire a powerful computer directly into the visual cortex. Brain Jacks • Image: https://www.flickr.com/photos/minnemom/12708596515
- 16. Organic Visual Cortex Interface • Image: https://www.flickr.com/photos/civilon/5425730840 These are wired in pretty well already.
- 17. Photons Are Cool In the analog world, we are bombarded by photons. These light signals come from physical objects containing color, brightness, and distance cues.
- 18. “We do not scan the world like a photocopier scans a document. Rather, we sporadically sample what is in front of our eyes.” Arne Dietrich • “Introduction to Consciousness” Image: https://www.flickr.com/photos/emzee/167706499
- 20. Image: http://jov.arvojournals.org/article.aspx?articleid=2122611 The problem with traditional 3D display techniques has been this mismatch between the focal and vergence distance. This incorrect signal puts our mind in “high alert” and, in the worst cases, causes discomfort.
- 21. Organic Visual Cortex Interface • Image: https://www.flickr.com/photos/civilon/5425730840 With optical view-through displays, the user is processing the analog world in a relaxed state. If the digital content is a sufficiently similar signal, we receive the benefit of the full perception system. At times, even creating non-visual sensations.
- 22. Mixed Reality display technology is amplified with environmental awareness. “Aligning 3D Models to RGB-D Images of Cluttered Scenes” • Image: https://people.eecs.berkeley.edu/~sgupta/
- 23. Input is becoming more natural too. “Aligning 3D Models to RGB-D Images of Cluttered Scenes” • Image: https://people.eecs.berkeley.edu/~sgupta/
- 24. Mixed Reality is going to give us unprecedented ability to create dynamic interactive digital content that people will have difficulty discerning from the analog world. Image: https://www.flickr.com/photos/99574551@N04/14723454269
- 25. Image: https://www.flickr.com/photos/accidentdesigns/6137308437/ “Sounds great, but how do I create with it?”
- 26. Good News • Bad News BAD NEWS Everything is rendered in realtime 3D. Current tools and workflows come from video game technology. If you want to start making things now, the learning curve may be steep. GOOD NEWS Tools will evolve to be more intuitive and accessible. And, most of you have lived your entire life in a 3D world!
- 27. Image: https://www.flickr.com/photos/accidentdesigns/6137308437/ It’s early days. Get in the headspace first.
- 28. Image: https://www.flickr.com/photos/accidentdesigns/6137308437/ Unlike traditional media, you no longer control the context. Think sparse: First generation AR/MR tech will be best utilized for “magical moments” and VR is best suited for “magical worlds” Native experiences that take advantage of the unique capabilities will always win.
- 29. Kiki the Elephant • Magic Leap, Inc.
- 30. (Quick aside.) Reddit • https://www.reddit.com/r/oculus/comments/2m0owl/i_got_into_the_magic_leap_beta/ “I got into the Magic Leap Beta!”
- 31. Mixed Reality Grocery Game • Source: http://hyper-reality.co
- 32. Source: Artefact Group • https://www.artefactgroup.com/articles/mixed-reality-without-rose-colored-glasses Laws of Mixed Reality proposed by @John_Rousseau Law 1: The Individual Mixed reality must enhance our capacity for mindful attention. Law 2: Society Mixed reality must embody a shared human experience. Law 3: Economics Mixed reality must respect boundaries between commerce and data. “The Laws provide a foundation for identifying preferable outcomes that should be considered in the creation of new products, services and business models.”
- 33. Mixed Reality Grocery Game • Source: http://hyper-reality.co
- 34. Mount Jefferson • Image: https://www.flickr.com/photos/nagarajan-kanna/15337821354 Thoughtful design always wins over novelty. “Is this better?” “Is this building the world I want to live in?” Let’s help each other make cool stuff! @MugOfPaul • paul@vertexlabs.co
- 35. Fourth Edition Applied Mixed Reality Mount Jefferson • Image: https://www.flickr.com/photos/nagarajan-kanna/15337821354 Paul Reynolds