Mixed Reality in the Workspace
6 likes3,127 views
The document discusses the evolution and application of mixed reality (MR) in the workplace, emphasizing its integration of digital and physical environments to enhance productivity, marketing, training, and collaboration. Key examples include smart glasses for warehouse tasks, AR for marketing campaigns, VR for training, and remote collaboration using MR technologies. It concludes with insights on future trends in MR, such as improved content capture and empathic computing, highlighting the potential for significant returns on small technology investments.
Mixed Reality in the Workspace
- 1. YOU ARE NOT DAYDREAMING – IT’S A MIXED REALITY WORKPLACE! Mark Billinghurst mark.billinghurst@unisa.edu.au DIGI_X, June 21st 2018
- 2. 1967 – IBM 1401 – half of the computers in the world, $10,000/month to run
- 3. The Incredible Disappearing Computer 1960-70’s Room 1970-80’s Desk 1980-90’s Lap 1990-2000’s Hand
- 5. Physical
- 6. Graphical User Interfaces • Separation between real and digital worlds • WIMP (Windows, Icons, Menus, Pointer) metaphor
- 7. Ubiquitous Computing/IoT • Embed computing and sensing in real world • Smart objects, sensors, etc..
- 8. Virtual Reality • Users immersed in Computer Generated environment • HMD, gloves, 3D graphics, body tracking
- 10. Virtual Reality •Defining Characteristics •Immersion •Interaction •Imagination Grigore Burdea (1993). Virtual Reality Technology
- 11. Augmented Reality • Virtual Images blended with the real world • See-through HMD, handheld display, viewpoint tracking, etc..
- 13. Augmented Reality •Defining Characteristics •Combines Real andVirtual Images •Interactive in real-time •Registered in 3D Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.
- 14. AR vsVR
- 15. Rekimoto, J. and Nagao, K. 1995. The world through the computer: computer augmented interaction with real world environments. Making Interfaces Invisible
- 16. From Reality toVirtual Reality Ubiquitous Computing Augmented Reality Virtual Reality Real World Virtual World
- 17. Milgram’s Mixed Reality Continuum Ubiquitous Computing Augmented Reality Virtual Reality Real World Virtual World Mixed Reality "...anywhere between the extrema of the virtuality continuum." P. Milgram and A. F. Kishino, (1994) A Taxonomy of Mixed Reality Visual Displays
- 18. Using Mixed Reality in the Workplace • Blending digital/physical worlds.. • Productivity • Marketing • Training • Collaboration
- 19. Example: Productivity • MR technology for hands busy tasks • Warehouse picking (DHL, SAP) • Smart glasses show pick location • Simple user interface • Hands-free interaction • Improved performance RW VR
- 23. Example: Marketing • Add magic to companies products • Snapchat lenses • Face tracking technology • Simple interaction • Animated content • Significant ROI • $750K for 224 million views • c.f. $5 million for SuperBowl ad RW VR https://www.youtube.com/watch?v=Wkysq4gvRK4
- 25. Example: Training • AR/VR training for difficult/dangerous tasks • Train with real objects, controls • GlobalSim Crane Simulator • Virtual Reality simulation • Train with real controls • Virtual body/hands • Realistic physics RW VR
- 27. Example: Collaboration • Use MR technology for remote collaboration • See through another’s eyes, virtual avatars • Microsoft Remote Assist • HoloLens see-through display • Remote video sharing • AR drawing/annotation • Document sharing • Group calling RW VR
- 30. Introducing MR into the Workplace •Identify key real world tasks • Involve spatial ability, physical interaction, etc. •Justify Return on Investment • Small technology investment leads to big return •Focus on Human Needs • User centered design •Work with Experts • Combine AR/VR experts with domain experts
- 31. IA before AI Intelligence Augmentation rather than Artificial Intelligence
- 32. What’s Next?
- 33. Modern Technology Trends 1. Improved Content Capture • Move from sharing faces to sharing places 2. Increased Network Bandwidth • Sharing natural communication cues 3. Implicit Understanding • Recognizing behaviour and emotion
- 36. Empathic Computing Can we develop systems that allow us to share what we are seeing, hearing and feeling with others?
- 37. Empathy Glasses • Combine together eye-tracking, display, face expression • Implicit cues – eye gaze, face expression ++ Pupil Labs Epson BT-200 AffectiveWear
- 38. Remote Collaboration • Eye gaze pointer and remote pointing • Face expression display • Implicit cues for remote collaboration
- 40. Shared Sphere
- 41. Shared Sphere System Features •AR / VR view collaboration • VR user feels that they are in AR users location •View independence • Allow one user to look around independently from another •View awareness cues • Show where the other user is looking •Hand gesture communication cues • Sharing hand gesture cues
- 42. MR Technology Trends •Advanced displays •Real time space capture •Natural gesture interaction •Robust eye-tracking •Emotion sensing/sharing
- 43. MR Technology Trends •Advanced displays •Real time space capture •Natural gesture interaction •Robust eye-tracking •Emotion sensing/sharing Empathic Tele-Existence
- 44. Conclusions •MR in the workspace •Breaks barrier between real/digital worlds •Proven technology (display, input, sensing) •Ready for implementation •Future Research •Empathic Computing •Trend towards Empathic Tele-existence