SlideShare a Scribd company logo

Object Theory Mixed Reality Use Cases and Challenges

M
Michael Hoffman

The document outlines various use cases and challenges of mixed reality (MR) applications across industries, highlighting its capabilities in enhancing remote collaboration, product design, training, space planning, and more. MR offers benefits like improved comprehension through stereoscopic vision, hands-free access to information, and better data visualization, addressing the limitations of traditional 2D tools. However, challenges such as internet connectivity requirements, geometry complexity, and safety compliance need to be managed for effective implementation.

Software
1 of 41
Downloaded 130 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
Mixed Reality Use Cases and Challenges
As a trusted advisor, Object Theory helps F1000 clients strategically identify, design and build XR solutions that provide real business value utilizing today’s XR devices
Mixed Reality Benefits • Hands-free – Increase information access efficiency while performing tasks • Shared 3D context – Accurately convey focus & intent to reduce misunderstandings • Stereoscopic vision – Improve comprehension of subject matter • True scale – Accurately experience & evaluate spatial relationships and appearance • Spatial mapping – Reduce mistakes by proximity of information to objects/environment • 3D sound – Increase sense of presence, and accurately direct attention to focal points • Data visualization – Improve comprehension of complex geospatial data sets • High fidelity 3D objects – • Reduce need for expensive 3D print & paint • Reduce dependency on expensive equipment and supplies • Safely train for dangerous tasks • 3D environments – Leverage spatial memory to improve retention & navigation Quantifiable business value from these unique features & benefits: © 2018 object theory, llc
Mixed Reality Use Cases Remote Collaboration Product Design Annotated Environment Premium Selling Soft Skills Training Hard Skills Training Space Planning Situation Planning Experience Invisible Data Medical Imaging Remote Expert Infinite Screen Education Expert Coaching Automated Guidance Art and Creativity Entertainment © 2018 object theory, llc
Remote Collaboration The Business Challenge When dispersed teams collaborate on 3D problems, it’s difficult to establish an accurate shared context and convey intent with existing 2D tools such as screen sharing, which can result in costly mistakes. Mixed Reality Solution Collaborators feel a sense of presence, plus virtual geospatial annotations and markers can accurately convey intent to establish a more accurate shared context resulting in more informed decisions and fewer mistakes due to miscommunication. Why Mixed Reality? • Gaze indicates focus and intent • 3D Spatial sound provides cues and sense of presence • Stereoscopic vision improves comprehension • Geospatial annotations provide critical context • Ability to see content while conversing/collaborating Potential Challenges • 3D audio chat requires reliable internet connection • Geometry complexity • Outdoor use / safety compliance requirements • WiFi Security (for Defense use cases) © 2018 object theory, llc
Remote Collaboration The Business Challenge When dispersed teams collaborate on 3D problems, it’s difficult to establish an accurate shared context and convey intent with existing 2D tools such as screen sharing, which can result in costly mistakes. Mixed Reality Solution Collaborators feel a sense of presence, plus virtual geospatial annotations and markers can accurately convey intent to establish a more accurate shared context resulting in more informed decisions and fewer mistakes due to miscommunication. Why Mixed Reality? • Gaze indicates focus and intent • 3D Spatial sound provides cues and sense of presence • Stereoscopic vision improves comprehension • Geospatial annotations provide critical context • Ability to see content while conversing/collaborating Potential Challenges • 3D audio chat requires reliable internet connection • Geometry complexity • Outdoor use / safety compliance requirements • WiFi Security (for Defense use cases) © 2018 object theory, llc
Product Design The Business Challenge When designing products, it is difficult to understand how all of its components interplay and how it will appear as a final product. Furthermore, efficiently collaborating between different design disciplines to find the best outcomes is challenging using existing 2D means. Mixed Reality Solution Mixed Reality makes it possible for design collaborators to establish an accurate shared context of a product under design for efficient, accurate decision making and faster iteration cycle times. Why Mixed Reality? • Stereoscopic vision • Accurate, true scale visualization of product • Ability to see content while conversing/collaborating • Efficient ability to try alternative designs Potential Challenges • Color fidelity not as good as calibrated monitors • Large model geometries © 2018 object theory, llc
Product Design The Business Challenge When designing products, it is difficult to understand how all of its components interplay and how it will appear as a final product. Furthermore, efficiently collaborating between different design disciplines to find the best outcomes is challenging using existing 2D means. Mixed Reality Solution Mixed Reality makes it possible for design collaborators to establish an accurate shared context of a product under design for efficient, accurate decision making and faster iteration cycle times. Why Mixed Reality? • Stereoscopic vision • Accurate, true scale visualization of product • Ability to see content while conversing/collaborating • Efficient ability to try alternative designs Potential Challenges • Color fidelity not as good as calibrated monitors • Large model geometries © 2018 object theory, llc
Annotated Environment (BIM / IoT) The Business Challenge BIM data and environmental sensor data is collected by the terabytes, yet most of that data is never utilized. Only a fraction of the potential value is extracted. Mixed Reality Solution With ML/AI + MR, the collected data can be analyzed for patterns an then the insights can be presented geosnatially right where an issues need addressing. Further, the relationships between the metadata and the physical plant are much easier to glean from observation. Why Mixed Reality? • Virtual on Physical • Ability to see data while performing tasks • Stereoscopic vision for better insights Potential Challenges • Not recommended yet for outdoor use cases • Need to use markers when navigating large facilities. © 2018 object theory, llc
Annotated Environment (BIM / IoT) The Business Challenge BIM data and environmental sensor data is collected by the terabytes, yet most of that data is never utilized. Only a fraction of the potential value is extracted. Mixed Reality Solution With ML/AI + MR, the collected data can be analyzed for patterns an then the insights can be presented geosnatially right where an issues need addressing. Further, the relationships between the metadata and the physical plant are much easier to glean from observation. Why Mixed Reality? • Virtual on Physical • Ability to see data while performing tasks • Stereoscopic vision for better insights Potential Challenges • Not recommended yet for outdoor use cases • Need to use markers when navigating large facilities. © 2018 object theory, llc
Premium Selling The Business Challenge It is difficult to sell expensive products, services and experiences that are hard to put in front of a client or hard to explain in detail. Mixed Reality Solution Telling the rich story of an offering in 3D makes it more personal, relatable, understandable and memorable Why Mixed Reality? • Stereoscopic vision to better visualize • Alignment to physical to reveal hidden features • Spatial story telling is more compelling and memorable Potential Challenges • It takes 5 - 15 minutes to acclimate to mixed reality © 2018 object theory, llc
Premium Selling The Business Challenge It is difficult to sell expensive products, services and experiences that are hard to put in front of a client or hard to explain in detail. Mixed Reality Solution Telling the rich story of an offering in 3D makes it more personal, relatable, understandable and memorable Why Mixed Reality? • Stereoscopic vision to better visualize • Alignment to physical to reveal hidden features • Spatial story telling is more compelling and memorable Potential Challenges • It takes 5 - 15 minutes to acclimate to mixed reality © 2018 object theory, llc
Soft skills training The Business Challenge It is expensive to train soft skills that require understanding nuance and adept reaction to varying external stimuli and behaviors. Mixed Reality Solution The combination of AI+MR reduces training cost by making it possible to recreate realistic interactive soft skill scenarios, automate the AI/ML assessment of performance and generation of precise feedback. Why Mixed Reality? • Stereoscopic vision for more realistic scenarios • Alignment to physical further increases realism • Gaze indicates trainee focus and intent • Positional info, camera and mics feed data to cognitive services • Hands free enables using actual soft skill devices Potential Challenges • No significant challenges © 2018 object theory, llc
Soft skills training The Business Challenge It is expensive to train soft skills that require understanding nuance and adept reaction to varying external stimuli and behaviors. Mixed Reality Solution The combination of AI+MR reduces training cost by making it possible to recreate realistic interactive soft skill scenarios, automate the AI/ML assessment of performance and generation of precise feedback. Why Mixed Reality? • Stereoscopic vision for more realistic scenarios • Alignment to physical further increases realism • Gaze indicates trainee focus and intent • Positional info, camera and mics feed data to cognitive services • Hands free enables using actual soft skill devices Potential Challenges • No significant challenges © 2018 object theory, llc
Hard skills training The Business Challenge It is expensive to train skills to a large workforce that require learning a wide variety of steps and operations, particularly in high-turnover environments. Mixed Reality Solution Creation of self-guided, interactive skills training tutorials substantially reduces the labor cost of repeatedly training the same skill. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster comprehension • Alignment to physical enables practicing on real equipment • Information close to where you need it Potential Challenges • Creating 3D interactive content for each skill can be expensive © 2018 object theory, llc
Hard skills training The Business Challenge It is expensive to train skills to a large workforce that require learning a wide variety of steps and operations, particularly in high-turnover environments. Mixed Reality Solution Creation of self-guided, interactive skills training tutorials substantially reduces the labor cost of repeatedly training the same skill. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster comprehension • Alignment to physical enables practicing on real equipment • Information close to where you need it Potential Challenges • Creating 3D interactive content for each skill can be expensive © 2018 object theory, llc
Space Planning The Business Challenge Experiencing the feel and function of a space under design is a critical step in the design process to reduce mistakes, yet is so costly to achieve that it’s rarely done. Mixed Reality Solution Mixed Reality makes it possible to efficiently experience and even modify a non-existent room design at true scale. Why Mixed Reality? • True size and scale • Stereoscopic vision • Ability to see content while conversing/collaborating • Align virtual changes to physical environment Potential Challenges • True scale immersive scenarios can benefit from wider FOV, particularly for new users © 2018 object theory, llc
Space Planning The Business Challenge Experiencing the feel and function of a space under design is a critical step in the design process to reduce mistakes, yet is so costly to achieve that it’s rarely done. Mixed Reality Solution Mixed Reality makes it possible to efficiently experience and even modify a non-existent room design at true scale. Why Mixed Reality? • True size and scale • Stereoscopic vision • Ability to see content while conversing/collaborating • Align virtual changes to physical environment Potential Challenges • True scale immersive scenarios can benefit from wider FOV, particularly for new users © 2018 object theory, llc
Situation Planning The Business Challenge Planning and monitoring complex geospatial scenarios demands comprehensive understanding of complex information across a dispersed team of experts. It is difficult to provide all relevant information to create a comprehensive and accurate shared context. Mixed Reality Solution Mixed reality enables effective collaboration across dispersed teams while interacting with a wide variety of geospatially accurate 3D information and supplementary 2D information. Why Mixed Reality? • Geospatially accurate information • Stereoscopic vision • Ability to see content while conversing/collaborating Potential Challenges • Content creation can be expensive • Geometry complexity • WiFi security (for Defense use cases) © 2018 object theory, llc
Situation Planning The Business Challenge Planning and monitoring complex geospatial scenarios demands comprehensive understanding of complex information across a dispersed team of experts. It is difficult to provide all relevant information to create a comprehensive and accurate shared context. Mixed Reality Solution Mixed reality enables effective collaboration across dispersed teams while interacting with a wide variety of geospatially accurate 3D information and supplementary 2D information. Why Mixed Reality? • Geospatially accurate information • Stereoscopic vision • Ability to see content while conversing/collaborating Potential Challenges • Content creation can be expensive • Geometry complexity • WiFi security (for Defense use cases) © 2018 object theory, llc
Experience Invisible Data The Business Challenge Data analysis of 3D data sets and simulations of geospatial information on 2D screens makes it difficult to comprehend the full extent of insights that can be gained. Mixed Reality Solution With Mixed Reality, simulations and visualizations of collected sensor data or simulations can be played and animated geospatially and can be aligned with physical objects related to the data. Why Mixed Reality? • Stereoscopic vision • 3D in 3D • Align virtual to physical • Ability to see content while conversing/collaborating • Experience the inaccessible Potential Challenges • No major challenges © 2018 object theory, llc
Experience Invisible Data The Business Challenge Data analysis of 3D data sets and simulations of geospatial information on 2D screens makes it difficult to comprehend the full extent of insights that can be gained. Mixed Reality Solution With Mixed Reality, simulations and visualizations of collected sensor data or simulations can be played and animated geospatially and can be aligned with physical objects related to the data. Why Mixed Reality? • Stereoscopic vision • 3D in 3D • Align virtual to physical • Ability to see content while conversing/collaborating • Experience the inaccessible Potential Challenges • No major challenges © 2018 object theory, llc
Medical Imaging The Business Challenge Surgeons are constantly evaluating 3D problems on 2D screens. Missing critical insights and longer assessment times can lead to worse outcomes for patients. Mixed Reality Solution Hands-free access to all relevant 2D and 3D information exactly where it’s needed enables more accurate and efficient assessment for better outcomes. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster insights • Alignment to physical reduces errors • Information proximity without physical interference • Instant access to vast amounts of 2D & 3D information Potential Challenges • Accurate alignment to body below 1-2mm difficult • Regulatory requirements for operating room • Weight and comfort for long-term use © 2018 object theory, llc
Medical Imaging The Business Challenge Surgeons are constantly evaluating 3D problems on 2D screens. Missing critical insights and longer assessment times can lead to worse outcomes for patients. Mixed Reality Solution Hands-free access to all relevant 2D and 3D information exactly where it’s needed enables more accurate and efficient assessment for better outcomes. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster insights • Alignment to physical reduces errors • Information proximity without physical interference • Instant access to vast amounts of 2D & 3D information Potential Challenges • Accurate alignment to body below 1-2mm difficult • Regulatory requirements for operating room • Weight and comfort for long-term use © 2018 object theory, llc
Remote Expert The Business Challenge Flying subject matter experts onsite to support field operations is expensive and requires too many experts on staff for peak load. Mixed Reality Solution A smaller team of centralized experts can effectively assist many field technicians as needed at lower travel and labor cost. Why Mixed Reality? • Hands free enables performing tasks while being assisted • Geospatial indicators/annotations increases accuracy • Stereoscopic vision increases comprehension Potential Challenges • Requires reliable internet connection for audio & video • Safety compliance requirements • Outdoor use • Safety compliance requirements • WiFi security (for Defense use cases) © 2018 object theory, llc
Remote Expert The Business Challenge Flying subject matter experts onsite to support field operations is expensive and requires too many experts on staff for peak load. Mixed Reality Solution A smaller team of centralized experts can effectively assist many field technicians as needed at lower travel and labor cost. Why Mixed Reality? • Hands free enables performing tasks while being assisted • Geospatial indicators/annotations increases accuracy • Stereoscopic vision increases comprehension Potential Challenges • Requires reliable internet connection for audio & video • Safety compliance requirements • Outdoor use • Safety compliance requirements • WiFi security (for Defense use cases) © 2018 object theory, llc
Infinite Screen The Business Challenge Many tasks require analyzing huge amounts of 2D and 3D information. We are constrained by the realistic number of pixels we can surround ourselves with. Mixed Reality Solution Mixed Reality enables augmenting existing screen real estate with a nearly infinite amount of additional 2D panels as well as 3D content for a vast increase in available information for analysis and decision making. Why Mixed Reality? • Can interact with physical and virtual world simultaneously • Not constrained by limits of 2D monitors Potential Challenges • Today’s devices don’t yet run the sophisticated apps professionals depend on. © 2018 object theory, llc
Infinite Screen The Business Challenge Many tasks require analyzing huge amounts of 2D and 3D information. We are constrained by the realistic number of pixels we can surround ourselves with. Mixed Reality Solution Mixed Reality enables augmenting existing screen real estate with a nearly infinite amount of additional 2D panels as well as 3D content for a vast increase in available information for analysis and decision making. Why Mixed Reality? • Can interact with physical and virtual world simultaneously • Not constrained by limits of 2D monitors Potential Challenges • Today’s devices don’t yet run the sophisticated apps professionals depend on. © 2018 object theory, llc
Education The Business Challenge It is difficult and expensive to teach concepts and techniques that consume expensive supplies, depend on expensive equipment, or can be dangerous. Mixed Reality Solution For at least the early stages of the learning process, simulating concepts and techniques is a less dangerous and expensive alternative, and can reduce dependency on access to expensive equipment. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster comprehension • Alignment to physical enables practicing with some or all physical equipment, or even props. • Information close to where you need it • Instant access to vast amounts of 2D & 3D information • Ability to see content while conversing/collaborating Potential Challenges • Creating a large variety of interactive 3D content can be expensive. © 2018 object theory, llc
Education The Business Challenge It is difficult and expensive to teach concepts and techniques that consume expensive supplies, depend on expensive equipment, or can be dangerous. Mixed Reality Solution For at least the early stages of the learning process, simulating concepts and techniques is a less dangerous and expensive alternative, and can reduce dependency on access to expensive equipment. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster comprehension • Alignment to physical enables practicing with some or all physical equipment, or even props. • Information close to where you need it • Instant access to vast amounts of 2D & 3D information • Ability to see content while conversing/collaborating Potential Challenges • Creating a large variety of interactive 3D content can be expensive. © 2018 object theory, llc
Expert Coaching The Business Challenge Improving a fine motor skill such as the perfect golf swing is extremely difficult and requires deep expertise. Mixed Reality Solution IoT sensors plus mixed reality enables accurate capture and visualization of a wide variety of information for more accurate assessment and improvement of technique. Why Mixed Reality? • Hands free • Alignment to physical to see relationships and variance • 3D visualization for accurate assessment and comparison of 3D movements Potential Challenges • Outdoor use not recommended © 2018 object theory, llc
Expert Coaching The Business Challenge Improving a fine motor skill such as the perfect golf swing is extremely difficult and requires deep expertise. Mixed Reality Solution IoT sensors plus mixed reality enables accurate capture and visualization of a wide variety of information for more accurate assessment and improvement of technique. Why Mixed Reality? • Hands free • Alignment to physical to see relationships and variance • 3D visualization for accurate assessment and comparison of 3D movements Potential Challenges • Outdoor use not recommended © 2018 object theory, llc
Automated Guidance The Business Challenge Utilizing only physical props, providing all useful information to guide an audience through an experience creates traffic bottlenecks, unwanted visual clutter and limits storytelling possibilities. Mixed Reality Solution Mixed reality increases expressiveness and efficiency while eliminating bottlenecks. Any amount of interactive 2D, 3D and spatial audio content can be situated geospatially around points of interest to convey useful information in compelling ways that maximize expressiveness, comprehension and memory. Why Mixed Reality? • Stereoscopic vision for better, faster comprehension • Information proximity & alignment increases context • Hands free • Instant access to vast amounts of 2D & 3D information Potential Challenges • Outdoor use not recommended • Spatial mapping limits may require ID targets © 2018 object theory, llc
Automated Guidance The Business Challenge Utilizing only physical props, providing all useful information to guide an audience through an experience creates traffic bottlenecks, unwanted visual clutter and limits storytelling possibilities. Mixed Reality Solution Mixed reality increases expressiveness and efficiency while eliminating bottlenecks. Any amount of interactive 2D, 3D and spatial audio content can be situated geospatially around points of interest to convey useful information in compelling ways that maximize expressiveness, comprehension and memory. Why Mixed Reality? • Stereoscopic vision for better, faster comprehension • Information proximity & alignment increases context • Hands free • Instant access to vast amounts of 2D & 3D information Potential Challenges • Outdoor use not recommended • Spatial mapping limits may require ID targets © 2018 object theory, llc
Art and Creativity The Business Challenge Monetizing entertainment is becoming increasingly difficult. Theater and sports arena attendance continues to drop. Mixed Reality Solution Mixed Reality adds interactivity and extends the average time spent consuming entertainment. This increases the opportunities to monetize it. Why Mixed Reality? • Can augment existing means of consuming entertainment. • Can move and interact with environment while experiencing content. Potential Challenges • MR not yet a ubiquitous consumer device. © 2018 object theory, llc
Art and Creativity The Business Challenge Monetizing entertainment is becoming increasingly difficult. Theater and sports arena attendance continues to drop. Mixed Reality Solution Mixed Reality adds interactivity and extends the average time spent consuming entertainment. This increases the opportunities to monetize it. Why Mixed Reality? • Can augment existing means of consuming entertainment. • Can move and interact with environment while experiencing content. Potential Challenges • MR not yet a ubiquitous consumer device. © 2018 object theory, llc
Entertainment The Business Challenge Monetizing entertainment is becoming increasingly difficult. Theater and sports arena attendance continues to drop. Mixed Reality Solution Mixed Reality adds interactivity and extends the average time spent consuming entertainment. This increases the opportunities to monetize it. Why Mixed Reality? • Can augment existing means of consuming entertainment. • Can move and interact with environment while experiencing content. Potential Challenges • MR not yet a ubiquitous consumer device. © 2018 object theory, llc
Entertainment The Business Challenge Monetizing entertainment is becoming increasingly difficult. Theater and sports arena attendance continues to drop. Mixed Reality Solution Mixed Reality adds interactivity and extends the average time spent consuming entertainment. This increases the opportunities to monetize it. Why Mixed Reality? • Can augment existing means of consuming entertainment. • Can move and interact with environment while experiencing content. Potential Challenges • MR not yet a ubiquitous consumer device. © 2018 object theory, llc
Addressing Today’s Challenges • Safety: 3rd Party HoloLens hard hats (Trimble) • Typing: Device assisted authentication • Placement/Location: • Fiducial markers • Manual logical alignment • Global anchor sharing • Attention: 3D audio, narrative and visual cues • Static 3D Content: • Expert manual optimization • Level-of-detail (LODs) • Smart use of geometry culling • FOV: • Start small for context, then enlarge • Attention directors and audio cues • Dynamic 3D Content: Simplygon automation • Material fidelity: Hand optimized shaders • Input: • Hand controllers and clickers • Smart phones as companion input devices • All day: • USB battery packs • Device swap • Spectator View for professional videos / photos • Spatial mapping / tracking: • Clear out old spaces • Guide user through good room scan • Setting late stage reproduction (LSR) plane • Environment: Comprehensive client training How Object Theory addresses today’s MR challenges: © 2018 object theory, llc
With thoughtful experience design, diligent optimization and smart engineering, today’s mixed reality devices deliver real business value for a wide variety of use cases.
Thank you! Michael Hoffman Co-founder / Partner Object Theory michael@objecttheory.com linkedin.com/in/mthoffman @objecttheory

More Related Content

PDF
From the Promise of Spatial Computing to Actual Delivery of Real Solutions
Michael Hoffman
 
PDF
Michael Hoffman (Object Theory): Mixed Reality Use Cases and Challenges
AugmentedWorldExpo
 
PDF
Mixed Reality Use Cases, by Object Theory
Darold Massaro
 
PPT
Obiee Training in bangalore
rajkamal560066
 
PPT
Tucana HR Analytics Data Visualisation, April 2014 (London)
Mark Lawrence
 
PDF
Ai, IBM Watson External
Jerry O'Brien
 
PDF
CWIN17 san francisco-rob vellinga - Interaction between AI and people
Capgemini
 
PDF
Using synthetic data for computer vision model training
Unity Technologies
 
From the Promise of Spatial Computing to Actual Delivery of Real Solutions
Michael Hoffman
 
Michael Hoffman (Object Theory): Mixed Reality Use Cases and Challenges
AugmentedWorldExpo
 
Mixed Reality Use Cases, by Object Theory
Darold Massaro
 
Obiee Training in bangalore
rajkamal560066
 
Tucana HR Analytics Data Visualisation, April 2014 (London)
Mark Lawrence
 
Ai, IBM Watson External
Jerry O'Brien
 
CWIN17 san francisco-rob vellinga - Interaction between AI and people
Capgemini
 
Using synthetic data for computer vision model training
Unity Technologies
 

What's hot (15)

PDF
Azure IoT - A Practical Entry to New Retail
Daniel Li
 
PDF
The Tipping Point: How Virtual Experiences Are Transforming Global Industries
Unity Technologies
 
PPTX
AI future 2025 - IBM Watson Re
Sarmad Ibrahim
 
PPTX
Watson AI platform for business - IBM Cloud
Sarmad Ibrahim
 
PDF
Cognitive Insurance
Kim Escherich
 
PDF
T Bytes Hybrid cloud infrastructure
EGBG Services
 
PDF
Keeping Your Cloud Infrastructure Healthy with the Internet of Things
Jennifer Stern
 
PPTX
IBM Cognitive platform: IBM Watson
Daniela Zuppini
 
PDF
Learn abc-again-bi-on-cloud
zslmarketing
 
PDF
The Key to Going Digital: Think People
Jennifer Stern
 
PPTX
Mixed and Augmented Reality Studio (MARS): what you need to know - Unite Cope...
Unity Technologies
 
PPTX
Bi New Frontiers, adding senses
Jorge Garcia
 
PDF
Azure IoT in Industrial Automation - Practical Considerations
Daniel Li
 
PPTX
UX STRAT Online 2021 Presentation by Josephine Scholtes, Microsoft
UX STRAT
 
PPTX
Code camp HoloLens Build and Deploy
Sarah Sexton
 
Azure IoT - A Practical Entry to New Retail
Daniel Li
 
The Tipping Point: How Virtual Experiences Are Transforming Global Industries
Unity Technologies
 
AI future 2025 - IBM Watson Re
Sarmad Ibrahim
 
Watson AI platform for business - IBM Cloud
Sarmad Ibrahim
 
Cognitive Insurance
Kim Escherich
 
T Bytes Hybrid cloud infrastructure
EGBG Services
 
Keeping Your Cloud Infrastructure Healthy with the Internet of Things
Jennifer Stern
 
IBM Cognitive platform: IBM Watson
Daniela Zuppini
 
Learn abc-again-bi-on-cloud
zslmarketing
 
The Key to Going Digital: Think People
Jennifer Stern
 
Mixed and Augmented Reality Studio (MARS): what you need to know - Unite Cope...
Unity Technologies
 
Bi New Frontiers, adding senses
Jorge Garcia
 
Azure IoT in Industrial Automation - Practical Considerations
Daniel Li
 
UX STRAT Online 2021 Presentation by Josephine Scholtes, Microsoft
UX STRAT
 
Code camp HoloLens Build and Deploy
Sarah Sexton
 
Ad

Similar to Object Theory Mixed Reality Use Cases and Challenges (20)

PDF
Michael Hoffman (Object Theory): Mixed Reality Use Cases and Challenges
AugmentedWorldExpo
 
PPTX
Regatta VR Customer Service Case Study
William West
 
PPTX
5 vuforia studio intro sales presentation
Senthilkumar R
 
PPTX
John Nall (Appzion): Why AR/VR Will Disrupt Collaboration and Productivity in...
AugmentedWorldExpo
 
PDF
Real-Time 3D Environments: Enhancing Client Engagement
Immersive Studio
 
PPTX
The Role of Augmented Reality & Virtual Reality – PowerPoint Presentation
Prezentation Jit
 
PDF
What is Hybrid Cloud and understanding what's right for your business?
Emma Large
 
PPSX
NIIT Immersive Learning Solutions - Where to Start
William West
 
PPTX
Do You Trust Your Machine Learning Outcomes?
Precisely
 
PPTX
Extended Reality Usecases
Vincent Guigui
 
PPTX
Allan Cook (Deloitte Consulting): How Do I Sell a “First” VR/AR Project to My...
AugmentedWorldExpo
 
PDF
Tech Days Sweden - Power BI - A look into the future with mixed reality
Ida Bergum
 
PPTX
EY + Neo4j: Why graph technology makes sense for fraud detection and customer...
Neo4j
 
PDF
Virtual Reality in Financial Services (A Primer)
Sandhya Krishnamurthy
 
PPTX
Extended Reality usecases for B2C and B2E - Virtual Meetup September 2021
Vincent Guigui
 
PDF
Digital Reality
Deloitte Digital
 
PPTX
Business Corporate Profile - DTC Infotech - Digital Transformation Partner
DTC Infotech
 
PPTX
SlideEgg_300510-How AI is Transforming Cloud Computing.pptx
SithamparanaathanPir
 
PDF
Cognitive spaces 2019
Parthasarathi Kar
 
PPTX
Unlock Data driven Insights in Databricks Using Location Intelligence
Precisely
 
Michael Hoffman (Object Theory): Mixed Reality Use Cases and Challenges
AugmentedWorldExpo
 
Regatta VR Customer Service Case Study
William West
 
5 vuforia studio intro sales presentation
Senthilkumar R
 
John Nall (Appzion): Why AR/VR Will Disrupt Collaboration and Productivity in...
AugmentedWorldExpo
 
Real-Time 3D Environments: Enhancing Client Engagement
Immersive Studio
 
The Role of Augmented Reality & Virtual Reality – PowerPoint Presentation
Prezentation Jit
 
What is Hybrid Cloud and understanding what's right for your business?
Emma Large
 
NIIT Immersive Learning Solutions - Where to Start
William West
 
Do You Trust Your Machine Learning Outcomes?
Precisely
 
Extended Reality Usecases
Vincent Guigui
 
Allan Cook (Deloitte Consulting): How Do I Sell a “First” VR/AR Project to My...
AugmentedWorldExpo
 
Tech Days Sweden - Power BI - A look into the future with mixed reality
Ida Bergum
 
EY + Neo4j: Why graph technology makes sense for fraud detection and customer...
Neo4j
 
Virtual Reality in Financial Services (A Primer)
Sandhya Krishnamurthy
 
Extended Reality usecases for B2C and B2E - Virtual Meetup September 2021
Vincent Guigui
 
Digital Reality
Deloitte Digital
 
Business Corporate Profile - DTC Infotech - Digital Transformation Partner
DTC Infotech
 
SlideEgg_300510-How AI is Transforming Cloud Computing.pptx
SithamparanaathanPir
 
Cognitive spaces 2019
Parthasarathi Kar
 
Unlock Data driven Insights in Databricks Using Location Intelligence
Precisely
 
Ad

Recently uploaded (20)

PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 41
ghrom2211g
 
PDF
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
ghrom2211g
 
PDF
How to Migrate SBCGlobal Email to Yahoo Easily
raymondjones7273
 
PDF
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
Actowiz Solustions
 
PPTX
Computer Software and OS of computer science of grade 11.pptx
GauravDahal9
 
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
blackmambaettijean
 
PDF
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
Andre Kraus
 
PDF
PTS Company Brochure 2025 (1).pdf.......
pts464036
 
PDF
Design an Analysis of Algorithms I-SECS-1021-03
DilanEscobar1
 
PPTX
Operating system designcfffgfgggggggvggggggggg
rmskumara09
 
PPTX
history of c programming in notes for students .pptx
Vijayakumari829030
 
PPTX
assetexplorer- product-overview - presentation
nonameist3434
 
PDF
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
pts464036
 
PDF
System and Network Administraation Chapter 3
jaramharo
 
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
IT IDOL Technologies
 
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
ghrom2211g
 
PPTX
ai tools demonstartion for schools and inter college
harshavardhanreddyka11
 
PDF
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
OnePlan Solutions
 
PDF
Designing Intelligence for the Shop Floor.pdf
nikglvk
 
PDF
Digital Strategies for Manufacturing Companies
Virendra Rai, PMP
 
Internet Downloader Manager (IDM) Crack 6.42 Build 41
ghrom2211g
 
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
ghrom2211g
 
How to Migrate SBCGlobal Email to Yahoo Easily
raymondjones7273
 
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
Actowiz Solustions
 
Computer Software and OS of computer science of grade 11.pptx
GauravDahal9
 
VVF-Customer-Presentation2025-Ver1.9.pptx
blackmambaettijean
 
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
Andre Kraus
 
PTS Company Brochure 2025 (1).pdf.......
pts464036
 
Design an Analysis of Algorithms I-SECS-1021-03
DilanEscobar1
 
Operating system designcfffgfgggggggvggggggggg
rmskumara09
 
history of c programming in notes for students .pptx
Vijayakumari829030
 
assetexplorer- product-overview - presentation
nonameist3434
 
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
pts464036
 
System and Network Administraation Chapter 3
jaramharo
 
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
IT IDOL Technologies
 
Adobe Illustrator 28.6 Crack My Vision of Vector Design
ghrom2211g
 
ai tools demonstartion for schools and inter college
harshavardhanreddyka11
 
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
OnePlan Solutions
 
Designing Intelligence for the Shop Floor.pdf
nikglvk
 
Digital Strategies for Manufacturing Companies
Virendra Rai, PMP
 

Object Theory Mixed Reality Use Cases and Challenges

  • 1. Mixed Reality Use Cases and Challenges
  • 2. As a trusted advisor, Object Theory helps F1000 clients strategically identify, design and build XR solutions that provide real business value utilizing today’s XR devices
  • 3. Mixed Reality Benefits • Hands-free – Increase information access efficiency while performing tasks • Shared 3D context – Accurately convey focus & intent to reduce misunderstandings • Stereoscopic vision – Improve comprehension of subject matter • True scale – Accurately experience & evaluate spatial relationships and appearance • Spatial mapping – Reduce mistakes by proximity of information to objects/environment • 3D sound – Increase sense of presence, and accurately direct attention to focal points • Data visualization – Improve comprehension of complex geospatial data sets • High fidelity 3D objects – • Reduce need for expensive 3D print & paint • Reduce dependency on expensive equipment and supplies • Safely train for dangerous tasks • 3D environments – Leverage spatial memory to improve retention & navigation Quantifiable business value from these unique features & benefits: © 2018 object theory, llc
  • 4. Mixed Reality Use Cases Remote Collaboration Product Design Annotated Environment Premium Selling Soft Skills Training Hard Skills Training Space Planning Situation Planning Experience Invisible Data Medical Imaging Remote Expert Infinite Screen Education Expert Coaching Automated Guidance Art and Creativity Entertainment © 2018 object theory, llc
  • 5. Remote Collaboration The Business Challenge When dispersed teams collaborate on 3D problems, it’s difficult to establish an accurate shared context and convey intent with existing 2D tools such as screen sharing, which can result in costly mistakes. Mixed Reality Solution Collaborators feel a sense of presence, plus virtual geospatial annotations and markers can accurately convey intent to establish a more accurate shared context resulting in more informed decisions and fewer mistakes due to miscommunication. Why Mixed Reality? • Gaze indicates focus and intent • 3D Spatial sound provides cues and sense of presence • Stereoscopic vision improves comprehension • Geospatial annotations provide critical context • Ability to see content while conversing/collaborating Potential Challenges • 3D audio chat requires reliable internet connection • Geometry complexity • Outdoor use / safety compliance requirements • WiFi Security (for Defense use cases) © 2018 object theory, llc
  • 6. Remote Collaboration The Business Challenge When dispersed teams collaborate on 3D problems, it’s difficult to establish an accurate shared context and convey intent with existing 2D tools such as screen sharing, which can result in costly mistakes. Mixed Reality Solution Collaborators feel a sense of presence, plus virtual geospatial annotations and markers can accurately convey intent to establish a more accurate shared context resulting in more informed decisions and fewer mistakes due to miscommunication. Why Mixed Reality? • Gaze indicates focus and intent • 3D Spatial sound provides cues and sense of presence • Stereoscopic vision improves comprehension • Geospatial annotations provide critical context • Ability to see content while conversing/collaborating Potential Challenges • 3D audio chat requires reliable internet connection • Geometry complexity • Outdoor use / safety compliance requirements • WiFi Security (for Defense use cases) © 2018 object theory, llc
  • 7. Product Design The Business Challenge When designing products, it is difficult to understand how all of its components interplay and how it will appear as a final product. Furthermore, efficiently collaborating between different design disciplines to find the best outcomes is challenging using existing 2D means. Mixed Reality Solution Mixed Reality makes it possible for design collaborators to establish an accurate shared context of a product under design for efficient, accurate decision making and faster iteration cycle times. Why Mixed Reality? • Stereoscopic vision • Accurate, true scale visualization of product • Ability to see content while conversing/collaborating • Efficient ability to try alternative designs Potential Challenges • Color fidelity not as good as calibrated monitors • Large model geometries © 2018 object theory, llc
  • 8. Product Design The Business Challenge When designing products, it is difficult to understand how all of its components interplay and how it will appear as a final product. Furthermore, efficiently collaborating between different design disciplines to find the best outcomes is challenging using existing 2D means. Mixed Reality Solution Mixed Reality makes it possible for design collaborators to establish an accurate shared context of a product under design for efficient, accurate decision making and faster iteration cycle times. Why Mixed Reality? • Stereoscopic vision • Accurate, true scale visualization of product • Ability to see content while conversing/collaborating • Efficient ability to try alternative designs Potential Challenges • Color fidelity not as good as calibrated monitors • Large model geometries © 2018 object theory, llc
  • 9. Annotated Environment (BIM / IoT) The Business Challenge BIM data and environmental sensor data is collected by the terabytes, yet most of that data is never utilized. Only a fraction of the potential value is extracted. Mixed Reality Solution With ML/AI + MR, the collected data can be analyzed for patterns an then the insights can be presented geosnatially right where an issues need addressing. Further, the relationships between the metadata and the physical plant are much easier to glean from observation. Why Mixed Reality? • Virtual on Physical • Ability to see data while performing tasks • Stereoscopic vision for better insights Potential Challenges • Not recommended yet for outdoor use cases • Need to use markers when navigating large facilities. © 2018 object theory, llc
  • 10. Annotated Environment (BIM / IoT) The Business Challenge BIM data and environmental sensor data is collected by the terabytes, yet most of that data is never utilized. Only a fraction of the potential value is extracted. Mixed Reality Solution With ML/AI + MR, the collected data can be analyzed for patterns an then the insights can be presented geosnatially right where an issues need addressing. Further, the relationships between the metadata and the physical plant are much easier to glean from observation. Why Mixed Reality? • Virtual on Physical • Ability to see data while performing tasks • Stereoscopic vision for better insights Potential Challenges • Not recommended yet for outdoor use cases • Need to use markers when navigating large facilities. © 2018 object theory, llc
  • 11. Premium Selling The Business Challenge It is difficult to sell expensive products, services and experiences that are hard to put in front of a client or hard to explain in detail. Mixed Reality Solution Telling the rich story of an offering in 3D makes it more personal, relatable, understandable and memorable Why Mixed Reality? • Stereoscopic vision to better visualize • Alignment to physical to reveal hidden features • Spatial story telling is more compelling and memorable Potential Challenges • It takes 5 - 15 minutes to acclimate to mixed reality © 2018 object theory, llc
  • 12. Premium Selling The Business Challenge It is difficult to sell expensive products, services and experiences that are hard to put in front of a client or hard to explain in detail. Mixed Reality Solution Telling the rich story of an offering in 3D makes it more personal, relatable, understandable and memorable Why Mixed Reality? • Stereoscopic vision to better visualize • Alignment to physical to reveal hidden features • Spatial story telling is more compelling and memorable Potential Challenges • It takes 5 - 15 minutes to acclimate to mixed reality © 2018 object theory, llc
  • 13. Soft skills training The Business Challenge It is expensive to train soft skills that require understanding nuance and adept reaction to varying external stimuli and behaviors. Mixed Reality Solution The combination of AI+MR reduces training cost by making it possible to recreate realistic interactive soft skill scenarios, automate the AI/ML assessment of performance and generation of precise feedback. Why Mixed Reality? • Stereoscopic vision for more realistic scenarios • Alignment to physical further increases realism • Gaze indicates trainee focus and intent • Positional info, camera and mics feed data to cognitive services • Hands free enables using actual soft skill devices Potential Challenges • No significant challenges © 2018 object theory, llc
  • 14. Soft skills training The Business Challenge It is expensive to train soft skills that require understanding nuance and adept reaction to varying external stimuli and behaviors. Mixed Reality Solution The combination of AI+MR reduces training cost by making it possible to recreate realistic interactive soft skill scenarios, automate the AI/ML assessment of performance and generation of precise feedback. Why Mixed Reality? • Stereoscopic vision for more realistic scenarios • Alignment to physical further increases realism • Gaze indicates trainee focus and intent • Positional info, camera and mics feed data to cognitive services • Hands free enables using actual soft skill devices Potential Challenges • No significant challenges © 2018 object theory, llc
  • 15. Hard skills training The Business Challenge It is expensive to train skills to a large workforce that require learning a wide variety of steps and operations, particularly in high-turnover environments. Mixed Reality Solution Creation of self-guided, interactive skills training tutorials substantially reduces the labor cost of repeatedly training the same skill. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster comprehension • Alignment to physical enables practicing on real equipment • Information close to where you need it Potential Challenges • Creating 3D interactive content for each skill can be expensive © 2018 object theory, llc
  • 16. Hard skills training The Business Challenge It is expensive to train skills to a large workforce that require learning a wide variety of steps and operations, particularly in high-turnover environments. Mixed Reality Solution Creation of self-guided, interactive skills training tutorials substantially reduces the labor cost of repeatedly training the same skill. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster comprehension • Alignment to physical enables practicing on real equipment • Information close to where you need it Potential Challenges • Creating 3D interactive content for each skill can be expensive © 2018 object theory, llc
  • 17. Space Planning The Business Challenge Experiencing the feel and function of a space under design is a critical step in the design process to reduce mistakes, yet is so costly to achieve that it’s rarely done. Mixed Reality Solution Mixed Reality makes it possible to efficiently experience and even modify a non-existent room design at true scale. Why Mixed Reality? • True size and scale • Stereoscopic vision • Ability to see content while conversing/collaborating • Align virtual changes to physical environment Potential Challenges • True scale immersive scenarios can benefit from wider FOV, particularly for new users © 2018 object theory, llc
  • 18. Space Planning The Business Challenge Experiencing the feel and function of a space under design is a critical step in the design process to reduce mistakes, yet is so costly to achieve that it’s rarely done. Mixed Reality Solution Mixed Reality makes it possible to efficiently experience and even modify a non-existent room design at true scale. Why Mixed Reality? • True size and scale • Stereoscopic vision • Ability to see content while conversing/collaborating • Align virtual changes to physical environment Potential Challenges • True scale immersive scenarios can benefit from wider FOV, particularly for new users © 2018 object theory, llc
  • 19. Situation Planning The Business Challenge Planning and monitoring complex geospatial scenarios demands comprehensive understanding of complex information across a dispersed team of experts. It is difficult to provide all relevant information to create a comprehensive and accurate shared context. Mixed Reality Solution Mixed reality enables effective collaboration across dispersed teams while interacting with a wide variety of geospatially accurate 3D information and supplementary 2D information. Why Mixed Reality? • Geospatially accurate information • Stereoscopic vision • Ability to see content while conversing/collaborating Potential Challenges • Content creation can be expensive • Geometry complexity • WiFi security (for Defense use cases) © 2018 object theory, llc
  • 20. Situation Planning The Business Challenge Planning and monitoring complex geospatial scenarios demands comprehensive understanding of complex information across a dispersed team of experts. It is difficult to provide all relevant information to create a comprehensive and accurate shared context. Mixed Reality Solution Mixed reality enables effective collaboration across dispersed teams while interacting with a wide variety of geospatially accurate 3D information and supplementary 2D information. Why Mixed Reality? • Geospatially accurate information • Stereoscopic vision • Ability to see content while conversing/collaborating Potential Challenges • Content creation can be expensive • Geometry complexity • WiFi security (for Defense use cases) © 2018 object theory, llc
  • 21. Experience Invisible Data The Business Challenge Data analysis of 3D data sets and simulations of geospatial information on 2D screens makes it difficult to comprehend the full extent of insights that can be gained. Mixed Reality Solution With Mixed Reality, simulations and visualizations of collected sensor data or simulations can be played and animated geospatially and can be aligned with physical objects related to the data. Why Mixed Reality? • Stereoscopic vision • 3D in 3D • Align virtual to physical • Ability to see content while conversing/collaborating • Experience the inaccessible Potential Challenges • No major challenges © 2018 object theory, llc
  • 22. Experience Invisible Data The Business Challenge Data analysis of 3D data sets and simulations of geospatial information on 2D screens makes it difficult to comprehend the full extent of insights that can be gained. Mixed Reality Solution With Mixed Reality, simulations and visualizations of collected sensor data or simulations can be played and animated geospatially and can be aligned with physical objects related to the data. Why Mixed Reality? • Stereoscopic vision • 3D in 3D • Align virtual to physical • Ability to see content while conversing/collaborating • Experience the inaccessible Potential Challenges • No major challenges © 2018 object theory, llc
  • 23. Medical Imaging The Business Challenge Surgeons are constantly evaluating 3D problems on 2D screens. Missing critical insights and longer assessment times can lead to worse outcomes for patients. Mixed Reality Solution Hands-free access to all relevant 2D and 3D information exactly where it’s needed enables more accurate and efficient assessment for better outcomes. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster insights • Alignment to physical reduces errors • Information proximity without physical interference • Instant access to vast amounts of 2D & 3D information Potential Challenges • Accurate alignment to body below 1-2mm difficult • Regulatory requirements for operating room • Weight and comfort for long-term use © 2018 object theory, llc
  • 24. Medical Imaging The Business Challenge Surgeons are constantly evaluating 3D problems on 2D screens. Missing critical insights and longer assessment times can lead to worse outcomes for patients. Mixed Reality Solution Hands-free access to all relevant 2D and 3D information exactly where it’s needed enables more accurate and efficient assessment for better outcomes. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster insights • Alignment to physical reduces errors • Information proximity without physical interference • Instant access to vast amounts of 2D & 3D information Potential Challenges • Accurate alignment to body below 1-2mm difficult • Regulatory requirements for operating room • Weight and comfort for long-term use © 2018 object theory, llc
  • 25. Remote Expert The Business Challenge Flying subject matter experts onsite to support field operations is expensive and requires too many experts on staff for peak load. Mixed Reality Solution A smaller team of centralized experts can effectively assist many field technicians as needed at lower travel and labor cost. Why Mixed Reality? • Hands free enables performing tasks while being assisted • Geospatial indicators/annotations increases accuracy • Stereoscopic vision increases comprehension Potential Challenges • Requires reliable internet connection for audio & video • Safety compliance requirements • Outdoor use • Safety compliance requirements • WiFi security (for Defense use cases) © 2018 object theory, llc
  • 26. Remote Expert The Business Challenge Flying subject matter experts onsite to support field operations is expensive and requires too many experts on staff for peak load. Mixed Reality Solution A smaller team of centralized experts can effectively assist many field technicians as needed at lower travel and labor cost. Why Mixed Reality? • Hands free enables performing tasks while being assisted • Geospatial indicators/annotations increases accuracy • Stereoscopic vision increases comprehension Potential Challenges • Requires reliable internet connection for audio & video • Safety compliance requirements • Outdoor use • Safety compliance requirements • WiFi security (for Defense use cases) © 2018 object theory, llc
  • 27. Infinite Screen The Business Challenge Many tasks require analyzing huge amounts of 2D and 3D information. We are constrained by the realistic number of pixels we can surround ourselves with. Mixed Reality Solution Mixed Reality enables augmenting existing screen real estate with a nearly infinite amount of additional 2D panels as well as 3D content for a vast increase in available information for analysis and decision making. Why Mixed Reality? • Can interact with physical and virtual world simultaneously • Not constrained by limits of 2D monitors Potential Challenges • Today’s devices don’t yet run the sophisticated apps professionals depend on. © 2018 object theory, llc
  • 28. Infinite Screen The Business Challenge Many tasks require analyzing huge amounts of 2D and 3D information. We are constrained by the realistic number of pixels we can surround ourselves with. Mixed Reality Solution Mixed Reality enables augmenting existing screen real estate with a nearly infinite amount of additional 2D panels as well as 3D content for a vast increase in available information for analysis and decision making. Why Mixed Reality? • Can interact with physical and virtual world simultaneously • Not constrained by limits of 2D monitors Potential Challenges • Today’s devices don’t yet run the sophisticated apps professionals depend on. © 2018 object theory, llc
  • 29. Education The Business Challenge It is difficult and expensive to teach concepts and techniques that consume expensive supplies, depend on expensive equipment, or can be dangerous. Mixed Reality Solution For at least the early stages of the learning process, simulating concepts and techniques is a less dangerous and expensive alternative, and can reduce dependency on access to expensive equipment. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster comprehension • Alignment to physical enables practicing with some or all physical equipment, or even props. • Information close to where you need it • Instant access to vast amounts of 2D & 3D information • Ability to see content while conversing/collaborating Potential Challenges • Creating a large variety of interactive 3D content can be expensive. © 2018 object theory, llc
  • 30. Education The Business Challenge It is difficult and expensive to teach concepts and techniques that consume expensive supplies, depend on expensive equipment, or can be dangerous. Mixed Reality Solution For at least the early stages of the learning process, simulating concepts and techniques is a less dangerous and expensive alternative, and can reduce dependency on access to expensive equipment. Why Mixed Reality? • Hands free • Stereoscopic vision for better, faster comprehension • Alignment to physical enables practicing with some or all physical equipment, or even props. • Information close to where you need it • Instant access to vast amounts of 2D & 3D information • Ability to see content while conversing/collaborating Potential Challenges • Creating a large variety of interactive 3D content can be expensive. © 2018 object theory, llc
  • 31. Expert Coaching The Business Challenge Improving a fine motor skill such as the perfect golf swing is extremely difficult and requires deep expertise. Mixed Reality Solution IoT sensors plus mixed reality enables accurate capture and visualization of a wide variety of information for more accurate assessment and improvement of technique. Why Mixed Reality? • Hands free • Alignment to physical to see relationships and variance • 3D visualization for accurate assessment and comparison of 3D movements Potential Challenges • Outdoor use not recommended © 2018 object theory, llc
  • 32. Expert Coaching The Business Challenge Improving a fine motor skill such as the perfect golf swing is extremely difficult and requires deep expertise. Mixed Reality Solution IoT sensors plus mixed reality enables accurate capture and visualization of a wide variety of information for more accurate assessment and improvement of technique. Why Mixed Reality? • Hands free • Alignment to physical to see relationships and variance • 3D visualization for accurate assessment and comparison of 3D movements Potential Challenges • Outdoor use not recommended © 2018 object theory, llc
  • 33. Automated Guidance The Business Challenge Utilizing only physical props, providing all useful information to guide an audience through an experience creates traffic bottlenecks, unwanted visual clutter and limits storytelling possibilities. Mixed Reality Solution Mixed reality increases expressiveness and efficiency while eliminating bottlenecks. Any amount of interactive 2D, 3D and spatial audio content can be situated geospatially around points of interest to convey useful information in compelling ways that maximize expressiveness, comprehension and memory. Why Mixed Reality? • Stereoscopic vision for better, faster comprehension • Information proximity & alignment increases context • Hands free • Instant access to vast amounts of 2D & 3D information Potential Challenges • Outdoor use not recommended • Spatial mapping limits may require ID targets © 2018 object theory, llc
  • 34. Automated Guidance The Business Challenge Utilizing only physical props, providing all useful information to guide an audience through an experience creates traffic bottlenecks, unwanted visual clutter and limits storytelling possibilities. Mixed Reality Solution Mixed reality increases expressiveness and efficiency while eliminating bottlenecks. Any amount of interactive 2D, 3D and spatial audio content can be situated geospatially around points of interest to convey useful information in compelling ways that maximize expressiveness, comprehension and memory. Why Mixed Reality? • Stereoscopic vision for better, faster comprehension • Information proximity & alignment increases context • Hands free • Instant access to vast amounts of 2D & 3D information Potential Challenges • Outdoor use not recommended • Spatial mapping limits may require ID targets © 2018 object theory, llc
  • 35. Art and Creativity The Business Challenge Monetizing entertainment is becoming increasingly difficult. Theater and sports arena attendance continues to drop. Mixed Reality Solution Mixed Reality adds interactivity and extends the average time spent consuming entertainment. This increases the opportunities to monetize it. Why Mixed Reality? • Can augment existing means of consuming entertainment. • Can move and interact with environment while experiencing content. Potential Challenges • MR not yet a ubiquitous consumer device. © 2018 object theory, llc
  • 36. Art and Creativity The Business Challenge Monetizing entertainment is becoming increasingly difficult. Theater and sports arena attendance continues to drop. Mixed Reality Solution Mixed Reality adds interactivity and extends the average time spent consuming entertainment. This increases the opportunities to monetize it. Why Mixed Reality? • Can augment existing means of consuming entertainment. • Can move and interact with environment while experiencing content. Potential Challenges • MR not yet a ubiquitous consumer device. © 2018 object theory, llc
  • 37. Entertainment The Business Challenge Monetizing entertainment is becoming increasingly difficult. Theater and sports arena attendance continues to drop. Mixed Reality Solution Mixed Reality adds interactivity and extends the average time spent consuming entertainment. This increases the opportunities to monetize it. Why Mixed Reality? • Can augment existing means of consuming entertainment. • Can move and interact with environment while experiencing content. Potential Challenges • MR not yet a ubiquitous consumer device. © 2018 object theory, llc
  • 38. Entertainment The Business Challenge Monetizing entertainment is becoming increasingly difficult. Theater and sports arena attendance continues to drop. Mixed Reality Solution Mixed Reality adds interactivity and extends the average time spent consuming entertainment. This increases the opportunities to monetize it. Why Mixed Reality? • Can augment existing means of consuming entertainment. • Can move and interact with environment while experiencing content. Potential Challenges • MR not yet a ubiquitous consumer device. © 2018 object theory, llc
  • 39. Addressing Today’s Challenges • Safety: 3rd Party HoloLens hard hats (Trimble) • Typing: Device assisted authentication • Placement/Location: • Fiducial markers • Manual logical alignment • Global anchor sharing • Attention: 3D audio, narrative and visual cues • Static 3D Content: • Expert manual optimization • Level-of-detail (LODs) • Smart use of geometry culling • FOV: • Start small for context, then enlarge • Attention directors and audio cues • Dynamic 3D Content: Simplygon automation • Material fidelity: Hand optimized shaders • Input: • Hand controllers and clickers • Smart phones as companion input devices • All day: • USB battery packs • Device swap • Spectator View for professional videos / photos • Spatial mapping / tracking: • Clear out old spaces • Guide user through good room scan • Setting late stage reproduction (LSR) plane • Environment: Comprehensive client training How Object Theory addresses today’s MR challenges: © 2018 object theory, llc
  • 40. With thoughtful experience design, diligent optimization and smart engineering, today’s mixed reality devices deliver real business value for a wide variety of use cases.
  • 41. Thank you! Michael Hoffman Co-founder / Partner Object Theory michael@objecttheory.com linkedin.com/in/mthoffman @objecttheory