The Future of Augmented Reality Infrastructure
- 1. The Future of Augmented Reality Infrastructure (Software and Hardware) Vitaliy Goncharuk 2018
- 2. Why AR is critical in the future? AR: 1. decreases the complexity of the external world /environment 2. increases your personal efficiency; 3. creates new data and new knowledge;
- 3. Augmented Reality Infrastructure SOFTWARE HARDWARE • SLAM; • Real-Time AI (CV/ML/DP); • Maps; • Cloud AI / AR Cloud; • UI/UX; • Content creation & distribution platforms; • Services; • Sensors; • Optics; • Chips; • Battery; • Data transfer tech;
- 4. AR + Phone - > AR + Glasses –> AR + Lenses
- 5. Issues 1. Poor user experience (latency, stability, not realistic image quality, etc.) 2. Battery drain issues 3. Big form-factor (impossible to carry around all day due to the weight)
- 6. Software stack SLAM + FUSION Real time AI Simple Scene Semantics Classification Recognition Detection Advanced re- localization Loop closure Content creation, B2C, C2C Services: AR *outube AR Cooperative Work and Games AR *acebook AR *elp AR + Maps for DP, Robotics, B2B, Human2Human, Robot2Human, Robot2Robot. DENSE / SPARSE Mapping CLOUD Infrastructure Cloud AI / “AR Cloud” Advanced Scene Semantic Smart Maps management (Merge , upgrade, etc.) Maps Analytics & Statistics Labeling, Matching
- 7. Hardware stack IMAGE SENSORS INERTIAL SENSORS OPTICS BATTERY Silicon Chips SOUND Data Transfer
- 8. DETAILS
- 10. CHIPS Main: • Hardware acceleration of all critical AI algorithms (“AI processor”). • The most common configuration - ARM cores + DSPs Leaders: Movidius, Qualcomm Snapdragon 835(build in DSP), Intuitive, Apple, Microsoft.
- 11. Cloud based AI / AR Cloud NOT FOR PUBLISHING
- 12. Real Time “AI” software Stack NOT FOR PUBLISHING
- 13. Conclusions 1. More sensors -> More data -> better quality of user experience, BUT more CPU and energy consumption 2. B2B – first wave. 3. B2C – second wave. Perfect quality of hardware and media content is needed.
- 14. Author Vitaliy Goncharuk About: http://vactivity.com/aboutauthor/ E-mail: vactivity@gmail.com
Editor's Notes
- #5: https://www.theverge.com/2016/4/6/11376442/microsoft-hololens-holograms-parts-teardown-photos-hands-on