ITD 150: Intro to Augmented Reality
- 1. INTRO TO AUGMENTED REALITY ITD 150 (21059) INTRODUCTION TO AUGMENTED REALITY
- 2. 01 - INTRODUCTION TO AUGMENTED REALITY ABOUT ME ▸ Designing for 4+ Years ▸ Worked as a UX/UI Designer ▸ Moved to Augmented Reality 2+ Years Ago ▸ In the the XR Space Since 2015 ▸ Co-organizer of Austin Augmented Reality ▸ Working at Double A Labs as AR/UX Developer PIC OF ME
- 3. 01 - INTRODUCTION TO AUGMENTED REALITY OVERVIEW ▸ What is Augmented Reality? ▸ The Medium of Augmented Reality / Mixed reality ▸ Understanding the Difference Between AR/VR/MR ▸ A Brief History of Augmented Reality ▸ Real World Examples of Augmented Reality ▸ Markets of Augmented Reality ▸ Overview of Primary Augmented Reality Technology ▸ Developing Augmented Reality ▸ Work Examples ▸ Demos!
- 4. 04 - INTRODUCTION TO AUGMENTED REALITY ACRONYM OVERVIEW OF AUGMENTED REALITY Acronym Definitions AR — Augmented Reality VR — Virtual Reality MR — Mixed Reality XR — Encompasses all Realties Display Acronyms HMD — Head Mounted Displays HUD — Heads Up Display OST — Optical See-Through VST — Video See-Through
- 5. 01 - INTRODUCTION TO AUGMENTED REALITY WHAT IS AUGMENTED REALITY IMAGE OF RETICLE IMAGE OR IRON MAN HUD& Simple Advanced Microsoft Hololens 2017First Ever Telescope 1608
- 6. 02 - INTRODUCTION TO AUGMENTED REALITY DEFINING THE MEDIUM OF AUGMENTED REALITY / MIXED REALITY Definition of Augmented Reality “ The immense potential of augmented reality as a paradigm-shifting user interface metaphor becomes apparent when we review the most recent few milestones in human–computer interaction: the emergence of the World Wide Web, the social web, and the mobile device revolution. “ Three Main Characteristics of AR Combines real and virtual Interactive in real time Registered in 3D Azuma, R. T. (1997, August). A Survey of Augmented Reality. Retrieved from https://www.cs.unc.edu/~azuma/ARpresence.pdf.
- 7. 03 - INTRODUCTION TO AUGMENTED REALITY TYPES OF AUGMENTED REALITY (VISUAL, AUDITORY , MULTI-SENSE) Main Types of AR Include the Following: Visual - Head Mounted Display / Mobile (Most Accessible and Common) Auditory - Spatial Sound Devices Multi-Sense - Combination of Haptics, Sound and Visual stimuli
- 8. 04 - INTRODUCTION TO AUGMENTED REALITY VIRTUAL REALITY Definition of Virtual Reality Virtual reality is an artificial environment that is created with software and presented to the user in such a way that the user suspends belief and accepts it as a real environment. On a computer, virtual reality is primarily experienced through two of the five senses: sight and sound. Three Main Characteristics of VR Fully Immersive Always Stereoscopic Larger FOV Then Most AR/MR Headsets
- 9. 03 - INTRODUCTION TO AUGMENTED REALITY UNDERSTANDING THE DIFFERENCE BETWEEN AR/VR/MR Augmented Reality and Mixed Reality can be one in the same
- 10. 03 - INTRODUCTION TO AUGMENTED REALITY AUGMENTED REALITY ENCAPSULATION ▸ Augmented Reality (AR) - Overlays virtual objects on the real-world environment. ▸ Virtual Reality (VR) - Immerses users in a fully artificial digital environment. ▸ Mixed Reality (MR) - Not just overlays but anchors virtual objects to the real world. MIXED REALITY OVERLAY SPATIAL Real Virtual Augmented Reality
- 11. 04 - INTRODUCTION TO AUGMENTED REALITY A BRIEF HISTORY OF AUGMENTED REALITY ▸ 1968 - Ivan Sutherland creates the first Head Mounted Display ▸ 1974 - Myron Krueger established an artificial reality laboratory ▸ 1992 - Birth of the term “augmented reality” ▸ 1997 - First outdoor AR system, the Touring Machine
- 12. 04 - INTRODUCTION TO AUGMENTED REALITY A BRIEF HISTORY OF AUGMENTED REALITY ▸ 2009 - AR Tool Kit brings Augmented Reality to the Web ▸ 2014 - Google Glass begins shipment of their glasses ▸ 2016 - AR/VR invest reaches 1.1 billion ▸ 2018 - Magic Leap One gets released and ARkit 2.0 releases
- 13. 04 - INTRODUCTION TO AUGMENTED REALITY REAL WORLD EXAMPLES OF AUGMENTED REALITY Popular Mobile AR Applications Pokemon GO - Catch Pokemon on ground Snapchat and Facebook - Face filters and stickers IKEA Place - Place furniture in your house AR MeasureKit - Measure things through AR
- 14. 04 - INTRODUCTION TO AUGMENTED REALITY REAL WORLD EXAMPLES OF AUGMENTED REALITY Heads-up displays F-35 Lighting II - One of the most advanced AR system (400k per HMD) BMW HUDs - BMW’s new X3 SUV with a full-color HUD Google Glass - Still making them for increased productivity in manufacturing (UpSkill)
- 15. MARKET APPLICATIONS ITD 150 (21059) INTRODUCTION TO AUGMENTED REALITY
- 16. 04 - INTRODUCTION TO AUGMENTED REALITY HEALTHCARE AND MEDICINE Improving access Boosting training Assisting practice EMMR
- 17. 04 - INTRODUCTION TO AUGMENTED REALITY MANUFACTURING 32% More Productive Workforce 30% Higher Quality Output 20% Greater Utilization UPSKILL
- 18. 04 - INTRODUCTION TO AUGMENTED REALITY EDUCATION Process 90% Information Visually Tele-Communication Elevated Student Engagement VIDEO
- 19. AUGMENTED REALITY TECHNOLOGY ITD 150 (21059) INTRODUCTION TO AUGMENTED REALITY
- 20. 04 - INTRODUCTION TO AUGMENTED REALITY DISPLAYS
- 21. 04 - INTRODUCTION TO AUGMENTED REALITY METHODS OF AUGMENTATION (OST VS VST) - DISPLAYS Two Main Types Displays Optical See-Through (OST) - Head Mounted Displays Video See-Through (VST) - Mobile Applications Mono vs Bino HMD Monocular - Presents images to only one eye Binocular - Presents a separate image to each eye, resulting in a stereoscopic effect.
- 22. 04 - INTRODUCTION TO AUGMENTED REALITY METHODS OF AUGMENTATION (OST VS VST) - DISPLAYS Optical See-Through (OST) Examples Binocular Monocular Google Glass Microsoft Hololens
- 23. 04 - INTRODUCTION TO AUGMENTED REALITY METHODS OF AUGMENTATION (OST VS VST) - DISPLAYS Video See-Through (VST) Examples Mobile HMD
- 24. 04 - INTRODUCTION TO AUGMENTED REALITY TRACKING
- 25. 04 - INTRODUCTION TO AUGMENTED REALITY 5 MAIN TYPES OF AR TRACKING 1. Image Target Based - Easy to Use 2. Ground Plane Detection - Pokemon GO Experiences 3. Markerless Tracking - ARkit using VIO 4. 3D Object and Scene Tracking - Harder to use because of lighting 5. Geo-Location for AR Fencing - Very specialized Applications IMAGE IMAGE IMAGE
- 26. 04 - INTRODUCTION TO AUGMENTED REALITY TRACKING & REGESTRATION & CALIBRATION Simple Explanation
- 27. 04 - INTRODUCTION TO AUGMENTED REALITY TRACKING & REGESTRATION & CALIBRATION More in Depth TRACKING REGISTRATION CALIBRATION The alignment of coordinate systems between virtual and real objects Process of comparing measurements made with two different devices, a reference device and a device to be calibrated. Update the position and orientation of the AR display relative to the real objects.
- 28. DEVELOPING FOR AUGMENTED REALITY ITD 150 (21059) INTRODUCTION TO AUGMENTED REALITY
- 29. 04 - INTRODUCTION TO AUGMENTED REALITY CURRENT AVAILABLE HARDWARE AND SOFTWARE Augmented Reality Hardware - HMD Microsoft Hololens - Market Value $3000 Magic Leap One - Market Value $2200 Google Glass Enterprise - Market Value $1300 Vuzix Blade AR - Market Value $1000 Coming Soon Microsoft Hololens 2 - Feb. 24th Apple AR Glasses - 2020
- 30. 04 - INTRODUCTION TO AUGMENTED REALITY CURRENT AVAILABLE HARDWARE AND SOFTWARE Augmented Reality Software Development Environments Unity, Unreal, Xcode , Android Studio etc… My preferred is Unity because of education content and 2/3 of all AR/ VR applications are made with Unity Software Development Kits AR ToolKit, ARkit (Apple), ARcore(Android), Wikitude, Vuforia, AR.js My preferred is Wikitude because of the flexibility license agreements and access to public events inside Unity IDE
- 31. 04 - INTRODUCTION TO AUGMENTED REALITY TOOLS I USE TO GET THE JOB DONE (SOFTWARE) UNITY + VISUAL STUDIO / C# ‣ Unity - This is my main development environment ‣ Visual Studio - Main development environment for writing code ‣ C# - Most popular for developing applications on Unity. Most documented compared to Javascript
- 32. 04 - INTRODUCTION TO AUGMENTED REALITY TOOLS I USE TO GET THE JOB DONE (DESIGN) SKETCH + PHOTOSHOP + GOOGLE DOCS ‣ Sketch - Designing User Interfaces for HMD and Mobile ‣ Photoshop - For client branding and misc. designs ‣ Google Docs - Mostly for User Experience Documentation
- 33. 04 - INTRODUCTION TO AUGMENTED REALITY WORK SAMPLES
- 34. 04 - INTRODUCTION TO AUGMENTED REALITY MR. MERCEDES FINDERS KEEPERS
- 35. 04 - INTRODUCTION TO AUGMENTED REALITY DELL DESTINATION Client: Dell Technologies Location: Everywhere Type of AR: Ground Plane Based and Image target for PAT Build Time: On-Going
- 36. 04 - INTRODUCTION TO AUGMENTED REALITY DOUBLE A LABS: VIEWFORGE Client: Double A Labs Location: Austin , TX Type of AR: Mobile Image Target Based Build Time: On-Going
- 37. THANK YOU ITD 150 (21059) INTRODUCTION TO AUGMENTED REALITY