Mobile AR Tutorial
11 likes4,790 views
This document provides an overview of augmented reality (AR) and the Vuforia platform for building AR applications. It discusses key Vuforia features like image and object tracking. It also provides steps for setting up a Vuforia project in Unity, including importing the Vuforia Unity plugin, adding a tracking target, and deploying the built application to Android. Additional topics covered include interactive scripting, using Vuforia samples, and resources for further learning.
![Augmented Reality Definition
• Defining Characteristics [Azuma 97]
• Combines Real andVirtual Images
• Both can be seen at the same time
• Interactive in real-time
• The virtual content can be interacted with
• Registered in 3D
• Virtual objects appear fixed in space
Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.](https://image.slidesharecdn.com/mobilear-tutorial-151202145835-lva1-app6892/85/Mobile-AR-Tutorial-3-320.jpg)
Mobile AR Tutorial
- 1. MOBILE AR: A TUTORIAL Mark Billinghurst mark.billinghurst@unisa.edu.au 1st – 5th December 2015 INDMF/ICIDM 2015
- 2. 1977 – StarWars –Augmented Reality
- 3. Augmented Reality Definition • Defining Characteristics [Azuma 97] • Combines Real andVirtual Images • Both can be seen at the same time • Interactive in real-time • The virtual content can be interacted with • Registered in 3D • Virtual objects appear fixed in space Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.
- 4. 2008 - CNN
- 5. • Put AR pictures here Augmented Reality Examples
- 7. Virtual Reality • ImmersiveVR • Head mounted display, gloves • Separation from the real world
- 8. AR vsVR
- 10. Milgram’s Reality-Virtuality continuum Mixed Reality Reality - Virtuality (RV) Continuum Real Environment Augmented Reality (AR) Augmented Virtuality (AV) Virtual Environment "...anywhere between the extrema of the virtuality continuum." P. Milgram and A. F. Kishino, Taxonomy of Mixed Reality Visual Displays IEICE Transactions on Information and Systems, E77-D(12), pp. 1321-1329, 1994.
- 11. Summary • Augmented Reality has three key features • Combines Real andVirtual Images • Interactive in real-time • Registered in 3D • AR can be classified alongside other technologies • Milgram’s Mixed Reality continuum
- 12. TECHNOLOGY
- 13. Augmented Reality Definition • Defining Characteristics • Combines Real andVirtual Images • Display Technology • Interactive in real-time • Interaction Technology • Registered in 3D • Tracking Technology
- 14. DISPLAY
- 15. Display Technologies ! Types (Bimber/Raskar 2003) ! Head attached • Head mounted display/projector ! Body attached • Handheld display/projector ! Spatial • Spatially aligned projector/monitor
- 17. ViewThrough Google Glass Always available peripheral information display Combining computing, communications and content capture
- 18. TRACKING
- 19. Objects Registered in 3D • Registration • Positioning virtual object wrt real world • Tracking • Continually locating the users viewpoint • Position (x,y,z), Orientation (r,p,y)
- 20. Tracking Technologies " Active • Mechanical, Magnetic, Ultrasonic • GPS, Wifi, cell location " Passive • Inertial sensors (compass, accelerometer, gyro) • Computer Vision • Marker based, Natural feature tracking " Hybrid Tracking • Combined sensors (eg Vision + Inertial)
- 21. INTERACTION
- 22. • Interface Components • Physical components • Display elements • Visual/audio • Interaction metaphors Physical Elements Display ElementsInteraction MetaphorInput Output AR Interface Elements
- 23. AR APPLICATIONS
- 24. • Web based AR • Flash, HTML 5 based AR • Marketing, education • Outdoor Mobile AR • GPS, compass tracking • Viewing Points of Interest in real world • Eg: Junaio, Layar, Wikitude • Handheld AR • Vision based tracking • Marketing, gaming • Location Based Experiences • HMD, fixed screens • Museums, point of sale, advertising Typical AR Experiences
- 25. CityViewARApplication • Visualize Christchurch before the earthquakes
- 26. Warp Runner • Puzzle solving game • Deform real world terrain
- 27. Rock-em Sock-em • Shared AR Demo • Markerless tracking
- 28. Demo:colAR • Turn colouring books pages into AR scenes • Markerless tracking, use your own colours.. • Try it yourself: http://www.colARapp.com/
- 29. What Makes a GoodAR Experience? • Compelling • Engaging,‘Magic’ moment • Intuitive, ease of use • Uses existing skills • Anchored in physical world • Seamless combination of real and digital
- 30. INTRODUCTION TO UNITY Mark Billinghurst mark.billinghurst@unisa.edu.au
- 32. Unity 3D Game Editor
- 33. SETUP
- 34. Download and Install • Go to unity3d.com/download • Use Download Assistant – pick components you want
- 35. Getting Started • First time running Unity you’ll be asked to create a project • Specify project name and location • Can pick asset packages (pre-made content)
- 36. Unity Interface • Toolbar, Scene, Hierarchy, Project, Inspector
- 38. Building Scenes • Use GameObjects: • Containers that hold different components • Eg 3D model, texture, animation • Use Inspector • View and edit object properties and other settings • Use Scene View • Position objects, camera, lights, other GameObjects etc • Scripting • Adding interaction, user input, events, etc
- 39. GameObjects • Every object in Scene is a GameObject • GameObjects contain Components • Eg Transform Component, Camera Component
- 40. Adding 3D Content • Create 3D asset using modeling package, or download • Fbx, Obj file format for 3D models • Add file to Assets folder in Project • When project opened 3D model added to Project View • Drag mesh from Project View into Hierarchy or Scene View • Creates a game object
- 41. Positioning/Scaling Objects • Click on object and choose transform
- 42. Unity Asset Store • Download thousands models, scripts, animations, etc • https://www.assetstore.unity3d.com/
- 43. UNITY BASICS
- 44. Making a Simple Scene 1. Create New Project 2. Create Game Object 3. Moving main camera position 4. Adding lights 5. Adding more objects 6. Adding physics 7. Changing object materials 8. Adding script behaviour
- 45. CreateProject • Create new folder and project
- 47. Create GameObject • Load a Sphere into the scene • GameObject -> 3D Object -> Sphere
- 48. Moving main camera • Select Main Camera • Select translate icon • Move camera
- 49. Add Light • GameObject -> Light -> Directional Light • Use inspector to modify light properties (colour, intensity)
- 50. Add Physics • Select Sphere • Add Rigidbody component • Add Component -> Physics -> RigidBody • or Component -> Physics -> RigidBody • Modify inspector properties (mass, drag, etc)
- 51. Add More Objects • Add several cubes • GameObject -> 3D Object – Cube • Move cube • Add Rigid Body component (uncheck gravity)
- 52. Add Material • Assets -> Create -> Material • Click Albedo colour box in inspector • Select colour • Drag asset onto object to apply
- 53. Add Script • Assets -> Create -> C# script • Edit script using Mono • Drag script onto Game Object
- 54. Example C# Script GameObject Rotation using UnityEngine; using System.Collections; public class spin : MonoBehaviour { // Use this for initialization void Start () { } // Update is called once per frame void Update () { this.gameObject.transform.Rotate(Vector3.up*10); } } #
- 55. Scripting C# Unity 3D • void Awake(): • Is called when the first scene is loaded and the game object is active • void Start(): • Called on first frame update • void FixedUpdate(): • Called before physics calculations are made • void Update(): • Called every frame before rendering • void LateUpdate(): • Once per frame after update finished
- 56. Final Spinning Cube Scene
- 57. Resources • Unity Main site • http://www.unity3d.com/ • Holistic Development with Unity • http://holistic3d.com • Official Unity Tutorials • http://unity3d.com/learn/tutorials • Unity Coder Blog • http://unitycoder.com
- 60. What you will learn • Introduction to Vuforia • Platform and features • How to install/set-up Vuforia • Vuforia Basics • Marker Tracking, Object tracking • Deploying to Mobile Device • Android, iOS
- 61. OVERVIEW
- 62. Vuforia Overview • Platform for Mobile Computer Vision • https://www.qualcomm.com/products/vuforia • Released by Qualcomm in 2010, acquired by PTC 2015 • Used by over 100K developers, >10K applications • Main Features: • Recognition • Image, text, object recognition • Tracking • Image, marker, scene, object
- 63. Vuforia Provides • Android • iOS • Unity Extension Device SDK • Target Management System • App Development Guide • Vuforia Web Services Tools & Services • Dedicated technical support engineers • Thousands of posts Support Forum
- 64. Vuforia Features
- 66. Developer Tools
- 67. Target Manager
- 68. Cloud Services
- 69. Platform Anatomy
- 71. INSTALLATION
- 72. Download Vuforia for Unity SDK • https://developer.vuforia.com/downloads/sdk
- 74. Installing Vuforia Unity Extension • Create new Unity Project • Import the Vuforia Unity Extension • Double clicking the *.unitypackage file • Eg vuforia-unity-5-0-6.unitypackage • Manually install package • Assets -> Import Package -> Custom Package • The extension archive will self install • folders, plugins and libraries, etc
- 76. Unity Asset Structure • Editor - Contains the scripts required to interact with Target data in the Unity editor • Plugins - Contains Java and native binaries that integrate the Vuforia AR SDK with the Unity Android or Unity iOS application • Vuforia - Contains the prefabs and scripts required to bring AR to your application • Streaming Assets / QCAR - Contains the Device Database configuration XML and DAT files from the online Target Manager
- 77. USING VUFORIA
- 78. Setting up a Vuforia Project • Register as Developer • Create a Project • Obtain a License Key • Add license key to AR Camera • Replace Main Camera with AR camera • Add Tracking Targets • Move ImageTarget into Scene • Add sample object to ImageTarget
- 79. Register as Developer • https://developer.vuforia.com/user/register
- 80. Create License Key • https://developer.vuforia.com/targetmanager/licenseManager/licenseListing
- 81. Obtain a License Key • Vuforia 5 apps utilize a license key that uniquely identifies each app. License keys are created in the License Manager • The steps to creating a new license key are.. • Choose a SDK • Choose a licensing option based on your requirements • Provide your Billing Information if you've chosen to use a paid license • Obtain your license Key
- 83. Add License Key to Vuforia Project • Open ARCamera Inspector in Vuforia • Assets -> Vuforia -> Prefabs • Move AR Camera to scene hierarchy (Delete Main Camera) • Paste License Key
- 84. Adding Tracking Targets • Create a target on the Target Manager • OR - Use existing targets from other projects
- 85. Which Type of Database • Device Database vs. Cloud Database? • Device: local, Cloud: online
- 86. Creating a Target • Create a database • Add targets
- 89. Loaded Image Target • Rating indicates how good a target • Download Dataset -> create unity package
- 90. Building the AR Application • Delete “Main Camera” in Scene Hierarchy • Drag ARCamera prefab in the Scene Hierarchy • Vuforia -. Prefabs -> AR Camera • Import tracking dataset package • Assets -> Import Package -> Custom Package • Drag ImageTarget prefab into Scene Hierarchy • Select ImageTarget, pick Data Set then Image Target • On AR Camera load target database and activate
- 92. Add 3D Content • As a test, create a simple Cube object • GameObject > Create Other > Cube • Add the cube as a child of the ImageTarget object by dragging it onto the ImageTarget item. • Move the cube until it is centered on the Image Target.
- 93. AR Test View
- 94. NEXT STEPS
- 95. Add more than one ImageTarget • Drag new ImageTargets onto hierarchy • Pick tracking pattern • Add 3D objects
- 96. Download 3D Assets • Open Asset Store in Unity (Window -> Asset Store) • Select free 3D model • Download asset into project panel • Move under ImageTarget, position and scale
- 97. Add Interactive Scripts • Install Vuforia samples • E.g. Virtual Buttons • Install VirtualButtons-5-0-6.unitypackage
- 98. Try Vuforia Samples • Object Recognition • Image Targets • Cylinder Targets • Multi Targets • User Defined Targets • Smart Terrain (Unity only) • Cloud Recognition • Text Recognition • Frame Markers • Virtual Buttons
- 100. APPLICATION • Unity • Creating the Application • Configure the export settings and build the Application 100
- 101. Building for Android • Open Build Settings • Change Target platform to Android • Switch Platform • Under Player Settings • Edit Bundle Identifier – eg com.UniSA.cubeTest • Minimum API level • Build and Run • Select .apk file name
- 102. RESOURCES
- 103. Resources • Vuforia Product Page https://www.qualcomm.com/products/vuforia • Vuforia Developer Page https://developer.vuforia.com • SDK Download Page https://developer.vuforia.com/downloads/sdk • Installing Vuforia for Unity extension http://developer.vuforia.com/library/articles/Solution/ Installing-the-Unity-Extension • Tutorials https://developer.vuforia.com/resources/tutorials