SlideShare a Scribd company logo
LECTURE 7:
MOBILE AR USING VUFORIA
Mark Billinghurst
mark.billinghurst@unisa.edu.au
Zi Siang See
zisiang@reina.com.my
November 29th-30th 2015
Mobile-Based Augmented Reality Development
Mobile AR Lecture 7 - Introduction to Vuforia
What you will learn
•  Introduction to Vuforia
•  Platform and features
•  How to install/set-up Vuforia
•  Vuforia Basics
•  Marker Tracking, Object tracking
•  Deploying to Mobile Device
•  Android, iOS
OVERVIEW
Vuforia Overview
•  Platform for Mobile Computer Vision
•  https://www.qualcomm.com/products/vuforia
•  Released by Qualcomm in 2010, acquired by PTC 2015
•  Used by over 100K developers, >10K applications
•  Main Features:
•  Recognition
•  Image, text, object recognition
•  Tracking
•  Image, marker, scene, object
Vuforia
•  Android	
  
•  iOS	
  
•  Unity	
  Extension	
  
Device	
  SDK	
  
•  Target	
  Management	
  System	
  	
  
•  App	
  Development	
  Guide	
  
•  Vuforia	
  Web	
  Services	
  
Tools	
  &	
  Services	
  
•  Dedicated technical
support engineers
•  Thousands of posts
Support	
  Forum	
  
Vuforia Features
Tracking Targets
Image
Object
Environment
Multiple Device and Tool Support
Developer Tools
Target Manager
Image Analysis Tools
Cloud Services
Platform Anatomy
User Experiences Enabled
INSTALLATION
Download Vuforia for Unity SDK
•  https://developer.vuforia.com/downloads/sdk
Download Samples
•  https://developer.vuforia.com/downloads/samples
Installing Vuforia Unity Extension
• Create new Unity Project
• Import the Vuforia Unity Extension
•  Double clicking the *.unitypackage file
•  Eg vuforia-unity-5-0-6.unitypackage
•  Manually install package
•  Assets -> Import Package -> Custom Package
• The extension archive will self install
•  folders, plugins and libraries, etc
Imported Vuforia Assets
Unity Asset Structure
•  Editor - Contains the scripts required to
interact with Target data in the Unity editor
•  Plugins - Contains Java and native binaries
that integrate the Vuforia AR SDK with the
Unity Android or Unity iOS application
•  Vuforia - Contains the prefabs and scripts
required to bring AR to your application
•  Streaming Assets / QCAR - Contains the
Device Database configuration XML and
DAT files from the online Target Manager
USING VUFORIA
Setting up a Vuforia Project
•  Create a Project
•  Replace Main Camera with AR camera
•  Obtain a License Key
•  Add license key to AR Camera
•  Add Tracking Targets
•  Add sample object
Register as Developer
•  https://developer.vuforia.com/user/register
Create License Key
•  https://developer.vuforia.com/targetmanager/licenseManager/licenseListing
Obtain a License Key
•  Vuforia 5 apps utilize a license key that uniquely identifies
each app. License keys are created in the License Manager
•  The steps to creating a new license key are..
•  Choose a SDK
•  Choose a licensing option based on your requirements
•  Provide your Billing Information if you've chosen to use a paid license
•  Obtain your license Key
License Key Generated
Add License Key to Vuforia Project
•  Open ARCamera Inspector in Vuforia
•  Assets -> Vuforia -> Prefabs
•  Move AR Camera to scene hierarchy (Delete Main Camera)
•  Paste License Key
Obtain a License Key
•  Vuforia 5 apps utilize a license key that uniquely identifies
each app. License keys are created in the License Manager
•  The steps to creating a new license key are..
•  Choose a SDK
•  Choose a licensing option based on your requirements
•  Provide your Billing Information if you've chosen to use a paid license
•  Obtain your license Key
Adding Tracking Targets
•  Create a target on the Target Manager
•  OR - Use existing targets from other projects
Which Type of Database
•  Device Database vs. Cloud Database?
•  Device: local, Cloud: online
Creating a Target
•  Create a database
•  Add targets
Selecting Target Type
Loaded Image Target
• Rating indicates how good a target
• Download Dataset -> create unity package
Building the AR Application
•  Delete “Main Camera” in Scene Hierarchy
•  Drag ARCamera prefab in the Scene Hierarchy
•  Vuforia -. Prefabs -> AR Camera
•  Import tracking dataset package
•  Assets -> Import Package -> Custom Package
•  Drag ImageTarget prefab into Scene Hierarchy
•  Select ImageTarget, pick Data Set then Image Target
•  On AR Camera load target database and activate
Running the Application
Add 3D Content
•  As a test, create a simple Cube object
•  GameObject > Create Other > Cube
•  Add the cube as a child of the ImageTarget object by
dragging it onto the ImageTarget item.
•  Move the cube until it is centered on the Image Target.
Cube Test
AR Test View
Sample Applications
•  Object Recognition
•  Image Targets
•  Cylinder Targets
•  Multi Targets
•  User Defined Targets
•  Smart Terrain (Unity only)
•  Cloud Recognition
•  Text Recognition
•  Frame Markers
•  Virtual Buttons
DEPLOYING TO MOBILE
APPLICATION
•  Unity
•  Creating the Application
•  Configure the export settings and build the Application
42
Building for Android
•  Open Build Settings
•  Change Target platform to Android
•  Switch Platform
•  Under Player Settings
•  Edit Bundle Identifier – eg com.UniSA.cubeTest
•  Minimum API level
•  Build and Run
•  Select .apk file name
RESOURCES
Resources
•  Vuforia Product Page
https://www.qualcomm.com/products/vuforia
•  Vuforia Developer Page
https://developer.vuforia.com
•  SDK Download Page
https://developer.vuforia.com/downloads/sdk
•  Installing Vuforia for Unity extension
http://developer.vuforia.com/library/articles/Solution/
Installing-the-Unity-Extension
•  Tutorials
https://developer.vuforia.com/resources/tutorials

More Related Content

PDF
Developing AR and VR Experiences with Unity
PDF
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration
PPTX
360 camera
PDF
Introduction to Interaction Design
PPTX
Unity 3d Basics
PDF
AR Assemblr edu
PDF
COMP 4010 Lecture5 VR Audio and Tracking
PDF
Raspberry Pi
Developing AR and VR Experiences with Unity
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration
360 camera
Introduction to Interaction Design
Unity 3d Basics
AR Assemblr edu
COMP 4010 Lecture5 VR Audio and Tracking
Raspberry Pi

What's hot (20)

PPT
Introduction-to-Unity.ppt
PDF
Comp4010 Lecture4 AR Tracking and Interaction
PDF
Native Augmented Reality: An Introduction to ARKit and ARCore
DOCX
AR with vuforia
PDF
Game Engine Architecture
PPTX
Virtual reality
PPTX
Mobile Augmented Reality
PDF
Mixed Reality
PPTX
Game Development with Unity
PPTX
Augmented Reality - the next big thing in mobile
PPTX
Augmented reality
PPTX
Augmented Reality Application - Final Year Project
PDF
Comp 4010 2021 - Snap Tutorial-1
PDF
Unity Introduction
PDF
Comp4010 lecture6 Prototyping
PDF
『ラブライブ!スクールアイドルフェスティバル ALL STARS』を支えるビルドパイプライン 〜より安定したサービス提供を目指して〜
PPT
Android Presentation
PDF
2022 COMP4010 Lecture 6: Designing AR Systems
PPTX
Android Operating System
PDF
The Basics of Unity - The Game Engine
Introduction-to-Unity.ppt
Comp4010 Lecture4 AR Tracking and Interaction
Native Augmented Reality: An Introduction to ARKit and ARCore
AR with vuforia
Game Engine Architecture
Virtual reality
Mobile Augmented Reality
Mixed Reality
Game Development with Unity
Augmented Reality - the next big thing in mobile
Augmented reality
Augmented Reality Application - Final Year Project
Comp 4010 2021 - Snap Tutorial-1
Unity Introduction
Comp4010 lecture6 Prototyping
『ラブライブ!スクールアイドルフェスティバル ALL STARS』を支えるビルドパイプライン 〜より安定したサービス提供を目指して〜
Android Presentation
2022 COMP4010 Lecture 6: Designing AR Systems
Android Operating System
The Basics of Unity - The Game Engine
Ad

Viewers also liked (20)

PDF
Mobile AR Lecture 5 - Location Based AR
PPT
Augmented Reality ppt
PPTX
Istvan Siklossy (Vuforia) What's Augmented? What's Reality?
PPTX
Introductory Augmented Reality in Unity with Android and Vuforia
PPTX
Overview Augmeted Reality with Vuforia SDK presented at Wayra Webimar.
PDF
Building a Vuforia App for Hololens
PDF
Vuforia
PDF
Building AR and VR Experiences
PPTX
Augmented reality
PPT
AR - Augmented Reality
PDF
Fifty Shades of Augmented Reality: Creating Connection Using AR
PDF
Hands-On with the Qualcomm Vuforia Mobile Vision Platform (Beginning tutorial)
PPTX
The Present & Future of Augmented Reality + How to make your first AR app
PPTX
Developing Hybrid Applications with IONIC
ODP
Lucio Grenzi - Use Ionic framework to develop mobile application
PDF
Mobile Augmented Reality Using junaio
PPTX
Augmented Reality Application Tutorial for Education 2
PDF
Wearable Computing 시대, 플랫폼으로서의 AR(증강현실)의 비전
PPTX
презентация Solution box2 (на generations)
PPTX
Дополненная реальность
Mobile AR Lecture 5 - Location Based AR
Augmented Reality ppt
Istvan Siklossy (Vuforia) What's Augmented? What's Reality?
Introductory Augmented Reality in Unity with Android and Vuforia
Overview Augmeted Reality with Vuforia SDK presented at Wayra Webimar.
Building a Vuforia App for Hololens
Vuforia
Building AR and VR Experiences
Augmented reality
AR - Augmented Reality
Fifty Shades of Augmented Reality: Creating Connection Using AR
Hands-On with the Qualcomm Vuforia Mobile Vision Platform (Beginning tutorial)
The Present & Future of Augmented Reality + How to make your first AR app
Developing Hybrid Applications with IONIC
Lucio Grenzi - Use Ionic framework to develop mobile application
Mobile Augmented Reality Using junaio
Augmented Reality Application Tutorial for Education 2
Wearable Computing 시대, 플랫폼으로서의 AR(증강현실)의 비전
презентация Solution box2 (на generations)
Дополненная реальность
Ad

Similar to Mobile AR Lecture 7 - Introduction to Vuforia (20)

PDF
Mobile AR Tutorial
PDF
Building VR Applications For Google Cardboard
PPTX
How to build a serverless helmet detection system
PPTX
Augmented Reality based Product Identification and Advertising System - Final...
PPTX
Mobile AR SDK Tutorial - Augmented World Expo New York 2014
PDF
Cardboard VR: Building Low Cost VR Experiences
PDF
7.imaging on windows phone
PDF
Cordova Tutorial
PPTX
NIC - Windows Azure Pack - Level 300
PDF
March 2014 Meetup - Nokia X Tech Session
PPTX
Deploying Cloud ServicesDeploying Cloud Services.pptx
PPTX
Kåre Rude Andersen - Create a scombot – automate and monitor azure
PDF
Create Your Own VR Experience
PDF
Developing VR Experiences with Unity
PDF
Open Source Tools for Container Security and Compliance @Docker LA Meetup 2/13
PDF
Widgets neil
PPTX
Canada DevOps Summit 2020 Presentation Nov_03_2020
PDF
Leveraging Microsoft Azure for Next Gen App Development
PDF
Best Practices in Enterprise Video and Digital Asset Management
PDF
Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
Mobile AR Tutorial
Building VR Applications For Google Cardboard
How to build a serverless helmet detection system
Augmented Reality based Product Identification and Advertising System - Final...
Mobile AR SDK Tutorial - Augmented World Expo New York 2014
Cardboard VR: Building Low Cost VR Experiences
7.imaging on windows phone
Cordova Tutorial
NIC - Windows Azure Pack - Level 300
March 2014 Meetup - Nokia X Tech Session
Deploying Cloud ServicesDeploying Cloud Services.pptx
Kåre Rude Andersen - Create a scombot – automate and monitor azure
Create Your Own VR Experience
Developing VR Experiences with Unity
Open Source Tools for Container Security and Compliance @Docker LA Meetup 2/13
Widgets neil
Canada DevOps Summit 2020 Presentation Nov_03_2020
Leveraging Microsoft Azure for Next Gen App Development
Best Practices in Enterprise Video and Digital Asset Management
Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop

More from Mark Billinghurst (20)

PDF
Empathic Computing: Creating Shared Understanding
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Rapid Prototyping for XR: Lecture 6 - AI for Prototyping and Research Directi...
PDF
Rapid Prototyping for XR: Lecture 5 - Cross Platform Development
PDF
Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
PDF
Rapid Prototyping for XR: Lecture 3 - Video and Paper Prototyping
PDF
Rapid Prototyping for XR: Lecture 2 - Low Fidelity Prototyping.
PDF
Rapid Prototyping for XR: Lecture 1 Introduction to Prototyping
PDF
Research Directions in Heads-Up Computing
PDF
IVE 2024 Short Course - Lecture18- Hacking Emotions in VR Collaboration.
PDF
IVE 2024 Short Course - Lecture13 - Neurotechnology for Enhanced Interaction ...
PDF
IVE 2024 Short Course Lecture15 - Measuring Cybersickness
PDF
IVE 2024 Short Course - Lecture14 - Evaluation
PDF
IVE 2024 Short Course - Lecture12 - OpenVibe Tutorial
PDF
IVE 2024 Short Course Lecture10 - Multimodal Emotion Recognition in Conversat...
PDF
IVE 2024 Short Course Lecture 9 - Empathic Computing in VR
PDF
IVE 2024 Short Course - Lecture 8 - Electroencephalography (EEG) Basics
PDF
IVE 2024 Short Course - Lecture16- Cognixion Axon-R
PDF
IVE 2024 Short Course - Lecture 2 - Fundamentals of Perception
PDF
Research Directions for Cross Reality Interfaces
Empathic Computing: Creating Shared Understanding
Reach Out and Touch Someone: Haptics and Empathic Computing
Rapid Prototyping for XR: Lecture 6 - AI for Prototyping and Research Directi...
Rapid Prototyping for XR: Lecture 5 - Cross Platform Development
Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
Rapid Prototyping for XR: Lecture 3 - Video and Paper Prototyping
Rapid Prototyping for XR: Lecture 2 - Low Fidelity Prototyping.
Rapid Prototyping for XR: Lecture 1 Introduction to Prototyping
Research Directions in Heads-Up Computing
IVE 2024 Short Course - Lecture18- Hacking Emotions in VR Collaboration.
IVE 2024 Short Course - Lecture13 - Neurotechnology for Enhanced Interaction ...
IVE 2024 Short Course Lecture15 - Measuring Cybersickness
IVE 2024 Short Course - Lecture14 - Evaluation
IVE 2024 Short Course - Lecture12 - OpenVibe Tutorial
IVE 2024 Short Course Lecture10 - Multimodal Emotion Recognition in Conversat...
IVE 2024 Short Course Lecture 9 - Empathic Computing in VR
IVE 2024 Short Course - Lecture 8 - Electroencephalography (EEG) Basics
IVE 2024 Short Course - Lecture16- Cognixion Axon-R
IVE 2024 Short Course - Lecture 2 - Fundamentals of Perception
Research Directions for Cross Reality Interfaces

Recently uploaded (20)

PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
Big Data Technologies - Introduction.pptx
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
Cloud computing and distributed systems.
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPT
Teaching material agriculture food technology
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Electronic commerce courselecture one. Pdf
PDF
Approach and Philosophy of On baking technology
PDF
Encapsulation theory and applications.pdf
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Spectral efficient network and resource selection model in 5G networks
Understanding_Digital_Forensics_Presentation.pptx
Network Security Unit 5.pdf for BCA BBA.
Big Data Technologies - Introduction.pptx
Mobile App Security Testing_ A Comprehensive Guide.pdf
Advanced methodologies resolving dimensionality complications for autism neur...
Encapsulation_ Review paper, used for researhc scholars
Cloud computing and distributed systems.
Digital-Transformation-Roadmap-for-Companies.pptx
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Teaching material agriculture food technology
Dropbox Q2 2025 Financial Results & Investor Presentation
20250228 LYD VKU AI Blended-Learning.pptx
“AI and Expert System Decision Support & Business Intelligence Systems”
Electronic commerce courselecture one. Pdf
Approach and Philosophy of On baking technology
Encapsulation theory and applications.pdf
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
How UI/UX Design Impacts User Retention in Mobile Apps.pdf

Mobile AR Lecture 7 - Introduction to Vuforia

  • 1. LECTURE 7: MOBILE AR USING VUFORIA Mark Billinghurst mark.billinghurst@unisa.edu.au Zi Siang See zisiang@reina.com.my November 29th-30th 2015 Mobile-Based Augmented Reality Development
  • 3. What you will learn •  Introduction to Vuforia •  Platform and features •  How to install/set-up Vuforia •  Vuforia Basics •  Marker Tracking, Object tracking •  Deploying to Mobile Device •  Android, iOS
  • 5. Vuforia Overview •  Platform for Mobile Computer Vision •  https://www.qualcomm.com/products/vuforia •  Released by Qualcomm in 2010, acquired by PTC 2015 •  Used by over 100K developers, >10K applications •  Main Features: •  Recognition •  Image, text, object recognition •  Tracking •  Image, marker, scene, object
  • 6. Vuforia •  Android   •  iOS   •  Unity  Extension   Device  SDK   •  Target  Management  System     •  App  Development  Guide   •  Vuforia  Web  Services   Tools  &  Services   •  Dedicated technical support engineers •  Thousands of posts Support  Forum  
  • 9. Multiple Device and Tool Support
  • 17. Download Vuforia for Unity SDK •  https://developer.vuforia.com/downloads/sdk
  • 19. Installing Vuforia Unity Extension • Create new Unity Project • Import the Vuforia Unity Extension •  Double clicking the *.unitypackage file •  Eg vuforia-unity-5-0-6.unitypackage •  Manually install package •  Assets -> Import Package -> Custom Package • The extension archive will self install •  folders, plugins and libraries, etc
  • 21. Unity Asset Structure •  Editor - Contains the scripts required to interact with Target data in the Unity editor •  Plugins - Contains Java and native binaries that integrate the Vuforia AR SDK with the Unity Android or Unity iOS application •  Vuforia - Contains the prefabs and scripts required to bring AR to your application •  Streaming Assets / QCAR - Contains the Device Database configuration XML and DAT files from the online Target Manager
  • 23. Setting up a Vuforia Project •  Create a Project •  Replace Main Camera with AR camera •  Obtain a License Key •  Add license key to AR Camera •  Add Tracking Targets •  Add sample object
  • 24. Register as Developer •  https://developer.vuforia.com/user/register
  • 25. Create License Key •  https://developer.vuforia.com/targetmanager/licenseManager/licenseListing
  • 26. Obtain a License Key •  Vuforia 5 apps utilize a license key that uniquely identifies each app. License keys are created in the License Manager •  The steps to creating a new license key are.. •  Choose a SDK •  Choose a licensing option based on your requirements •  Provide your Billing Information if you've chosen to use a paid license •  Obtain your license Key
  • 28. Add License Key to Vuforia Project •  Open ARCamera Inspector in Vuforia •  Assets -> Vuforia -> Prefabs •  Move AR Camera to scene hierarchy (Delete Main Camera) •  Paste License Key
  • 29. Obtain a License Key •  Vuforia 5 apps utilize a license key that uniquely identifies each app. License keys are created in the License Manager •  The steps to creating a new license key are.. •  Choose a SDK •  Choose a licensing option based on your requirements •  Provide your Billing Information if you've chosen to use a paid license •  Obtain your license Key
  • 30. Adding Tracking Targets •  Create a target on the Target Manager •  OR - Use existing targets from other projects
  • 31. Which Type of Database •  Device Database vs. Cloud Database? •  Device: local, Cloud: online
  • 32. Creating a Target •  Create a database •  Add targets
  • 34. Loaded Image Target • Rating indicates how good a target • Download Dataset -> create unity package
  • 35. Building the AR Application •  Delete “Main Camera” in Scene Hierarchy •  Drag ARCamera prefab in the Scene Hierarchy •  Vuforia -. Prefabs -> AR Camera •  Import tracking dataset package •  Assets -> Import Package -> Custom Package •  Drag ImageTarget prefab into Scene Hierarchy •  Select ImageTarget, pick Data Set then Image Target •  On AR Camera load target database and activate
  • 37. Add 3D Content •  As a test, create a simple Cube object •  GameObject > Create Other > Cube •  Add the cube as a child of the ImageTarget object by dragging it onto the ImageTarget item. •  Move the cube until it is centered on the Image Target.
  • 40. Sample Applications •  Object Recognition •  Image Targets •  Cylinder Targets •  Multi Targets •  User Defined Targets •  Smart Terrain (Unity only) •  Cloud Recognition •  Text Recognition •  Frame Markers •  Virtual Buttons
  • 42. APPLICATION •  Unity •  Creating the Application •  Configure the export settings and build the Application 42
  • 43. Building for Android •  Open Build Settings •  Change Target platform to Android •  Switch Platform •  Under Player Settings •  Edit Bundle Identifier – eg com.UniSA.cubeTest •  Minimum API level •  Build and Run •  Select .apk file name
  • 45. Resources •  Vuforia Product Page https://www.qualcomm.com/products/vuforia •  Vuforia Developer Page https://developer.vuforia.com •  SDK Download Page https://developer.vuforia.com/downloads/sdk •  Installing Vuforia for Unity extension http://developer.vuforia.com/library/articles/Solution/ Installing-the-Unity-Extension •  Tutorials https://developer.vuforia.com/resources/tutorials