COMP 4010 Lecture9 AR Displays
3 likes2,063 views
The document details augment reality (AR) technology, focusing on its definition, interactive characteristics, and various display technologies. It compares head-mounted displays (HMDs), optical and video see-through systems, and introduces spatial augmented reality with examples and advancements in AR displays. The discussion also includes various applications and considerations for different display methods and their implications in fields such as manufacturing and medicine.
![Augmented Reality Definition
• Defining Characteristics [Azuma 97]
• Combines Real andVirtual Images
• Both can be seen at the same time
• Interactive in real-time
• The virtual content can be interacted with
• Registered in 3D
• Virtual objects appear fixed in space
Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.](https://image.slidesharecdn.com/lecture9-artechnologynovideo2-161012194551/85/COMP-4010-Lecture9-AR-Displays-2-320.jpg)
COMP 4010 Lecture9 AR Displays
- 1. LECTURE 9: AR TECHNOLOGY: DISPLAYS AND TRACKING COMP 4010 – Virtual Reality Semester 5 – 2016 Bruce Thomas, Mark Billinghurst University of South Australia October 11th 2016
- 2. Augmented Reality Definition • Defining Characteristics [Azuma 97] • Combines Real andVirtual Images • Both can be seen at the same time • Interactive in real-time • The virtual content can be interacted with • Registered in 3D • Virtual objects appear fixed in space Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.
- 3. Augmented RealityTechnology ! Combining Real and Virtual Images • Display technologies ! Interactive in Real-Time • Input and interactive technologies ! Registered in 3D • Viewpoint tracking technologies Display Processing Input Tracking
- 4. AR DISPLAYS
- 5. Display Technologies ! Types (Bimber/Raskar 2003) ! Head attached • Head mounted display/projector ! Body attached • Handheld display/projector ! Spatial • Spatially aligned projector/monitor
- 8. Head Mounted Displays (HMD) • Display and Optics mounted on Head • May or may not fully occlude real world • Provide full-color images • Considerations • Cumbersome to wear • Brightness • Low power consumption • Resolution limited • Cost is high?
- 9. Types of Head Mounted Displays Occluded See-thru Multiplexed
- 10. ImmersiveVRArchitecture Head! Tracker Host! Processor Data Base! Model Rendering! Engine Frame! Buffer head position/orientation to network Display! Driver Non see- thru! Image source & optics virtual object Virtual World
- 11. See-thruARArchitecture Head! Tracker Host! Processor Data Base! Model Rendering! Engine Frame! Buffer head position/orientation to network Display! Driver see-thru! combiner Virtual Image superimpos ed! over real world object real world Image source
- 12. Optical see-through head-mounted display Virtual images from monitors Real World Optical Combiners
- 14. Epson Moverio BT-200 ▪ Stereo see-through display ($700) ▪ 960 x 540 pixels, 23 degree FOV, 60Hz, 88g ▪ Android Powered, separate controller ▪ VGA camera, GPS, gyro, accelerometer
- 15. ViewThrough Optical See-Through HMD
- 16. Strengths of optical see-throughAR • Simpler (cheaper) • Direct view of real world • Full resolution, no time delay (for real world) • Safety • Lower distortion • No eye displacement • but some video see-through displays avoid this
- 17. VideoARArchitecture Head! Tracker Host! Processor Graphics! renderer Digital! Mixer Frame! Buffer head position/orientation to network Display! Driver Non see- thru! Image source & optics Head- mounted camera aligned to display optics Video! Processor Video image of real world Virtual image inset into video of real world
- 20. Vuzix Wrap 1200DXAR ▪ Stereo video see-through display ($1500) ■ Twin 852 x 480 LCD displays, 35 deg. FOV ■ StereoVGA cameras ■ 3 DOF head tracking
- 21. ViewThrough aVideo See-Through HMD
- 22. Strengths ofVideo See-ThroughAR • True occlusion • Kiyokawa optical display that supports occlusion • Digitized image of real world • Flexibility in composition • Matchable time delays • More registration, calibration strategies • Wide FOV is easier to support
- 23. Optical vs.VideoAR Summary • Both have proponents • Video is more popular today? • Likely because lack of available optical products • Depends on application? • Manufacturing: optical is cheaper • Medical: video for calibration strategies
- 24. Eye multiplexedARArchitecture Head! Tracker Host! Processor Data Base! Model Rendering! Engine Frame! Buffer head position/orientation to network Display! Driver Virtual Image inset into! real world scene real world Opaque! Image source
- 25. Virtual Image‘inset’ into real
- 26. Google Glass
- 29. Vuzix M-100 ▪ Monocular multiplexed display ($1000) ■ 852 x 480 LCD display, 15 deg. FOV ■ 5 MP camera, HD video ■ GPS, gyro, accelerometer
- 30. DisplayTechnology • Curved Mirror • off-axis projection • curved mirrors in front of eye • high distortion, small eye-box • Waveguide • use internal reflection • unobstructed view of world • large eye-box
- 31. See-through thin displays • Waveguide techniques for thin see-through displays • Wider FOV, enable AR applications • Social acceptability Opinvent Ora Lumus DK40
- 33. SpatialAugmented Reality • Project onto irregular surfaces • Geometric Registration • Projector blending, High dynamic range • Book: Bimber, Rasker “Spatial Augmented Reality”
- 34. Projector-basedAR Examples: Raskar, MIT Media Lab Inami, Tachi Lab, U. Tokyo Projector Real objects with retroreflective covering User (possibly head-tracked)
- 35. Example of projector-basedAR Ramesh Raskar, UNC, MERL
- 36. Example of projector-basedAR Ramesh Raskar, UNC Chapel Hill
- 37. Head Mounted Projector • NVIS P-50 HMPD • 1280x1024/eye • Stereoscopic • 50 degree FOV • www.nvis.com
- 38. HMD vs.HMPD Head Mounted Display Head Mounted Projected Display
- 39. CastAR - http://technicalillusions.com/ • Stereo head worn projectors • Interactive wand • Rollable retro-reflective sheet
- 40. • Designed for shared interaction
- 42. Pico Projectors • Microvision - www.mvis.com • 3M, Samsung, Philips, etc
- 44. MIT Sixth Sense • Body worn camera and projector • http://www.pranavmistry.com/projects/sixthsense/
- 47. Video MonitorAR Video cameras Monitor Graphics Combiner Video Stereo glasses
- 48. Examples
- 49. Virtual Showcase • Mirrors on a projection table • Head tracked stereo • Up to 4 users • Merges graphic and real objects • Exhibit/museum applications • Fraunhofer Institute (2001) • Bimber, Frohlich
- 51. Augmented Paleontology Bimber et. al. IEEE Computer Sept. 2002
- 52. Alternate Displays LCD Panel Laptop PDA
- 54. OtherTypes ofAR Display • Audio • spatial sound • ambient audio • Tactile • physical sensation • Haptic • virtual touch
- 55. Haptic Input • AR Haptic Workbench • CSIRO 2003 – Adcock et. al.
- 56. Phantom • Sensable Technologies (www.sensable.com) • 6 DOF Force Feedback Device
- 57. AR Haptic Interface • Phantom,ARToolKit, Magellan