Learning The Rules to Break Them: Designing for the Future of VR
- 1. Learning the Rules to Break Them Designing for the Future of VR Mike Harris Immersive Technologies Developer CrossComm www.crosscomm.com mikeharris@crosscomm.com @harris_in_nola Note: This deck is being turned into a multi- part series filmed in VR. For updates, subscribe to: https://bit.ly/2SjDP8j
- 2. “One of the symptoms of an approaching nervous breakdown is the belief that one's work is terribly important.” - Bertrand Russell
- 3. Primary Sources Cardboard Design Lab Oculus VR Best Practices Google Designing for Google Cardboard Publishing Google VR Apps Daydream Elements: Foundational VR Design Microsoft Design for Mixed Reality Unity VR Best Practice Unreal Virtual Reality Best Practices Mike Alger - VR Interface Design Pre-Visualisation Methods Designing Screen Interfaces for VR (Google I/O ‘17) Intel Guidelines for Immersive Virtual Reality Experiences 3D User Interfaces for Virtual Reality and Games: 3D Selection, Manipulation, and Spatial Navigation: Siggraph 2018 Course Notes Samsung: VR Design: Transitioning from a 2D to 3D Design Paradigm
- 14. Oculus Rift HTC Vive Windows Mixed Reality Gear VR Lenovo Mirage Oculus GO Google Daydream Google Cardboard
- 15. DoF = Degrees of Freedom 3DoF v. 6DoF 6DoF = Rotation and Position3DoF = Rotation Only
- 16. 6DoF3DoF Oculus Rift HTC Vive Windows Mixed RealityGear VR Lenovo Mirage Oculus GO Google Daydream Google Cardboard
- 17. • Gaze based – Based on where the user is looking • Single 3DoF controller – One hand, rotation only • Dual 6DoF controller – Two hands, rotation and position VR Input
- 18. Gaze-Based
- 19. 3 DoF Controllers 3DoF Controllers Oculus Go Gear VR Google Daydream
- 20. 3DoF Controllers
- 21. 3 DoF Controller Tracking to real life comparison
- 22. 6 DoF Controllers Trigger Grip 2-Axis TriggerGrip 2-Axis Trigger Grip 2-Axis Oculus Rift HTC Vive Windows Mixed Reality
- 24. Mobile vs. PC tethered Refresh rates differ 60Hz/72Hz/90Hz/120Hz Missed Frames = Judder Performance =
- 25. Performance Sacrifices • Post Processing Effects • Shadows • HDR Rendering • Transparency • Textures • Shader Complexity • Physics • Number of Visible Objects • Complexity of 3D Geometry • UI Complexity VR Input
- 26. VR in 2019 Standalone 6DoF + Dual 6DoF Controllers
- 27. Spatial Design
- 28. Vergence Accommodation Vergence Accommodation Conflict
- 30. Vergence Accommodation Conflict Be Cognizant of Depth: • Avoid forcing users to switch between near/far object repeatedly • Avoid forcing users to track objects moving towards/away from them for extended periods • Depth budget? • What is the ideal depth for VR content?
- 31. Vergence Accommodation Conflict • < 0.5M Avoid Placing Objects Here • 1M – 5M Ideal Depth for 3D Objects • > 20M Depth Perception Falls Off
- 32. Monocular Depth Cues Parallax Motion
- 36. Distance Fog Monocular Depth Cues
- 37. Texture Scaling Monocular Depth Cues
- 38. Monocular Depth Cues Horizon Proximity
- 39. Monocular Depth Cues Parallax Motion Perspective Relative/Familiar/Absolute Size Occlusion Distance Fog Texture Scaling Horizon Proximity
- 40. Seated VR vs. Standing VR
- 44. Standing VR
- 46. User Responsive Design Oculus - OVRBoundary.GetGeometry() SteamVR - SteamVR_PlayArea.GetBounds() WMR - UnityEngine.Experimental.XR.Boundary.TryGetGeometry()
- 48. Audio
- 49. Audio
- 50. Audio
- 51. Audio
- 52. Audio
- 53. Haptic Feedback
- 54. Haptic Feedback
- 55. Haptic Feedback
- 57. Interaction
- 58. Interfaces
- 59. Interfaces
- 60. Occlusion and Depth Cue Conflicts Interfaces
- 61. Interfaces Occlusion and Depth Cue Conflicts Occlusion and Depth Cue Conflicts
- 62. Interfaces Occlusion and Depth Cue Conflicts Occlusion and Depth Cue Conflicts
- 63. • Cardboard Design Lab: • .5 meters is range for comfortable closeness, but still hard to read UI • 1 meter is the minimum range for comfortable UI • 3 meters is suggested • Oculus VR Best Practices: • Objects that you know the user will be fixating their eyes on for an extended period of time (e.g., a menu, an object of interest in the environment) should be rendered at least 0.5 meters away. Many have found that 1 meter is a comfortable distance for menus and GUIs that users may focus on for extended periods of time. • Microsoft: • For maximum comfort, the optimal zone for hologram placement is between 1.25m and 5m. In every case, designers should attempt to structure content scenes to encourage users to interact 1m or farther away from the content • Designing Screen Interfaces for VR (Google I/O '17): • 2.5 meter for main Content, 2.25 meter for navigation elements. Interfaces 1M 5M 1M 5M
- 64. Interfaces
- 65. Interfaces
- 66. Font and Symbol Sizing Interfaces Designing Screen Interfaces for VR - Google I/O 2017
- 68. DMM = Distance-independent Millimeter Interfaces 1 DMM = 1mm at 1M 1 DMM = 20mm at 20M 1 DMM = .5mm at .5M
- 69. Interfaces
- 70. Current VR Headset 10-20 pixels per degree Human Retina 60 pixels per degree Interfaces
- 71. Interfaces
- 73. Interfaces
- 74. Input
- 75. Interfaces “Gorilla Arm” Copyright 20th Century Fox, DreamWorks Pictures, Amblin Entertainment, Blue Tulip Productions
- 76. Input Reticles
- 77. Input
- 78. Input
- 79. • Smooth out controller shaking • Magnetism • Stickiness • Postdating User Input Input Improving Accuracy
- 81. Input
- 84. Let Users Throw Things!
- 85. Throwing Can be Tricky
- 86. Grabbing
- 91. Motion-Induced VR Sickness • Sensory Conflict – “Brain is expecting one type of input, but getting something different.” • Postural Instability – “Information we need to properly maintain balance is missing/incorrect.” • Vestibulo-Ocular Reflex – “Feedback loop between eye muscles and inner ear is disrupted.” • Poison Theory – “Incorrect inner ear signals is typically associated with poisoning, so we should vomit to be safe.” Vestibular System vs. Visual System
- 95. Vection
- 96. Vection
- 99. Early Lessons • Always Maintain Head Tracking • No Zoom, Blur, Screen-Shake, or Artificial Head-Bob • No Traditional Mouse & Keyboard or Gamepad Locomotion (especially smooth rotation) • Acceleration is Worse than Constant Velocity • Rotational Acceleration is Worse than Linear • Rhythmic Acceleration is Worse than Constant UPSHOT: Avoid artificial movement. If you must move the user, use constant velocities and (near)instantaneous acceleration
- 100. Room Scale VR
- 102. Teleportation
- 103. Teleportation
- 104. Teleportation
- 105. Teleportation
- 106. Teleportation
- 107. Teleportation Problems • Disorientation (especially with rotation change) • Loss of Immersion/presence • Tedious (especially over long distances)
- 108. Artificial Movement
- 109. Artificial Movement
- 110. Artificial Movement
- 111. Artificial Movement
- 112. Artificial Movement
- 113. Artificial Movement
- 114. Proprioception = Signals from Muscles and Joints Proprioception
- 116. Proprioception
- 117. Proprioception
- 118. Advice for Designing Locomotion: • Users have different levels of sensitivity • Sensitivity tends to decrease over time • Test often and with a variety of users • Provide comfort options
- 119. Comfort Options
- 120. Comfort Options
- 121. Comfort Options
- 122. Comfort Options
- 123. • Snap Turns • Stable Frame of Reference • FOV Narrowing During Motion • Stabilizing Grid • Consider Leaving On by Default Comfort Options
- 124. Learning the Rules to Break Them Designing for the Future of VR Mike Harris Immersive Technologies Developer CrossComm www.crosscomm.com mikeharris@crosscomm.com @harris_in_nola