What's my geometry?
- 1. What’s my geometry? Putting more reality into your AR. James Bryan Graves Mobile Applications Developer at Sogeo Company jamesbryangraves@gmail.com Twitter: @jbryangraves
- 2. Today • Most AR relies on existing data to be present (or queried for) at the scene. • Most common, in the mobile space anyway, is geographic data including latitude, longitude, heading and altitude. • Input: GPS and accelerometer sensors. • Output: some rendering over a camera view
- 3. Output: OpenGL ES Model of geographic data
- 4. Enable AR geometry interaction with picking • Picking is the translation of screen coordinates into 3D world space points.
- 5. What’s wrong with this picture? • Although this is a completely valid use case: “Walk toward this spot.” • It’s misleading in other use cases. The spot is not on my window sill!
- 6. Tomorrow • Marker/Pattern based recognition • Has been in R&D, but Apple is now officially allowing access to raw camera pixels with iPhone OS4, just like Android had all along. • Markers provide projection and geometry data • Software still requires existing data to be present at the location. Specifically knowledge about markers.
- 7. So. . .what about the data after tomorrow? • Realtime analysis of the geometry of the real world for more realistic augmentations.
- 8. this becomes this
- 9. How?
- 10. Clouds of the mushroom kingdom (2.5D) NES SNES move at the same rate as move slower than the the foreground foreground, on their own layer
- 11. What’s have to do with AR? • The cloud layer suggests a projection matrix in Mario’s reality.
- 12. Stereographic Images • It’s why you have 2 eyes • Using 2 camera to produce 3D images is technology that has been around since the 1800’s • Hollywood is now capitalizing on it
- 13. But mobile phones only have one camera. . .
- 14. So sample. . . Keyframe 1 Keyframe 2
- 16. Already with 2 images, 6 points and 2 planes we have some reasonable geometry with which to construct a projection matrix.
- 17. Why is this cool? • No need to rely on markers for 3D model placement • Users can pick objects in reality just like they can pick AR objects • Geometry adds additional contextual information for data queries.
- 18. Thanks! James Bryan Graves Mobile Applications Developer at Sogeo Company jamesbryangraves@gmail.com Twitter: @jbryangraves