Occlusion in Outdoor Augmented Reality using Geospatial Building Data
Download as PPTX, PDF2 likes779 views
The document discusses the use of geospatial building data to improve occlusion in outdoor augmented reality (AR) environments, addressing challenges like real-time geometric model reconstruction. A proposed model-based method integrates this data to enable effective occlusion handling on non-depth sensing devices, resulting in enhanced user experiences. User tests indicate satisfaction with the occlusion handler, noting better depth perception and a more integrated experience of virtual and real objects.
![1. Query OpenStreetMap
{
"type": "way",
"id": 24968329,
"nodes": [
1406078451,
1863238948,
2554104722,
...
],
"tags": {
"building": "museum",
"building:colour": "brown",
"building:levels": "3",
"description": "Sweden's leading museum for art and
design.",
"name": "Nationalmuseum",
"name:en": "National Museum of Fine Arts",
"opening_hours": "Tu-We, Fr-Su 10:00-17:00; Th
10:00-20:00",
"roof:colour": "MediumAquamarine",
"source": "yahoo_imagery",
"tourism": "museum",
"website": "http://www.nationalmuseum.se",
"wheelchair": "yes",
"wikipedia": "sv:Nationalmuseum"
}
}
12](https://image.slidesharecdn.com/vrst2017kasperipicharomero-171109000940/85/Occlusion-in-Outdoor-Augmented-Reality-using-Geospatial-Building-Data-12-320.jpg)
Occlusion in Outdoor Augmented Reality using Geospatial Building Data
- 1. Occlusion in outdoor Augmented Reality using geospatial building data Johan Kasperi kasperi@kth.se Malin Picha Edwardsson picha@kth.se Mario Romero marior@kth.se
- 2. 2
- 3. The Contribution 3 False Occlusion Improved OcclusionOpenStreetMap
- 4. Augmented Reality “The ultimate goal will be to generate virtual objects that are so realistic that they are virtually indistinguishable from the real environment” - Ronald T Azuma 1997 Ronald T Azuma. 2016. The Most Important Challenge Facing Augmented Reality. PRESENCE: Teleoperators and Virtual Environments 21, 3 (2016). 4
- 5. Occlusion in Augmented Reality • Virtual objects always overlaying real ones • Real objects that are closer not in line-of-sight • Misleading experience Manisah Mohd Shah, Haslina Arshad, and Riza Sulaiman. 2012. Occlusion in augmented reality. In Information Science and Digital Content Technology (ICIDT), 2012 8th International Conference on, Vol. 2. IEEE, 372–378. 5
- 6. The challenge • Reconstruct the geometric model in current environment • Real-time • Two methods: Model- and depth-based David E Breen, Ross T Whitaker, Eric Rose, and Mihran Tuceryan. 1996. Interactive occlusion and automatic object placement for augmented reality. In Computer Graphics Forum, Vol. 15. Wiley Online Library, 11–22. 6
- 8. But AR applications look like this 8
- 9. Goals for the proposed solution • Functioning on regular non-depth sensing devices • Occlusion handling in outdoor urban dynamic environment • “Good enough” 9
- 10. Research question From a human-centric perspective, what are the results of occluding virtual 3D buildings with real world buildings using geospatial data in a dynamic outdoor urban Augmented Reality environment? 10
- 11. The proposed solution • Model-based method • Reconstructs the geometric model of the current environment with Geospatial data • Only buildings • Implemented on a sensor-based (GPS, gyroscope, magnetometer) AR application running on a non-depth sensing device. 11
- 12. 1. Query OpenStreetMap { "type": "way", "id": 24968329, "nodes": [ 1406078451, 1863238948, 2554104722, ... ], "tags": { "building": "museum", "building:colour": "brown", "building:levels": "3", "description": "Sweden's leading museum for art and design.", "name": "Nationalmuseum", "name:en": "National Museum of Fine Arts", "opening_hours": "Tu-We, Fr-Su 10:00-17:00; Th 10:00-20:00", "roof:colour": "MediumAquamarine", "source": "yahoo_imagery", "tourism": "museum", "website": "http://www.nationalmuseum.se", "wheelchair": "yes", "wikipedia": "sv:Nationalmuseum" } } 12
- 13. 1.1 Nodes { "type": "node", "id": 1863238950, "lat": 59.3285374, "lon": 18.0785740 } 13
- 14. 2. Create 2D polygon 14
- 15. 3. Create 3D model: levels x 3m 15
- 16. 4. Implement in the AR application • Add each occlusion model (building) to its geolocation • Make them transparent • Use depth buffering 16
- 17. Results – Visual effect 17
- 18. Results – User experience • 9 of 13 agreed that the occlusion handler was satisfying • 11 of 13 thought their experience was better with the occlusion handler activated • 12 of 13 thought they got a better depth perception • 9 of 13 agreed that they got an experience of the virtual content being more mixed with the real objects 18
- 19. Conclusions From a human-centric perspective, what are the results of occluding virtual 3D buildings with real world buildings using geospatial data in a dynamic outdoor urban Augmented Reality environment? • Reaches the goal for occlusion handlers • Issues with height and roof details • Pixel-perfection possibly not necessary • Can be good enough solution until more AR devices hits the market 19
- 20. Future research • Further develop the public database of geospatial data • Use other sources of geospatial data • Use solution with other tracking techniques • Same solution but for other physical simulations, for example shadowing or collisions 20
- 21. Occlusion in outdoor Augmented Reality using geospatial building data Johan Kasperi kasperi@kth.se Malin Picha Edwardsson picha@kth.se Mario Romero marior@kth.se