2008 brokerage 03 scalable 3 d models [compatibility mode]
1 like319 views
1) There is a trend towards capturing and modeling massive 3D environments and dynamic 4D scenes for applications like virtual worlds, games, and navigation systems. 2) Acquiring and processing large amounts of 3D data poses challenges for technologies related to acquisition, editing, transmission, rendering and presentation as the scale increases. 3) The document discusses various methods for large-scale 3D acquisition including structure from motion, stereo vision, LIDAR, structured light scanning, as well as challenges in editing, streaming, and rendering massive 3D models.
2008 brokerage 03 scalable 3 d models [compatibility mode]
- 1. Scaleable 3D models Luc Van Gool
- 2. Large-scale 3D modeling Clear trend towards ever more massive 3D models, and dynamic capture (4D) SecondLife, Google Earth, games like the Runaway, 3D navigation systems, Digital 3D Cartography (AGIV), digitalisation of museum content (EDL), … Developers of acquisition, editing, transmission, rendering, and presentation technologies are struggling to match Problem is huge, as massive, high-quality modelling also requires bridging the infamous semantic gap
- 3. Large-scale 3D modeling ACQUISITION
- 4. 3D acquisition taxonomy 3D acquisition methods passive active uni-directional multi-directional uni-directional multi-directional Shape-from Stereo LIDAR Line scanning - texture Structured light - contour Str. from motion - silhouettes Photom. stereo - defocus - shading
- 5. 3D acquisition taxonomy 3D acquisition methods passive active uni-directional multi-directional uni-directional multi-directional Shape-from Stereo LIDAR Line scanning - texture Structured light - contour Str. from motion - silhouettes Photom. stereo - defocus - shading
- 6. Underlying principles Structure from motion TRIANGULATION Structured light LIDAR TIME-OF-FLIGHT
- 7. Stereo The underlying principle is “triangulation” :
- 8. Active triangulation Triangulation 3D measurements Camera Projector 8
- 9. Active triangulation Camera image
- 10. Active triangulation Need for registration... Has to be automatic for large-scale work
- 11. Time-of-flight Cyrax Distance = C x T ÷2
- 12. Time-of-flight Cyrax Laser sweeps over surface No correspondences needed
- 13. Large-scale 3D capture Speed becomes essential … fast calculations (e.g. helped by GPU) … but also easy setup and data capture Increasingly systems that are based on comsumer HW … and intelligent modeling tools … and automatic data capture
- 14. 3D acquisition / structure-from-motion Tracking Dense 3D and depth surface Calibration estimation modeling Points and cameras Depth map 3D models
- 15. 3D acquisition / structure-from-motion Shape from Video (KUL)
- 16. 3D acquisition / structure-from-motion Shape from Stills (KUL)
- 17. ARC – Free 3D webservice ARC Automatic Reconstruction Conduit non-commercial use is free www.arc3d.be
- 19. Use in movies / e.g. King Arthur (2003) Dublin: The Hollywood Valley (Eyetronics) 19
- 20. Use in movies / e.g. King Arthur (2003) Area B 20
- 21. Use in movies / e.g. King Arthur (2003) Combined areas 21
- 22. Use in movies / e.g. King Arthur (2003)
- 23. Use in movies / e.g. King Arthur (2003)
- 24. 3D acquisition / structured light One-shot ShapeCam
- 25. 3D acquisition / structured light Jackie Chan Latest RushHour Movie (Eyetronics)
- 26. 3D acquisition / structured light MLB 1200 players for gaming (Eyetronics)
- 27. 3D acquisition / structured light MLB 1200 players for gaming (Eyetronics)
- 28. 3D acquisition / structured light MLB 1200 players for gaming (Eyetronics)
- 29. 4D acquisition / structured light 3D snapshots in fast succession (KUL)
- 30. 4D acquisition / structured light (KUL & ETH Zurich) 30
- 31. 4D acquisition / structured light Real-time 3D extraction, incl. texture (KUL & ETH Zurich)
- 32. 3D acquisition / structured light
- 33. LIDAR Chevron hydrocarbon plant
- 34. LIDAR Cyrax / Leica
- 35. LIDAR
- 36. Large-scale 3D modeling EDITING / REPRESENTATION
- 37. LIDAR (Cyrax / Leica)
- 38. LIDAR
- 39. 39
- 40. LIDAR 400’x500’ area 10 vessels; 5 pumps 6,000 objects 81 scans from 30 tripod locations Cyrax field time = 50 hrs
- 41. Measuring for cartographic surveying Large-scale 3D measurements Efficiency of the interface !
- 42. Procedural modeling Modeling using rules from a style-specific shape grammar (ETH Zurich & Procedural)
- 43. Large-scale 3D modeling STREAMING / RENDERING
- 44. QoS • Bandwith of channel and type of platform! • Local, over network, wireless, ...? • PC cluster, PC, PDA, mobile phone, ...? • Level-of-Detail mechanisms • Compact representations • Exploit differential sensitivity HVS • 3D meshes or... point splashing, IBR, ...?
- 45. A4MC3 WIFI connected community with PDAs (EDM, IMEC, VUB)
- 46. MobiComp (Un. Kent & Bologna )
- 47. MeshGrid A scalable coding scheme for 3D models that: • enables progressive transmission • offers quality, resolution scalability and region-of-interest coding • guarantees a minimum distortion at any bit-rate • provides resilience against transmission errors
- 48. MeshGrid A MeshGrid model consists of a connectivity-wireframe (CW) and a reference-grid (RG) that acts as the reference-system (RS) of the model.
- 49. MeshGrid G2 G2 V V G1 G1 Vertex offset is a relative value: Update vertex position when uuuu r G1V grid is deformed or animated: offset = uuuuu , with offset ∈ [0,1) r uuuu uuuuu r r G1G2 G1V = G1G2 offset
- 50. MeshGrid Scalability, Regions Of Interest Coding Volumetric Morphing Volumetric Animation (a) (b) (c)
- 51. Image-based Rendering (KUL) (Un. Bonn) (EDM) 51
- 52. Large-scale 3D modeling PRESENTATION
- 53. Blue-C project Shuttered Walls & Synchronized Cameras walls opaque – walls transparent – no acquisition, projection acquisition, no projection (ETH Zurich)
- 54. Blue-C project
- 56. Towards holistic vision – 3D & recognition 56