CR-Play INRIA engineer part (Capture Reconstruct and Play with Image Based Rendering)
1 like870 views
The document outlines an innovative mixed pipeline for video game development focused on various aspects such as capturing real-world data, image-based rendering (IBR), and video-based rendering (VBR). It details the roles of project team members, the technical requirements of IBR and VBR, and integration with the Unity3D engine. Additionally, it mentions formative evaluations, dissemination activities, and feedback mechanisms throughout the project phases.
![[1] Gaurav Chaurasia, Sylvain Duchêne, Olga Sorkine-Hornung, George Drettakis,
Depth Synthesis and Local Warps for Plausible Image-based Navigation,
ACM Transactions on Graphics, Volume 32, 2013
Details here: http://www-sop.inria.fr/reves/Basilic/2013/CDSD13/
WP2: Image Based Rendering framework : IBR_COMMON
https://youtu.be/YbQDC589eb0](https://image.slidesharecdn.com/cr-play-inria-engineer-part-150425192321-conversion-gate02/85/CR-Play-INRIA-engineer-part-Capture-Reconstruct-and-Play-with-Image-Based-Rendering-5-320.jpg)
CR-Play INRIA engineer part (Capture Reconstruct and Play with Image Based Rendering)
- 1. An innovative mixed pipeline for videogames development Sophia Antipolis Mai 2014 Technical contributions George Drettakis – INRIA – scientific project manager Jerome Esnault – INRIA – R&D engineer
- 2. WP1 Capture of real world data WP2 Image Based rendering (IBR) WP3 Video Based rendering (VBR) WP4 Design and Development (Requirements, Functional Specifications, Prototypes) WP5 Formative and Summative Evaluation WP6 Disseminatio n activities and Exploitation planning WP7 Management and coordination VBR Tech.Req.IBR Tech.Req.Req. Tools Feedback Results Results Feedback Results Feedback Feedback MVE Tech
- 3. Partners Involved Link IBR to MVE project Research collaborations Link IBR pipeline to Unity3D Engine Research collaborations
- 4. WP2: Image Based Rendering framework : IBR_COMMON
- 5. [1] Gaurav Chaurasia, Sylvain Duchêne, Olga Sorkine-Hornung, George Drettakis, Depth Synthesis and Local Warps for Plausible Image-based Navigation, ACM Transactions on Graphics, Volume 32, 2013 Details here: http://www-sop.inria.fr/reves/Basilic/2013/CDSD13/ WP2: Image Based Rendering framework : IBR_COMMON https://youtu.be/YbQDC589eb0
- 6. WP2: Image Based Rendering framework : IBR_COMMON
- 7. WP2: Image Based Rendering framework : IBR_COMMON
- 8. WP2: Image Based Rendering framework : IBR_COMMON
- 9. WP2: Image Based Rendering framework : IBR_COMMON
- 10. PMVS superpixel Depth synthesis Depth MVE Multi-View Algorithms Choose : Cameras parameters Undistorted images 3D point cloud Mesh Depth maps images Clipping planes Over segmented images Neighbors graph Improved depth maps Bundler VisualSFM Structure from motion Algorithms Choose : CLOUD (gforge) : - Update needed? - auto download Bundler package VisualSFM package PMVS package MVE package IBR package Pictures STEPS IBR dataset IBR dataset generation process (reconstruction tool) WP4: Integration and technical validation : IBR PRE-PROCESS
- 11. Load bundler Load images Load mesh Solver Rendering loop ShaderLab IBR Unity scripts components Depth data Superpixel data Solver structure IBR Unity binary plugin Unity game developper GUI editor IBR dataset WP4: Integration and technical validation : IBR RUNTIME
- 12. Final prototypes (IBR, VBR and a game which combine both). Realized with technical partners https://youtu.be/s90PaaOMW74