Light Field Photography Introduction
Download as PPTX, PDF2 likes2,761 views
This document discusses light field photography. Light field photography captures information about the direction that light rays travel in a scene, allowing effects like image refocusing and new viewpoints to be generated. Traditionally, light field information has been captured using lenslet arrays or camera arrays. The proposed technology discussed is mask-coded light field projection, which uses a coded attenuation mask to project structured light and sample the light field of a scene with a single sensor. Potential applications mentioned include image refocusing, depth estimation, segmentation, object recognition, and changing viewpoints or enabling 3D displays.
![Scene from
Above
Applications: Change Viewpoint & 3D Display
e.g., Tensor Displays [Wetzstein et al. 2012]](https://image.slidesharecdn.com/1introclass-130924104413-phpapp02/85/Light-Field-Photography-Introduction-10-320.jpg)
![Camera Arrays
e.g., [Wilburn et al. 2002,2005]
How is it done today?
Sequential Acquisition
e.g., [Levoy and Hanrahan 1996],
[Liang et al. 2008]](https://image.slidesharecdn.com/1introclass-130924104413-phpapp02/85/Light-Field-Photography-Introduction-11-320.jpg)
![Scene from
Above
Lenslet Array
[Lippman 1908], [Adelson and Wang 1992], [Ng et al. 2005]
Integral Imaging
# Sensor Pixels X
#SensorPixelsY](https://image.slidesharecdn.com/1introclass-130924104413-phpapp02/85/Light-Field-Photography-Introduction-13-320.jpg)
Light Field Photography Introduction
- 1. Light Field Photography Gordon Wetzstein Research Scientist MIT Media Lab . Camera Culture media.mit.edu/~gordonw slides: many talks & computational photography courses from Media Lab, CSAIL (Fredo Durand), Stanford (Marc Levoy)
- 2. Conventional Photo – Large ApertureScene from Above
- 3. Conventional Photo – Small ApertureScene from Above
- 5. Scene from Above Proposed Technology: Mask-Coded Light Field Projection Coded Attenuation Mask
- 8. Scene from Above Applications: Image Refocus
- 9. Scene from Above Applications: Depth, Segmentation, Object Recognition, …
- 10. Scene from Above Applications: Change Viewpoint & 3D Display e.g., Tensor Displays [Wetzstein et al. 2012]
- 11. Camera Arrays e.g., [Wilburn et al. 2002,2005] How is it done today? Sequential Acquisition e.g., [Levoy and Hanrahan 1996], [Liang et al. 2008]
- 13. Scene from Above Lenslet Array [Lippman 1908], [Adelson and Wang 1992], [Ng et al. 2005] Integral Imaging # Sensor Pixels X #SensorPixelsY
- 15. Scene from Above # Sensor Pixels X / # Views X #SensorPixelsY/#ViewsY Example Sensor with 2000 x 1000 pixels 5 x 5 light field views, each with 400 x 200 pixels Integral Imaging: Spatio-Angular Resolution Tradeoff!Spatio-Angular Resolution Tradeoff!
- 16. Light Field is Redundant!Scene from Above
- 17. Exploit redundancy Compressive Reconstruction Key Insights Light Field Atoms Sparsify Preserve information Mask-based Light Field Coding