light field photography introduction
DESCRIPTION
TRANSCRIPT
- Light Field Photography Gordon Wetzstein Research Scientist MIT Media Lab . Camera Culture media.mit.edu/~gordonw slides: many talks & computational photography courses from Media Lab, CSAIL (Fredo Durand), Stanford (Marc Levoy)
- Conventional Photo Large ApertureScene from Above
- Conventional Photo Small ApertureScene from Above
- Scene from Above Proposed Technology: Mask-Coded Light Field Projection Coded Attenuation Mask
- Scene from Above Light Field
- Light FieldScene from Above
- Scene from Above Applications: Image Refocus
- Scene from Above Applications: Depth, Segmentation, Object Recognition,
- Scene from Above Applications: Change Viewpoint & 3D Display e.g., Tensor Displays [Wetzstein et al. 2012]
- Camera Arrays e.g., [Wilburn et al. 2002,2005] How is it done today? Sequential Acquisition e.g., [Levoy and Hanrahan 1996], [Liang et al. 2008]
- Scene from Above Lenslet Array [Lippman 1908], [Adelson and Wang 1992], [Ng et al. 2005] Integral Imaging # Sensor Pixels X #SensorPixelsY
- Scene from Above Integral Imaging
- Scene from Above # Sensor Pixels X / # Views X #SensorPixelsY/#ViewsY Example Sensor with 2000 x 1000 pixels 5 x 5 light field views, each with 400 x 200 pixels Integral Imaging: Spatio-Angular Resolution Tradeoff!Spatio-Angular Resolution Tradeoff!
- Light Field is Redundant!Scene from Above
- Exploit redundancy Compressive Reconstruction Key Insights Light Field Atoms Sparsify Preserve information Mask-based Light Field Coding