Light Field Photography Gordon Wetzstein Research Scientist MIT Media Lab . Camera Culture media.mit.edu/~gordonw slides: many talks & computational photography courses from Media Lab, CSAIL (Fredo Durand), Stanford (Marc Levoy)
Light Field Photography Gordon Wetzstein Research Scientist MIT
Media Lab . Camera Culture media.mit.edu/~gordonw slides: many
talks & computational photography courses from Media Lab, CSAIL
(Fredo Durand), Stanford (Marc Levoy)
Conventional Photo Large ApertureScene from Above
Conventional Photo Small ApertureScene from Above
Scene from Above Proposed Technology: Mask-Coded Light Field
Projection Coded Attenuation Mask
Scene from Above Light Field
Light FieldScene from Above
Scene from Above Applications: Image Refocus
Scene from Above Applications: Depth, Segmentation, Object
Recognition,
Scene from Above Applications: Change Viewpoint & 3D
Display e.g., Tensor Displays [Wetzstein et al. 2012]
Camera Arrays e.g., [Wilburn et al. 2002,2005] How is it done
today? Sequential Acquisition e.g., [Levoy and Hanrahan 1996],
[Liang et al. 2008]
Scene from Above Lenslet Array [Lippman 1908], [Adelson and
Wang 1992], [Ng et al. 2005] Integral Imaging # Sensor Pixels X
#SensorPixelsY
Scene from Above Integral Imaging
Scene from Above # Sensor Pixels X / # Views X
#SensorPixelsY/#ViewsY Example Sensor with 2000 x 1000 pixels 5 x 5
light field views, each with 400 x 200 pixels Integral Imaging:
Spatio-Angular Resolution Tradeoff!Spatio-Angular Resolution
Tradeoff!
Light Field is Redundant!Scene from Above
Exploit redundancy Compressive Reconstruction Key Insights
Light Field Atoms Sparsify Preserve information Mask-based Light
Field Coding