compressive light field projection @ siggraph 2014

38
A Compressive Light Field Projection System Matthew Hirsch 1* Gordon Wetzstein 1,2* Ramesh Raskar 1 1 MIT Media Lab 2 now at Stanford University * equal contribution

Upload: stanfordcomputationalimaging

Post on 14-Jun-2015

5.111 views

Category:

Technology


0 download

DESCRIPTION

A compressive approach to light field synthesis with projection devices. We propose a novel, passive screen design that is combined with high-speed light field projection and nonnegative light field factorization. We demonstrate that the projector can alternatively achieve super-resolved and high dynamic range 2D image display when used with a conventional screen.

TRANSCRIPT

  • 1. A Compressive Light Field Projection System Matthew Hirsch1* Gordon Wetzstein1,2* Ramesh Raskar1 1MIT Media Lab 2now at Stanford University *equal contribution

2. Raskar et al. 1998 3. 3D Theaters Specialized Glasses Specialized Projector Specialized Screen 4. Projector 5. Glasses Free 3D Theaters Cyclostereoscope, France, 1940-50s Seymon Palovich Ivanov, Russia, 1935 Inventors & Filmmakers, 1950s 6. Mechanical Movement Bogaert et al. 2010Cossairt et al. 2005 7. Multi-projector Glasses Free 3D USC ICT SIGGRAPH 2013 ETech Holografika 8. Anatomy of a Projector Modulator Projection LensDiffuse Screen Viewer 9. Building a 3D Projector Side View Vertical-Only Diffuser 10. Building a 3D Projector Lenticular 11. Building a 3D Projector 12. Our Approach 13. LIGHT FIELD PROJECTOR Prototype Implementation 14. Prototype Schematic 15. Prototype Schematic Illumination Spatial Light Modulator (LCOS) Spatial Light Modulator (LCOS) Relay Lens Projector Lens Beamsplitter Beamsplitter 16. Prototype 17. ANGLE EXPANDING SCREEN Prototype Implementation 18. Angle Expanding Screen Back Front Fresnel Lens Lenticular (Long F) Lenticular (Short F) Vertical Diffuser (Lenticular) 19. Laser Test 20. COMPUTATION Non-negative Tensor Factorization 21. gt gt FT (bl (Yht )) FT (l (Yht ))+e ht ht YT (bl (Fgt )) YT (l (Fgt ))+e minimize bl - (Fgt ) (Yht ) t 2 subject to 0 g,h 1 l(x,u) = g(f(x,u)) h(y(x,u)) Top View g h YF l = Light Field l(x,u) g(f(x,u)) h(y(x,u)) t vertical diffuser inversion Side View tt perceptual integration convolution (diffusion & aberrations) 22. Flexible Display Modes Superresolution and HDR conventional screen LightFieldProjector projected signal cos ( fg x ) cos ( fh x ) 0.5 ( cos ( (fg+fh ) x) + cos ( (fg-fh ) x) ) 23. More Details in the Paper & Supplement! Matlab Source Code & OpenGL Pseudo-Code Compressibility Convergence Optics 24. Possible Extensions Extended Field of View Coded Aperture Projection Vertical stacking: Higher rank Color projection 25. Limitations Color projection (e.g. multiple devices) Screen More angle expansion Larger size Less scattering and aberrations 26. A Compressive Light Field Projection System Matthew Hirsch Gordon Wetzstein Ramesh Raskar media.mit.edu/~gordonw/CompressiveLightFieldProjector/ See demo at Emerging Technologies! Thanks to: Hisham Bedri, Silicon Micro Display, Vincent Lee, Matthew OToole, Phil Surman 27. standard formulationalternate formulation Low-rank Tensor Factorization 28. alternate formulation forward projection (multiview rendering) back projection (projective texture mapping) Efficient GPU Implementation Tensor Factorization - Implementation