Transcript
- Slide 1
- Jason Holloway Aswin Sankaranarayanan Ashok Veeraraghavan Salil Tambe April 28, 2012
- Slide 2
- Low-speed images work for static scenes
- Slide 3
- open shut 33 ms
- Slide 4
- Blurring in dynamic areas High spatial resolution in static areas
- Slide 5
- 30 million voxel budget Increasing fps decreases light throughput 1 Megapixel x 30 fps175 x 175 x 1000 fps
- Slide 6
- Optical coding
- Slide 7
- -LCOS -Per pixel coded exposure P2C2 [Reddy et al. 2011] Per pixel shutter control Flexible Voxels Gupta et al. 2011] CPEV [Hitomi et al. 2010, -Implement on CMOS -Single bump per pixel per frame Per pixel sensor control FSVC Global shutter control Global shutter control y t x Exposure Single Pixel Camera [Wakin et al. 2006] Spatial-muliplexing y t x y t x
- Slide 8
- Slide 9
- Video Removed General motion Linear with known velocity PeriodicityLinear dynamical systems Coded Strobing [Veeraraghavan et al. 2011] CD-LDS [Sankaranarayanan et al. 2010] Flutter Shutter [Raskar et al. 2006] P2C2 [Reddy et al. 2011] Flexible Voxels [Gupta et al. 2010] CPEV [Hitomi et al. 2011] FSVC 80x20x-50x 6x-16x
- Slide 10
- Locally linear motion model Union of subspaces (UoS) General motion TV minimization
- Slide 11
- High-speed PCA subspace approx. A 18x18x24 patch can be expressed using 324 dimensional subspace y t x 521 velocities, 40 angles and 13 speeds y t
- Slide 12
- High-speed subspace Low-speed subspace Patch based reconstruction
- Slide 13
- Speed = 1.38 pixels/high-speed frame Direction = 61 Speed (pixels/frame)
- Slide 14
- Video Removed PSNR: 35.5 dB
- Slide 15
- Slide 16
- Video Removed Hairnets advertisement placard moving right PSNR: 40.6 dB
- Slide 17
- Video Removed Dancer clapping causes a chalk cloud to form PSNR: 28.7 dB
- Slide 18
- PointGrey Machine Vision cameras were used to simulate FSVC Flea3 grayscale camera operating at 8 fps
- Slide 19
- Video Removed Observed framesRecovered video (6x) Video Removed
- Slide 20
- Hardware complexity Reconstruction quality FSVC CPEV P2C2 Global shutter control suffices for high speed video recovery
- Slide 21
- Questions?
