Slide 1

Jason Holloway Aswin Sankaranarayanan Ashok Veeraraghavan Salil Tambe April 28, 2012

Slide 2

Low-speed images work for static scenes

Slide 3

open shut 33 ms

Slide 4

Blurring in dynamic areas High spatial resolution in static areas

Slide 5

30 million voxel budget Increasing fps decreases light throughput 1 Megapixel x 30 fps175 x 175 x 1000 fps

Slide 6

Optical coding

Slide 7

-LCOS -Per pixel coded exposure P2C2 [Reddy et al. 2011] Per pixel shutter control Flexible Voxels Gupta et al. 2011] CPEV [Hitomi et al. 2010, -Implement on CMOS -Single bump per pixel per frame Per pixel sensor control FSVC Global shutter control Global shutter control y t x Exposure Single Pixel Camera [Wakin et al. 2006] Spatial-muliplexing y t x y t x

Slide 8

Slide 9

Video Removed General motion Linear with known velocity PeriodicityLinear dynamical systems Coded Strobing [Veeraraghavan et al. 2011] CD-LDS [Sankaranarayanan et al. 2010] Flutter Shutter [Raskar et al. 2006] P2C2 [Reddy et al. 2011] Flexible Voxels [Gupta et al. 2010] CPEV [Hitomi et al. 2011] FSVC 80x20x-50x 6x-16x

Slide 10

Locally linear motion model Union of subspaces (UoS) General motion TV minimization

Slide 11

High-speed PCA subspace approx. A 18x18x24 patch can be expressed using 324 dimensional subspace y t x 521 velocities, 40 angles and 13 speeds y t

Slide 12

High-speed subspace Low-speed subspace Patch based reconstruction

Slide 13

Speed = 1.38 pixels/high-speed frame Direction = 61 Speed (pixels/frame)

Slide 14

Video Removed PSNR: 35.5 dB

Slide 15

Slide 16

Video Removed Hairnets advertisement placard moving right PSNR: 40.6 dB

Slide 17

Video Removed Dancer clapping causes a chalk cloud to form PSNR: 28.7 dB

Slide 18

PointGrey Machine Vision cameras were used to simulate FSVC Flea3 grayscale camera operating at 8 fps

Slide 19

Video Removed Observed framesRecovered video (6x) Video Removed

Slide 20

Hardware complexity Reconstruction quality FSVC CPEV P2C2 Global shutter control suffices for high speed video recovery

Slide 21

Questions?