siggraph 2012 computational plenoptic imaging course - 1 introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

This slide has a 16:9 media windowComputational Plenoptic Imaging

Wolfgang HeidrichUniversity of British Columbia

Gordon WetzsteinMIT Media Lab

Ivo IhrkeSaarland University

Douglas LanmanMIT Media Lab

Ramesh RaskarMIT Media Lab

Kurt AkeleyLytro, Inc.

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

HDR Imaging & Computed Tomography

Tomographic

HDR Reconstruction

wik

ipe

dia

[Ro

uf

et

al.

20

11]

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Lytro Light Field Camera

[Ng et al. 2005]

[Lytro, Inc.]

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Ultra-fast Imaging & Looking around Corners

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Introduction & Overview

Gordon Wetzstein

Postdoctoral Researcher

MIT Media Lab

media.mit.edu/~gordonw

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – High Dynamic Range Imaging

Wolfgang Heidrich

Professor

University of British Columbia

cs.ubc.ca/~heidrich

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Spectral Imaging

Ivo Ihrke

Research Group Leader

Saarland University

giana.mmci.uni-saarland.de/

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Light Field Acquisition

Douglas Lanman

Research Scientist, Nvidia Research

Postdoctoral Researcher, MIT Media Lab

media.mit.edu/~dlanman

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Inside the Lytro Camera

Kurt Akeley

Computer Graphics Pioneer & CTO at Lytro, Inc.

lytro.com/team/kurt_akeley

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Ultra-fast Imaging

Ramesh Raskar

Associate Professor

MIT Media Lab

media.mit.edu/~raskar

cameraculture.media.mit.edu

TED Talk: Imaging at a Trillion FPS

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Introduction & Overview, Gordon (7 mins)

High Dynamic Range Imaging, Wolfgang (10 mins)

Spectral Imaging, Ivo (10 mins)

Light Field Acquisition, Douglas (10 mins)

Insight the Lytro Camera, Kurt (20 mins)

Imaging at a Trillion FPS, Ramesh (20 mins)

Schlieren Imaging, Gordon (5 mins)

Q & A, all (10 mins)

Course Outline

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

The Mantis Shrimp

Up to 16 different photoreceptors: 12 for color (4 UV, visible, IR) 4 for polarization (linear & circular)

3 bands = trinocular vision

with each eye!

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

sensors are buckets collecting photons…

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

… disregarding color …

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

… direction …

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

… time of arrival …

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

… all photons are integrated.

Information loss!

++

Computational Photography

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Cameras are modeled as one Human Eye[W

illia

ms

91

]

webvision.med.utah.eduwikipedia.org

wikipedia.org

How would a camera look like if it was

modeled as a mantis shrimp eye?

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Visual Information Sampled

Human Visual System

Alla

n B

roo

ks,

EE

42

1,

20

03

Consumer Video Camera

4 Plenoptic parameterssampled (no Vx,y,z)

1920 x 1080 (HD)

3 – Color Filter Array

Continuous ~30 fps

1

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

The Plenoptic Function

xVyV

High-dimensional, ray-based model for light Includes variations in space, time, angle, & wavelength

Common parameterizations

[Adelson and Bergen 91]

( , , , , , , )x y zP P t V V V

( , , , )x yP P V V plenoptic function

4D light field

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Computational Photograph & Plenoptic Imaging

Co-design of camera optics & computational processing

Categorized by plenoptic dimensions (+ HDR)