siggraph 2012 computational plenoptic imaging course - 1 introduction

21
Edit this text to create a Heading This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this This slide has a 16:9 media window Computational Plenoptic Imaging Wolfgang Heidrich University of British Columbia Gordon Wetzstein MIT Media Lab Ivo Ihrke Saarland University Douglas Lanman MIT Media Lab Ramesh Raskar MIT Media Lab Kurt Akeley Lytro, Inc.

Upload: gordon-wetzstein

Post on 17-May-2015

4.086 views

Category:

Education


2 download

DESCRIPTION

SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

TRANSCRIPT

Page 1: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

This slide has a 16:9 media windowComputational Plenoptic Imaging

Wolfgang HeidrichUniversity of British Columbia

Gordon WetzsteinMIT Media Lab

Ivo IhrkeSaarland University

Douglas LanmanMIT Media Lab

Ramesh RaskarMIT Media Lab

Kurt AkeleyLytro, Inc.

Page 2: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

HDR Imaging & Computed Tomography

Tomographic

HDR Reconstruction

wik

ipe

dia

[Ro

uf

et

al.

20

11]

Page 3: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Lytro Light Field Camera

[Ng et al. 2005]

[Lytro, Inc.]

Page 4: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Ultra-fast Imaging & Looking around Corners

Page 5: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Introduction & Overview

Gordon Wetzstein

Postdoctoral Researcher

MIT Media Lab

media.mit.edu/~gordonw

Page 6: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – High Dynamic Range Imaging

Wolfgang Heidrich

Professor

University of British Columbia

cs.ubc.ca/~heidrich

Page 7: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Spectral Imaging

Ivo Ihrke

Research Group Leader

Saarland University

giana.mmci.uni-saarland.de/

Page 8: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Light Field Acquisition

Douglas Lanman

Research Scientist, Nvidia Research

Postdoctoral Researcher, MIT Media Lab

media.mit.edu/~dlanman

Page 9: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Inside the Lytro Camera

Kurt Akeley

Computer Graphics Pioneer & CTO at Lytro, Inc.

lytro.com/team/kurt_akeley

Page 10: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Instructors – Ultra-fast Imaging

Ramesh Raskar

Associate Professor

MIT Media Lab

media.mit.edu/~raskar

cameraculture.media.mit.edu

TED Talk: Imaging at a Trillion FPS

Page 11: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Introduction & Overview, Gordon (7 mins)

High Dynamic Range Imaging, Wolfgang (10 mins)

Spectral Imaging, Ivo (10 mins)

Light Field Acquisition, Douglas (10 mins)

Insight the Lytro Camera, Kurt (20 mins)

Imaging at a Trillion FPS, Ramesh (20 mins)

Schlieren Imaging, Gordon (5 mins)

Q & A, all (10 mins)

Course Outline

Page 12: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

The Mantis Shrimp

Up to 16 different photoreceptors: 12 for color (4 UV, visible, IR) 4 for polarization (linear & circular)

3 bands = trinocular vision

with each eye!

Page 13: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

sensors are buckets collecting photons…

Page 14: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

… disregarding color …

Page 15: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

… direction …

Page 16: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

… time of arrival …

Page 17: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Sensors Today

… all photons are integrated.

Information loss!

++

Computational Photography

Page 18: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Cameras are modeled as one Human Eye[W

illia

ms

91

]

webvision.med.utah.eduwikipedia.org

wikipedia.org

How would a camera look like if it was

modeled as a mantis shrimp eye?

Page 19: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Visual Information Sampled

Human Visual System

Alla

n B

roo

ks,

EE

42

1,

20

03

Consumer Video Camera

4 Plenoptic parameterssampled (no Vx,y,z)

1920 x 1080 (HD)

3 – Color Filter Array

Continuous ~30 fps

1

Page 20: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

The Plenoptic Function

xVyV

High-dimensional, ray-based model for light Includes variations in space, time, angle, & wavelength

Common parameterizations

[Adelson and Bergen 91]

( , , , , , , )x y zP P t V V V

( , , , )x yP P V V plenoptic function

4D light field

Page 21: SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

Edit this text to create a Heading

This subtitle is 20 points Bullets are blue They have 110% line spacing, 2 points before & after Longer bullets in the form of a paragraph are harder to

read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). Sub bullets look like this

Computational Photograph & Plenoptic Imaging

Co-design of camera optics & computational processing

Categorized by plenoptic dimensions (+ HDR)