techreport slides
DESCRIPTION
http://scripts.mit.edu/~raskar/lightfields/index.php?title=An_Introduction_to_The_Wigner_Distribution_in_Geometric_OpticsTRANSCRIPT
![Page 1: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/1.jpg)
Wave Phenomenon in Geometric Optics
Tom CuypersSe Baek Oh
Roarke HorstmeyerRamesh Raskar
![Page 2: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/2.jpg)
Part 1Introduction
![Page 3: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/3.jpg)
Overview
1. Introduction and Welcome
2. Relating wave propagation to Light Fields
3. Augmented Light Fields
4. Applications in Imaging
![Page 4: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/4.jpg)
Motivation
• Dual representation of light:
– Photons travelling in a straight line
Computer Graphics
http://graphics.ucsd.edu/~henrik/images
Computational Photography
http://graphics.stanford.edu/projects/lightfield
![Page 5: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/5.jpg)
Motivation
• Dual representation of light:
– Photons travelling in a straight line
– Waves traveling in all directionsHolography
http://www.humanproductivitylab.com/images
Optics
![Page 6: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/6.jpg)
Motivation
• Dual representation of light:
– Photons travelling in a straight line
– Waves traveling in all directions
• Goal of the course:
Provide a gentle introduction of wave phenomenon using ray-based representations
![Page 7: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/7.jpg)
Wave phenomena in the real world
• Fluid surfaces
http://4.bp.blogspot.com/_NpINLHeo8rM/Rsl52vjOKII/AAAAAAAAFMM/WnESejvzq5Y/s400/s
plash-water-waves-4559.JPG
![Page 8: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/8.jpg)
Wave phenomena in the real world
• Fluid surfaces
• Sound waves
http://fetch1.com/wp-content/uploads/2009/11/hd-800_detail_sound-waves1.jpg
![Page 9: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/9.jpg)
Wave phenomena in the real world
• Fluid surfaces
• Sound waves
• Electromagnetic waves
– Microscopic scale
http://upload.wikimedia.org/wikipedia/commons/archive/1/1f/20090127195426!Ggb_in_soap_bubble_1.jpg
![Page 10: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/10.jpg)
1
Coherence
• Degree of making interference– coherent ⇐ partially coherent ⇒ incoherent
• Correlation of two points on wavefront– (≈phase difference)
Coherent: deterministic phase relation
Incoherent: uncorrelated phase
relation
![Page 11: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/11.jpg)
1
Coherence
• throwing stones......
single point source many point sources
⇒ coherent ⇒ if thrown identically, still coherent!
⇒ if thrown randomly, then incoherent!
![Page 12: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/12.jpg)
1
Coherence
• Temporal coherence:
– spectral bandwidth
• monochromatic: temporally coherent
• broadband (white light): temporally incoherent
• Spatial coherence:
– spatial bandwidth (angular span)
• point source: spatially coherent
• extended source: spatially incoherent
![Page 13: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/13.jpg)
1
ExampleTemporally incoherent;
spatially coherent
Temporally &
spatially coherent
Temporally &
spatially incoherentTemporally coherent;
spatially incoherent
laser
rotating diffuser
![Page 14: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/14.jpg)
What is a wave?
• Types
– Electromagnetic waves
– Mechanical Waves
http://en.wikipedia.org/wiki/File:EM_spectrum.svg
![Page 15: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/15.jpg)
What is a wave?
• Types
– Electromagnetic waves
– Mechanical Waves
http://www.gi.alaska.edu/chaparral/acousticspectrum.jpg
![Page 16: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/16.jpg)
What is a wave?
• Types
• Properties
– Wavelength: λ
– Frequency :
– Phase: p
– Amplitude: A
– Polarization
λ
p=0p=π/2
p=πp=3π/2
A
http://www.ccrs.nrcan.gc.ca/glossary/images/3104.gif
![Page 17: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/17.jpg)
What are wave phenomena?
• Huygens principle
![Page 18: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/18.jpg)
What are wave phenomena?
• Huygens principle
![Page 19: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/19.jpg)
What are wave phenomena?
• Huygens principle
![Page 20: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/20.jpg)
What are wave phenomena?
• Huygens principle
![Page 21: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/21.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
![Page 22: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/22.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
![Page 23: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/23.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
![Page 24: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/24.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
![Page 25: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/25.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
![Page 26: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/26.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
• Interference
Wave A
Wave B
Constructive
interference
![Page 27: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/27.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
• Interference
Wave A
Wave B
Destructive
interference
![Page 28: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/28.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
• Interference
• Example N
Reflection
Ray-based
![Page 29: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/29.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
• Interference
• Example
Reflection
Huygens Principle
![Page 30: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/30.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
• Interference
• Example
Reflection
Huygens Principle
![Page 31: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/31.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
• Interference
• Example
Reflection
Huygens Principle
![Page 32: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/32.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
• Interference
• Example
Reflection
Huygens Principle
![Page 33: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/33.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
• Interference
• Example
Reflection
Huygens Principle
![Page 34: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/34.jpg)
What are wave phenomena?
• Huygens principle
• Diffraction
• Interference
• Example
Reflection
Huygens Principle
![Page 35: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/35.jpg)
Part 2Relating Wave Phenomena
to Light Fields
![Page 36: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/36.jpg)
Introduction
• Review of Light Fields
• Review of Waves using Fourier optics principles ? (intro)
• Introduction to the Wigner Distribution Function
• Augmented Light Fields to represent wave phenomena
![Page 37: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/37.jpg)
Plenoptic Function
• Q: What is the set of all things that we can ever see?
• A: The Plenoptic Function (Adelson & Bergen)
Let’s start with a stationary person and try to parameterize
everything that he can see…
![Page 38: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/38.jpg)
Gray Snapshot
• P(θ,φ) is intensity of light– Seen from a single view point– At a single time– Averaged over the wavelengths of the visible spectrum• (can also do P(x,y), but spherical coordinate are nicer)
![Page 39: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/39.jpg)
Color Snapshot
P(θ,φ,λ) is intensity of light– Seen from a single view point– At a single time– As a function of wavelength
![Page 40: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/40.jpg)
Movie
P(θ,φ,λ,t) is intensity of light– Seen from a single view point– Over time– As a function of wavelength
![Page 41: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/41.jpg)
Holographic Movie
P(θ,φ,λ,t,Vx, Vy, Vz) is intensity of light
• – Seen from ANY single view point
• – Over time
• – As a function of wavelength
![Page 42: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/42.jpg)
Plenoptic Function
P(θ,φ,λ,t,Vx, Vy, Vz)
• Can reconstruct every possible view, at every moment, from every position, at every wavelength
• Contains every photograph, every movie, everything that anyone has ever seen.
![Page 43: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/43.jpg)
Sampling Plenoptic Function (top view)
![Page 44: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/44.jpg)
Ray
Let’s not worry about time and color:
5D : P(θ,φ,VX,VY,VZ)
• – 3D position
• – 2D direction
![Page 45: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/45.jpg)
Ray
• No Occluding ObjectsP(θ,φ,VX,VY,VZ)
• 4D2D position– 2D direction
• The space of all lines in 3-D space is 4D.
![Page 46: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/46.jpg)
Representation
(x,y)
(θ,φ)
(x,y)
(u,v)
Position-angle
representation
2 plane
representation
![Page 47: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/47.jpg)
Light Field Camera
Point Grey
Mark levoy
![Page 48: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/48.jpg)
Why Study Light Fields Using Wave Optics?
MacroMicro
x
θz=z0
z=0
x
fz=z0
z=0
Light
Field
Wigner
Distribution
![Page 49: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/49.jpg)
Wave Optics
• Waves instead of rays
• Interference & diffraction
• Plane of point emitters
(Huygen’s principle)
• Each emitter has amplitude
and phase
Parallel rays Plane waves
![Page 50: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/50.jpg)
Position and direction in wave optics
• Spatial frequency: f
1
f
![Page 51: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/51.jpg)
Position and direction in wave optics
• Spatial frequency: f
• Direction of wave: θ
1
f
λ
θSmall θ assumption:
![Page 52: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/52.jpg)
Position and direction in wave optics
Complex wavefront = parallel wavefronts
![Page 53: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/53.jpg)
Wigner Distribution Function
• Input: one-dimensional function of position
• Output: two-dimensional function of position and spatial frequency
• (some) information about spectrum at each position
Auto correlation of complex wavefront
![Page 54: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/54.jpg)
5
Wigner Distribution Function
...
...
![Page 55: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/55.jpg)
2D Wigner Distribution
• Projection along frequency yields power
• Projection along position yield spectral power
f
x
W(x,f)
![Page 56: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/56.jpg)
2D Wigner Distribution
• Projection along frequency yields power
• Projection along position yield spectral power
f
x
x
W(x,f)
|h(x)|²
![Page 57: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/57.jpg)
2D Wigner Distribution
• Projection along frequency yields power
• Projection along position yield spectral power
f
x
x
W(x,f)
|h(x)|²
f
|f(x)|²
![Page 58: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/58.jpg)
2D Wigner Distribution
• Projection along frequency yields power
• Projection along position yield spectral power
f
x
x
W(x,f)
|h(x)|²
f
|f(x)|²
![Page 59: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/59.jpg)
2D Wigner Distribution
Remarks:
• Possible negative values
• Uncertainty principle
f
x
W(x,f)
![Page 60: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/60.jpg)
Relationship with Light Fields:Observable Light Fields
• Move aperture across plane
• Look at direction spread
• Continuous form of plenopticcamera
Scene
![Page 61: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/61.jpg)
• Move aperture across plane
• Look at direction spread
• Continuous form of plenopticcamera
Scene
Relationship with Light Fields:Observable Light Fields
![Page 62: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/62.jpg)
• Move aperture across plane
• Look at direction spread
• Continuous form of plenopticcamera
Scene
Relationship with Light Fields:Observable Light Fields
![Page 63: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/63.jpg)
• Move aperture across plane
• Look at direction spread
• Continuous form of plenopticcamera
Scene
Relationship with Light Fields:Observable Light Fields
![Page 64: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/64.jpg)
• Move aperture across plane
• Look at direction spread
• Continuous form of plenopticcamera
Scene
Relationship with Light Fields:Observable Light Fields
![Page 65: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/65.jpg)
• Move aperture across plane
• Look at direction spread
• Continuous form of plenopticcamera
Scene
Relationship with Light Fields:Observable Light Fields
![Page 66: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/66.jpg)
• Move aperture across plane
• Look at direction spread
• Continuous form of plenopticcamera
Scene
Aperture
Position x
θ
Relationship with Light Fields:Observable Light Fields
![Page 67: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/67.jpg)
Relationship with Light Fields:Observable Light Fields
![Page 68: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/68.jpg)
Relationship with Light Fields:Observable Light Fields
Wave
Aperture Window
Fourier Transform
Power
![Page 69: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/69.jpg)
Relationship with Light Fields:Observable Light Fields
Wave
Aperture Window
Fourier Transform
Power
![Page 70: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/70.jpg)
Relationship with Light Fields:Observable Light Fields
Wave
Aperture Window
Fourier Transform
Power
Wigner Distribution
of wave functionWigner Distribution
of aperture window
![Page 71: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/71.jpg)
Relationship with Light Fields:Observable Light Fields
Wigner Distribution
of wave functionWigner Distribution
of aperture window
Blur trades off
resolution in position
with direction
![Page 72: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/72.jpg)
Relationship with Light Fields:Observable Light Fields
Wigner Distribution
of wave function
At zero wavelength limit
(regime of ray optics)
![Page 73: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/73.jpg)
Relationship with Light Fields:Observable Light Fields
At zero wavelength limit
(regime of ray optics)
Observable light field and Wigner equivalent!
![Page 74: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/74.jpg)
Observable Light Field
• Observable light field is a blurred Wigner distribution with a modified coordinate system
• Blur trades off resolution in position with direction
• Wigner distribution and observable light field equivalent at zero wavelength limit
![Page 75: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/75.jpg)
Light Fields and Wigner
• Observable Light Fields = special case of Wigner
• Ignores wave phenomena
• Can we also introduce wave phenomena in light fields?
– -> Augmented Light Fields
![Page 76: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/76.jpg)
Part 3Augmenting Light Fields
![Page 77: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/77.jpg)
Introduction
Traditional
Light Field
light field
radiance of ray
ref. plane
position
ray optics based
simple and powerful
![Page 78: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/78.jpg)
Introduction
Traditional
Light Field
light field
radiance of ray
ref. plane
position
direction
ray optics based
simple and powerful
![Page 79: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/79.jpg)
Introduction
Traditional
Light Field
ray optics based
simple and powerful
![Page 80: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/80.jpg)
Introduction
Wigner
Distribution
Function
Traditional
Light Field
ray optics based
simple and powerful
rigorous but cumbersome
wave optics based
limited in diffraction & interference
![Page 81: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/81.jpg)
Introduction
Wigner
Distribution
Function
Traditional
Light Field
ray optics based
simple and powerful
rigorous but cumbersome
wave optics based
limited in diffraction & interference
holograms beam shaping
rotational PSF
![Page 82: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/82.jpg)
Augmented LF
Wigner
Distribution
Function
Traditional
Light Field
WDF
Traditional
Light Field
Augmented LF
Interference & Diffraction
Interaction w/ optical elements
ray optics based
simple and powerful
limited in diffraction & interference
rigorous but cumbersome
wave optics based
Non-paraxial propagation
![Page 83: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/83.jpg)
Augmented LF
• Not a new light field
• A new methodology/framework to create, modulate, and propagate light fields
– stay purely in position-angle space
• Wave optics phenomena can be understood with the light field
![Page 84: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/84.jpg)
Augmented LF framework
(diffractive)
optical
element
LF
![Page 85: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/85.jpg)
Augmented LF framework
LF propagation
(diffractive)
optical
element
LF LF
![Page 86: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/86.jpg)
Augmented LF framework
LF propagation
(diffractive)
optical
element
LF LF LF
light field transformer
negative radiance
![Page 87: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/87.jpg)
Augmented LF framework
LF propagation
(diffractive)
optical
element
LF LF LF LF
LF propagation
light field transformer
negative radiance
Tech report, S. B. Oh et al.
![Page 88: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/88.jpg)
Outline
• Limitations of Light Field analysis
– Ignore wave phenomena
– Only positive ray -> no interference
![Page 89: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/89.jpg)
Outline
• Limitations of Light Field analysis
• Augmented Light Field
– free-space propagation
![Page 90: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/90.jpg)
Outline
• Limitations of Light Field analysis
• Augmented Light Field
– free-space propagation
– virtual light projector in the ALF
• Possible negative
• Coherence
![Page 91: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/91.jpg)
Outline
• Limitations of Light Field analysis
• Augmented Light Field
– free-space propagation
– virtual light projector in the ALF
• Possible negative
• Coherence
– light field transformer
![Page 92: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/92.jpg)
Assumptions
• Monochromatic (= temporally coherent)
– can be extended into polychromatic
• Flatland (= 1D observation plane)
– can be extended to the real world
• Scalar field and diffraction (= one polarization)
– can be extended into polarized light
• No non-linear effect (two-photon, SHG, loss,
absorption, etc)
![Page 93: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/93.jpg)
Young’s experiment
light from
a laser
screendouble
slit
constructive interference
![Page 94: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/94.jpg)
Young’s experiment
light from
a laser
screendouble
slitdestructive interference
![Page 95: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/95.jpg)
Young’s experiment
ref. plane
Light Field WDF
![Page 96: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/96.jpg)
Young’s experiment
Light Field WDF
ref. plane
projection projection
![Page 97: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/97.jpg)
9
Virtual light projector
virtual light projector
Augmented
LF
positive
negative
intensity=0
at the mid point
projection
Not conflict with physics
real projector
real projector
![Page 98: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/98.jpg)
9
Virtual light projector
real projector
real projector
first null
(OPD = λ/2)
virtual light projector
![Page 99: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/99.jpg)
9
Virtual light projector
first null
(OPD = λ/2)hyperbola
λ/2asymptote of
hyperbola
valid in Fresnel regime
(or paraxial)
![Page 100: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/100.jpg)
1
Virtual light projectorin high school physics
class,
destructive interference(need negative radiance from
virtual light projector)
Video
waves
![Page 101: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/101.jpg)
1
Question
• Does a virtual light projector also work for incoherent light?
• Yes!
![Page 102: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/102.jpg)
1
Temporal coherence
• Broadband light is incoherent
• ALF (also LF and WDF) can be defined for different wavelength and treated independently
![Page 103: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/103.jpg)
1
Young’s Exp. w/ white light
![Page 104: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/104.jpg)
1
Young’s Exp. w/ white lightRed
Green
Blue
![Page 105: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/105.jpg)
1
Young’s Exp. w/ white lightRed
Green
Blue
![Page 106: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/106.jpg)
1
Spatial coherence
• ALF w/ virtual light projectors is defined for spatially coherent light
• For partially coherent/incoherent light, adding the defined ALF still gives valid results!
![Page 107: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/107.jpg)
1
Young’s Exp. w/ spatially incoherent light
![Page 108: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/108.jpg)
1
Young’s Exp. w/ spatially
incoherent light
![Page 109: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/109.jpg)
1
Young’s Exp. w/ spatially incoherent light
![Page 110: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/110.jpg)
1
w/ random
phase
(uncorrelated)
spatially incoherent light:
infinite number of waves propagating along all
the direction with random phase delay
Young’s Exp. w/ spatially incoherent light
![Page 111: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/111.jpg)
1
w/ random
phase
(uncorrelated)
Addition
Young’s Exp. w/ spatially
incoherent light
![Page 112: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/112.jpg)
1
w/ random
phase
(uncorrelated)
Addition
Young’s Exp. w/ spatially
incoherent light
![Page 113: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/113.jpg)
1
Light Field Transformer
• light field interactions w/ optical elements
Light field transformer
![Page 114: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/114.jpg)
1
Light Field Transformer
Dimension Property Note8D reflectance field,
volume hologram
6D display,
BTF
many optical elements
shield field
8D(4D) thick, shift variant,
angular variant
thin, shift variant,
angular variant
thin, shift variant,
angular invariant
attenuation
6D(3D)
4D(2D)
2D(1D)
![Page 115: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/115.jpg)
1
• the most generalized case
8D LF Transformer
![Page 116: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/116.jpg)
1
• For thin optical elements
6D LF Transformer
6D Display
Bidirectional
Texture Function
Courtesy of Paul Debevec
Courtesy of Martin Fuchs
![Page 117: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/117.jpg)
1
4D LF Transformer
• w/ angle shift invariant elements (in the paraxial region)– e.g. aperture, lens, thin grating, etc
![Page 118: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/118.jpg)
Part 4Applications in Imaging
![Page 119: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/119.jpg)
1
Message
• LF is a very powerful tool to understand wave-related phenomena
– and potentially design and develop new systems and applications
![Page 120: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/120.jpg)
1
Augmented LF
WDF
Light
Field
Augmented LF
LF
propagation
(diffractive)
optical
element
LF LF LF LF
LF
propagation
light field transformer
negative radiance
![Page 121: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/121.jpg)
Outline
wavefront coding
holography
gaussian beam
rotating PSF
![Page 122: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/122.jpg)
1
Gaussian Beam (from a laser pointer)
• Beam from a laser
– a solution of paraxial wave equation
20 mm beam
width
20 m distance
![Page 123: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/123.jpg)
1
• ALF (and WDF) of the Gaussian Beam is also Gaussian in x-θspace
Gaussian Beam
![Page 124: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/124.jpg)
1
Gaussian Beam
x-θ space z-x space
20 mm beam
width
20 m
distance
![Page 125: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/125.jpg)
1
Wavefront coding
• ALF of a phase mask(slowly varying ϕ(x))
conventional wavefront coding
extended DOF
(w/ deconvolution)
![Page 126: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/126.jpg)
1
Unusual PSF for depth from defocus
standard PSF DH PSF
Courtesy of S. R. P. Pavani
U. of Colorado@Boulder
Prof. Rafael Piestun’s group
Univ. of Colorado@Boulder
Defocus circle with distance
![Page 127: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/127.jpg)
1
Rotating PSF
• Rotating beams
– Superposition along a straight line
– Rotation rate related to slope of line
– Both intensity and phase rotate
– Maximum rotation rate in Rayleigh range
intensity
Courtesy of S. R. P. Pavani
![Page 128: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/128.jpg)
1
Courtesy of S. R. P. Pavani
Rotating PSF
![Page 129: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/129.jpg)
1
Conceptually...
![Page 130: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/130.jpg)
1
Conceptually...
other modes need to be balanced...
![Page 131: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/131.jpg)
1
WDF (ALF) of (1,1) order
intensity
R. Simon and G. S. Agarwal, "Wigner
representation of Laguerre-Gaussian beams", Opt.
Lett., 25(18), (2000)
![Page 132: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/132.jpg)
1
θx
θy
WDF in θx- θy
intensity in x-
y
y
x θx
θy
WDF in θx- θy
θx
θy
WDF in θx- θy
![Page 133: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/133.jpg)
1
Holography
laser
object wave
reference wave
Recording
hologram
Reconstruction
reference wave
hologram
observer
real image
virtual image
object
![Page 134: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/134.jpg)
1
Holography
recording
reconstruction
• For a point object
![Page 135: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/135.jpg)
1
Future direction
• Tomography & Inverse problems
• Beam shaping/phase mask design by ray-based optimization
• New processing w/ virtual light source
![Page 136: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/136.jpg)
Other LF
representations
WDF
Traditional
light field
Augmented
LF
Observable
LF
Rihaczek
Distribution
Function
Space of LF representations
Time-frequency representations
Phase space representations
Quasi light field
incoherent
coherent
Other LF
representations
![Page 137: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/137.jpg)
1
Property of the RepresentationConstant
along rays
Non-
negativityCoherence Wavelength
Interference
Cross term
Traditional LFalways
constantalways positive
only incoherent zero no
Observable
LF
nearly constant
always positive
any coherence
stateany yes
Augmented
LF
only in the paraxial region
positive and negative any any yes
WDFonly in the paraxial region
positive and negative any any yes
Rihaczek DFno; linear
driftcomplex any any reduced
![Page 138: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/138.jpg)
1
Benefits & Limitations of the Representation
Ability to
propagate
Modeling
wave optics
Simplicity of
computatio
n
Adaptability
to current
pipe line
Near Field Far Field
Traditional
Light Fieldsx-shear no
very simple
high no yes
Observable
Light Fields
not x-shear
yes modest low yes yes
Augmented
Light Fieldsx-shear yes modest high no yes
WDF x-shear yes modest low yes yes
Rihaczek
DFx-shear yes
better than WDF, not as simple
as LF
low no yes
![Page 139: Techreport Slides](https://reader036.vdocuments.mx/reader036/viewer/2022070315/554e0d05b4c90597278b55cb/html5/thumbnails/139.jpg)
1
Conclusions
• Wave optics phenomena can be understood with geometrical ray based representation
• There are many different phase-space representations
• We hope to inspire researchers in computer vision/graphics as well as in optics graphics to develop new tools and algorithms based on joint exploration of geometric and wave optics concepts