image based rendering. light field gershun in 1936 –an illuminated objects fills the surrounding...
TRANSCRIPT
![Page 1: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/1.jpg)
Image Based Image Based Rendering Rendering
Image Based Image Based Rendering Rendering
![Page 2: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/2.jpg)
Light Field• Gershun in 1936
– An illuminated objects fills the surrounding space with light reflected of its surface, establishing the object’s “light field”
• Adelson and Bergen 1991– Plenoptic Function
![Page 3: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/3.jpg)
Plenoptic Funtions• An observer at any point in space (x,y,z) and any m
oment in time (t) can look in any direction(θ,ǿ.) and record the incoming light intensity Φ at all visible wavelength λ
• Φ= Φ(x,y,z,t, θ,ǿ., λ)
• Φ is the radiation’s spectral intensity, a scalar value denotes the incoming light’s power per unit per area per solid angle per unit wavelength interval
![Page 4: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/4.jpg)
Image Based Rendering
• If Φis known, any view of the scene can be reconstructed
• IBR an approach to computer-generated 2D-views of natural 3D-scenes
• Approximation of the plenoptic functions from a number of conventional images
![Page 5: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/5.jpg)
IBR Topics• View-Dependent Texture Mapping• Hybrid Geometry and Image Based Rendering• Delta Tree Representation• Multiple-Centre-of-Projection Images• Layered Depth Images• Sprites with Depth• Plenoptic Modeling and Environment Maps• Light Field Rendering and Lumigraphs
![Page 6: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/6.jpg)
Light Field Rendering• M. Levoy• A ray is parameterized
by its intersection coordinates (u,v,s,t)
• The set of all rays that can be parameterized by two grid planes represents a light field slab
![Page 7: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/7.jpg)
Light Field Rendering
![Page 8: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/8.jpg)
Sampling Requirements
• S X T = • 256 x 256• U X V = • 121000 images
![Page 9: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/9.jpg)
IBR with Controllable Illumination
• For a static scene, 3 or more images with “orthogonal” lighting can be used to render all possible lighting conditions
![Page 10: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/10.jpg)
Set of all possible images
• Original 6 Photos with different lighting conditions
• Three basis images
![Page 11: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/11.jpg)
Set of all possible images
• a
![Page 12: Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing](https://reader036.vdocuments.mx/reader036/viewer/2022062720/56649f125503460f94c25f03/html5/thumbnails/12.jpg)
IBR and Video Scene with Camera Motion
• A video scene with camera motion contains a sequence of images of different viewing positions
• Applying IBR or IBM, develop algorithm to do video object segmentation
• Object elimination inside a video sequence, like the one in “Rising Sun” - Sean Connery
• Any help to video understanding ?• Evolution of Vision ?