bringing photographs to life with view morphing bringing photographs to life with view morphing...
TRANSCRIPT
Bringing Photographs to LifeBringing Photographs to LifeWith View MorphingWith View Morphing
Steve Seitz
University of Wisconsin—Madison
Images Are Static
• Photographs Lack– Movement — scene is frozen in time– Depth — image is two-dimensional
• Can we animate the scene via the image?
Objective:Scene Interaction Via Photos
• Scene Viewing– Move virtual camera, view real scene
• Scene Interaction– Move objects — cut and paste– Change objects — paint, sculpt– Animate the scene — make things walk, talk
Talk Outline
• Adding Motion and Depth• View Morphing
• Applications• Visualization, photo correction, special effects
• Interacting With the Scene• Scene editing via photographs
Features of View Morphing
• Provides– A mobile virtual camera– Better image morphs
• Requires no prior knowledge– No 3D shape information– No camera information– No training on other images
Applications: Visualization
• User-controlled Virtual Camera– Telepresence — visit a remote scene– Web commerce — product viewing over Internet– Viewing historical sites– Animating paintings
Applications: Photo Correction• Image Postprocessing
– Alter image perspective in the lab
• Image Databases– Normalize images for better indexing– Simplify face recognition tasks
Applications: Better Image Transitions
– Avoid bending and shearing distortions– Shapes do not need to be aligned
Image MorphImage Morph
View MorphView Morph
The Next Step:Interacting With the Scene
• Scene Editing Via Photographs– Move objects — cut and paste– Change objects — paint, warp
SceneScene
PaintedPainted Photo Photo
PhotoPhoto
PropagationPropagation
Painted Painted PhotoPhoto
Cut PhotoCut PhotoOriginal PhotoOriginal Photo
Original PhotoOriginal Photo
Painted PhotoPainted Photo Cut PhotoCut Photo
New Views ofNew Views ofModified SceneModified Scene
Original PhotoOriginal Photo