bringing photographs to life with view morphing bringing photographs to life with view morphing...

21
Bringing Photographs to Bringing Photographs to Life Life With View Morphing With View Morphing Steve Seitz University of Wisconsin— Madison

Upload: maggie-levers

Post on 15-Dec-2015

220 views

Category:

Documents


0 download

TRANSCRIPT

Bringing Photographs to LifeBringing Photographs to LifeWith View MorphingWith View Morphing

Steve Seitz

University of Wisconsin—Madison

Images Are Static

• Photographs Lack– Movement — scene is frozen in time– Depth — image is two-dimensional

• Can we animate the scene via the image?

Objective:Scene Interaction Via Photos

• Scene Viewing– Move virtual camera, view real scene

• Scene Interaction– Move objects — cut and paste– Change objects — paint, sculpt– Animate the scene — make things walk, talk

Adding Movement

• •

Original ImageOriginal Image Expression ChangeExpression Change

Adding Depth

• •

Original ImageOriginal Image Perspective ChangePerspective Change

Talk Outline

• Adding Motion and Depth• View Morphing

• Applications• Visualization, photo correction, special effects

• Interacting With the Scene• Scene editing via photographs

PhotograPhotographph

PhotograPhotographph

Morphed Morphed ViewView

Virtual CameraVirtual Camera

• 1. Prewarp• align views

• 1. Prewarp• align views

• 2. Morph • move camera

• 1. Prewarp• align views

• 2. Morph • move camera

• 3. Postwarp• point camera

Features of View Morphing

• Provides– A mobile virtual camera– Better image morphs

• Requires no prior knowledge– No 3D shape information– No camera information– No training on other images

Applications: Visualization

• User-controlled Virtual Camera– Telepresence — visit a remote scene– Web commerce — product viewing over Internet– Viewing historical sites– Animating paintings

Applications: Photo Correction• Image Postprocessing

– Alter image perspective in the lab

• Image Databases– Normalize images for better indexing– Simplify face recognition tasks

Corrected PhotographsCorrected Photographs

Original PhotographsOriginal Photographs

Applications: Better Image Transitions

– Avoid bending and shearing distortions– Shapes do not need to be aligned

Image MorphImage Morph

View MorphView Morph

The Next Step:Interacting With the Scene

• Scene Editing Via Photographs– Move objects — cut and paste– Change objects — paint, warp

SceneScene

PaintedPainted Photo Photo

PhotoPhoto

PropagationPropagation

Original PhotoOriginal Photo

Original PhotoOriginal Photo

Painted Painted PhotoPhoto

Cut PhotoCut PhotoOriginal PhotoOriginal Photo

Original PhotoOriginal Photo

Painted PhotoPainted Photo Cut PhotoCut Photo

New Views ofNew Views ofModified SceneModified Scene

Original PhotoOriginal Photo

Conclusions

• Photographs Come Alive– Motion, depth added by View Morphing

• User-Scene Interaction Via Photos– Still images interactive movies– What kinds of scene changes are possible?– Which modes of interaction are natural?