image formation ii chapter 2 (r. szelisky) · image formation ii chapter 2 (r. szelisky) guido...

19
Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: Slides used/modified from Prof. Trevor Darrell ([email protected]) (http://www.eecs.berkeley.edu/~trevor/CS280.html)

Upload: others

Post on 24-Sep-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Image Formation IIChapter 2 (R. Szelisky)

Guido GerigCS 6320 Spring 2012

Acknowledgements: • Slides used/modified from Prof. Trevor Darrell

([email protected]) (http://www.eecs.berkeley.edu/~trevor/CS280.html)

Page 2: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Recall, perspective effects…

• Far away objects appear smaller

Forsyth and Ponce

Page 3: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Perspective effects

Page 4: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Perspective effects

Page 5: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Perspective effects

• Parallel lines in the scene intersect in the image

• Converge in image on horizon lineImage plane(virtual)

Scene

pinhole

Page 6: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Projection properties

• Many-to-one: any points along same ray map to same point in image

• Points ? – points

• Lines ?– lines (collinearity preserved)

• Distances and angles are / are not ?preserved– are not

• Degenerate cases:– Line through focal point projects to a point.– Plane through focal point projects to line– Plane perpendicular to image plane projects to

part of the image.

Page 7: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Weak perspective

• Approximation: treat magnification as constant

• Assumes scene depth << average distance to camera

World points:

Image plane

Page 8: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Orthographic projection

• Given camera at constant distance from scene

• World points projected along rays parallel to optical access

Page 9: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor
Page 10: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor
Page 11: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

2D

Page 12: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

3D

Page 13: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Other types of projection

• Lots of intriguing variants…• (I’ll just mention a few fun ones)

S. Seitz

Page 14: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

360 degree field of view…

• Basic approach– Take a photo of a parabolic mirror with an orthographic lens

(Nayar)– Or buy one a lens from a variety of omnicam manufacturers…

• See http://www.cis.upenn.edu/~kostas/omni.html

S. Seitz

Page 15: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Tilt-shift

Titlt-shift images from Olivo Barbieriand Photoshop imitations

http://www.northlight-images.co.uk/article_pages/tilt_and_shift_ts-e.html

S. Seitz

Page 16: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

tilt, shift

http://en.wikipedia.org/wiki/Tilt-shift_photography

wikipedia http://www.luminous-landscape.com/tutorials/focusing-ts.shtml

Page 17: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Tilt-shift perspective correction

http://en.wikipedia.org/wiki/Tilt-shift_photography

Page 18: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

normal lens tilt-shift lens

http://www.northlight-images.co.uk/article_pages/tilt_and_shift_ts-e.html

Page 19: Image Formation II Chapter 2 (R. Szelisky) · Image Formation II Chapter 2 (R. Szelisky) Guido Gerig CS 6320 Spring 2012 Acknowledgements: • Slides used/modified from Prof. Trevor

Rollout Photographs © Justin Kerr http://research.famsi.org/kerrmaya.html

Rotating sensor (or object)

Also known as “cyclographs”, “peripheral images”S. Seitz