eecs 442 computer vision fall 2012 - university of … · eecs 442 – computer vision – fall...
TRANSCRIPT
![Page 1: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/1.jpg)
EECS 442 – Computer Vision – fall 2012
• Instructor – Silvio Savarese – [email protected] – Office: ECE Building, room: 4435 – Office hour: Tues 4:30-5:30pm or under appoint.
• GSI: – Johnny Chao ([email protected])
• Class Time & Location – Tu Th 3:00PM - 4:30PM -- G906 COOL
• Conversation hour [it’s part of the course!]
– Wed 3:30PM - 4:30PM -- 1013 DOW
http://www.eecs.umich.edu/vision/teaching/EECS442_2011/eecs442.html
![Page 2: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/2.jpg)
If you plan to audit this class,
please signup your name on the mailing list
EECS 442 – Computer Vision – fall 2011
• Text books:
– [FP] D. A. Forsyth and J. Ponce. Computer Vision: A Modern Approach (2nd Edition). Prentice Hall, 2011
(or first edition, 2003).
– [HZ] R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Academic Press, 2002.
– [R] R. Szeliski, Computer Vision: Algorithms and Applications, Springer, 2011
– [HS] D. Hoiem and S. Savarese. Representations and Techniques for 3D Object Recognition and Scene Interpretation, Synthesis lecture on Artificial Intelligence and Machine Learning. Morgan Claypool Publishers, 2011
![Page 3: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/3.jpg)
Agenda
• Administrative – Grading policy
– Project
• What is computer vision?
• Syllabus
![Page 4: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/4.jpg)
Grading policy • Homeworks: 40%
– 5 homeworks
• Mid term exam: 10% [end of October]
• Course project: 45% – progress report 5%
– final report 30%
– presentation 10%
• Attendance and class participation: 5% – Questions, answers, remarks…
• Late policy home works: – If 1 day late, 50% off the grade for that homework
– Zero credits if more than one day.
– A “48-hours one-time late submission bonus" is available; that is, you can use this bonus to submit your HW late (i.e. after at most 48 hours). This is one time bonus: After you use your bonus, you must adhere to the standard late submission policy. No exceptions will be made.
• Late policy project: – If 1 day late, 25% off the grade for the project
– If 2 days late, 50% off the grade for the project
– Zero credits if more than 2 days
– No "late submission bonus" is allowed when submitting your exam or project.
• Collaboration policy – Read the student code book, understand what is ‘collaboration’ and what is ‘academic infraction’.
– Discussing project assignment with each other is allowed, but coding must be done individually
– Home works or class project coding policy: using on line code or other students/researchers’ code is not allowed in general. Exceptions can be made and individual cases will be discussed with the instructor.
![Page 5: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/5.jpg)
Course Project
• Replicate an interesting paper
• Comparing different methods to a test bed
• A new approach to an existing problem
• Original research
• Write a 8-page paper summarizing your results
• Release the final code
• Give a presentation
• We will introduce projects in two weeks
• Important dates: look up class schedule
![Page 6: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/6.jpg)
Course Project
• Form your team:
– 1-3 people
– the quality is judged regardless of the number of
people on the team
– be nice to your partner: do you plan to drop the
course?
• Evaluation – Quality of the project (including writing)
– Final ~15 minutes project presentation in class – students will
vote your presentation!
– For final code and paper due dates please consult webpage
![Page 7: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/7.jpg)
Agenda
• Administrative – Grading policy
– Project
• What is computer vision?
• Syllabus
![Page 8: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/8.jpg)
Illustration by Arthur Rackham
“The table was a large one, but
the three were all crowded
together at one corner of it …”
From “A Mad Tea-Party”
Alice's Adventures in Wonderland
by
Lewis Carroll
“There was a table set out under
a tree in front of the house,
and the March Hare and the
Hatter were having tea at it.”
![Page 9: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/9.jpg)
-semantic
Image/video
Computer vision
…
Object 1 Object N
- semantic
![Page 10: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/10.jpg)
-semantic
Image/video
…
Object 1 Object N
- semantic
-geometry -geometry
Computer vision
![Page 11: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/11.jpg)
-semantic
Image/video
…
Object 1 Object N
- semantic
-geometry -geometry
spatial & temporal relations
Computer vision
![Page 12: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/12.jpg)
-semantic
Image/video
…
Object 1 Object N
- semantic
-geometry -geometry
-Semantic
- geometry
Scene
spatial & temporal relations
Computer vision
![Page 13: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/13.jpg)
Sensing device
•Extract
information
• Interpretation
Computer vision
• Scene
• Objects
• People
• Actions Information: visual cues, 3D structure, motion flows, etc…
Interpretation: recognize objects, scenes, actions, events
Computational
device
Computer vision studies the tools and theories that enable the design of
machines that can extract useful information from imagery data
(images and videos) toward the goal of interpreting the world
![Page 14: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/14.jpg)
Physical attributes
Se
ma
nti
c
3D modeling
Categorization
Object Recognition
Have we reached
humans?
Actions, Events
3D scenes
… not yet – computer vision is still no match for human
perception
– but catching up, particularly in certain areas
![Page 15: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/15.jpg)
Optical character recognition (OCR)
Technology to convert scanned docs to text
License plate readers http://en.wikipedia.org/wiki/Automatic_number_plate_recognition
Source: S. Seitz
Digit recognition, AT&T labs
![Page 17: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/17.jpg)
How the Afghan Girl was Identified by Her Iris Patterns
Source: S. Seitz
Iris Patterns
recognition
Biometrics
![Page 18: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/18.jpg)
Face recognition systems http://www.sensiblevision.com/
Biometrics
Source: S. Seitz
![Page 19: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/19.jpg)
Consumer applications
![Page 20: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/20.jpg)
• Many new digital cameras now detect faces
– Canon, Sony, Fuji, …
Consumer applications
Face detection
http://www.apple.com/ilife/iphoto/ Source: S. Seitz
![Page 21: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/21.jpg)
Consumer applications
Smile detection
Sony Cyber-shot® T70 Digital Still Camera Source: S. Seitz
![Page 22: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/22.jpg)
Special effects movies - videogames
So
urc
e:
S.
Se
itz
![Page 24: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/24.jpg)
3D urban modeling: Microsoft Photosynth
http://labs.live.com/photosynth/ Source: S. Seitz
![Page 25: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/25.jpg)
Toy & Robots
Credit slide: Fei-Fei Li
![Page 26: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/26.jpg)
Mobile visual search:
4-Sep-12 27
![Page 27: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/27.jpg)
Vision in supermarkets
LaneHawk by EvolutionRobotics
Source: S. Seitz
![Page 28: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/28.jpg)
Vision-based interaction (and games)
Microsoft’s Kinect
Sony EyeToy
![Page 29: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/29.jpg)
Vision for robotics, space exploration
Vision systems (JPL) used for several tasks • Panorama stitching
• 3D terrain modeling
• Obstacle detection, position tracking
• For more, read “Computer Vision on Mars” by Matthies et al.
So
urc
e:
S.
Se
itz
30
![Page 30: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/30.jpg)
Applications of computer vision
Driver assistance
(collision warning, lane departure
warning, rear object detection)
Surveillance
Autonomous driving,
robot navigation
Assistive technologies
Sources: K. Grauman, L. Fei-Fei, S. Laznebick
Security
Medical Imaging
![Page 31: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/31.jpg)
Computer vision
•Automatic
control
•Robotics
•Signal processing
•Compression
Robot
vision
Non linear SP
Multi-variate SP
•Physics
• Imaging •Optics
•Smart
cameras
•Neurobiology
Biological vision
Visual Psychophysics
•Applied math
Statistics
Geometry
Optimization
•Machine learning
•Artificial intelligence
Visual pattern
recognition
Computer
graphics
Acquisition
methods
•Data
mining
Image
retrivial
![Page 32: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/32.jpg)
EECS 442 course overview
1. Geometry
2. Low & Mid-level vision
3. High level vision
![Page 33: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/33.jpg)
1. Geometry
2. Low & Mid-level vision
3. High level vision
Geometry: - How to extract 3d information?
- Which cues are useful?
- What are the mathematical tools?
EECS 442 course overview
![Page 34: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/34.jpg)
Visual cues: texture shading contours shadows reflections
![Page 35: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/35.jpg)
Visual cues: texture shading contours shadows reflections
![Page 36: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/36.jpg)
Visual cues: texture shading contours shadows reflections
![Page 37: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/37.jpg)
Vision techniques Visual cues: texture shading contours shadows reflections
![Page 38: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/38.jpg)
Visual cues: texture shading contours shadows reflections
![Page 39: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/39.jpg)
Number of observers: monocular multiple views
Vision techniques
camera
Visual cues: texture shading contours shadows reflections
![Page 40: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/40.jpg)
Vision techniques
camera 1 camera 2 camera N
Number of observers: monocular multiple views
Vision techniques Visual cues: texture shading contours shadows reflections
![Page 41: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/41.jpg)
Projective structure from motion:
Here be dragons!
Stereo
Structure from motion
Tomasi & Kanade (1993)
Epipolar geometry
Image sources: S. Laznebick
![Page 43: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/43.jpg)
Active lighting: laser stripes structured lighting patterns
Vision techniques
camera Laser/projector/light
Number of observers: monocular multiple views
Visual cues: texture shading contours shadows reflections
![Page 44: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/44.jpg)
3D Scanning
Scanning Michelangelo’s “The David” • The Digital Michelangelo Project
- http://graphics.stanford.edu/projects/mich/
• 2 BILLION polygons, accuracy to .29mm
Courtesy of Stanford computer graphics lab
![Page 45: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/45.jpg)
3D Digital models
Architecture
Entertainment
Medicine
![Page 46: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/46.jpg)
The ‘yellow line’ in superbowls
![Page 47: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/47.jpg)
The ‘yellow line’ in superbowls
![Page 48: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/48.jpg)
Course overview
1. Geometry
2. Low & Mid-level vision
3. High level vision
Mid-level vision: - Extract useful building blocks
- Region segmentation
- Motion flows
![Page 49: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/49.jpg)
Extract useful building blocks
![Page 50: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/50.jpg)
Alignment Extract planar regions
Object segmentation
Mid-level vision
Extract useful building blocks
![Page 51: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/51.jpg)
Image enhancement
![Page 52: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/52.jpg)
Automatic Panorama Stitching
Sources: M. Brown
![Page 53: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/53.jpg)
Automatic Panorama Stitching
Sources: M. Brown
![Page 54: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/54.jpg)
Image Modeling
![Page 55: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/55.jpg)
Co
urt
esy o
f J
ea
n-Y
ve
s B
ou
gu
et
– V
isio
n L
ab
, C
ali
forn
ia In
sti
tute
of
Te
ch
no
log
y
Tracking and 3D modeling
![Page 57: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/57.jpg)
Course overview
1. Geometry
2. Low & Mid-level vision
3. High level vision
High level operations –Recognition of objects and people
–Places
–Actions & events
![Page 58: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/58.jpg)
Building
clock
person car
Object recognition and categorization
Pedestrians crossing street
Downtown chicago
![Page 59: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/59.jpg)
Challenges: viewpoint variation
Michelangelo 1475-1564 slide credit: Fei-Fei, Fergus & Torralba
![Page 60: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/60.jpg)
Challenges: illumination
image credit: J. Koenderink
![Page 61: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/61.jpg)
Challenges: scale
slide credit: Fei-Fei, Fergus & Torralba
![Page 62: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/62.jpg)
Challenges: deformation
![Page 63: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/63.jpg)
Challenges:
occlusion
Magritte, 1957 slide credit: Fei-Fei, Fergus & Torralba
![Page 64: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/64.jpg)
Challenges: background clutter
Kilmeny Niland. 1995
![Page 65: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/65.jpg)
Challenges: object intra-class variation
slide credit: Fei-Fei, Fergus & Torralba
![Page 66: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/66.jpg)
![Page 67: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/67.jpg)
Face recognition
![Page 68: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/68.jpg)
Recognizing scenes
![Page 69: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/69.jpg)
Personal photo albums
Surveillance and security
Movies, news, sports
Medical and scientific images
Credit slide: S. Lazebnik
Sorting out millions of images/videos
![Page 70: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/70.jpg)
Detecting and tracking people C
hoi &
S
hah
id &
Sa
va
rese
WM
C 2
01
0
Ch
oi &
S
ava
rese
, E
CC
V 2
01
0
![Page 71: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/71.jpg)
Recognizing human activities
Biking Walking Walking
Credit slide: Song & Perona
![Page 72: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/72.jpg)
“The table was a large one, but
the three were all crowded
together at one corner of it …”
From “A Mad Tea-Party”
Alice's Adventures in Wonderland
by
Lewis Carroll
“There was a table set out under
a tree in front of the house,
and the March Hare and the
Hatter were having tea at it.”
![Page 74: EECS 442 Computer Vision fall 2012 - University of … · EECS 442 – Computer Vision – fall 2012 •Instructor ... EECS 442 – Computer Vision ... • Mid term exam: 10%](https://reader036.vdocuments.mx/reader036/viewer/2022062504/5b816f6e7f8b9ae97b8c4dda/html5/thumbnails/74.jpg)
Next lecture
- Review of linear algebra for multi-view geometry
- Basic image transformations