week 9: web-assisted object detection
DESCRIPTION
Week 9: Web-Assisted Object Detection. Alejandro Torroella & Amir R. zamir. Sensor Model: Perspective Projection. Implemented a sensor model based on perspective projection (objects that are far away appear smaller in the image as compared to objects that are closer) Where: - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/1.jpg)
WEEK 9:
WEB-ASSISTED OBJECT
DETECTION
A L E J A N D R O TO R R O E L L A &
AM
I R R . ZA M
I R
![Page 2: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/2.jpg)
SENSOR MODEL: PERSPECTIVE PROJECTION
Implemented a sensor model based on perspective projection (objects that are far away appear smaller in the image as compared to objects that are closer)
Where:
P = pixel transformation matrix
K = camera calibration matrix
R = rotation matrix
C = world coordinate of the camera
Xw = world coordinate of the object
Xi = pixel coordinate of the object
![Page 3: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/3.jpg)
GEOMETRY METHOD RESULTS: BEFORE
Street LightsTrash Cans
![Page 4: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/4.jpg)
GEOMETRY METHOD RESULTS: AFTER GIS SIFT(WITHOUT PERSPECTIVE PROJECTION)
Street LightsTrash Cans
![Page 5: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/5.jpg)
GEOMETRY METHOD RESULTS: AFTER GIS SIFT(WITH PERSPECTIVE PROJECTION)
Street LightsTrash Cans
![Page 6: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/6.jpg)
GEOMETRY METHOD RESULTS: AFTER FUSION (WITHOUT PERSPECTIVE PROJECTION)
Street LightsTrash Cans
![Page 7: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/7.jpg)
Street LightsTrash Cans
GEOMETRY METHOD RESULTS: AFTER FUSION (WITH PERSPECTIVE PROJECTION)
![Page 8: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/8.jpg)
GEOMETRY METHOD RESULTS: BEFORE
𝑆𝑇𝐷
Traffic SignalsStreet Lights
![Page 9: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/9.jpg)
GEOMETRY METHOD RESULTS: AFTER GIS SIFT(WITHOUT PERSPECTIVE PROJECTION)
𝑆𝑇𝐷
Traffic SignalsStreet Lights
![Page 10: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/10.jpg)
GEOMETRY METHOD RESULTS: AFTER GIS SIFT(WITH PERSPECTIVE PROJECTION)
Traffic SignalsStreet Lights
![Page 11: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/11.jpg)
GEOMETRY METHOD RESULTS: AFTER FUSION (WITHOUT PERSPECTIVE PROJECTION)
𝑆𝑇𝐷
Traffic SignalsStreet Lights
![Page 12: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/12.jpg)
GEOMETRY METHOD RESULTS: AFTER FUSION (WITH PERSPECTIVE PROJECTION)
Traffic SignalsStreet Lights
![Page 13: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/13.jpg)
GOALS FOR NEXT WEEK
• Test the GIS fusion with perspective projection thoroughly
• Possibly fix bugs with the implementation of the sensor model• Principal point of the image is unknown, need some way to
find what it is.• Some pixel values result in out of the bounds of the image• Not sure why, but it might be due to the rough estimation
of the principal point and/or error in the conversion from geodetic to ECEF.
![Page 14: Week 9: Web-Assisted Object Detection](https://reader036.vdocuments.mx/reader036/viewer/2022081513/568152d9550346895dc0f430/html5/thumbnails/14.jpg)
THANK YOUFIN.