![Page 1: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/1.jpg)
1
Improving and Filtering Laser Data for Extrinsic Laser Range
Finder/Camera CalibrationSukhum Sattaratnamai
Advisor: Dr.Nattee Niparnan
![Page 2: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/2.jpg)
2
OutlineIntroduction
LRF-Camera System, ApplicationsRelated work
LRF-Camera Calibration MethodOur Problem
Challenge, Propose methodScope & Work plan
![Page 3: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/3.jpg)
3
Nice Point Cloud
![Page 4: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/4.jpg)
4
Point Cloud DataHard to classify the objects without color
information
![Page 5: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/5.jpg)
5
Color InformationGive rich information about the environment
![Page 6: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/6.jpg)
6
Laser Range FinderGive depth data of scan plane,
and can be used to generate 3D point cloud
![Page 7: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/7.jpg)
7
CameraCamera Model
1100
00
1C
C
C
yy
xx
ZYX
cfcf
vu
Appm
![Page 8: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/8.jpg)
8
LRF-Camera System
![Page 9: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/9.jpg)
9
LRF-Camera System
PtRAAppm |
1
|
11
L
L
L
C
C
C
ZYX
tRAZYX
Avu
![Page 10: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/10.jpg)
10
LRF-Camera CalibrationProblem Definition [Ganhua Li, 2007]
Find the transformation [R |t ] of the camera w.r.t. LRF
![Page 11: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/11.jpg)
11
TransportationSurveillanceTourismRobotics
Applications
![Page 12: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/12.jpg)
12
Precision?“Stanley: The Robot that Won the DARPA
Grand Challenge”
![Page 13: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/13.jpg)
13
Precision?Accident
![Page 14: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/14.jpg)
14
ObjectiveCalibration method can give most accurate
resultlaser data post-processing method
![Page 15: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/15.jpg)
15
Projection Error (2D)
Point to Plane Distance (3D)
Related work
![Page 16: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/16.jpg)
16
Related work (2D)Wasielewski, S.; Strauss, O.;, "Calibration of a
multi-sensor system laser rangefinder/camera," Intelligent Vehicles '95 Symposium., 1995
![Page 17: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/17.jpg)
17
Related work (2D)Mei, C.; Rives, P.;, "Calibration between a
central catadioptric camera and a laser range finder for robotic applications," ICRA 2006
![Page 18: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/18.jpg)
18
Related work (2D)Ganhua Li; Yunhui Liu; Li Dong; Xuanping
Cai; Dongxiang Zhou;, "An algorithm for extrinsic parameters calibration of a camera and a laser range finder using line features," IROS 2007
![Page 19: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/19.jpg)
19
Related work (3D)Qilong Zhang; Pless, R.;, "Extrinsic
calibration of a camera and laser range finder (improves camera calibration)," IROS 2004
![Page 20: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/20.jpg)
20
Related work (3D)Dupont, R.; Keriven, R.; Fuchs, P.;, "An
improved calibration technique for coupled single-row telemeter and CCD camera," 3DIM 2005
![Page 21: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/21.jpg)
21
Comparison2004 vs 2007
![Page 22: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/22.jpg)
22
Our ProblemPropose an autonomous data improving and
filtering method which lead to more accurate calibration result
![Page 23: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/23.jpg)
23
LRF-Camera SystemLaser Range Finder
Camera
![Page 24: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/24.jpg)
24
ChallengeSensor Model [Kneip, L.; 2009]
Laser range finder sampling an environment discretely
Laser data are noisy : Mixed pixel
![Page 25: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/25.jpg)
25
ChallengeLaser beams are invisible
Point-Line constrainsNo ground truth available
Autonomous processAutonomously improve and filter the data
![Page 26: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/26.jpg)
26
Proposed methodData improvement : Reduce angular error
![Page 27: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/27.jpg)
27
Proposed methodData filtering: Remove outlier
In case of mixed pixel: may select neighbor point instead
In case of moving calibration object: remove data pairs
![Page 28: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/28.jpg)
28
Scope of the researchPropose an autonomous laser data improving
and filtering method for extrinsic LRF/camera calibration
Laser range finder and camera can be placed at arbitrarily position as long as they have a common detection area
An environment is suitable for laser range finder and camera so that they can detect the calibration object
![Page 29: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/29.jpg)
29
Work PlanStudy the works in the related fieldsDevelop data improvement methodDevelop data filtering methodTest the proposed methodPrepare and engage in a thesis defense
![Page 30: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/30.jpg)
30
Thank you
![Page 31: Improving and Filtering Laser Data for Extrinsic Laser Range Finder/Camera Calibration](https://reader036.vdocuments.mx/reader036/viewer/2022062323/56815b82550346895dc983ef/html5/thumbnails/31.jpg)
31
Bundle adjustmentConceived in the field of photogrammetry during
1950s and increasingly been used by computer vision researchers during recent years
Mature bundle algorithms are comparatively efficient even on very large problems
Bundle adjustment boils down to minimizing the re-projection error between the image locations of observed and predicted image points
Visual reconstruction attempts to recover a model of a 3D scene from multiple images and also recovers the poses of the cameras that took the images