road surface analysis for driving assistance - pcl · road surface analysis for driving assistance...
TRANSCRIPT
![Page 1: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/1.jpg)
Road Surface Analysis for Driving Assistance
M. Bellone and G. Reina
Department of Engineering for Innovation, University of Salento, Lecce, Italy
Robotics and Mechanic Systems Lab
Speaker: Mauro BelloneE-mail: [email protected] student, University of Salento
1st International Workshop on 3D Robot
Perception with Point Cloud Library
![Page 2: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/2.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Introduction
• Terrain description aimed at safe navigation for autonomous vehicles;• Investigation of advanced perception techniques using 3D points cloud; • Perception systems for autonomous driving;
![Page 3: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/3.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Which is the problem ?
Road Hazards Avoidance
![Page 4: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/4.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Terrain Analysis & Road Hazards Detection
«ground» segmentation in outdoor environments Terrain Analysis
![Page 5: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/5.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Acquisition via OpenNI Grabber in PCL
openni_wrapper::Imagepcl::OpenNIGrabber
OpenNI Grabber Framework in PCL - callbacks
![Page 6: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/6.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Points Cloud filtering
pcl::StatisticalOutlierRemoval
pcl::PassThrough
![Page 7: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/7.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Points Cloud filtering
pcl::StatisticalOutlierRemoval
pcl::PassThrough
![Page 8: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/8.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Reference Frame Transformation
pcl::transformPointCloud (in, out, Eigen::Matrix)
![Page 9: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/9.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Terrain Analysis Through Normal Vectors
orientation
homogeneity
𝜁𝑘𝑞
= 1𝜁𝑘𝑞
< 1
pcl::NormalEstimation normal estimation using Principal Componet Analysis
pcl::KdTreeFLANN fast neighbourhood selection using KdTrees
UPD =𝐹 𝑝𝑞 , 𝑃𝑘 = 𝑟x
𝑞, 𝑟y𝑞, 𝑟z𝑞, 𝜁𝑘𝑞
![Page 10: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/10.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Orientation Analysis
All vectors whose orientation is higher than a solid angle α, are defined asNON GROUND
![Page 11: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/11.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
DUNE:
• Mobile robot featuring a 4-wheel independent drive steering and a rocker-bogie passive suspension system;
• 3-dimentional vision via Microsoft Kinect sensor;
• Vision range – 4m.
CLAAS AXION 840 4WD:
• Commercial Agricultural tractor equipped with a robotic vision system;
• Stereoscopic vision via Bumblebee XB3 camera;
• Vision range – 22m.
Alfa 147:
• Commercial car;
• 3-dimentional vision via Microsoft Kinect sensor;
• Vision range – 4m.
Test beds
![Page 12: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/12.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Indoor Test
Typical indoor scenario: The floor is correctly detected as a traversable region, whereas walls are correctly classified as non traversable
𝜁𝑘𝑞
max
𝜁𝑘𝑞
min
Typical indoor environment
![Page 13: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/13.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Road Hazards Detection - Mechanic System
Holding system design (b) where, α is the view angle, β is the sensor inclination angle, and Lw is the look-ahead distance
Kinematic chain
The experimental test bed equipped with a Kinect camera
![Page 14: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/14.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Road Hazards Detection - Results
![Page 15: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/15.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Road Hazards Detection - Results
![Page 16: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/16.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Link on YouTube: https://www.youtube.com/watch?v=X8badVvQ3Q4
Road Hazards Detection - Results
![Page 17: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/17.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Histogram Analysis
![Page 18: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/18.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Computational Time
The computational time has been measured on low-performance computer:Eee-pc Asus 1215N – Intel Atom CPU 1.8 GHzOS Ubuntu 12.04
![Page 19: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/19.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Obstacles Detection
Positive Objects Ramp
Positive Obstacles: Every object, cause of potential collision, should be correctlyinterpreted
![Page 20: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/20.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Obstacles Detection
Dynamic Obstacles: The vehicle should always preserve the safety of humansinterpreted as dynamic object
Single Human Operator Multiple Human Operators
![Page 21: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/21.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Obstacles Detection
Negative Obstacle
Difficult Scenarios: Woodlands, high grass and waterholes should be correctlydetected in order to preserve the vehicle safety.
Woodland High Grass
![Page 22: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/22.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Experimental Application: Agricultural
Link on YouTube: https://www.youtube.com/watch?v=wjZxROMB3QE
![Page 23: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/23.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Advanced perception system for mobile robotics can be enhanced using 3D points cloud processing. Possible tasks are:
• Navigation and reconnaissance for autonomous driving• Obstacle detection and recognition;
Specifically, by using UPD as a geometric descriptor, it is possible to:
• Enhance safe driving;• Interpret outdoor scenes in challenging terrain;
Further work:
• Include the UPD descriptor for path planning applications; • Enhance the reliability of the descriptor;
Conclusion
![Page 24: Road Surface Analysis for Driving Assistance - PCL · Road Surface Analysis for Driving Assistance M. Bellone and G. Reina Department of Engineering for Innovation, University of](https://reader031.vdocuments.mx/reader031/viewer/2022022713/5c4ac5b693f3c31f4a7c6944/html5/thumbnails/24.jpg)
1st International Workshop on 3D Robot Perception
with Point Cloud Library - July 2014
Any question ?
All the content has been published on my personal webpage at:https://sites.google.com/site/bellonemauro/
and on the following YouTube channel: https://www.youtube.com/channel/UCQCiwHWxLcmMnRj6JyShkfA
Mauro BelloneE-mail: [email protected]