robust lane detection and tracking prasanth jeevan esten grotli
Post on 20-Dec-2015
220 views
TRANSCRIPT
![Page 1: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/1.jpg)
Robust Lane Detection and Tracking
Prasanth Jeevan
Esten Grotli
![Page 2: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/2.jpg)
Motivation
Autonomous driving Driver assistance (collision avoidance,
more precise driving directions)
![Page 3: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/3.jpg)
Some Terms
Lane detection - draw boundaries of a lane in a single frame
Lane tracking - uses temporal coherence to track boundaries in a frame sequence
Vehicle Orientation- position and orientation of vehicle within the lane boundaries
![Page 4: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/4.jpg)
Goals of our lane tracker
Recover lane boundary for straight or curved lanes in suburban environment
Recover orientation and position of vehicle in detected lane boundaries
Use temporal coherence for robustness
![Page 5: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/5.jpg)
Starting with lane detection
Extended the work of Lopez et. al. 2005’s work on lane detection Ridgel feature Hyperbola lane model RANSAC for model fitting Realtime
Our extension: Temporal coherence for lane tracking
![Page 6: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/6.jpg)
The Setup
Data: University of Sydney (Berkeley-Sydney Driving Team) 640x480, grayscale, 24 fps Suburban area of Sydney
Lane Model: Hyperbola 2 lane boundaries 4 parameters
2 for vehicle position and orientation 2 for lane width and curvature
Features: Ridgels Picks out the center line of lane markers More robust than simple gradient vectors and edges
Fitting: RANSAC Robustly fit lane model to ridgel features
![Page 7: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/7.jpg)
Setup
![Page 8: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/8.jpg)
Setup
![Page 9: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/9.jpg)
Setup
![Page 10: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/10.jpg)
The Setup
Data: University of Sydney 640x480, grayscale, 24 fps Suburban area of Sydney
Lane Model: Hyperbola 2 lane boundaries 4 parameters
2 for vehicle position and orientation 2 for lane width and curvature
Features: Ridgels Picks out the center line of lane markers More robust than simple gradient vectors and edges
Fitting: RANSAC Robustly fit lane model to ridgel features
![Page 11: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/11.jpg)
Lane Model
Assumes flat road, constant curvature
L and K are the lane width and road curvature
and x0 are the vehicle’s orientation and position
is the pitch of the camera, assumed to be fixed
![Page 12: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/12.jpg)
Lane Model
v is the image row of a lane boundary uL and uR are the image column of the left
and right lane boundary, respectively
![Page 13: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/13.jpg)
The Setup
Data: University of Sydney (Berkeley-Sydney Driving Team) 640x480, grayscale, 24 fps Suburban area of Sydney
Lane Model: Hyperbolic 2 lane boundaries 4 parameters
2 for vehicle position and orientation 2 for lane width and curvature
Features: Ridgels Picks out the center line of lane markers More robust than simple gradient vectors and edges
Fitting: RANSAC Robustly fit lane model to ridgel features
![Page 14: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/14.jpg)
Ridgel Feature
Center line of elongated high intensity structures (lane markers)
Originally proposed for use in rigid registration of CT and MRI head volumes
![Page 15: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/15.jpg)
Ridgel Feature
Recovers dominant gradient orientation of pixel
Invariance under monotonic-grey level transforms (shadows) and rigid movements of image
![Page 16: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/16.jpg)
The Setup
Data: University of Sydney 640x480, grayscale, 24 fps Suburban area of Sydney
Lane Model: Hyperbola 2 lane boundaries 4 parameters
2 for vehicle position and orientation 2 for lane width and curvature
Features: Ridgels Picks out the center line of lane markers More robust than simple gradient vectors and edges
Fitting: RANSAC Robustly fit lane model to ridgel features
![Page 17: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/17.jpg)
Fitting with RANSAC
Need a minimum of four ridgels to solve for L, K, , and x0
Robust to clutter (outliers)
![Page 18: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/18.jpg)
Fitting with RANSAC
Error function Distance measure
based on # of pixels between feature and boundary
Difference in orientation of ridgel and closest lane boundary point
![Page 19: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/19.jpg)
Temporal Coherence
At 24fps the lane boundaries in sequential frames are highly correlated
Can remove lots of clutter more intelligently based on coherence Doesn’t make sense to use global (whole
image) fixed thresholds for processing a (slowly) varying scene
![Page 20: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/20.jpg)
Classifying and removing ridgels
Using the previous lane boundary Dynamically classify left and right ridgels per row image gradient comparison “far left” and “far right” ridgels removed
![Page 21: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/21.jpg)
Velocity Measurements
Optical encoder provides velocity Model for vehicle motion
Updates lane model parameters and x0
for next frame
![Page 22: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/22.jpg)
Results, original algorithm
QuickTime™ and a decompressor
are needed to see this picture.
![Page 23: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/23.jpg)
Results, algorithm w/ temporal
QuickTime™ and a decompressor
are needed to see this picture.
![Page 24: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/24.jpg)
Conclusion
Robust by incorporating temporal features Still needs work
Theoretical speed up by pruning ridgel features
Ridgel feature robust Lane model assumptions may not hold in
non-highway roads
![Page 25: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/25.jpg)
Future Work
Implement in C, possibly using OpenCV Cluster ridgels together based on location Possibly work with Berkeley-Sydney Driving
Team to use other sensors to make this more robust (LIDAR, IMU, etc.)
![Page 26: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/26.jpg)
Acknowledgements
Allen Yang Dr. Jonathan Sprinkle University of Sydney Professor Kosecka
![Page 27: Robust Lane Detection and Tracking Prasanth Jeevan Esten Grotli](https://reader034.vdocuments.mx/reader034/viewer/2022051415/56649d4e5503460f94a2db18/html5/thumbnails/27.jpg)
Important works reviewed/considered
Zhou. et. al. 2006 Particle filter and Tabu Search Hyperbolic lane model Sobel edge features
Zu Kim 2006 Particle filtering and RANSAC Cubic spline lane model No vehicle orientation/position estimation Template image matching for features