computer vision, machine learning, autonomous driving · 2014-11-07 · today’s computer vision...
TRANSCRIPT
Sahin KirtavitOctober 21, 2014
COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING
Cars* are getting smarter …
(*) Car Computers
Today’s Computer Vision Pipeline
car
ped
Data Gathering Pre-Processing
Petabytes of video
10,000 hours of video
100 thousands of images
Off-line Training
car
pe Positive and
Negative samples
Decision Tree
Data Crunching
Object Detection
Image Processing
Detection
Visualization
Offline Real-time
• Highly accelerated Vision primitives• Framework
• Assemble primitives, efficient pipelining• Memory access optimizations, locality• Schedule across different HW modules• Multimedia and graphics access abstraction
• Set of sample pipelines• Training tools for classifiers
• Speedup by desktop GPU
High Performance
Vision Primitives
High Performance
Vision Primitives
Framework
Samples and Apps
VisionWorks
VisionWorks Software Stack
Application Code
SamplePipelines
Tegra/Kepler dGPU
CUDA
VisionWorksFramework
OpenVX
VisionWorks APIs
…Classifier Corner Detection
FeatureTracking SLAM
Example : Feature Tracking
Grab• OpenCV
Framesource• NVMedia
Find• Harris
corners
Track• Pyramidal
Lucas-Kanade
Display• OpenCV
imshow• OpenGL
VisionWorks
Feature Tracking Speedup
Image Pyramid
FastCornerDetection
Harris Corner Detection
Optical Flow
8.8
21.05
84.04
21.25
1
10
100
Speedup (x) GPU vs ARM code on Tegra TK1*
5 TFLOPS 2048 Cores
Maxwell The Most Advanced GPU Ever Made
One is a photo,One is CG …
Next-Gen Computer Vision Pipeline
Deep Neural NetworksData Creation Intelligent Car
Evolution
Driver Software Designer Self Learning Machines
Questions?