pro.pilot advanced driver assistance systems enhancement of comfort and safety

pro.pilotAdvanced Driver Assistance Systems

Enhancement of Comfort and Safety

Sensors and Systems

© Siemens VDO Automotive | SV C RS DA 321.02.2006

Local Data Lane recognition Object detection …

50

Global Data Lane segments Traffic signs …

Internal Data Steering angle Wheel speed ….

Driver Destination Action Dynamic etc…

Local environmental sensing is the missing link between vehicle, digital map and real world !

Local Environmental Sensing


Advanced Driver Assistance SystemsKey Sensors

Laser Range Detection SIT 3D Camera

Monocular Vision Stereo Vision

VideoRadar

24 GHz UWB near range 24 GHz NB mid range

Lidar

GPS & Map

Localization by GPS and map

Ultrasonic

Short Range Low Cost Distance Sensor

Communication

Car to Car Car to Infrastructure


pro.pilot System Competence @ Siemens VDO

pro.pilot


pro.pilotSensitive Guidance

pro.pilotNight Vision (NIR)

pro.pilot Concept Car

pro.pilotAdaptive Cruise Control

pro.pilotBlind Spot Detection / Lane Change Assist

pro.pilotLane Departure Warning

pro.pilotSafe Exit Assist

pro.pilotTraffic Sign Recognition

pro.pilotTraffic Jam Assist

pro.pilotPark Mate

pro.pilotNight Vision (FIR)

System Concept HMI

Implementation in 2006


Lidar sensor & ECU for distance measurement with 5 infrared laser beams (one main plus 2 x 2 to cover cut-ins)

Beam adjustment into curve High sensitivity (230m detection range) Effective water spray suppression

Components

HW Integration

Brake & throttle control

Sensor Fusion (e.g. with Digital Maps via Electronic Horizon)

Integration of camera, rain sensor & light sensor into Lidar package possible

Vehicle Integration Control via steering

arm

Warning strategy

System status via Icons in Head Up Display or Instrument Cluster

Acoustic signal for driver intervention

Driver Interface

Object detection and tracking

Lane association

Control of beam adjustment (sweep and micro-sweep)

Algorithms

Adaptive Cruise Control ACCFunction and System


HW Integration

CAN-Bus Interfaces


Vehicle Integration Directed Vibration warning via

steering wheel

Variable thresholds for vibration and steering torque

System Warning strategy


Driver Interface

Object Detection Algorithm for lane recognition based on lane track markings

consideration of curves

Monitoring of vehicle dynamics and driver actions

Algorithms CMOS High Dynamic

Range Camera

Modular Image Processing ECU

Electronic Steering Actuator for steering wheel vibration

Components

Lane Departure WarningFunction and System


Dual-beam 24GHz Radar sensor with ECU in one package applying a pulsed frequency hopping UWB mode (SV patented)

Electronic Steering Actuator for HMI

Components

Red LED in door frame close to wing mirror

Vibrating steering wheel in combination with turn signal

warning strategy

Driver Interface

Detection of relevant objects within the detection zone

Classification of detected objects

Issue warning

Algorithms

8 6 5 4 3 2 1 0

beam-shape I

beam-shape II

Warning Zone

Blind Spot Detection (BSD)Function and System

Integration of radar sensors invisibly behind fascia

CAN-Bus Interfaces


Vehicle Integration

© Siemens VDO Automotive | SV C RS DA 10

21.02.2006

Filtering

Image analysis

Object detection

Algorithms

Visualization via head up display

Integration of navigation info

Integration of lane markings in FIR-image

Driver Interface

Pedestrians ahead!Pedestrians ahead!

HW Integration

HUD visualization strategy with other functions

Vehicle Integration

Pedestrians ahead!Pedestrians ahead!

Components NIR-sensitive

camera (0,9μm) (same HDR CMOS camera as for LDW)

ECU NIR headlights Alternatively:

FIR-Camera Head Up Display

Night VisionFunction and System


21.02.2006

eHorizon: provides GPS & map data for ADAS applications

Data fusion of sensors and digital maps

Object Detection (e.g. traffic signs) with probability calculation

Algorithms

Driver Interface

Head-up Display or Instrument Cluster

Reject button on steering wheel

warning strategy

Digital maps via eHorizon

HDR CMOS Camera with ECU

Head Up Display (HMI)

Components

HW Integration

ECU

CAN-Bus Interfaces

Sensor Fusion

Vehicle Integration

Traffic Sign RecognitionFunction and System


21.02.2006

CMOS High Dynamic Range Camera

Modular Image Processing ECU

Components

HW Integration

CAN-Bus Interfaces

Sensor Fusion (e.g. with LIDAR)

Vehicle Integration

Object Detection Algorithm for vehicle recognition

Monitoring of vehicle dynamics and driver actions

Algorithms

System Warning strategy


Driver Interface

Traffic Jam AssistFunction and System


21.02.2006

Driver Interface

Display in Instrument Cluster

warning strategy

HW Integration

ECU

CAN-Bus Interfaces

Vehicle Integration

calculation of trajectory for semiautonomous parking maneuver

Algorithms

ultrasonic sensors

steering actuator

Components

Park MateFunction and System


21.02.2006

Driver Interface

Enhanced road information on (navigation) display (e.g. lane position)

Situation adapted driving instructions

HW Integration

ECU

CAN-Bus Interfaces

Sensor Fusion

Vehicle Integration

Digital maps Multiple sensors

(Radar, Lidar, Camera)

GPS Information

Components

Integration of environmental sensors data into navigation process

Algorithms

Sensitive GuidanceFunction and System

ADASSafety and Comfort


21.02.2006

Reduction of accident probability

Get ready for the accident

Mitigation of accident impactfor passengers

Normal Driving

Critical Condition

Pre-Crash In-Crash Post-Crash

pro.pilot

Blind Spot Detection

Lane Departure Warning

Night Vision Adaptive Cruise

Control Driver

Monitoring

Vehicle Dynamics

ABS Anti Slip

Control (e.g. ESP)

Pre-Crash system

RestraintSystem

Front AirbagSide Airbag

Post-Crash system

GSM Telemetrics

Rescue

Sco

peS

yste

mS

ituat

ion

Accident happensAccident avoidance

C r a

s h

Integrated Passive and Active Safety Systems


21.02.2006

(Source: Statistisches Bundesamt, 2005)

7%

16%

4%

29%

9%

6%11%

9%

1%

8%

... runs in or stands

... drives in front or w aits

... drives side by side in thesame direction

... is driving in oppositedirection

... turns or crosses

Collision betw een vehicleand pedestrian

Collision w ith an obstacle onthe road

Lane Departure to the right

Lane Departure to the left

Other

Types of accidents in Germany in the year 2004

Europe29 % Turns or Crosses -> BSD

16 % drives in front -> ACC15 % Lane Departure -> LDW


21.02.2006

pro.pilotMarket Drivers

Regular bodies (EU commission, NHTSA) require a substantial reduction of accident fatalities

Increasing traffic density leads to more complex traffic situations and an increased workload of the driver

Ageing society requires cars taking physical deficiencies of the driver into account

Legislation: e.g. pedestrian protection, new regulations e.g. for mirrors

Stringent fuel consumption and emission legislations may demand new driving strategies

0

100.000.000

200.000.000

300.000.000

400.000.000

500.000.000

600.000.000

700.000.000

800.000.000

1970 1980 1985 1990 1995 2000 2002 2003 2004

1.000 km

0,4

0,5

0,6

0,7

0,8

0,9

1,010.000 Vehicles/km

Number of Vehicles Kilometer Traveled Traffic Density

0

2000

4000

6000

8000

10000

12000

14000

16000

1980 1985 1990 1995 2000 2010

Year

Fat

alit

ies

Trend

fatalities

EU demand


21.02.2006

pro.pilotMarket Drivers

Regular bodies (EU commission, NHTSA) require a substantial reduction of accident fatalities

Increasing traffic density leads to more complex traffic situations and an increased workload of the driver

Ageing society requires cars taking physical deficiencies of the driver into account

Legislation: e.g. pedestrian protection, new regulations e.g. for mirrors

Stringent fuel consumption and emission legislations may demand new driving strategies

27,97

23,0720,65

USA

UK

Japan

40

35

30

25

20

15

10

5

0

(%)

1900 1940 1980 20201920 1960 2000 2030


21.02.2006

Safety Comfort Fun &

Pleasure Orientation &

Overview Costs

Driver

Sales Profit Branding and

differentiation

OEMs

Supplier

Safety of all road users

Environmental Protection

Economics

Society

Vision "Collision Free Driving"

Advanced Driver Assistance Systems

Collision free drivingBenefits for different interest groups


21.02.2006

Assist but not patronize the driver!

pro.pilot (Advanced Driver Assistance Systems)

pro.pilot uses environmental sensing in order to assist the driver in his driving task to increase safety and comfort

pro.pilot

Philosophy of Siemens VDO


21.02.2006

public name recognition of ADAS functions(Source: SV Consumer Survey)

n = 290

0 10 20 30 40 50 60 70 80 90

Adaptive Cruise Control

Blind Spot Detection

Lane Departure Warning

Night Vision

Park Mate

Traffic Jam Assist

Traffic Sign Recognition

number of persons in %known unknown


21.02.2006

Advantages of different ADAS(Source: SV Consumer Survey)

Adaptive

Cruise Control

BlindSpot

Detection

LaneDeparture

Warning

NightVision

Park Mate

TrafficSign

Recognition

TrafficJam

Assist

higher safety 56 % 68 % 70 % 66 % 23 % 27 % 36 %

higher comfort 31 % 15 % 14 % 12 % 56 % 35 % 43 %

more orientation 7 % 14 % 7 % 20 % 9 % 21 % 5 %

no advantage 5 % 3 % 9 % 2 % 11 % 17 % 16 %

n = 290

=> ADAS can't be separated in Comfort-Systems and Safety-Systems

Summary


21.02.2006

Orientation & Overview

Driving like on the home coursee.g. Sensitive Guidance, Night

Vision, Object Detection

Driving Pleasure & Fun

Economic Driving

Driving with less fuel consumption, less coste.g. ACC Stop&Go

Comfort /Relax

Driving without stresse.g. LDW, ACC

Enjoy driving, but never leave

the limit

Driver

pro.pilot Profile @ SV

pro.pilot advanced driver assistance systems enhancement of comfort and safety

Documents

pilot slide

siemens vdo pro

pilot concept car pro

system slide

pilot park mate pro

pilot sensitive guidance

pilot system competence

pilot traffic jam assist