11

Light Vehicle Extended Pilot Test

Dave LeBlancMary Lynn Buonarosa

Adam BlankespoorUMTRI

Extended Pilot Test (EPT) Objectives

• Demonstrate FOT readiness through a full dress rehearsal.– 12 drivers from the general public– 4 FOT vehicles equipped with IVBSS– Experimental process exercised

• Success criteria:– Is driver acceptance positive?– Does IVBSS perform as expected? Is it robust?– Is data collection reliable?– Is the experimental process ready for the FOT?

2

Light Vehicle Field Operational Test & Extended Pilot Test

Platform Test Drivers / usage period Travel distance

Light vehicle

FOT 108 drivers @ 6 wksplus 10 drivers @ 6 additional wks

Baseline ( 2 weeks )IVBSS enabled (4 weeks)

272,000 Miles*436,000 Km

Extendedpilot

12 drivers @ 4 weeks

IVBSS enabled only (4 weeks)

12,600 Miles20,200 Km

* Prediction based on previous FOTs

Drivers for both tests: •Evenly split by gender•Evenly split by age groups (20-30, 40-50, 60-70 years)

Driver Recruitment & Orientation

• Recruitment with licensing agency database– Southeast Michigan resident with 2 yrs driving, no

egregious violations, and self-reported mileage at least 75% of average NPTS for the age/gender group.

• Pre-drive information and training:– Informed consent form – Questionnaires: demographic background,driver

behavior questionnaire (DBQ), driver style questionnaire (DSQ)

– Video overview of IVBSS– Hands-on demonstration, including static demo of driver

interfaces, and on-road test driveFebruary 10, 2009 IVBSS 11th Quarterly Briefing 4

Post-Drive Instruments

• Written Questionnaire– General Impression of IVBSS– Combinatorial Effects of the Warnings– Forward Crash Warning (FCW)– Lateral Drift Warning (LDW)– Lane Change/Merge Warning (LCM)– Overall IVBSS Warning Acceptance– Displays and Controls– Training and Ease of Learning

• Verbal questions• Video-assisted review of the driver’s alerts

IVBSS Data Acquisition System

Data sources: CAN buses – IVBSS, OEM J1939 (heavy truck) 5 cameras with video capture &

compression 6 or 7 radars Onboard map match (LV)UMTRI Data acquisition system: Two CPU system Automotive-grade hard disks Second GPS Vehicle motion IMU Microphone………ETC! GPRS/Edge cellular modem DAS power management system

77

Travel During EPT

Total distance traveled: 12,629 miles.99.7% of distance traveled was capturedby DAS.

Video

8

99

Alerts by Warning Functionality

Note: 45% of alerts involve no audible alerts, only haptic seat vibration.

(All alerts are followed by text on the OEM center-stack display.)

FCW/audible9%

CSW/audible6%

LDW‐unoccupied/

haptic45%

LDW‐occupied/audible22%

LCM/audible18%

Alert Experience Varies by Driver

38%

6% 31%

4%

21%

Driver 20113%

11%

51%

2%

23%

Driver 2028%

12%

61%

15%3%

Driver 203

17%

36%

37%

6%4%

Driver 204

14%

31% 48%

< 1%6%Driver 205

7%

21%

49%

4%

18%

Driver 206

20%

14%

50%

2%

14%Driver 207

41%

20%

29%

3%6%

Driver 208

16%

30% 51%

3%< 1%Driver 209

22%

9%

52%

11%6%

Driver 210

21%

34%

27%

4%

14%Driver 211

6%6%

44%

< 1%

44%

Driver 212

LDW-unoccupiedLDW-occupiedLCMFCWCSW

1111

Alerts Per 100 Mi (161 Km)

Individual drivers Mean

0.0

2.5

5.0

7.5

10.0

12.5

15.0

17.5

Overall Alert Rate by Individual Drivers

121225 < V < 35 35 < V < 55 V > 55

0

10

20

30

40

50

60

70

80

90

100LDW Lane Tracking Availability Results

Per

cent

age

of T

ime

Ava

ilabl

e

LeftBothRight

Host speed (mph)

LDW AvailabilityNote: Testing in Winter

13

Subjective Results: Overview

Questionnaire topic MeanHelpful 6.3Attention‐getting 6.6Not annoying 6.1Not distracting 5.7Will increase driving safety 6.3

14

Questionnaire: Sample of Response Distribution

 

0

2

4

6

8

10

1 2 3 4 5 6 7

Res

pons

e Fr

eque

ncy

Overall, how satisfied were you with the integrated system?

Mean = 6.4 St. Dev = 0.8

VeryDissatified

VerySatisfied

15

Sanity Check: Comparing IVBSS to RDCW FOT

Using Van der Laan Ratings

0

0.5

1

1.5

2

0 0.5 1 1.5 2

Satis

fact

ion

Usefulness

RDCW

IVBSS

Very useful,very satisfied

Neutral

• IVBSS extended pilot test results : 11 subjects feedback.• RDCW FOT results: 78 drivers.

LV pilot

Safety impacts & driver performance - Examples

• Examine:– Driving pattern changes:

• Involvement in scenarios, e.g., approaches to decelerating lead vehicles

• Changes in pre-conflict and conflict distributions, e.g., headway times, forward conflict distributions, lane change metrics, curve-taking

– Driver response to events– Unintended consequences

• Estimates of potential safety benefits - Volpe

Example - Forward conflict –analysis steps*

 

17

-1.5

-0.8

Dec

el-to

-avo

id (m

/sec

^2)

Time to collision(sec)0 0

Region defining candidateconflict episodes

0.5

continues

10

0

5

10

15

20

25

4 4.5 5 5.5 6 6.5 7 7.5 8 8.5 9 9.5 10

Driver's mean enhanced TTC at brake onset (sec)

Num

ber o

f driv

ers

Week 1

Weeks 3, 4

* ACAS FOT [USDOT HS 809 901]

1818

LV Extended Pilot Test Conclusions

• Driver acceptance of IVBSS is high. • IVBSS performed well, but modest changes and

calibration changes would reduce potential nuisance alerts in specific scenarios.

• IVBSS was robust in the field. • Data collection & management is ready, with

adjustments.• Recruitment, subject handling, and subjective data

instruments is ready, with adjustments.