filtration analysis of pedestrian-vehicle interactions for ...yee mun lee, laura garach, natasha...

15
Filtration analysis of pedestrian-vehicle interactions for autonomous vehicle control IAS-15 Workshop on Robot Perception of Humans Baden-Baden June 11th 2018 Institute for Transport Studies, University of Leeds Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden Fanta Camara, Oscar Giles, Ruth Madigan, Markus Rothmueller, Pernille Holm Rasmussen, Signe Alexandra Vendelbo-Larsen, Gustav Markkula, Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox

Upload: others

Post on 08-Sep-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Filtration analysis of pedestrian-vehicle interactions for autonomous vehicle control

IAS-15 Workshop on Robot Perception of Humans Baden-Baden June 11th 2018

Institute for Transport Studies, University of Leeds

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Fanta Camara, Oscar Giles, Ruth Madigan, Markus Rothmueller, Pernille Holm Rasmussen, Signe Alexandra Vendelbo-Larsen, Gustav Markkula,

Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox

Page 2: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Team

Charles W. FoxFanta Camara

Oscar GilesGustav Markkula

Ruth Madigan Yee Mun Lee Laura Garach

Natasha Merat

Markus Rothmueller Pernille Holm Rasmussen

Signe Alexandra Vendelbo-Larsen

Robotics

Neuro-science

Psychology

Techno-anthropology

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 3: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Motivations

EU H2020 interACT project

EU City mobil 2 project

Trials of an AV:La Rochelle (France) and Trikala

(Greece)

Finding from Madigan et al.: pedestrians intentionally step in front the AV once every 3 hours

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 4: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Background

Fox et al. 2018

Camara et al. 2018

Sequential Chicken Game: Game theory model for pedestrian-vehicle interactions

Non-zero probability for a collision to occur

Real world pedestrian-pedestrian interactionsBetween Hollywood and Highland, Los Angeles

Fit parameters U_crash and U_time to H-H interactions

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 5: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Data collection: Pedestrain-Vehicle interactions

Descriptor Features: gender, age, weather, number of

pedestrian and vehicle, pedestrian“s distraction

Event Features:(what is the pedestrian/vehicle doing ?)

Approaching while keeping pace, stopped to due the traffic, turning the head to the right, using the turn indicator, looking at other road users, etc

Observers“ standing locations (X and Y)

Intersection near Woodhouse Lane, University of Leeds

2 Observers standing next each other:- one focusing on the pedestrian - the other focusing on the vehicle

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 6: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Examples of interactions

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 7: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Interactions

204 interactions 204 sequences of actions

Example: a sequence of an interaction

V comingfrom left

V turn indicator

V stopped traffic

P slowed down

P head turned left

P: PedestrianV: Vehicle

P didn“t stop

V turned right

V accelerated

V passed pedestrian

P looked at other RUs

P initiatedcrossing

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 8: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Interactions into games

P: PedestrianV: Vehicle

End of game event: vehicle winner of the interaction

Game: Vehicle or Pedestrian winner ?

V turn indicator

V stopped traffic

P slowed down

P head turned left

P didn“t stop

V turned right

V accelerated

V passed pedestrian

P looked at other RUs

P initiatedcrossing

V comingfrom left

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 9: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Interactions vs Games

Interactions

Games

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 10: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

FiltrationConcept to incorporate events over time, used in

optimal stopping problems e.g: Mariage problem, Biology (sequence analysis), Finance

Compute likelihood for each descriptor/event features

Fuse likelihoods over time

t=0 : prior P(W|0) (36%: 74 out of 204)

t=1 : all descriptors are observed and incorporated …

t=n : all features have been observed

where

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 11: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Filtration results for 10 interactions

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 12: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Filtration results: all interactions

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 13: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Residual filtration posterior volatilityA series of statistics to inform about the standard deviation over the filtration

The descriptor fetaures and the first event features are important but not the later ones

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Page 14: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Conclusion Large scale observation of real world pedestrian-vehicle interactions

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden

Filtration on the sequences of interaction

The residual shows that an Av should wait and observe the initial features before acting

Features are assumed to be independent => new way to model that

Infer pedestrian and driver assertiveness: U_crash and U_time

Take into account observation of non-features

Future work

Page 15: Filtration analysis of pedestrian-vehicle interactions for ...Yee Mun Lee, Laura Garach, Natasha Merat and Charles W. Fox. Team Charles W. Fox Fanta Camara Oscar Giles Gustav Markkula

Fanta Camara [email protected]

Thank

You

For

Your

Attention

!

Fanta Camara — IAS-15 Workshop on Robot Perception of Humans — June 11th Baden Baden