Towards integrated models of vehicle-pedestrian interaction

Estimating Speeds of Pedestrians in Real-World Using Computer VisionSultan Daud Khan, Fabio Porta, Giuseppe Vizzari and Stefania BandiniComplex Systems and Artificial Intelligence Research Center (CSAI)University of Milano-Bicocca, Italy

OutlineCrowd studies: towards integrated analysis and synthesisComputer vision and crowd studiesVelocity estimation in naturalistic conditionsCrowd flow segmentation and countingIdentification of sources and sinks, towards pedestrian behaviour understanding

C&CA @ ACRI 2014 Sept. 22, 2014OutlineCrowd studies: towards integrated analysis and synthesisComputer vision and crowd studiesVelocity estimation in naturalistic conditionsCrowd flow segmentation and countingIdentification of sources and sinks, towards pedestrian behaviour understanding

C&CA @ ACRI 2014 Sept. 22, 2014Motivations of crowd studiesLarge events involving large number of people in relatively small spaces are periodically held all around the world (sports, expositions, festivals, etc.)Public safety in high density crowds is potentially a big issueDecision support for designers and crowd managers, both in planning and management phases, is highly desirable

C&CA @ ACRI 2014 Sept. 22, 2014Towards integrated analysis and synthesis of crowd phenomena

C&CA @ ACRI 2014 Sept. 22, 2014OutlineCrowd studies: towards integrated analysis and synthesisComputer vision and crowd studiesVelocity estimation in naturalistic conditionsCrowd flow segmentation and countingIdentification of sources and sinks, towards pedestrian behaviour understanding

C&CA @ ACRI 2014 Sept. 22, 2014Computer vision and crowd studiesRelevant factors influencing choice of techniquesCrowd typesStructured (motion constrained by environmental structure, crowd management procedures, other rules)Unstructured (little constraints to pedestrian movements)Crowd densityInitially driven by surveillance and security (anomalous movements detection)Recent interest in collaborating with modeling and simulation community1st IEEE Workshop on Modeling, Simulation and Visual Analysis of Large Crowds ICCV 2011First International Workshop on Pattern Recognition and Crowd Analysis ICPR 2012

Junior, Musse, Jung, Crowd Analysis Using Computer Vision Techniques IEEE Signal Processing Magazine, 2010

C&CA @ ACRI 2014 Sept. 22, 2014Current activities and resultsLow-medium density situationsVelocity estimation in naturalistic conditionsHigh density situationsCrowd flow segmentation and countingIdentification of sources and sinks, towards pedestrian behaviour understanding

C&CA @ ACRI 2014 Sept. 22, 2014OutlineCrowd studies: towards integrated analysis and synthesisComputer vision and crowd studiesVelocity estimation in naturalistic conditionsCrowd flow segmentation and countingIdentification of sources and sinks, towards pedestrian behaviour understanding

C&CA @ ACRI 2014 Sept. 22, 2014Initial tracking approachFrame enhancement and foreground segmentationTracking with KLT after corner detection

C&CA @ ACRI 2014 Sept. 22, 2014Velocity estimation in side view scenariosPixel to metric coordinates conversion approach based on the idea of scaling factorsOnly applicable to limited kind ofscenarioRequires coordinates of two pointsper considered path

C&CA @ ACRI 2014 Sept. 22, 2014Velocity estimation through homography Alternative and more applicable (not limited to analysis of linear paths) approach to conversion between pixel and metric coordinatesRequires coordinates of four points in the analyzed scene

C&CA @ ACRI 2014 Sept. 22, 2014Tracking with the GMPC approach

Zamir, Dehghan, Shah: GMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs. ECCV (2) 2012: 343-356

C&CA @ ACRI 2014 Sept. 22, 2014OutlineCrowd studies: towards integrated analysis and synthesisComputer vision and crowd studiesVelocity estimation in naturalistic conditionsCrowd flow segmentation and countingIdentification of sources and sinks, towards pedestrian behaviour understanding

C&CA @ ACRI 2014 Sept. 22, 2014Crowd flow segmentation and counting

C&CA @ ACRI 2014 Sept. 22, 2014OutlineCrowd studies: towards integrated analysis and synthesisComputer vision and crowd studiesVelocity estimation in naturalistic conditionsCrowd flow segmentation and countingIdentification of sources and sinks, towards pedestrian behaviour understanding

C&CA @ ACRI 2014 Sept. 22, 2014Identification of sources and sinks

C&CA @ ACRI 2014 Sept. 22, 2014Towards pedestrian behaviour understanding

C&CA @ ACRI 2014 Sept. 22, 2014ConclusionsModeling and simulation studies need different types of data for calibration, validation, but also for the initial configuration of plausible simulationsComputer vision approaches can offer several solutions to these requirements and needsThe jargons, goals, perception of research challenges is not necessarily shared...... working together, possibly in joint projects, can surely improve the situation and achieved results

C&CA @ ACRI 2014 Sept. 22, 2014

Giuseppe Vizzari