automation of pedestrian tracking in a crowded situation using angled uncalibrated camera

Upload: matthew-cua

Post on 30-May-2018

215 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    1/21

    AUTOMATION OFAUTOMATION OFPEDESTRIAN TRACKINGPEDESTRIAN TRACKING

    IN A CROWDEDIN A CROWDED

    SITUATION USINGSITUATION USINGANGLED UNCALIBRATEDANGLED UNCALIBRATED

    CAMERACAMERASaman SaadatSovannarith HengKardi Teknomo

    Ateneo de Manila University

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    2/21

    Overview

    Introduction

    Problem

    MethodResults

    Conclusion

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    3/21

    IntroductionThe importance of measurement of

    individual pedestrian trajectories

    E.g. In Business, Evacuation, and Traffic

    etc.

    Pedestrians movement influencing safetyconcerns in crowded locations.

    E.g. such as sports venues, public transportstation, and religious events etc

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    4/21

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    5/21

    Kelly (2007) states that most ofthe person detection techniqueworks better in well controlled

    environments such as laboratorysetting with a small amount ofpeople.

    Literature

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    6/21

    Kelly, OConnor, and Smeaton (2009)shows that other techniques require morethan one camera with overlapping fields ofview in order to cope with the pedestrian

    segmentation problem in the a densecrowd.

    We need to use extra cameras which cost

    much.

    Literature

    R

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    7/21

    How can we track all pedestrians in the sceneusing a single camera and save the data oftracking as a NTXY table?

    Fig. 1 Walking experiment at Ateneo de Manila

    Researc

    Problem

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    8/21

    Method in

    Automation

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    9/21

    Object Detection1. Split the video sequence into three channels of

    Red, Green and Blue (RGB)

    2. Subtracting green channel from the redchannel

    3. Threshold of 70 (out of 255)

    i(x, y) = r(x, y) g(x, y)

    >

    =

    otherwise0

    ),(if1),(

    yxiyxf

    Obj D i

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    10/21

    Object Detection(cont.)

    Obj t D t ti

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    11/21

    Object Detection(cont.)

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    12/21

    Run the particle analysis in ImageJ to:

    Detect all objects in a frame by usingconnected component algorithm

    Analyze each detected object for their area

    and centroid coordinate

    The result will be a table with ID, coordinateand slices number of each object.

    Object Analysis

    Obj t A l i

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    13/21

    Fig. 4 Results of particlesanalysis of the binary image

    Fig. 5 Tabulated result of particleanalysis

    Object Analysis(cont.)

    Obj t A l i i

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    14/21

    Object Analysis inImageJ

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    15/21

    Flowchart of Tracking

    Algorithm

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    16/21

    Object Tracking

    Searching for the neighborhood

    Obj t T ki

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    17/21

    Object Tracking

    (cont.)

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    18/21

    Comparison with ManualTracking

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    19/21

    Research Question:How can we track all pedestrians in thescene using a single camera and savethe data of tracking as a NTXY table?

    1. Red hat detection2. Blob identification

    3. Frame by frame tracking of

    trajectories4. Conversion to NTXY

    Summary

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    20/21

    We were able to create algorithms to detect,to analyze and to track pedestrian fromuncalibrated angle camera for outdoorcrowded situation

    The system was able to recognize

    pedestrians at reasonable rate ofmisclassification

    86.7% correctly detected (red hat)

    13.3% maximum error (any other red

    object) Accuracy can further be improved by taking

    into account the size and shape of the blob asit moves (distinguishing red hat from other

    red objects)

    Conclusion

  • 8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA

    21/21

    Thank you