automation of pedestrian tracking in a crowded situation using angled uncalibrated camera
TRANSCRIPT
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
1/21
AUTOMATION OFAUTOMATION OFPEDESTRIAN TRACKINGPEDESTRIAN TRACKING
IN A CROWDEDIN A CROWDED
SITUATION USINGSITUATION USINGANGLED UNCALIBRATEDANGLED UNCALIBRATED
CAMERACAMERASaman SaadatSovannarith HengKardi Teknomo
Ateneo de Manila University
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
2/21
Overview
Introduction
Problem
MethodResults
Conclusion
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
3/21
IntroductionThe importance of measurement of
individual pedestrian trajectories
E.g. In Business, Evacuation, and Traffic
etc.
Pedestrians movement influencing safetyconcerns in crowded locations.
E.g. such as sports venues, public transportstation, and religious events etc
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
4/21
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
5/21
Kelly (2007) states that most ofthe person detection techniqueworks better in well controlled
environments such as laboratorysetting with a small amount ofpeople.
Literature
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
6/21
Kelly, OConnor, and Smeaton (2009)shows that other techniques require morethan one camera with overlapping fields ofview in order to cope with the pedestrian
segmentation problem in the a densecrowd.
We need to use extra cameras which cost
much.
Literature
R
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
7/21
How can we track all pedestrians in the sceneusing a single camera and save the data oftracking as a NTXY table?
Fig. 1 Walking experiment at Ateneo de Manila
Researc
Problem
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
8/21
Method in
Automation
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
9/21
Object Detection1. Split the video sequence into three channels of
Red, Green and Blue (RGB)
2. Subtracting green channel from the redchannel
3. Threshold of 70 (out of 255)
i(x, y) = r(x, y) g(x, y)
>
=
otherwise0
),(if1),(
yxiyxf
Obj D i
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
10/21
Object Detection(cont.)
Obj t D t ti
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
11/21
Object Detection(cont.)
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
12/21
Run the particle analysis in ImageJ to:
Detect all objects in a frame by usingconnected component algorithm
Analyze each detected object for their area
and centroid coordinate
The result will be a table with ID, coordinateand slices number of each object.
Object Analysis
Obj t A l i
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
13/21
Fig. 4 Results of particlesanalysis of the binary image
Fig. 5 Tabulated result of particleanalysis
Object Analysis(cont.)
Obj t A l i i
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
14/21
Object Analysis inImageJ
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
15/21
Flowchart of Tracking
Algorithm
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
16/21
Object Tracking
Searching for the neighborhood
Obj t T ki
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
17/21
Object Tracking
(cont.)
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
18/21
Comparison with ManualTracking
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
19/21
Research Question:How can we track all pedestrians in thescene using a single camera and savethe data of tracking as a NTXY table?
1. Red hat detection2. Blob identification
3. Frame by frame tracking of
trajectories4. Conversion to NTXY
Summary
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
20/21
We were able to create algorithms to detect,to analyze and to track pedestrian fromuncalibrated angle camera for outdoorcrowded situation
The system was able to recognize
pedestrians at reasonable rate ofmisclassification
86.7% correctly detected (red hat)
13.3% maximum error (any other red
object) Accuracy can further be improved by taking
into account the size and shape of the blob asit moves (distinguishing red hat from other
red objects)
Conclusion
-
8/14/2019 AUTOMATION OF PEDESTRIAN TRACKING IN A CROWDED SITUATION USING ANGLED UNCALIBRATED CAMERA
21/21
Thank you