anomaly detection in surveillance

15
Learning Abnormal Behavioural for Surveillance Systems By Ahmed Ibrahim 23/2/2011

Upload: ahmed-ibrahim

Post on 25-May-2015

437 views

Category:

Education


4 download

DESCRIPTION

Research in human gestures recognition

TRANSCRIPT

Page 1: Anomaly Detection in Surveillance

Learning Abnormal Behavioural

for Surveillance Systems

By Ahmed Ibrahim

23/2/2011

Page 2: Anomaly Detection in Surveillance

Outline

• Introduction

• Key Challenges

• Proposed approaches

• Preliminary experiments

• Discussion and future directions

Page 3: Anomaly Detection in Surveillance

What is Abnormal Behaviour ?

• Abnormal Behaviour is a pattern in the data

that does not conform to the expected normal

behaviour.

• Also referred to as outliers, exceptions,

suspicion, surprise, etc.

• Example: set of data points

Feature space.

F1

F2

N1

N2

o1

o2

O3

Page 4: Anomaly Detection in Surveillance

Video Surveillance Example

A car on pedestrian roadway

A piece of luggage left in a check in-area

Source: Performance Evaluation of Tracking and Surveillance dataset (PETS)

Page 5: Anomaly Detection in Surveillance

Key Challenges

• Defining a representative normal behaviour is challenging.

• The boundary between normal and outlying behaviour is often not precise.

• The exact notion of an outlier is different for different video surveillance applications.

• Availability of labelled data for training/validation.

• Data always contain noise.

• Normal behaviour keeps evolving

Page 6: Anomaly Detection in Surveillance

Abnormal Behavior Detection

Framework

Motion Detection

• Background

subtraction

• Temporal

differencing

• Optical flow

Object Tracking

• Model

• Region

• Active contour

• Feature based

Behavior

Understanding

• Classification

(supervised)

• Clustering

(unsupervised)

Behavior Type

• Label

• Score

Source: PETS

Page 7: Anomaly Detection in Surveillance

Unsupervised Behavior Modeling

•The following trajectory

has been generating by:

•Applying principal

component analysis

on the video stream;

•Selecting the first

three components

•Every point on the

trajectory represents a

frame from the video

stream

Page 8: Anomaly Detection in Surveillance

Learning Outliers

Behavior

Model

Gathering

Real Data

Statistically

Resampling

Visually

Resampling

Page 9: Anomaly Detection in Surveillance

Proposed Statistical Approach

Page 10: Anomaly Detection in Surveillance

Statistical Resampling Example

Subspace

trajectory of

waking pedestrian

in outdoor

PC: for principal components

Irregular segments

Page 11: Anomaly Detection in Surveillance

Proposed Visual Approach

Page 12: Anomaly Detection in Surveillance

Visual Resampling Example

Subspace

trajectory of

waking pedestrian

Subspace

trajectory of

synthetic

pedestrian

Time delay

Similar segments PC: for principal components

Page 13: Anomaly Detection in Surveillance

Behavior Model Output

• Label : each test instance is given a normal or

anomaly label

• Score: each test instance is assigned an

anomaly score

• Allows the output to be ranked

• Requires an additional threshold parameter

Page 14: Anomaly Detection in Surveillance

Research Plan

• To test the feasibility of statistical resampling: – The Ionosphere dataset from UCI machine learning

Repository will be used.

– This dataset are radar signals sent into the ionosphere and the class value indicates whether or not the signal returned information “Good” or “Bad” on the structure of the ionosphere.

• To test the feasibility of visual resampling: A set of animated videos with real backgrounds will be generated for the following events:– Walk, Run, Jump, Gallop sideways, Bend , One-hand wave,

Two-hands wave, Jump in place, Jumping Jack, Skip.

Page 15: Anomaly Detection in Surveillance

References

• [1] Weiming Hu; Tieniu Tan; Liang Wang; S. Maybank; , "A survey on visual surveillance of object motion and behaviors,"Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions, 2004

• [2] Monekosso, Remagnino, ”Synthetic Training Data Generation for Activity Monitoring and Behavior Analysis” , Proceedings of the European Conference on Ambient Intelligence, 2009.

• [3] Garg, Aggarwal, Sofat, ” Vision Based Hand Gesture Recognition”, 2009.

• [4] Poppe, “A survey on vision-based human action recognition”, Image and Vision Computing Journal, 2010.

• [5] Mitra, Acharya, ”Gesture Recognition: A Survey”, IEEE transactions on systems, man, and cybernetics, 2007.

• [6] Wang, Suter, “Recognizing Human Activities from Silhouettes: Motion Subspace and Factorial Discriminative Graphical Model”, IEEE Conference on In Computer Vision and Pattern Recognition, 2007.

• [7] Hua, “Probabilistic Variational Methods for Vision based Complex Motion Analysis”, PhD dissertation, Electrical and Computer Engineering, 2006.

• [8] Incertis, Garcia-Bermejo, Casanova, "Hand Gesture Recognition for Deaf People Interfacing", 18th International Conference on Pattern Recognition, 2006.