image subtraction for real time moving object extraction shahbe mat desa, qussay a. salih, cgiv’04
Post on 22-Dec-2015
215 views
TRANSCRIPT
![Page 1: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/1.jpg)
Image Subtraction for Real Time Moving Object Extraction
Shahbe Mat Desa, Qussay A. Salih, CGIV’04
![Page 2: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/2.jpg)
Outline
• Introduction
• Automatic Motion Detection
• Background Reconstruction
• Noise Reduction
• Experiment Results
• Conclusion
![Page 3: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/3.jpg)
Introduction
• In recent years, development of motion analysis in many vision systems arise researches in conjunction with the immense attentions of employing real time application to control complex real world system such as ATM security, airport surveillance, traffic monitoring, etc.
• The basic idea of mostly automated surveillance applications is that motion detection continuously operating and the system is triggered to perform higher-level processes such as object recognition and tracking.
• Standards such as MPEG-1, MPEG-2 use block-based motion compensation and DCT techniques may be time consuming and cause complex computation.
![Page 4: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/4.jpg)
Objectives
• Automatic motion detection
• Reference background update
• Segmentation of dynamic region from static region
• Noise reduction
• Reliable and less complex
• Real time and auto-completion
![Page 5: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/5.jpg)
Motion mask extraction
• Motion detection issue– As a binary labeling problem:
– Automatically detecting objects
tSyxss
sls at time image),( ,
background static if ,0
objects moving if ,1
![Page 6: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/6.jpg)
Motion mask extraction(2)
• Image subtraction– Background subtraction, dB: |fk – B|– Temporal differencing, dk-1, dk+1: |fk-1 – fk|, |fk+1 – fk|
• Calculate motion mask, motionk, with threshold Td
otherwise ,0
),(),( if ,1),(
dT|yxByx|fdyxmotion
kB
kB
otherwise ,0
),(),( if ,1 11
1
dT|yxfyx|fdmotion
kkk
kk
)()( 1 1 kkkBkkkBk motionmotionmotionmotionmotion
![Page 7: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/7.jpg)
Background reconstruction
• Background varies from time to time as the scene changes.
%*
_
hw
pixeldynamicdynamick
MdynamicfB kk if ,
w, h: width and height of frame
dynamic_pixel: Σ (motionk)
B: background image, f0
M: motion threshold, 4%
![Page 8: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/8.jpg)
Noise reduction
• Two operations– Erosion followed by dilation
• Erosion– With structuring element E
• Result in a value of 1 in motion mask motionk at P=(x,y) if the spatial arrangement of ones in EP fully matches that of motionk.
),( ,}|{ yxPmotionEPEmotion kPk
=> Removes isolated foreground pixels
![Page 9: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/9.jpg)
Noise reduction (2)
• Dilation– With structuring element D
• The result is the set of all points P=(x,y) so that reflection and motionk overlap by at least one nonzero elements.
=> Adds pixels to the boundary of the object
PD̂
),( ,}|{ yxPmotionDPDmotion kPk
![Page 10: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/10.jpg)
Result (1)
• Manual generate ground truth G
• Performance evaluator: Root Mean Square Error (RMSE) measurement
2/1
1 1
2)],(),([*
1
w
x
h
y
yxFyxGwh
RMSEG(x,y): ground truth
F(x,y): output
![Page 11: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/11.jpg)
Results (2)
• Four different-scene test sequences:– Moving vehicles on road– People walking indoors and outdoors
![Page 12: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/12.jpg)
![Page 13: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/13.jpg)
Result (3)
• Compared with the common background subtraction:
SceneCommon Method
Proposed Method
A 0.0324 0.0275
B 0.0524 0.0216
C 0.1288 0.0611
D 0.1495 0.0696
![Page 14: Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04](https://reader035.vdocuments.mx/reader035/viewer/2022062516/56649d7a5503460f94a5ea84/html5/thumbnails/14.jpg)
Conclusion
• Proposed a less-complex method that enables high-level real time processes.
• Compared with common background extraction method, the method is more reliable.