digital image stabilization 老師 : 楊士萱 學生 : 鄭馥銘. outline introduction basic...
Post on 22-Dec-2015
254 views
TRANSCRIPT
![Page 1: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/1.jpg)
Digital Image Stabilization
老師 : 楊士萱學生 : 鄭馥銘
![Page 2: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/2.jpg)
Outline Introduction Basic architecture of DIS MVI method for DIS Future work
![Page 3: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/3.jpg)
Introduction An image stabilization system
manages to remove unwanted movement form an image sequence
Previous image stabilization system accelerometers, gyros, mechanical dampers ,
angular velocity sensors………….. We prefer to use DIS
![Page 4: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/4.jpg)
Basic architecture of DIS Pre-processing
Stabilization Video Encoder
Video Decoder
Input
Output
Stabilized Input
![Page 5: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/5.jpg)
Basic architecture of DIS stabilization-aided encoder
Stabilization
Video Encoder Video DecoderInput Output
![Page 6: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/6.jpg)
Basic architecture of DIS stabilization-aided decoder
Stabilization
Video Encoder Video DecoderInput Output
![Page 7: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/7.jpg)
MVI Method for DIS MVI : Motion Vector Integration Basic idea :
Using some propose method to find reliable local motion vector(LMV)
Calculate the global motion vector(GMV) form LMV.
Integrating the previous frame GMV and current frame GMV to calculate AMV.
Using AMV to compensate current frame to be stabilized frame.
Reference paper [1-4]
![Page 8: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/8.jpg)
New Algorithm and Architecture of Digital Image stabilization System
CCD A/D DIS for FM
VideoEncoder
Block diagram of a digital video camera with DIS system.
![Page 9: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/9.jpg)
New Algorithm and Architecture of Digital Image stabilization System
Lack of features Existence of moving objects Intentional panning Existence of repeated patterns Intentional zooming Low signal-to-noise ratio Large movement out of the searching range of
block matching Complicated Motion (e.g. rotatory motion)
![Page 10: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/10.jpg)
A general structure of DIS system with frame memory
Pre-processing
Motion Estimation
Frame Register
Motion Decision
Motion Compensation
Frame Memory
Stabilized images
![Page 11: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/11.jpg)
Pre-Processing
Pre-processing
Motion Estimation
Frame Register
Motion Decision
Motion Compensation
Frame Memory
Stabilized images
![Page 12: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/12.jpg)
Pre-Processing Block Matching over Bit-Planes
![Page 13: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/13.jpg)
![Page 14: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/14.jpg)
Pre-Processing Block Matching over Gray-Code Bit-
Planes
![Page 15: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/15.jpg)
![Page 16: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/16.jpg)
Motion Estimation
Pre-processing
Motion Estimation
Frame Register
Motion Decision
Motion Compensation
Frame Memory
Stabilized images
![Page 17: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/17.jpg)
Motion Estimation
![Page 18: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/18.jpg)
Motion Estimation
![Page 19: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/19.jpg)
Motion Decision
Pre-processing
Motion Estimation
Frame Register
Motion Decision
Motion Compensation
Frame Memory
Stabilized images
![Page 20: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/20.jpg)
Motion Decision(Lack-of-Feature Condition)
![Page 21: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/21.jpg)
Motion Decision(Lack-of-Feature Condition)
![Page 22: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/22.jpg)
Motion Decision(Lack-of-Feature Condition)
![Page 23: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/23.jpg)
Motion Decision(Existence of Moving Objects)
Random-like motion
temporally correlated motion
![Page 24: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/24.jpg)
Motion Decision(Existence of Moving Objects)
![Page 25: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/25.jpg)
Motion Decision(Intentional Panning Condition) If 80% of the VALID_LMV are detected as
temporally correlated motion, we consider that the camera is under a panning condition and no motion compensation is needed Otherwise, we assume that these temporally correlated motion vectors are caused by some moving objects in the image.
![Page 26: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/26.jpg)
Motion Decision(Optical Zooming Condition)
![Page 27: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/27.jpg)
Motion Decision(Spatial Noise Checking of Noise Level)
![Page 28: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/28.jpg)
Procedure of Motion Decision
![Page 29: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/29.jpg)
Procedure of Motion Decision
![Page 30: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/30.jpg)
Motion Compensation Frame Motion Vector (FMV)
Accumulated Motion Vector (AMV)
Motion Compensation
![Page 31: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/31.jpg)
SimulationResult
![Page 32: Digital Image Stabilization 老師 : 楊士萱 學生 : 鄭馥銘. Outline Introduction Basic architecture of DIS MVI method for DIS Future work](https://reader036.vdocuments.mx/reader036/viewer/2022081421/56649d7a5503460f94a5f1e1/html5/thumbnails/32.jpg)
Future work Understanding mpeg4 framework
in order to write my propose method program in it.
stabilization-aided encoder
Stabilization
Video Encoder Video DecoderInput Output