02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 1
ENEE408G: Capstone Design Project:
Multimedia Signal Processing
Design Project 2:Video Processing
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 2
Today’s Schedule
Introduction to Design Project 2 Check in Digital Camera and Pocket PC Check out PC camera and Pocket PC
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 3
Outline of Design Project 2
Part I : Video Capturing by PC Camera Part II : Motion Estimation and
Compensation Part III: MPEG Video Part IV: Detect Scene Change in Video Part V: Mobile Computing and Pocket PC
Programming Bonus Part I : MPEG-7 Visual Descriptor Bonus Part II: Video Conference
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 4
Part I. Video Capturing by PC Camera
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 5
Pat II. Motion Estimation and Compensation
Inter-Frame Encoder
DCT QuantizationEntropyCoding
Inversequantization
+ DCT
FrameMemory
MotionCompensation
MotionEstimation
+
+
Reconstructed motioncompensated residualestimated
motionvectors
reconstructed motioncompensated
reference frame
MotionCompensated
residual
motioncompensatedmacroblocks
Originalmacroblocks
of pixels
EncodedInterframe_
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 6
ME: Exhaustive Block Matching
Reference Frame Current Frame
R R-1
R
N1
N 2
R-1
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 7
ME: Example
Reference Frame Current Frame
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 8
Exhaustive Block Matching (cont.1)
Demo: http://www.ece.umd.edu/class/enee408g/labs/
labV/Motion_Estimation_v3.exe http://www.ece.umd.edu/class/enee408g/labs/
labV/motion_estimation_3step.exe
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 9
Exhaustive Block Matching (cont.2)
0 2 4 6 8 10 12 14 160
2
4
6
8
10
12
14
16
18
Reference Frame Current Frame Motion Vectors
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 10
Motion Compensation
Estimated frame Residual
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 11
3-step approach
1
11
11
1
1 1
22
2
2 2 2
2
2
3
33
3
3
33
3
1
Search points in step 1
Search points in step 2
Search points in step 3
1
2
3
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 12
Part III.MPEG Video
MPEG-1 Video Use mpgwrite.m and mpgread.m. Tradeoff between bit rate and quality
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 13
Part IV. Detect Scene Change
Cut Scene Change Dissolve Scene Change Wipe Scene Change Multi-scene Change Design scene change detector
Hint: Use statistical characteristics for each frame
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 14
Part V. Pocket PC Programming
Apply what you learned from previous parts and design a simple application related to digital video processing by Microsoft eMbedded Tools for Pocket PC.
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 15
Bonus Part I. MPEG-7 Visual Descriptor
MPEG-7 Texture Descriptor http://nayana.ece.ucsb.edu/M7TextureDemo/Dem
o/client/M7TextureDemo.html
MPEG-7 Shape Descriptor http://
www.ee.surrey.ac.uk/Research/VSSP/imagedb/demo.html
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 16
MPEG-7 Texture Descriptor
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 17
MPEG-7 Shape Descriptor
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 18
Bonus Part II. Video Conference
Experience video conferencing using
Microsoft NetMeeting
Two scenarios:
video conferencing with different image modes
video conferencing with different available
bandwidths Do this part at home
02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 19
PC Camera / Digital Camera
Digital Camera and Pocket PC Check In PC Camera and Pocket PC Check Out