fast motion estimation and mode decision for h.264 video coding in packet loss environment li liu,...
TRANSCRIPT
![Page 1: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/1.jpg)
Fast motion estimation and mode decision
for H.264 video coding in packet loss environment
Fast motion estimation and mode decision
for H.264 video coding in packet loss environment
Li Liu, Xinhua Zhuang
Computer Science Department, University of Missouri-Columbia, USA
IEEE ICME(International Conference on Multimedia & Expo) 2008
June 2008
Presenter : SeungDae Jeong
![Page 2: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/2.jpg)
IntroductionIntroductionIntroductionIntroduction
Packet loss environment Practical video communications Videos are usually coded without considering varying channel
conditions Error propagation
2
![Page 3: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/3.jpg)
IntroductionIntroductionIntroductionIntroduction
“Intra refresh” algorithm Using intra frames that doesn't refer to previous frames
The decision of intra mode Rate distortion optimization
• Quantization distortion• Channel distortion
Simulation based estimation Model based estimation
3
Previous frame Inter framewith packet loss
Intra frame
![Page 4: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/4.jpg)
ContentsContentsContentsContents
RD Optimized intra fresh for error resilience Lagrange Cost Function in Packet Loss Environment Model Based Channel Distortion Estimation
Use channel distortion map for fast mode decision and motion estimation
Channel distortion map based fast mode decision and motion estimation algorithm Fast Mode Decision Fast Motion Estimation
Experiment results
Conclusion
4
![Page 5: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/5.jpg)
Lagrange Cost Function in Packet Loss EnvironmentLagrange Cost Function in Packet Loss EnvironmentLagrange Cost Function in Packet Loss EnvironmentLagrange Cost Function in Packet Loss Environment
Set of all defined coding options for macroblock m in frame n
5
The source distortion by quantization
The result bit rate
The relation between distortion and bit rate
![Page 6: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/6.jpg)
Lagrange Cost Function in Packet Loss EnvironmentLagrange Cost Function in Packet Loss EnvironmentLagrange Cost Function in Packet Loss EnvironmentLagrange Cost Function in Packet Loss Environment
In packet loss environment
6
The quantization distortion
The error concealment distortionwhen a macrobloak is lost
The error propagation distortionif reference frames in motion estimation are erroneous
The estimated channel packet loss rate
![Page 7: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/7.jpg)
Lagrange Cost Function in Packet Loss EnvironmentLagrange Cost Function in Packet Loss EnvironmentLagrange Cost Function in Packet Loss EnvironmentLagrange Cost Function in Packet Loss Environment
The modified Lagrange cost function for RD optimization mode decision
The rate distortion cost for intra mode
7
![Page 8: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/8.jpg)
Model Based Channel Distortion EstimationModel Based Channel Distortion EstimationModel Based Channel Distortion EstimationModel Based Channel Distortion Estimation
Define a channel distortion map on 4x4 block basis To track potential error propagation
8
![Page 9: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/9.jpg)
Model Based Channel Distortion EstimationModel Based Channel Distortion EstimationModel Based Channel Distortion EstimationModel Based Channel Distortion Estimation
Block based channel distortion map
9
The optimal mode decision
The error propagation distortion of ith block
The error concealment distortion
The estimated error propagation distortion
![Page 10: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/10.jpg)
Use channel distortion mapUse channel distortion mapfor fast mode decision and motion estimationfor fast mode decision and motion estimation
Use channel distortion mapUse channel distortion mapfor fast mode decision and motion estimationfor fast mode decision and motion estimation
The error propagation distortion tends to surpass the quantization distortion as
• frames contain more motions (e.g., from frame 150 to 250)• loss rate increases (e.g., from 0.05 to 0.10)
10
![Page 11: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/11.jpg)
Use channel distortion mapUse channel distortion mapfor fast mode decision and motion estimationfor fast mode decision and motion estimation
Use channel distortion mapUse channel distortion mapfor fast mode decision and motion estimationfor fast mode decision and motion estimation
Statistical information from coded video sequence using original MBDE algorithm
11
![Page 12: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/12.jpg)
Channel distortion map basedChannel distortion map basedfast mode decision and motion estimation algorithmfast mode decision and motion estimation algorithmChannel distortion map basedChannel distortion map basedfast mode decision and motion estimation algorithmfast mode decision and motion estimation algorithm
Fast mode decision Computational cost of estimating Dep(o) is quite small By using Dep(o) as assistance to decide early termination of possible
inter coding choices, encoding speed can be accelerated significantly
Fast Motion Estimation Choosing the best motion vector Minimizing a Lagrange cost function
12
![Page 13: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/13.jpg)
Fast mode decisionFast mode decisionFast mode decisionFast mode decision
Computational cost Inter coding cost > Intra coding cost
The calculation of minDep Dependent on optimal motion vector decision from motion
estimation process Computational cost can not be reduced
Computing Dep(o) based on the predicted motion vector
13
![Page 14: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/14.jpg)
Fast mode decisionFast mode decisionFast mode decisionFast mode decision
Computing Dep(o) based on the predicted motion vector
14
![Page 15: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/15.jpg)
Fast motion estimationFast motion estimationFast motion estimationFast motion estimation
Minimizing a Lagrange cost function
Fast motion estimation algorithm selects best motion vector from a set of candidates, and terminates those macroblocks that may have large error propagation distortion associated
15
The sum of absolute difference
The number of bits to code motion information
![Page 16: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/16.jpg)
Fast motion estimationFast motion estimationFast motion estimationFast motion estimation
16
![Page 17: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/17.jpg)
Experiment resultsExperiment resultsExperiment resultsExperiment results
Implemented using H.264 reference software JM12.1 http://iphome.hhi.de/suehting/tml/download/old_jm/
Video sequences Carphone, Foreman, Coastguard
QCIF format, 7.5 fps Fixed quantization parameter (QP)
Packet loss simulation S. Wenger, “Internet Error Patterns”
17
![Page 18: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/18.jpg)
Experiment resultsExperiment resultsExperiment resultsExperiment results
PSNR Peak Signal-to-Noise Ratio
Bit rate
Speed Very fast
18
![Page 19: Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University](https://reader035.vdocuments.mx/reader035/viewer/2022062423/5697bf711a28abf838c7e01d/html5/thumbnails/19.jpg)
ConclusionConclusionConclusionConclusion
Two stage fast mode decision and motion estimation algorithm for H.264 video coding in packet loss environment
Advantage of estimated channel distortion as assistance to decide early termination of possible inter coding options
Reduce coding complexity significantly while maintaining similar average picture quality
19