scalable and robust video encoding for real-time communication samah a. senbel advisor advisor: dr....

29
Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Upload: michael-winfred-richards

Post on 24-Dec-2015

224 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Scalable and Robust Video Encoding for Real-time

Communication

Samah A. Senbel

AdvisorAdvisor: Dr. Hussein Abdel Wahab

Page 2: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Outline

Introduction & Motivation Background A new Image Encoding Technique Quadtree-based Video Encoding

Technique Octree-based Video Encoding Technique Differential Octree-based Video Encoding

Technique Experimental results

Page 3: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Introduction & Motivation

The Requirements for a real-time encoding technique are :

Good Compression Ratio Simplicity Scalability Robustness Ease of decoding

Page 4: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Introduction & Motivation

We developed these 4 Encoders: Quadtree-based Image Encoder Differential Quadtree-based Video

Encoder Octree-based Video Encoder Differential Octree-based Video Encoder

Page 5: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Scalability

Page 6: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Why do we need Scalability?

Heterogeneous Receivers Low-bandwidth communication

• Distant Learning• Mobile hosts

Dealing with network traffic Better error control

Page 7: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Background (Quadtree)

Page 8: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Vector Quantization

Page 9: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Overview of the Image Encoding Technique

Page 10: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Step 1: Mean removal

Page 11: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Step 2: Generate Quadtree

level Structure

4 1

3 1011

2 1000 0011 0011

1 1000 1010 0000 1000 0100

0 0000 0000 0000 0000 0000

Page 12: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Step 3: Vector Quantization

The Quadtree data is then COMPRESSED using vector quantization

Each level is encoded independently to reflect its importance.

Page 13: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Decoding Technique

Perform reverse vector quantization (table look up)

Convert from Quadtree to array Add the means image

Page 14: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Experimental results

RobustnessLoss PSNR

New Tech.PSNRShusterman Tech.

0 % 32.35 dB 32.35 dB

5 % 31.62 dB 27.86 dB

10 % 31.17 dB 27.84 dB

20 % 27.27 dB 25.14 dB

40 % 23.86 dB 20.46 dB

Page 15: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Experimental Results

Robustness at 20 % loss

Page 16: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Differential Quadtree Encoding Technique

Page 17: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Test Videos

Page 18: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Compression results

Page 19: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Scalability

Page 20: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Robustness

Loss PSNRQuadtree

PSNRMPEG-2

0 % 32.69 dB 32.70 dB

5 % 32.03 dB 30.67 dB

10 % 31.17 dB 28.14 dB

20 % 27.27 dB 23.07 dB

40 % 23.86 dB 18.47 dB

Page 21: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Octree

Page 22: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

The Octree Video Encoding Technique

Page 23: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Encoding Technique

Page 24: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Compression(1)

MissA Encoded at 16 Kbps

Page 25: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Compression(2)

Football Encoded at 16 Kbps

Page 26: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Robustness

Loss PSNROctree

PSNRQuadtree

PSNRMPEG-2

0 % 32.70 dB 32.69 dB 32.70 dB

5 % 32.47 dB 32.03 dB 30.67 dB

10 % 32.07 dB 31.17 dB 28.14 dB

20 % 30.91 dB 27.27 dB 23.07 dB

40 % 28.62 dB 23.86 dB 18.47 dB

Page 27: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Differential Octree Encoding Technique

Page 28: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Summary

Main Objective:Design a Video Encoder with these

properties:• Good Compression• Scalability• Robustness• Ease of Decoding

Page 29: Scalable and Robust Video Encoding for Real-time Communication Samah A. Senbel Advisor Advisor: Dr. Hussein Abdel Wahab

Summary

We developed these 4 Encoders: Quadtree-based Image Encoder Differential Quadtree-based Video

Encoder Octree-based Video Encoder Differential Octree-based Video Encoder