proxy-based reference picture selection for error resilient conversational video in mobile networks...

27
Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on Circuits and Systems for Video Technology, VOL. 19, NO. 2, February 2009. Reporter 陳陳陳

Upload: jody-reed

Post on 17-Jan-2016

224 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks

Wei Tu and Eckehard Steinbach, IEEE Transactions on Circuits and Systems for Video Technology, VOL. 19, NO. 2, February 2009.

Reporter:陳志明

Page 2: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Outline Introduction Related Works Proxy-Based Reference Picture Select Simulation Results Conclusion

Page 3: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Introduction Conversational video requires very low delay. Decoding of erroneous or incomplete video

bit-stream leads to severe quality degradations.

Numerous studies have been performed to improve the error resiliency for video transmission over lossy channels.

Scenarios : Uplink Downlink Both

Page 4: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Introduction (con.)

Page 5: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Related Works Error resilience schemes used for comparison

Random intra-MB update(RIMU) Feedback multidecoder distortion estimation(F-

MDDE) NEWPRED RESCU

Page 6: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

RIMU One way to stop temporal error propagation is

the periodic insertion of Intra-coded pictures or macroblocks (MBs).

There is no feedback information available. However, without accurate information about the channel statics, the efficiency of RIMU is limited, if the packet loss rate changes rapidly over a wide range.

Page 7: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

F-MDDE A powerful yet computationally demanding

method is introduced to estimate the excepted reconstruction distortion.

If K is not large enough, the estimation will be inaccurate and affects the distortion estimation for later frames.

Page 8: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

NEWPRED NEWPRED uses the feedback about lost

packets or correctly received packets to prevent the prediction from those image areas that have been corrupted. A-NEWPRED N-NEWPRED

Page 9: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

NEWPRED(con.)

Page 10: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

RESCU RESCU is to change the frame dependencies

in a video sequence such that a retransmission of lost information can be used for error recovery.

Page 11: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Proxy-Based Reference Picture Select It have three scenarios.

Downlink Error Recovery Uplink Error Recovery Combination Both

Page 12: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Downlink Error Recovery

Error propagation for FDRPS when frame is corrupted.

Page 13: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Uplink Error Recover

Adaptive RPS triggered by feedback from the base station to the sender

Page 14: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Combination Both

Error robust mobile video telephony using the proposed PRPS framework

Page 15: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Simulation Results H.264/AVC test software version JM 11.0 Test video :

The first 300 frame of the test video Foreman QCIF at 15fps

The first 300 frame of the test video Salesman QCIF at 15fps

Video frame structure : I-P-P-P-I-…

Max RTT on the uplink and downlink are 200 ms(RTT = 3).

The end-to-end round-trip delay(including the wireless and wireline networks ) is 400 ms(RTT = 6).

Page 16: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

RIMU RD performance of RIMU for the Foreman

sequence and 1% random packet loss in both uplink and downlink.

Page 17: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

F-MDDE RD performance of MDDE and F-MDDE with for

the Foreman sequence and 1% random packet loss in both uplink and downlink.

Page 18: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

F-MDDE (con.) RD performance of F-MDDE for a RTT of 6

frames for the Foreman and Salesman sequences.

Page 19: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

NEWPRED RD performance of NEWPRED for the Foreman

sequence for different RTTs.

Page 20: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

RESCU RD performance of RESCU for the Foreman

sequence for different RTTs.

Page 21: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Adaptive RPS Performance of the adaptive RPS schemes

used for uplink error recovery, Foreman, RTT of 3 frames.

Page 22: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Proxy-Based Reference Picture Select RD performance of PRPS as a function of the

RTT on the uplink and downlink for a 5% packet loss channel. The mean burst length is 5 packets. The test sequence is Foreman.

Page 23: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

The comparison (Foreman sequence) Performance of PRPS and the comparison

schemes for the Foreman sequence.

Page 24: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

The comparison (Salesman sequence) Performance of PRPS and the comparison

schemes for the Salesman sequence.

Page 25: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

The comparison (Packet loss rate and PSNR) Mean reconstruction quality as a function of

packet loss rate for a mean packet burst loss length of 5 for the Foreman sequence.

Page 26: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

The comparison (uplink and downlink) 5% burst packet loss either on the uplink or

the downlink for the Foreman sequence at 150 kbps including all overheads.

we give the performance when either a wireless uplink or a wireless downlink is involved in the end-to-end transmission.

Page 27: Proxy-Based Reference Picture Selection for Error Resilient Conversational Video in Mobile Networks Wei Tu and Eckehard Steinbach, IEEE Transactions on

Conclusion Feedback information between the mobile user

and co-located base stations significantly decreases the feedback delay, and thus greatly improves the efficiency of error recovery.

The prediction distance is adjusted to the RTT of the downlink which gives us the opportunity to retransmit lose packets and to use retransmitted packets to stop error propagation.

Proxy-based RPS scheme is compatible with the h.264/AVC standard syntax and is of very low complexity at base stations.