distributed video system realized on mobile device with efficient feedback channel...
TRANSCRIPT
![Page 1: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/1.jpg)
1
Distributed Video System realized on mobile device with efficient Feedback channel分散式影像編碼在手機上的實現與有效率的回饋通道Chen, chun-yuan 陳群元Advisor: Prof. Wu, Ja-Ling 吳家麟 教授2012/6/28
![Page 2: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/2.jpg)
2
Outline
Motivation and introduction DVC architecture overview DVC architecture with mobile device Propose an efficient feedback channel Transcoding Experiment Result Conclusion Future work
![Page 3: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/3.jpg)
3
Motivation
Video communication is essential in Mobile device
Decrease the coding time and battery consuming on mobile.
![Page 4: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/4.jpg)
4
Introduction
For Mobile device video codec Conventional video coding (ex:MPEG-4 H.264)
Heavy weight encoder, light weight decoder. Distributed Video Coding
Light weight encoder, heavy weight decoder.
![Page 5: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/5.jpg)
5
Conventional video codec
Encoding Decoding
![Page 6: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/6.jpg)
6
DVC to H.264 Transcoder
Clouding server:DVC to H.264 transcoder
DVC encoderH.264 decoder
Feedback channel
Parity bits
Encoded sequence
![Page 7: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/7.jpg)
7
DVC codec baseline: DISPAC+DVC transcoder
1.Encoder2.Decoderno feedback channel !
Tse-Chung Su. Yun-Chung Shen. and Ja-Ling Wu. 2011. Real-time Decoding for LDPC Based Distributed Video Coding. National Taiwan University
![Page 8: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/8.jpg)
8
Time complexity analysis without feedback channel
DVC Decoding without Feedback channel Side-Information generation LDPCA
time ratio
SI generationLDPCA Decetc.
31%
Total decoding time: 17.10 sec
![Page 9: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/9.jpg)
9
Time complexity analysis with feedback channel
DVC Decoding Side-Information generation Send-Request at Feedback channel LDPCA
time ratio
SI generationLDPCA DecFeedback channeletc.
1%
95%Bottle neck!
Total decoding time: 330.51 sec
![Page 10: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/10.jpg)
10
Outline
Motivation and introduction DVC architecture Overview DVC architecture with mobile device Propose an efficient feedback channel Transcoding Experiment Result Conclusion Future work
![Page 11: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/11.jpg)
11
Distributed Video Codec
DCT
levelQuantizer
WZ Frames
𝑋𝑘
LDPCA Encoder
Buffer LDPCA Decoder
Key FramesConventional
IntraframeEncoder
Conventional Intraframe
Encoder
SI generation&refinement
DCT
SI ReconstructionBitplanes
Mode selection
CRCCRC
check
CRC-8
WZ bitstream
Feedback channel
Correlation Noise
Modeling
IDCT&Deblocking filter
Decoded WZ Frames
Decoded Key Frames
WZFrame
WZFrame
WZFrame
GOP size 4
KeyFrame
KeyFrame
![Page 12: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/12.jpg)
12
Outline
Motivation and introduction DVC architecture overview DVC architecture with mobile device Propose an efficient feedback channel Transcoding Experiment Result Conclusion Future work
![Page 13: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/13.jpg)
Distributed Video Codec with mobile
13
DCT
levelQuantizer
WZ Frames
𝑋𝑘
LDPCA Encoder
Buffer LDPCA Decoder
Key FramesConventional
IntraframeEncoder
Conventional Intraframe
Encoder
SI generation&refinement
DCT
SI Reconstruction
Bitplanes
Mode selection
CRCCRC
check
CRC-8
WZ bitstream
Feedback channel
Correlation Noise Modeling
IDCT&Deblocking filter
Decoded WZ Frames
Decoded Key Frames
Transcode Decoded Video sequenceWith specific form
Video deliver
![Page 14: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/14.jpg)
14
DVC Encoder Realization
Implement DVC encoder on Mobile Key frame encoding WZ frame encoding Efficient intra mode realization
Feedback channel transmission Network connection between mobile and server Determine payload of a packet with LDPCA
protocal
![Page 15: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/15.jpg)
15
Key frame encoding on Mobile
Previous ver. use JM9.5 Transcoder ref x.264 on PC
x.264 lib
Cross compilerKeyframe encoding
![Page 16: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/16.jpg)
16
DVC Encoder Realization
Implement DVC encoder on Mobile Key frame encoding WZ frame encoding Efficient intra mode realization
Feedback channel transmission Network connection between mobile and server Determine payload of a packet with LDPCA
protocal
![Page 17: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/17.jpg)
17
WZ coding with NDK
Native code
DVC encoder
![Page 18: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/18.jpg)
18
DVC Encoder Realization
Implement DVC encoder on Mobile Key frame encoding WZ frame encoding Efficient intra mode realization
Feedback channel transmission Network connection between mobile and server Determine payload of a packet with LDPCA
protocal
![Page 19: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/19.jpg)
19
Efficient intra block coding
Previous ver. Transcoder Use JM code. Intra block encoding consumes lots of time
in encoding.
Clouding server:DVC to H.264
transcoder
![Page 20: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/20.jpg)
20
DVC Encoder Realization
Implement DVC encoder on Mobile Key frame encoding WZ frame encoding Efficient intra mode realization
Feedback channel transmission Network connection between mobile and server Determine payload of a packet with LDPCA
protocal
![Page 21: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/21.jpg)
21
Network connection
Create network connection to connect remote server. TCP socket in C
Clouding server:DVC to H.264
transcoder
![Page 22: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/22.jpg)
22
DVC Encoder Realization
Implement DVC encoder on Mobile Key frame encoding WZ frame encoding Efficient intra mode realization
Feedback channel transmission Network connection between mobile and server Determine payload of a packet with LDPCA
protocal
![Page 23: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/23.jpg)
23
ACK at Feedback channel
TCP socket
…
syndromes
Send syndrome
Request
syndromessyndromes
syndromes
![Page 24: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/24.jpg)
24
Consuming time atFeedback channel
Packet header occupy large part of network bandwidth.
Network latency in communication at Feedback channel
![Page 25: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/25.jpg)
25
Outline
Motivation and introduction DVC architecture with mobile device DVC architecture overview Propose an efficient feedback channel Transcoding Experiment Result Conclusion Future work
![Page 26: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/26.jpg)
26
Efficient feedback channel
we propose two methods to decrease time consuming at feedback channel. Estimate the syndromes size per WZ frame Estimate the syndromes size per bitplane
![Page 27: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/27.jpg)
Average number of requests per bitplane
1234567123456123456123451234512345123412341234123412312312312120
200
400
600
800
1000 bit rate
bit rate
DC AC1 AC2 AC3 AC4 AC5 AC6 AC7 AC8 AC9AC10AC11
AC12AC13
AC14
Bitplane Number
![Page 28: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/28.jpg)
28
Estimate the syndromes size per WZ frame
Estimate syndromes size by correspond WZ frame in previous GOP
Ex. GOP 4 Key
frameKey
frameWZ
frameWZ
frameWZ
frame
First GOP
Key frame
Key frame
WZ frame
WZ frame
WZ frame
Second GOP
![Page 29: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/29.jpg)
formula
(ESbt)WZn=(Sbt)WZ(n-GOPsize)
WZn means the WZ frame’s index n-GOPsize means the correspond WZ frame in
the previous GOP. bt is the bitplane index. (ESbt)WZn means the estimated syndromes bit for
the bt’th bitplane of WZn frame. (Sbt)WZ(n-GOPsize) means the syndromes bit for the
bt’th bitplane of WZ(n-GOPsize) frame
![Page 30: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/30.jpg)
30
Efficient feedback channel
we propose two methods to decrease time consuming at feedback channel. Estimate the syndromes size per WZ frame Estimate the syndromes size per bitplane
![Page 31: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/31.jpg)
Number of requests per bitplane per band
1234567123456123456123451234512345123412341234123412312312312120
200
400
600
800
1000 bit rate
bit rate
DC AC1 AC2 AC3 AC4 AC5 AC6 AC7 AC8 AC9AC10AC11
AC12AC13
AC14
Bitplane Number
![Page 32: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/32.jpg)
Number of requests per bitplane per band
1234567123456123456123451234512345123412341234123412312312312120
200
400
600
800
1000 bit rate
bit rate
DC AC1 AC2 AC3 AC4 AC5 AC6 AC7 AC8 AC9AC10AC11
AC12AC13
AC14
Bitplane Number
![Page 33: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/33.jpg)
Estimate by previous bands
1.formula 2.time ratio
![Page 34: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/34.jpg)
Number of requests per bitplane per band
1234567123456123456123451234512345123412341234123412312312312120
200
400
600
800
1000
bit rateestimated bit rate
DC AC1 AC2 AC3 AC4 AC5 AC6 AC7 AC8 AC9AC10AC11
AC12AC13
AC14
Bitplane Number
![Page 35: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/35.jpg)
formula
(ESacn bt)WZn= ( Sdc bt-1 )WZn
WZn means the n’th WZ frame. acn means the n’th AC band. bt means the bitplane index of this AC band. Which ESacn
bt mean the estimated syndrome size for the bt’th bitplane in n’th AC band.
dc means the DC band. Sdc bt-1 means the syndromes bits for bt-1’th
bitplane in DC band.
![Page 36: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/36.jpg)
36
Outline
Motivation and introduction DVC architecture overview DVC architecture with mobile device Propose an efficient feedback channel Transcoding Experiment Result Conclusion Future work
![Page 37: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/37.jpg)
Transcode to mobile codec
Because DVC only encode luminance part in YUV, so we got only Y for output.
Our mobile device can only read mp4 and 3gp.
Y
U V
R G BFrame 1Frame 2Frame 3Frame4Frame 5Frame 6Frame 7Frame n.mp4
![Page 38: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/38.jpg)
38
Outline
Motivation and introduction DVC architecture overview DVC architecture with mobile device Propose an efficient feedback channel Transcoding Experiment Result Conclusion Future work
![Page 39: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/39.jpg)
39
Experiment Result
規格 實驗數據 :
時間 (&decode) 、 packet 數量 ( 傳幾次 )+
![Page 40: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/40.jpg)
Test condition
12 CPU, 24 processor Intel(R) Xeon(R) CPU X5650 @ 2.67GHz
GPU: Tesla M2050 Mobile device: HTC sensation
![Page 41: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/41.jpg)
Test sequences :
QCIF, 15Hz, all frames GOP Size 2, 4 and 8 Only luminance component is used
Test materials
Soccer Foreman Coastguard Hall Monitor
Motion: High Low
![Page 42: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/42.jpg)
Speed up
![Page 43: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/43.jpg)
Bitrate
![Page 44: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/44.jpg)
RD curve
Foreman with LRSS,GOP8
![Page 45: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/45.jpg)
RD curve
Hall monitor with LRSS,GOP8
![Page 46: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/46.jpg)
46
Outline
Motivation and introduction DVC architecture overview DVC architecture with mobile device Propose an efficient feedback channel Transcoding Experiment Result Conclusion Future work
![Page 47: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/47.jpg)
47
Conclusion
We combine DISPAC and transcoder, then port it’s encoder on mobile.
Implement and propose Feedback channel. Record video with mobile device’s camera. Transcode the decoded sequence to mobile
codec.
![Page 48: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/48.jpg)
48
Outline
Motivation and introduction DVC architecture overview DVC architecture with mobile device Propose an efficient feedback channel Transcoding Experiment Result Conclusion Future work
![Page 49: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/49.jpg)
49
Future Work
Take a more precise estimation of syndrome size.
Use motion information to estimate the syndrome size.
Build a reliable DVC codec which is loss tolerant.
![Page 50: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/50.jpg)
50
Thank You
![Page 51: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/51.jpg)
52
To do
Real time decoder Efficient intra coding Print MSG on Mobile
![Page 52: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/52.jpg)
53
DVC decoding time
Side Info Creation: 0.85 sec Overcomplete Transform: 2.35 sec Correlation Noise Modeling: 2.33 sec Conditional Bit Prob Compute: 0.60 sec Update Side Info: 7.14 sec Ldpca Decode: 123.34 sec Motion Learning: 1.79 sec Others: 1.80 sec
![Page 53: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/53.jpg)
57
Distributed Video Codec
DCT
levelQuantizer
WZ Frames
𝑋𝑘
LDPCA Encoder
Buffer LDPCA Decoder
Key FramesConventional
IntraframeEncoder
Conventional Intraframe
Encoder
SI generation&refinement
DCT
SI ReconstructionBitplanes
Mode selection
CRCCRC
check
CRC-8
WZ bitstream
Feedback channel
Correlation Noise
Modeling
IDCT&Deblocking filter
Decoded WZ Frames
Decoded Key Frames
![Page 54: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/54.jpg)
Distributed Video Codec with mobile
58
DCT
levelQuantizer
WZ Frames
𝑋𝑘
LDPCA Encoder
Buffer LDPCA Decoder
Key FramesConventional
IntraframeEncoder
Conventional Intraframe
Encoder
SI generation&refinement
DCT
SI Reconstruction
Bitplanes
Mode selection
CRCCRC
check
CRC-8
WZ bitstream
Feedback channel
Correlation Noise Modeling
IDCT&Deblocking filter
Decoded WZ Frames
Decoded Key Frames
Transcode Decoded Video sequenceWith specific form
Video deliver
![Page 55: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/55.jpg)
59
Video recodeWith mobile camera
![Page 56: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/56.jpg)
60
ACK at Feedback channel
…
Send syndrome
LDPCA Encoder
&CRC
LDPCA Decoder
&CRC
Syndromes for one bitplane
![Page 57: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/57.jpg)
61
ACK at Feedback channel
…
Request
LDPCA Encoder
&CRC
LDPCA Decoder
&CRC
Syndromes for one bitplane Decoding one bitplane
with received syndromesAnd chack CRC
![Page 58: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/58.jpg)
62
ACK at Feedback channel
…
Send syndrome
LDPCA Encoder
&CRC
LDPCA Decoder
&CRC
Syndromes for one bitplane
![Page 59: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/59.jpg)
67
Contribution
Realize DVC encoding part on Mobile device Implement Feedback channel Implement encoder’s component with x264 Propose an efficient Feedback channel Transcode the decoded sequence to mobile
codec
![Page 60: Distributed Video System realized on mobile device with efficient Feedback channel 分散式影像編碼在手機上的實現與有效率 的回饋通道 1 Chen, chun-yuan 陳群元](https://reader035.vdocuments.mx/reader035/viewer/2022062500/56649e425503460f94b34c43/html5/thumbnails/60.jpg)
68
Outline
Motivation and introduction DVC architecture with mobile device Propose an efficient feedback channel Transcoding Experiment Result Conclusion Future work