cs 529 multimedia networking review. digital audio what is the tradeoff between sample size and...

53
CS 529 Multimedia Networking Review

Upload: bryan-ferguson

Post on 23-Dec-2015

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

CS 529 Multimedia Networking

Review

Page 2: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Digital Audio

• What is the tradeoff between sample size and fidelity? Between sample rate and fidelity?

• What uses of computer audio require a high sample rate and large sample size? Which do not? Why?

a

Page 3: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Digital Audio

• What are the sample rate and sample sizes for typical voice-quality audio?

• If typical encoding captures a wave form “as it is”, what does MP3 attempt to do? And how?

a

Page 4: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[RS75]

• What is energy?• What is the zero crossing rate?

• More importantly– how are they used?– why are they used?

Page 5: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[RS75]

• What is IMN?– How computed?

• What is IMX?– How computed?

Page 6: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Digital Video

• What are typical frame rates for videos?• What are some common resolutions for

videos (e.g., HD)?• How many bits are needed for “true color”

images?

Page 7: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

QoS and Multimedia Applications

• Rank sensitivity (low, medium, high) for

Conversational Voice and DelayStreaming Video and DelayConversational Voice and CapacityStreaming Video and Capacity

Page 8: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Transport Protocols

• One reason TCP is “good” for multimedia applications? Example?

• One reason TCP is “bad” for multimedia applications? Example?

• One reason UDP is “good” for multimedia applications? Example?

• One reason UDP is “bad” for multimedia applications? Example?

Page 9: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Buffering

• What is a playout buffer?

• What is it used for?

• How big is it?

Page 10: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Skype

• What is the network architecture used for Skype?– What kinds of nodes are there?– How are the nodes connected?– Why are they connected this way?

Page 11: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

HTTP Streaming

• How does HTTP work for streaming video?

• Where is the “intelligence” in an HTTP streaming system?

Page 12: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Multimedia Quality Assessment

• Broadly, what are two types of methods to assess multimedia performance?

• What is an example of each method for assessing voice quality?

Page 13: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Experiments in CS

• What are the main steps in the scientific process?

• Provide a Hypothesis for something in Multimedia Networking– How would you test it?

Page 14: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

NetFlix

• Why isn’t frame loss a component of video quality for NetFlix?

• What are the components of NetFlix video quality?

Page 15: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

RTP

• What is it?• Can I use it instead of TCP/UDP?• What are some of RTP’s major features?

Page 16: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

SIP

• What is it? • What services does it provide?

– Registrar?– Proxy?

• How does it allow for a “mobile” caller?

Page 17: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Network Support for Multimedia?

• What are alternatives to “best effort”?• What is a challenge to “guaranteed” QoS?

Page 18: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Video Compression

• How is it similar to image compression?• How is it different?

• MPEG– What is a GoP?

Page 19: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WS00]

• What is at least one implicit hypothesis the researchers test?

• How are subjective audio quality ratings provided?

• How are objective audio quality “costs” gathered?

Page 20: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WS00]

• What is at least one implicit hypothesis the researchers test?– What are some of the independent variables?

• What tool do the researchers use to test audio?

Page 21: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WS00]

• Provide order, best to worstQuiet – one recorded low volume, other normBad mic – one had low quality mic, other norm5% loss – both voices, with repetitionLoud – one recorded high volume, other norm20% loss – both voices, with repetitionEcho – one had open mic, no headsetReference – non-degraded

Page 22: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HHH+12]

• Why is commercial streaming over HTTP confused?

• Why is commercial streaming over HTTP timid?

Page 23: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[RBV+12]

• Which is best?

• What else should be considered?

Page 24: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[LG14]

• For video messaging on smartphones, what are two main factors affect transmission speed?

• What are some suggested improvements by the authors?

Page 25: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[LG14]

• For video messaging on smartphones, what are two main factors affect transmission speed?

Answer: file size and location

• What are some suggested improvements by the authors?

Answer: Compress/transcode and distribute images among servers in cloud

Page 26: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SKH02]

• What are the 3 fundamental limitations faced by MCGs?

Page 27: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SKH02]

• What is the tension/tradeoff between responsiveness and consistency in MCGs?

• What is interest management? Describe how it works

• What is dead reckoning? Describe how it works

Page 28: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SJNC13]

• What are the benefits of using cloud gaming instead of traditional gaming?

• What are the challenges?

Page 29: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[CFGS14]

What are the main messages from the graph based on [CFGS14]?

Page 30: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[CFGS14]

• Order these from least downstream bitrate to most:– Thin game– Live video– Pre-recorded video– Traditional game– Virtual environment

• What are the approximate bitrates for each?

Page 31: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[CFGS14]

Turbulence Summary

Page 32: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SJ95]

• What is the E-Policy?• What is the I-Policy?

• When, in general, is the E-Policy good?• When, in general, is the I-Policy good?

• What is a talkspurt?

Page 33: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SJ95]

• How does QM-120 work?

• What is QM-(600,2)? What is the motivation behind it?

• Describe one item of future work.– Why is it of interest?– Briefly, how would you approach doing it?

Page 34: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WCCL09]

• What are the challenges proposed by the paper?– Hint: it considers buffer sizes

• What have the academics done about the challenges?

Page 35: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WCCL09]

• Briefly describe the methodology the author uses to determine the “optimal” buffer size

Page 36: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WCCL09]

• Briefly describe the methodology the author uses to determine the “optimal” buffer sizeAns: 1. Encode audio samples2. Simulate loss3. Add delay, dropping if needed4. Decode 5. Apply QoE measure – PESQ + E-model6. Repeat 1-5 for all buffer sizes, with highest QoE

being optimal

Page 37: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WCCL09]

• Interpret the above graph• What are the main messages?

Page 38: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[PHH98]

• What are the client loss characteristics of the Mbone (and other P2P networks)?

• Why can TCP and retransmissions be used to repair loss in the Mbone?

Page 39: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[PHH98]

• What is forward error correction (FEC)?

• What are the two categories of FEC described by the authors? What are the main advantages and disadvantages of each?

Page 40: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[PHH98]

• Broadly, what are receiver based repair techniques? Why are they often called error concealment?

• What is a recommended repair technique for a non-interactive, multicast multimedia session? Why?

Page 41: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HCH09]

2%

0%1%

0%

3%4%

5%6%

7%8%

9%10%

Significance of picture for Skype?

Page 42: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HCH09]

• What’s is the optimal redundancy ratio for repair as defined by the authors?

Page 43: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HCH09]

• What’s is the optimal redundancy ratio for repair as defined by the authors?Ans: Minimum amount of redundancy data needed to sustain same audio quality under different network conditions

Page 44: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HCH09]

How did the author’s generate this graph? How to read it?

Page 45: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HKBT01]

• What “alternate” service does ABE offer?– What is green traffic?– What is blue traffic?

Page 46: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HKBT01]

• What does it mean to say “Green does not hurt Blue”?

• Based on below formula, what happens if green “cuts” in line? How do you fix it?

Page 47: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HKBT01]

Using DSD, what is the order of the next 3 packets?

Page 48: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HKBT01]

What is the significanceof this graph?

Page 49: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[LCK10]

• What general property about network bitrates and latency sensitivity does CHAP rely upon?

• What are credits as assigned by CHAP? How are they assigned? How are they “spent”?

Page 50: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[LCK10]

• Interpret the above graph• What are the messages for CHAP?

0 100 200 300 400 500 6000.0

0.5

1.0

FIFO (only qstat)FIFO (qstat + 1 HTTP downloads)

Server Ping (ms)

Page 51: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[MSM04]

• How does the above quote relate to motivation for the proposed work?

• Describe the authors’ variant on the “method of limits” to determine video quality

Recent IBM QoS policy says:“The priority for smooth video is higher than the priority for frame quality”

Page 52: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[MSM04]

• What was difference between acceptability of video for Palmtops versus Desktops?

Page 53: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[CC10]

• What are three primary ways latency affects players in network games?

• How much does latency affect players in network games?