multimedia communications ecp 610
TRANSCRIPT
![Page 1: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/1.jpg)
Omar A. Nasr
Feb, 2015
Multimedia communications
ECP 610
1
![Page 2: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/2.jpg)
Motivation for the course
why you are taking this class?
2
![Page 3: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/3.jpg)
Motivation
3
![Page 4: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/4.jpg)
Google loon
4
![Page 5: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/5.jpg)
5
![Page 6: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/6.jpg)
6
![Page 7: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/7.jpg)
7
![Page 8: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/8.jpg)
8
![Page 9: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/9.jpg)
9
![Page 10: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/10.jpg)
10
![Page 11: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/11.jpg)
Motivation
Multimedia: content that uses a combination of content
formats:
Video
Audio
Speech
Text
Animations
Images
…
11
![Page 12: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/12.jpg)
Is it a new topic?
Speech signals in PSTN
Use of speech features
Need to understand the speech
Sampling rate, encoding, .. Etc
Speech in GSM
GSM speech CODEC (13kbps : full rate)
That was “multimedia communications” in its simplest form!
12
![Page 13: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/13.jpg)
Differences
Speech/audio/Image/video
Can tolerate errors
Quality depends on human perception
Can have strict deadlines
Have some sort of “ time correlation” for speech
Have some sort of “spatial correlation” for images
Have sort of “time AND spatial correlations” for video
13
![Page 14: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/14.jpg)
14
![Page 15: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/15.jpg)
15
![Page 16: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/16.jpg)
16
![Page 17: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/17.jpg)
Multimedia communications
Communications over what?
Circuit switched network (ISDN)
IP network
Wireless network
Mobile network (3G-LTE)
WiFi networks
17
![Page 18: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/18.jpg)
Multimedia communications
Different requirements for different applications
Delay sensitive applications
VoIP
Video chatting
Remote education
Delay sensitive, but less sensitive
Video streaming
Music streaming (sound cloud)
Delay sensitive, but less and less sensitive
TV broadcasting
18
![Page 19: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/19.jpg)
Different requirements for different
applications
Delay sensitive, really sensitive!
Telemedicine
Remote surgeries
Remote healthcare
Distributed gaming
Augmented reality
Surveillance
19
![Page 20: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/20.jpg)
Different requirements …
Data rates
Error tolerance
Receiver complexity
Tolerance for BW fluctuations
Heterogeneity of receivers
Tablets
Smart phones
Large displays
…
20
![Page 21: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/21.jpg)
Multimedia communications
21
![Page 22: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/22.jpg)
Major challenges
Multimedia signals at the receiver should satisfy some QoS
constraints
However, it is transmitted over the Internet, which generally
does not guarantee QoS
TCP versus UDP
What happens when an error occurs?
Can we do something better than ignoring the frames?
Is the order of packets important?
22
![Page 23: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/23.jpg)
23
![Page 24: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/24.jpg)
Major challenges
What about stored multimedia?
Locally stored
DVDs, blue ray
Remotely stored
Youtube, netflix
Compression?
Different receivers!
Transmission?
24
![Page 25: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/25.jpg)
25
![Page 26: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/26.jpg)
26
![Page 27: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/27.jpg)
Major challenges
Available bandwidth is dynamic
Cannot reserve BW in most wireless/Internet connections
What is the solution?
Faster than the available BW?
Slower than the available BW?
27
![Page 28: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/28.jpg)
28
![Page 29: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/29.jpg)
29
![Page 30: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/30.jpg)
Very hot in research!
30
![Page 31: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/31.jpg)
What will you learn in this course?
Multimedia signals representations
Speech, audio, images, video
Lossless compression techniques
Speech compression and quality of service
Image and video compression
Video error resilience and concealment
Network protocols for video transmission
Signaling (SIP)
IP multimedia subsystem
31
![Page 32: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/32.jpg)
Tools to be used
MATLAB
OPNET
C++
Will give you part of the code, you complete it
others
32
![Page 33: Multimedia communications ECP 610](https://reader030.vdocuments.mx/reader030/viewer/2022032904/6241c6f30e4f7279512665f0/html5/thumbnails/33.jpg)
Assignment (1)
- Write a report about your previous experiences related to
multimedia communications in your company, and your
company's approach to deal with the explosion happening in
data usage for multimedia applications. How it will handle
the high QoS requirements (delay, data rates, .. Etc)?
- Deadline: Sunday Feb 15th.
33