1
Platform and terminal aspects
IP-Networking and Mediacom 2004 Workshop
Session MM3/MM4: Convergence / Interactive Broadcast
Simão F. Campos NetoVice-Chair, SG16 (Brazil); Chair WP 3/16 (Media Coding)
Lockheed Martin Global Telecommunications
LMGT LOGO
2
Objective
• Present an overview of ITU-T perspective on provisioning Multimedia Services (MM)
3
MM Applications Development
Factors:•Users needs•Market Trend•System Design•Architecture•Interoperable
Common Multimedia Parts, e.g., Coding (G,H,T-series), Security (X-series), Directory (X-series)
Integration or Assembling of
Multimedia Parts(Terminal Design; J,H-Series)
Users
Media (CS, PS, Cable)Wired/Wireless
(ITU and non-ITU)
Recommendations for Applications &Services (F,T series)Interoperability
Numbering,Charging Specs.(E-series)
4
F.MDS
Se
rvice D
escriptio
nsT
echn
ical D
escrip
tions
T.130
H.263
H.262H.261
H.243
H.231
H.320
H.242
H.230
H.221
Q.931
ISDN
ISDN
F.MCS.1 = F.731
F.MCV.1
F.MRS.1
F.MDS.1
N. A.
H.324
H.245
H.223
Q.23
PSTN
PSTN
F.MCS.3
F.MCV.3
F.MRS.3
F.MDS.3
N. A.
H.324
H.245
H.223
F.MCS.4
F.MCV.4
F.MRS.4
F.MDS.4
Q.---
Mobiles
Mobiles
Terminals or End-points
Multipoint
In-band Signalling
Multiplex
Call Control
B-ISDN
B-ISDN
H.247
H.321
H.310
H.245
H.222.1
H.222.0
Q.2931
F.MCS.2 = F.732
F.MCV.2
F.MRS.2
F.MDS.2
Network Independent Recommendations Network Specific Recommendations
Video CodingAudio CodingProtocols
G.729
G.728
G.723G.722
Communication Capabilities :
F.700Service Description Process
F.MRS
F.MCVS
F.MCS = F.702
Generic Multimedia Services
H.332
H.323
H.245
H.225.0
Packets
Packets
F.MCS.5
F.MCV.5
F.MRS.5
F.MDS.5
G.711
Media Comp.
Comm. Tasks
MSEs
MSEs = middleware service elements
T.120
H.248
MM Element InterdependenceU
ser
pers
pect
ive
Equ
ipm
ent/
prot
ocol
per
spec
tive
5
Services
6
MM Service Descriptions
• Several MM tasks:– Conferencing (multipoint, bi-directional, real-time)
– Conversation (point-to-point, bi-directional, real-time)
– Distribution (point-to-multipoint, unidirectional)
– Sending (point-to-point distribution, Tx controlled, UD; info pushing)
– Receiving (point-to-point distribution, Rx controlled, UD; info retrieval)
– Collecting (multipoint-to-point distrib., UD, Rx controlled; info polling)
• Media components: audio, video, text, graphics, still-pictures, and data
• Quality level for media components: {-1, 0, 1, 2, 3, 4}
Service definition and requirements are available in the F-series. F.700 contains the umbrella definitions:
Integration of media components from the user’s point-of-view
7
MM Service Descriptions (2)
F.70x: network-independent definitions• F.702 (F.MCV)-Multimedia conference services
• F.703 (F.MCS)-MM conversational services
Network-specific definitions• F.731- N-ISDN MM conference services
• F.732- B-ISDN MM conference services
8
Terminals
9
Multimedia terminals
• H.320: Communications over N-ISDN
• H.310: Communications over B-ISDN
• H.323: Communications over packet networks (mainly IP)
• H.324: Communications using circuit-switched services (fixed and mobile, including
3GPP)
• H.246: Terminal Interworking
Integration of media components from the equipment/protocol point-of-view
10
Multimedia terminals (2)
Example: Functional model for H.320 N-ISDN Terminal
NetworkInterface
Video Coding (H.261)
Audio Coding (G.711)
System Control (H.242)
Call Control (Q.931)
MM Mux & Sync
(H.221)
Data Coding (T.120)
UserInterface
11
Multimedia terminals (3)
Example: Functional model for H.323 Terminal
NetworkInterface
Audio Coding (e.g. G.711, G.729)
Video Coding (e.g. H.261, H.263)
User Data Coding (T.120)
System Control (H.245)
Call Control (H.225.0, Q.931)
MM Mux & Sync
(H.225.0)
UserInterface
12
Multimedia terminals (4)
Example: Functional model for H.324 Terminal
NetworkInterface
Audio Coding (e.g. G.723.1)
Video Coding (e.g. H.261, H.263)
Data Coding (T.120; V.14, LAPM)
System Control (H.245,SRP/LAPM)
Call Control (National standards; V.250)
MM Mux & Sync(Fixed network: H.223;
Mobile: H.223 Annexes A-D)User
Interface
13
MM terminals (5): InteroperabilityH.324 H.310
H.320H.323
Audio/Video
User data
User data
User data
User data
Audio/Video
Audio/Video
Audio/Video
Mux
QoS
RTP/Non-QoS
H.223
H.225.0
H.222.0H.222.1
H.221
Call Control (H.245)
Call Control (H.242/H.243)
Call Control (H.245)
Call Control (H.245)
H.223 Anx.A-D
Fixed
Mob
ile
Scope for H.246
14
Media components
15
Data
• T.120-T.140,T.17x provide definitions for data exchange and control in MM conferencing applications. For example:– T.120 defines data protocols for multipoint
multimedia conferencing (Annex C describes a light version of T.120). E.g. White-board applications.
– T.140 adds text conversation (“chat” e.g. for hearing-impaired people)
– T.17x: MHEG for information retrieval
16
Media Coding
Four aspects:
• Audio
• Video
• Still-image
• Other media coding
17
Media Coding: Audio
• Three “classic” quality tiers: audio, wideband speech, and telephony speech.
• ITU-T focus on interactive communications, hence mainly produced wideband and telephony speech compression standards (F.700’s A0 and A1 Quality Levels).
18
Media Coding: A2/A3 Audio
• A2 coding for broadcast applications J.41 (logarithmic PCM compression, 15kHz, 384kb/s) 1988
• A2&A3 Audio coding: ISO MPEG– MPEG2/Audio (e.g. MP3) – MPEG4/Audio
19
Media Coding: A1 Audio
A1: Wideband speech coders (50-7000Hz)• J.42 11-bit logarithmic PCM compression
(192 kbit/s) 1988• G.722 Split-band ADPCM Coding of 7 kHz speech
(64,56&48 kbit/s) 1988• G.722.1 Transform coding (32&24 kbit/s) 1999• G.16kWB Coding of 7 kHz speech at around 16 kbit/s
(planned mid 2001)
20
Media Coding: A0 Audio
A0: Telephony speech coders (300-3400 Hz)• G.711 PCM coding (64 kbit/s) late 60’s• G.726 ADPCM coding (32; 40, 24 & 16 kbit/s) 1988• G.727 Embedded ADPCM coding (40-16 kbit/s) 1990• G.728 LD-CELP coding (16; 40, 11.8 &9.6 kbit/s) 1992• G.723.1 Dual-rate coding (5.3 & 6.3 kbit/s) 1995• G.729 CS-ACELP coding (8; 12.8 & 6.4 kbit/s) 1996-98• G.4kbit/s Coding of speech at 4 kbit/s• G.VBR Variable bitrate speech coding New
Ongoing
21
Media Coding: Video
• ITU standards:– H.261 Video Codec for N-ISDN– H.262 = MPEG2/Video (“Common text”)– H.263 and Annexes IP, wireless, and N-ISDN– H.26L: successor to H.263 Ongoing
22
Media Coding: Still Image
• Still image (B/W & color) is used in facsimile services, in Internet applications, digital photography, etc.
• Standards work performed by a “Collaborative ITU|ISO/IEC Team” working under ISO/IEC SC29 rules and organization
• ITU has “common-text” for JPEG/JBIG (T.80 series); soon-to-be JPEG2000 (T.800 series)
23
Other media coding
Currently not performed in ITU-T:• Character coding (ISO/IEC SC2 activity)• Speech synthesis (text-to-speech)• Speech recognition (new developments)
24
Conclusion
• Service definitions provide the user perspective for MM communication
• Terminals & protocols integrate different media components for specific applications
• Interoperability adaptations are necessary
• Existing terminals are network-specific, however there is a trend towards more flexible specifications.
25
Media Coding Supplemental Slides
26
Telephony-band Speech Coding Families
Channel
Formant
Homomorphic
LPC
MBE
Parametric(Vocoding)
WaveformCoding
PCM
DPCM
ADPCM
DM
ADM
CSVD
HybridCoding
APC
RELP
MPLPC
CELP
SELP
SBC
ATC
Sinusoidal
Harmonic
Phase
27
Telephony-band Speech Coding Families
1 2 4 8 16 32 64
Vocoding
Waveform Coding
Hybrid Coding
LPC10e
MBE
CELP
APC
MPLPC
ATC
RELP
DPCMADPCM
LogPCM
Quality
Bit rate (kbit/s)
28
A2/A3 Non-ITU Standards
• MPEG2/Audio: audio coding > 64 kbit/s (1992)• MPEG4/Audio: audio + speech coding at bit rates
between 64 and 2 kbit/s (1998)
29
A0-A1 Non-ITU Standards
• ETSI/3GPP: – 13 kbit/s RPE-LTP (Full rate GSM, 1988)– 6.5 kbit/s VSELP (Half-rate GSM, 1993)– 12.2 kbit/s EFR (Enhanced full-rate GSM, 1996)– 12.2 - 4.75 kbit/s AMR (Adaptive Multi Rate, 1999)– 6.6 - 23.85 kbit/s AMR-WB (Wideband AMR, 2001)
• ARIB (Japan)– Full-rate PDC (Personal Digital Communication) 6.7 kbit/s VSELP
– Half-rate PDC 3.45 kbit/s Pitch Synchronous Innovation CELP
30
A0-A1 Non-ITU Standards (cont’d)
• US TIA (ANSI)– CDMA
• IS96 8,4,2 kbit/s QCELP (Qualcomm CELP, 1992)• IS127 8.55, 4, 0.8 kbit/s EVRC (Enhanced Var. Rate Codec, 1996)• IS733 13.3, 6.2, 2.7, 1 kbit/s VRC (Variable Rate Codec, 1998)• CDMA2000 9.6,4,2.4,0.8 kbit/s SMV (Selec.Mode Vocoder, ?2002)
– TDMA• IS54 7.95 kbit/s VSELP (Vector-Sum Excitation Lin.Pred., 1990)• IS641 7.4 kbit/s ACELP (Algebraic CELP, 1997)
– PCS1800 (GSM upbanded to 1800 MHz)• IS136-410 12.2 kbit/s US1 (1999)
31
Still Image Coding Summary (1)
• Umbrella: T.80 [1992]
• JPEG: T.81 (Part I), lossy and loss-less [1992]; T.83 (Compliance testing) [1994]; T.85 (Extensions, defs & testing) [1996]; T.85 Corr.1 [1999]; T.86 Registration of JPEG Profiles [1998]; T.87 (Baseline) Lossless and near-lossless compression of continuous-tone still images [1998]
• JBIG: T.82, loss-less [1993]; T.82 Corr.1 [1995]; T.85 JBIG for fax terminals; T.85 Amd.1 [1996], 2 [1997]; T.85 Corr.1 [1997]; T.88 Lossy/lossless coding of bi-level images [2000]; T.89 Application profiles for Recommendation T.88 [2000]
32
Still Image Coding Summary (2)
Planned new common texts: • T.800: Part 1, JPEG 2000 Image Coding System: Core
Coding System• T.801: Part 2, JPEG 2000 Image Coding System:
Extensions• T.802: Part 3, Motion JPEG 2000• T.803: Part 4, Conformance Testing• T.804: Part 5, Reference Software• T.805: Part 6, Compound Image File Format• T.806: Part 7, Technical Report: Guideline of minimum
support function of Part-1
33
ITU-T Video Coding• H.261: Video Codec for A/V services at p x 64 kbit/s
– The first practical video coding standard (1990)– Used today in (ISDN) video conferencing systems– Bit rates commonly 40 kbit/s to 2 Mbit/s
• H.262: Same as MPEG-2/Video (ISO/IEC 13818-2)– Commonly used for entertainment-quality video applications– The first practical standard for interlaced video– Used in digital cable, digital broadcast, satellite, DVD, etc.– Bit rates commonly 4-20 Mbit/s
34
ITU-T Video Coding(continued)
• H.263: Video Coding for Low Bit Rate Communication– Significantly improved video coding compression
performance (especially at very low rates, but also at higher rates as well)
– The first error and packet loss resilient video coding standard– Used in Internet protocol, wireless, and ISDN video
conferencing terminals (H.323, H.324, 3GPP, etc.)– “Baseline” core mode interoperable with MPEG-4/Video– Rich set of features for many applications– Very wide range of bit rates and possible applications
35
Non-ITU-T Video Coding• MPEG-1/Video (ISO/IEC 11172-2)
– The first video coding standard using half-pel motion compensation
– Typical bit rates 1-2 Mbits/s
• MPEG-4/Visual (ISO/IEC 14496-2)– The first video coding standard defining arbitrary object shapes– Many creative features for synthetic and synthetic-natural hybrid
content– Contains essentially all features of all prior standard codec
designs– Interoperable with ITU-T H.263 “baseline”– Very wide range of bit rates and possible applications