Download - Dynamics of Video
Today and tomorrow of visual communications, building on 20 years of technology breakthroughs
October 8 – 10
Porto, Portugal
International Multimedia Telecommunications Consortium
Dynamics of Video in Mobile Environments
Chienchung ChangVice President, Head of Multimedia R&D
Qualcomm Inc.
IMTC 20th Anniversary Forum – Porto, Portugal
Behind the Smartphone Frenzy: Multimedia
1/3+of daily media interactions occur on a smartphone
3/4Worlds population has access to a mobile device
604MFacebook users are mobile
3 IMTC 20th Anniversary Forum – Porto, Portugal
• Millions of new consumers with video enabled device (phone/tablet)• Higher availability of digital content services and social sharing platforms
(Hulu, Netflix, Amazon, Facebook, YouTube…)• Improved capability of devices (higher resolution display, better camera and
video engine in devices)
Mobile Video Dominance
2012 2013 2014 2015 2016 20170
2
4
6
8
10
12
M2M Video File sharing Web/Data
Cisco® VNI report
Mobile Data Traffic (Exabytes [1018] per month)
4 IMTC 20th Anniversary Forum – Porto, Portugal
Mobile Video/Camera
5 IMTC 20th Anniversary Forum – Porto, Portugal
Data Growth Driven by Digital Video
1990 1995 2000 2005 2010 2013
1080p 30fps1980x1020
QCIF 15fps176x144
160 x
6 IMTC 20th Anniversary Forum – Porto, Portugal
Data Growth Driven by Digital Video
2015 2020
1080p 30fps1980x1020
2013
8K 120fps7680x4320
4K 60fps3840x2160
8 x
8 x
IMTC 20th Anniversary Forum – Porto, Portugal
MPEG-2
• Standard in 1996• DVD, Digital TV
MPEG-4
• Standard in 1999
AVC (H.264)
• Standard in 2003• Bluray, Digital TV
HEVC (H.265)
• Standard in 2013
25% better 25% better ~40% better
100 MBbyte MPEG-2 video compressed with newer codecs:
MPEG-2 MPEG-4 AVC (H.264) HEVC (H.265)
100MB 75MB 56MB 33MB
Data for high quality video increased by 150x in last 22 yearsWith 4K and 8K video, data will increase by 64x in next 10 yearsVideo codec compression efficiency has only increased by 3x
The Need for Better Compression
8 IMTC 20th Anniversary Forum – Porto, Portugal
• Mobile industry now in the driver seat– Driving the international standards– Friendly to embedded platforms: power, computation,
HW/SW implementation etal.– Mass digital contents are consumed on personal
screens
• Mobile and PC, TV, CE devices converge in video experience
Video Codec Evolution
MPEG-2H.262 (‘95)
MPEG-4 ASP (‘00/’11)H.263++ (‘00)
MPEG-4 AVC H.264 HP (‘03/’05)
HEVC MP (’13)
-40%-44%-20%
VCEG Initiates H.265 -KTA SW (Jul’06)
MPEG’s CfE Results(Apr’09)
-71%
IMTC 20th Anniversary Forum – Porto, Portugal
Drivers of High Resolution Video
Driving Beyond “Retina” Displays
qVGA
hVGA
WVGA
DVGA
HD
FHD
‘05 ‘07 ’08-’09 ’10 ‘11 ’12-’13 ‘14
130~180 ppi
180~310 ppi
326 ppi
329 ppi
450~520 ppi
132ppi
498ppi
244ppi
IMTC 20th Anniversary Forum – Porto, Portugal
Drivers of High Resolution Video
Resolution Upper Limits for Smartphones & Tablets
2 2.3 2.6 2.9 3.2 3.5 3.8 4.1 4.4 4.7 5 5.3 5.6 5.9 6.2 6.5 6.8 7.1 7.4 7.7
8.00000000000001
8.30000000000001
8.60000000000001
8.90000000000001
9.20000000000001
9.50000000000001
9.8000000000000110.1
10.410.7 11
11.311.6
0
100
200
300
400
500
600
QVGAHVGAVGAWVGAqHDXGA720HD1080HDQXGAWQXGA4K
Screen Size (inches)
Reso
lutio
n (P
PI)
Eye resolution SP: 573ppi
Eye resolution Tablet: 382ppi
IMTC 20th Anniversary Forum – Porto, Portugal
Drivers of High Resolution VideoMiracastTM WiFi Display
VideoGamingBrowsingPhotosSocial Networking
Consumers want to share content fromsmaller devices to larger displays.
Video projected via MiracastTM WiFi Display requires the video stream to be simultaneously decoded on the
smartphone/tablet and re-encoded and streamed to the larger display
Video Compression is key to lower overall network bandwidth traffic
IMTC 20th Anniversary Forum – Porto, Portugal
Video Technology Considerations for Mobile
Widely used codecs and file formats supported
Wide Range of Codec & Format Support• HW accelerated codec for higher performance
• Scalable covering from QCIF to 4K video• Transcode, trans-rate HD in real time• HFR (high frame rate) encode in HD
Scalable Performance & Rich Features
• Pre-processing for encode pathRotation, zoom, image stabilization, overlay
• Post-processing for decode pathScaling, sharpening, frame rate conversion, de-interlacing, de-blocking, de-noising, error concealment
CE Grade Video Quality
All major frameworks: DirectShow, OpenCore, StageFright, Flash, Silverlight
OpenMax IL level access to HW codecs Streaming protocol support:
RTSP, RTP, HTTP Live Streaming, HTTP Adaptive Streaming, DASH
Multimedia Framework Support
13 IMTC 20th Anniversary Forum – Porto, Portugal
• 1080p30 is ubiquitous in smartphones(de facto)• Next-gen imaging format: 4K (UHD-1) video is imminent.• Visual quality (VQ) emerges as a key metric• Internet traffic growth fuels the need of
– More efficient data compression : HEVC, SHVC and VP9 evolutions will set new bar in mobile video
– Delivery mechanisms : DASH
• As mobile and TV video experience converges, emerging technologies gain importance: Miracast, Alljoyn, DIAL, AirPlay
• High quality video post-processing is needed to compensate the gap of video and display resolution.
Mobile Video Dynamics
IMTC 20th Anniversary Forum – Porto, Portugal
Adaptive Video Streaming
Quality is adapted to changing network conditions.
Videos encoded to different streams at
different quality
Stored or generated on-
demand
Device selects optimal stream
Low
Video Segments Quality
Med
High
Time
Internet(CDN)