dynamics of video
Embed Size (px)
DESCRIPTIONPresented during IMTC 20th Anniversary Forum in Porto, Portugal
- 1. Today and tomorrow of visual communications, building on 20 years of technology breakthroughs October 8 10 Porto, Portugal International Multimedia Telecommunications Consortium Dynamics of Video in Mobile Environments Chienchung Chang Vice President, Head of Multimedia R&D Qualcomm Inc.
2. IMTC 20th Anniversary Forum Porto, Portugal Behind the Smartphone Frenzy: Multimedia 1/3+ of daily media interactions occur on a smartphone 3/4 Worlds population has access to a mobile device 604M Facebook users are mobile 3. IMTC 20th Anniversary Forum Porto, Portugal Millions of new consumers with video enabled device (phone/tablet) Higher availability of digital content services and social sharing platforms (Hulu, Netflix, Amazon, Facebook, YouTube) Improved capability of devices (higher resolution display, better camera and video engine in devices) Mobile Video Dominance 3 0 2 4 6 8 10 12 2012 2013 2014 2015 2016 2017 M2M Video File sharing Web/Data Cisco VNI report Mobile Data Traffic (Exabytes  per month) 4. IMTC 20th Anniversary Forum Porto, Portugal Mobile Video/Camera 4 5. IMTC 20th Anniversary Forum Porto, Portugal Data Growth Driven by Digital Video 5 1990 1995 2000 2005 2010 2013 1080p 30fps 1980x1020 QCIF 15fps 176x144 160 x 6. IMTC 20th Anniversary Forum Porto, Portugal Data Growth Driven by Digital Video 6 2015 2020 1080p 30fps 1980x1020 2013 8K 120fps 7680x4320 4K 60fps 3840x2160 8 x 8 x 7. IMTC 20th Anniversary Forum Porto, Portugal MPEG-2 Standard in 1996 DVD, Digital TV MPEG-4 Standard in 1999 AVC (H.264) Standard in 2003 Bluray, Digital TV HEVC (H.265) Standard in 2013 25% better 25% better ~40% better 100 MBbyte MPEG-2 video compressed with newer codecs: MPEG-2 MPEG-4 AVC (H.264) HEVC (H.265) 100MB 75MB 56MB 33MB Data for high quality video increased by 150x in last 22 years With 4K and 8K video, data will increase by 64x in next 10 years Video codec compression efficiency has only increased by 3x The Need for Better Compression 8. IMTC 20th Anniversary Forum Porto, Portugal Mobile industry now in the driver seat Driving the international standards Friendly to embedded platforms: power, computation, HW/SW implementation etal. Mass digital contents are consumed on personal screens Mobile and PC, TV, CE devices converge in video experience Video Codec Evolution 8 MPEG-2 H.262 (95) MPEG-4 ASP (00/11) H.263++ (00) MPEG-4 AVC H.264 HP (03/05) HEVC MP (13) -40%-44%-20% VCEG Initiates H.265 - KTA SW (Jul06) MPEGs CfE Results (Apr09) -71% 9. IMTC 20th Anniversary Forum Porto, Portugal Drivers of High Resolution Video Driving Beyond Retina Displays qVGA hVGA WVGA DVGA HD FHD 05 07 08-09 10 11 12-13 14 130~180 ppi 180~310 ppi 326 ppi 329 ppi 450~520 ppi 132ppi 498ppi 244ppi 10. IMTC 20th Anniversary Forum Porto, Portugal Drivers of High Resolution Video Resolution Upper Limits for Smartphones & Tablets 0 100 200 300 400 500 600 2 3 4 5 6 7 8 9 10 11 Resolution(PPI) Screen Size (inches) QVGA HVGA VGA WVGA qHD XGA 720HD 1080HD QXGA WQXGA 4K Eye resolution SP: 573ppi Eye resolution Tablet: 382ppi 11. IMTC 20th Anniversary Forum Porto, Portugal Drivers of High Resolution Video MiracastTM WiFi Display Video Gaming Browsing Photos Social Networking Consumers want to share content from smaller devices to larger displays. Video projected via MiracastTM WiFi Display requires the video stream to be simultaneously decoded on the smartphone/tablet and re-encoded and streamed to the larger display Video Compression is key to lower overall network bandwidth traffic 12. IMTC 20th Anniversary Forum Porto, Portugal Video Technology Considerations for Mobile Widely used codecs and file formats supported Wide Range of Codec & Format Support HW accelerated codec for higher performance Scalable covering from QCIF to 4K video Transcode, trans-rate HD in real time HFR (high frame rate) encode in HD Scalable Performance & Rich Features Pre-processing for encode path Rotation, zoom, image stabilization, overlay Post-processing for decode path Scaling, sharpening, frame rate conversion, de- interlacing, de-blocking, de-noising, error concealment CE Grade Video Quality All major frameworks: DirectShow, OpenCore, StageFright, Flash, Silverlight OpenMax IL level access to HW codecs Streaming protocol support: RTSP, RTP, HTTP Live Streaming, HTTP Adaptive Streaming, DASH Multimedia Framework Support 13. IMTC 20th Anniversary Forum Porto, Portugal 1080p30 is ubiquitous in smartphones(de facto) Next-gen imaging format: 4K (UHD-1) video is imminent. Visual quality (VQ) emerges as a key metric Internet traffic growth fuels the need of More efficient data compression : HEVC, SHVC and VP9 evolutions will set new bar in mobile video Delivery mechanisms : DASH As mobile and TV video experience converges, emerging technologies gain importance: Miracast, Alljoyn, DIAL, AirPlay High quality video post-processing is needed to compensate the gap of video and display resolution. Mobile Video Dynamics 13 14. IMTC 20th Anniversary Forum Porto, Portugal Adaptive Video Streaming Quality is adapted to changing network conditions. Videos encoded to different streams at different quality Stored or generated on- demand Device selects optimal stream Low Video SegmentsQuality Med High Time Internet (CDN) 15. 15 Chienchung Chang [email protected]