Video for Everyone

Casey Hickey | SUNY Cortland June 26, STC 2012 John Halsted Suite

Who is this session even for, and what’s it really about anyway?

What does this have to do with mobile technology?

http://blog.nielsen.com/nielsenwire/online_mobile/smartphones-account-for-half-of-all-mobile-phones-dominate-new-phone-purchases-in-the-us/

http://blog.nielsen.com/nielsenwire/online_mobile/survey-new-u-s-smartphone-growth-by-age-and-income/

Streaming Video: What is it?

Streaming refers to the delivery method, not the medium!

Streaming does not imply live streaming.

Where did streaming media come from?

• Netscape / Macromedia Shockwave (1995)

• RealNetworks Realplayer (1997)

• Microsoft Windows Media Player (1999)

• Apple Quicktime 4 (1999)

21st Century Streaming

• Macromedia / Adobe Flash (2002)

• HTML5 <video> (Proposed February 2007)

• Apple iOS: No Flash Support (2007)

• Microsoft Silverlight (2009)

• Adobe , Apple, & others HTTP Streaming ( ~2009 / 2010)

A transitional period for the web…

What’s changing?

• Fundamental markup languages of the web to be subsumed by HTML5

• Current browsers are gradually supporting HTML5 components

• HTML5 Video specification is incomplete mostly due to debate over video format

• Adobe has ended development for Flash plug-in for mobile browsers

So everything’s changing… How should we be streaming video right now?

• Most major video services use AVC (MPEG-4 / H.264) video and AAC audio.

Source: http://blog.mefeedia.com/html5-dec-2011

(around 50M videos from 30K video sources)

So everything’s changing… How should we be streaming video right now?

• Most major video services use AVC (MPEG-4 / H.264) video and AAC audio.

• Look for Dynamic / Adaptive Bit Rate streaming.

• Decide where to draw the line.

Source: http://www.pcworld.com/article/253808/3g_and_4g_wireless_speed_showdown_which_networks_are_fastest.html

Source: http://www.pcworld.com/article/253808/3g_and_4g_wireless_speed_showdown_which_networks_are_fastest.html

Source: http://techblog.netflix.com/2011/10/netflix-performance-on-top-networks.html

So everything’s changing. How should we be streaming video right now?

• Most major video services use AVC (MPEG-4 / H.264) video and AAC audio.

• Look for Dynamic / Adaptive Bit Rate streaming.

• Decide where to draw the line.

• Check playback devices / environments

Optimizing H.264 for mobile devices

• iPad and iPhone 3G and newer: H.264 Baseline Profile 3.1

• Earlier versions of iPhone: Do not exceed Baseline Profile 3.0

• Video Resolution Don’t go overboard!

• No CABAC (for now at least) Higher quality, but harder to decode

• Audio (AAC) 44.1 kHz, 22.05 kHz or 11.025 kHz

Want to learn more about encoding?

Video Compression for Flash, Apple Devices and HTML5

Jan Ozer, published May 2011

Playback devices…

• Check playback devices (and test your environments!)

• Update browsers, Flash Player, and drivers!

Source: http://www.tomshardware.com/reviews/adobe-flash-10.1-performance-hardware-acceleration,2805-4.html

Optimizing Devices for Playback

• Check playback devices

• Update browsers, Flash Player, and drivers!

• Performance will vary between browsers

That brings us back to…

• What should you take away from this?

• Mobile tech has changed the way content is streamed, and it’s not done yet. We need to keep up, and more importantly our video service providers need to keep up!

• Mobile First: We can no longer consider mobile devices second-class destinations.

Final Thoughts / Q&A

Sources & Extra Stuff: Understanding Video Streaming (Intro Video) http://marketing.primetime2.mediaplatform.com/#93 Streaming Media on Wikipedia http://en.wikipedia.org/wiki/Streaming_media A Look at Smartphone Owners in the US http://blog.nielsen.com/nielsenwire/?p=31688 Wireless Speed Showdown http://www.pcworld.com/article/253808/3g_and_4g_wireless_speed_showdown_which_networks_are_fastest.html Adobe Flash: Hardware Acceleration, GPU, Drivers, and Details http://www.tomshardware.com/reviews/adobe-flash-10.1-performance-hardware-acceleration,2805-4.html Nvidia GPUs supporting Adobe Flash 10.1 (H.264 Hardware Acceleration) http://www.nvidia.com/object/gpus_supporting_adobeflash.html?ClickID=cnzaaswps4ae7senfzapxfsqea44qvi4lnsn Steve Jobs: Thoughts on Flash http://www.apple.com/hotnews/thoughts-on-flash/ iOS-Specific Considerations – Supported Media https://developer.apple.com/library/safari/documentation/AudioVideo/Conceptual/Using_HTML5_Audio_Video/Device-SpecificConsiderations/Device-SpecificConsiderations.html#//apple_ref/doc/uid/TP40009523-CH5-SW9 Deploying HTTP Live Streaming Media for iOS http://developer.apple.com/library/ios/#technotes/tn2224/_index.html Flash to Focus on PC Browsing and Mobile Apps http://blogs.adobe.com/conversations/2011/11/flash-focus.html The Future of Flash http://www.mikechambers.com/blog/2011/11/11/clarifications-on-flash-player-for-mobile-browsers-the-flash-platform-and-the-future-of-flash/ Mozilla execs capitulate in H.264 Web-video war

http://news.cnet.com/8301-30685_3-57397031-264/mozilla-execs-capitulate-in-h.264-web-video-war/

… Sources & Extra Stuff Continued HTTP Dynamic Streaming http://www.adobe.com/products/hds-dynamic-streaming.html

Smartphones Accounts for half of U.S. Mobile Phones http://blog.nielsen.com/nielsenwire/online_mobile/smartphones-account-for-half-of-all-mobile-phones-dominate-new-phone-purchases-in-the-us/

Smartphone Growth by Age and Income http://blog.nielsen.com/nielsenwire/online_mobile/survey-new-u-s-smartphone-growth-by-age-and-income/

Mobile First http://www.abookapart.com/products/mobile-first/

Video Compression for Flash, Apple Devices and HTML5

http://www.amazon.com/Video-Compression-Flash-Apple-Devices/dp/0976259508 HTML5 on Wikipedia http://en.wikipedia.org/wiki/HTML5 HTML5 <video> on Wikipedia http://en.wikipedia.org/wiki/HTML5_video MediaInfo http://mediainfo.sourceforge.net/en