Key technologies for advanced media applicationsMike DowneyPrincipal Evangelist, Media Platform Evangelism3-117

Private cloud FrameworksClientsPublic cloud

Microsoft® Media Platform

VideoEditor

ContentManager

Microsoft® Media Platform

PlayerFramework

Microsoft® Media Platform

Microsoft®

PlayReady®

Windows Azure Media Services

Microsoft Media Platform

Porting Kit

Markers

Multi-Cam

Adaptive Bitrate

Live

Advertising

Captions

Playlists

Analytics

Robustness

DRM

Streaming media to Windows 8

IE10IE10 on theDesktop

IE10 on theDesktop on Windows RT

Demo: Bridging to desktop & apps

Demo: Windows 8 Media App Example

Elements of a video player

<video>MediaElement

MF Extensions & WinRT

ComponentsPlayer

framework

Basic playbackProgressive downloadLocal playback

Streaming (Live & VoD)CodecsPlayReady/DRMVideo effectsExtensibility

CaptioningAdvertisingError/Retry logicUI/StylingPlaylist Management

Demo: <video>

Going beyond <video>…

Windows 8 media pipelineWindows Store app

Playback/Preview

Capture Transcode StreamingExtensibilit

yProtection

MediaControl

Media Foundation

Audio/Video Source

Audio/Video Sink

Video Decoder

Audio Decoder

Video Encoder

Audio Encoder

Video Effect 1

Audio Effect 1

Video Effect 2

Audio Effect 2

DirectX Windows Audio Session API (WASAPI)

<audio src=“…”><video src=“…”> Windows Runtime (WinRT)MediaElement

Smooth Streaming SDK for Windows 8Adaptive bitrate streaming over HTTPLive and Video-on-DemandProven at scale with events like Olympics, SNFBased on MP4 formatNo licensing fee Supported on Windows, Windows Phone, Xbox, Silverlight, iOS, TV, Set-top boxes, etcOn-ramp to MPEG-DASH and UltraViolet

PlayReady SDK for Windows 8PlayReady fully supportedPlayback, License operations, Domain operations, Metering

Free developer SDK for Windows Store appsIntegrated with Visual Studio 2012Download from Visual Studio Gallery

New capabilities only available to Windows Store appsPer app / per user license storeLicense deletion

How do I implement all of this?

Microsoft Media Platform:Player Framework

Cross-platform, open source

Adaptive-bitrate heuristics

Rich DVR-style playback

Ad integration

Closed captions

Error-handling and retry logic

Playlist management

UI customization

Plugin model

3-D video

Media analytics

PlayTo

Player Framework for Windows 8

Windows 8 PF architectureHTML5 App

WinRT Shared Components (C#)

Player Framework Plugins

Player Framework for HTML5

XAML App

Player Framework for XAML

Captions Advertising Tracking PlaylistError

HandlerControlStri

pAdaptive

Adaptive Manager VAST HandlerMAST SchedulerVMAP Scheduler

VPAID PlayerFreeWheel Scheduler

Smooth Streaming SDK

Demo: Player Framework

Advanced features

Video advertising

Video advertising supportAd schedulingVMAP, MAST, FreeWheel

Types of scheduled adsPrerolls, midrolls, postrolls

Ad formatsVAST, Simple clips, Custom

Ad types & VPAIDLinear, Non-linear, Companion

Closed captioning

Closed captioning supportProviding closed captioning is increasingly important around the worldFCC requirementCaptioning is more than just textTTMLWebVTT (JS-only)Other standards considered for the futureSMPTE-TT, 607/708, New TTML Lite spec

Extensibility

ExtensibilityPlayer Framework extensibility originally architected using MEF in SilverlightThis architecture has been simplified for Windows 8All major features designed as pluginsWindows is also extensibleStreaming, codecs, content protection all provided via Media Foundation extensionsRichard Fricks’ session

MPEG-DASH

MPEG-DASHFramework standard requiring additional application profiles to create complete interoperability standards

Specifies media description and segment formats to enable efficient and high-quality delivery of media over the InternetMedia Presentation Description (MPD) format based on XMLSegment format defines syntax and semantics of HTTP responses

ProfilesISOBMFF (fMP4)M2TS

Demo: MPEG DASH Client

Sample app

RecapInternet Explorer 10Windows 8 for advanced scenariosSmooth StreamingPlayReadyExtensibilityPlayer Framework for Windows 8MPEG-DASH

Download the player framework and sample apphttp://playerframework.codeplex.com

• Develop: http://msdn.microsoft.com/en-US/windows/apps/br229512

• Design: http://design.windows.com/

• Samples: http://code.msdn.microsoft.com/windowsapps/Windows-8-Modern-Style-App-Samples

• Videos: http://channel9.msdn.com/Windows

Resources

Please submit session evals by using the Build Windows 8 appor at http://aka.ms/BuildSessions

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.