Intel® Graphics Virtualization Technology

Kevin Tian

Graphics Virtualization Architect

Legal Disclaimer

INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS. Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order. Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or go to: http://www.intel.com/design/literature.htm Intel, Core, Look Inside, and the Intel logo are trademarks of Intel Corporation in the United States and other countries.

*Other names and brands may be claimed as the property of others. Copyright © 2014 Intel Corporation.

GPU Virtualization

3

VM VM

Hypervisor

Intel Processor Graphics

VM …

3D Media Compute

GPU Cloud

4

Visual Understanding Cloud Graphics

GPU-as-a-service GPU-as-a-service

Store/Stream, Transcode Gaming, Remote Apps,

Rendering

Search, Surveillance

GPU Cloud

Video Delivery

Media Processing Opportunity

5

Internet video traffic is forecasted to grow at 29% CAGR and will represent 69% of consumer traffic by 2017

Source: Cisco Systems Inc., Visual Network Index (VNI), 2013, 2015

Consumer Internet Traffic

Internet Video

File Sharing

Web, Email and Data

Online Gaming

Pe

tab

yte

s p

er

Mo

nth

T

ho

usa

nd

s 2011-2018 China Online Video Industry Market

Online video market (0.1B) Year on year growth (%)

Source: 2015.1 iResearch Inc., www.iresearch.com.cn

Media Delivery Example

6

Media Cloud

OTT, VOD, Offline Video …

Transport Edge (RAN, IP, Cable)

Service Provider

Transport Edge (RAN, IP, Cable)

Service Provider

Content Provider Content Provider Content Deliver Network

Content Deliver Network

1 Video files store in cloud storage 2

Media transcoding before deliver to CDN

Servers

3 Media transcoding for client in Edge

Laptop

VM VM VM VM VM VM

VM VM VM SDN

NFV

Data Center

Edge Cloud

Realtime, Video Conf, video awareness

Servers

Requirements of GPU Virtualization

hcsvg hb b Performance

Capability

Sharing

Direct GPU acceleration

Consistent visual experience

Multiple Virtual Machines

Intel Confidential

GPU Virtualization Approaches

8

API Forwarding Direct Pass-thru Full GPU Virtualization

Pros: • Performance • Sharing

Cons: • No media/GPGPU • Compatibility

Pros: • Performance • Capability

Cons: • No sharing

Pros: • Performance • Capability • Sharing

Intel® Graphics Virtualization Technology

Intel® GVT-s for API level GPU sharing Make existing API forwarding protocols running best on Intel platform

Intel® GVT-d for direct GPU passthrough Xen GPU passthrough upstreaming in progress

KVM PoC patch in community

Intel® GVT-g for vGPU based sharing Achieve a good balance of performance, feature and sharing

Xen implementations (a.k.a XenGT) in production quality on HSW

BDW support is in alpha quality in 2015/Q1 release

KVM support (a.k.a KVMGT) in prototype quality on HSW

9

Intel GVT-g: Full GPU Virtualization

Performance Performance Feature Feature Sharing Sharing

3DMark: 80%

H.264 transcoding: 90% (of native performance)

Native driver

DirectX 11.1, OpenGL 4.2, OpenCL 1.2, MediaSDK x.x

HSW BDW SKL …

Simultaneously accelerate multiple

VMs

Building Blocks

11

Host OS or VM

ISV Guest OS Ubuntu*14.04 LTS

OpenStack*

Nova Control point

OpenStack*

Nova Control point

Xen* Hypervisor Xen* Hypervisor

Intel Xeon® E3 Processor

ISV Guest OS Windows* 7 64bit

ISV Guest OS Windows 8 32bit

Media Server Video

Conference

Media Server Video

Conference

KVM Hypervisor KVM Hypervisor

Intel HD Driver Intel HD Driver

4th generation Intel® Core™ i7

Cloud Infrastructure

Media Server Real Time

Transcoding

Media Server Real Time

Transcoding

Intel HD Driver Intel HD Driver

Media Server VoD streaming Media Server

VoD streaming

Intel® HD Driver Intel® HD Driver

Intel® Media SDK Intel® Media SDK

OpenStack Network node

OpenStack Network node

OpenStack Storage/Image

OpenStack Storage/Image

XenGT XenGT KVMGT KVMGT

ISV/Non Intel ISV/Non Intel

Intel Hardware

Intel Own

Intel Contributed

Intel Media SDK Intel Media SDK Intel Media SDK Intel Media SDK GPU instance GPU instance

Video Conference Usage Case

12

Media Server Pool (x86 platform with

Intel® Processor graphics)

4K Display

Intel Processor graphics-based Encoding, Decoding, and Composing.

OpenStack* Media Cloud 1080P Camera

4K Camera

4K Video Conferencing on Media Plane NFV Demo @ MWC’15

Performance Summary

13

Avg S90% of native H.264 transcoding performance

0.0

50.0

100.0

150.0

200.0

250.0

300.0

350.0

400.0

450.0

High Density workload: 1080p transcoding

native vMediaServer

0.0

200.0

400.0

600.0

800.0

1000.0

1200.0

1400.0

1ch-D1 5ch-D1 10ch-D1 20ch-D1 25ch-D1 30ch-D1

High Density workload: 480p transcoding

Native vMediaServer

Config: I7 4770, Guest Ubuntu* 14.04LTS, 4GB mem, 1.5G GraphicMem, MediaSDK

CPU Transcoding vs. GPU Transcoding

14

Lab data. Config: I7 4770, Guest Windows* 7_x64, 4GB mem, 1.5G GraphicMem, MediaSDK

22.579

37.426

66.11 60.925

159.448

131.142 137.496

142.4

0.00%

20.00%

40.00%

60.00%

80.00%

100.00%

120.00%

0

20

40

60

80

100

120

140

160

180

1 vCPU 2 vCPU 4 vCPU 6 vCPU

CP

U%

uti

liz

ed

FP

S t

hro

ug

hp

ut

vCPU vs Intel® Graphics Virtualization Technology (Intel® GVT-g) total fps

(1ch x 1080p MPEG2->720p H264 transcoding)

IA Software Solution Intel GVT-g basedSW Solution vCPU % Intel GVT vCPU %

Performance boost with Intel GVT-g!

Q&A

Intel Confidential