intro to nvidia gpus in azure · 2016-10-12 · top score. 15 visualization ... remote desktop...
TRANSCRIPT
![Page 1: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/1.jpg)
SEOUL | Oct.7, 2016
In Kee Paek, 10/07/2016
Cloud Data Solution Architect
Microsoft
INTRO TO NVIDIA GPUS IN AZURE
![Page 2: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/2.jpg)
2
GPU VIRTUALIZATION VISION
Deliver accelerated graphics & compute capabilities in Azure infrastructure
High end performance
Not “Swiss-army knife” offering
Helps achieve true “HPC in the Cloud”
Close partnership with NVIDIA
![Page 3: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/3.jpg)
3
FINANCE FX Options
Risk Management
Fixed Income Analytics
Market data analysis
Hedge Fund management
![Page 4: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/4.jpg)
4
MANUFACTURING OIL & GAS
Dynamic manipulation of Engineering
models and parts
Realistic material creation
Reservoir modelling and seismic
processing
Automotive engineering
![Page 5: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/5.jpg)
5
MEDIA Stream high fidelity video games
Encoding and transcoding
Image processing
Social media sentiment analysis
![Page 6: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/6.jpg)
6
RENDERING Visual Effects (VFX)
Ray-Tracing rendering
Advertising & Marketing
CAD Applications in Architecture
Simulations
![Page 7: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/7.jpg)
7
TECHNOLOGY
DDA – Discrete Device Assignment
Introduced in Windows Server 2016 as part of Hyper-V
Pass-through PCIe devices directly to a Guest VM
Allows for close to bare-metal performance
![Page 8: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/8.jpg)
8
DDA (DISCREET DEVICE ASSIGNMENT)
Entire device is mapped into the VM just as it would be running on bare metal
Allows for full access to capabilities of that device as well as allowing the device’s native driver to be used
Each device may be mapped to a single VM (1 device to 1 VM), but multiple devices can be mapped into the same VM (1 VM to many devices)
![Page 9: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/9.jpg)
9
![Page 10: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/10.jpg)
10
ARCHITECTURE
![Page 11: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/11.jpg)
11
COMPUTE VIRTUAL MACHINES
![Page 12: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/12.jpg)
12
TESLA K80 – “IT’S FAST…”
0x
5x
10x
15x
K80 CPU
Quantum Chemistry
Molecular Dynamics
PhysicsBenchmarks
![Page 13: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/13.jpg)
13
RATE OF IMPROVEMENT
72%74%
84%
88%
93%
96%
65%
70%
75%
80%
85%
90%
95%
100%
2010 2011 2012 2013 2014 2015
GPU
65%
70%
75%
80%
85%
90%
95%
100%
8-2013 12-2014 5-2016
Accuracy
39%
45%
55%
62%66%
72%75%
79%83%
86%87.5%
30%
40%
50%
60%
70%
80%
90%
100%
Top Score
![Page 14: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/14.jpg)
![Page 15: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/15.jpg)
15
VISUALIZATION VIRTUAL MACHINES
![Page 16: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/16.jpg)
16
REMOTE DESKTOP SERVICES
Graphics performance improvements through DDA
Enhanced support for OpenGL and OpenCL
Connection Broker capabilities to handle massive concurrent connections
Edge support
Pen support
Windows 10 and Mac preview available
![Page 17: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/17.jpg)
17
NV VM DEMO
![Page 18: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/18.jpg)
18
COLLABORATION WITH CNTK
First class citizen
Scalability – multi-GPU-multi-VM
Performance
Internal use-cases across various Microsoft properties and products
(DSVM) Data Science VM by Azure Machine Learning
N-Series and CNTK works really well together
![Page 19: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/19.jpg)
19
CNTK PERFORMANCE ON DDA
2670
10560
18755
27575
35750
0
5000
10000
15000
20000
25000
30000
35000
40000
CPU 1 GPU 2 GPUs 3 GPUs 4 GPUs
Sam
ple
s p
er S
eco
nd
Resource
Avg. Samples/Sec Linear (Avg. Samples/Sec)
![Page 20: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/20.jpg)
20
SUMMARY
High end platform
Support OpenGL and DirectX
Support OpenCL and CUDA
Support existing libraries and tools
Can utilize Azure higher-level services on top of GPU
Fulfill both Compute and Visualization use-cases
![Page 21: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/21.jpg)
21
RESOURCES
http://blogs.technet.com/b/virtualization/archive/2015/11/23/discrete-device-assignment-gpus.aspx
https://azure.microsoft.com/en-us/blog/azure-n-series-preview-availability/
https://channel9.msdn.com/Shows/Tuesdays-With-Corey/Tuesdays-with-Corey-Azure-N-Series-GPU-Acceleration-in-the-public-cloud
![Page 22: INTRO TO NVIDIA GPUS IN AZURE · 2016-10-12 · Top Score. 15 VISUALIZATION ... REMOTE DESKTOP SERVICES Graphics performance improvements through DDA Enhanced support for OpenGL and](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd7b0d4c46b638be2fbb5c/html5/thumbnails/22.jpg)
SEOUL | Oct.7, 2016
THANK YOU