using nvidia gpu cloud containers on nimbix cloud · 2018-06-12 · nvidia gpu cloud discover 30...
TRANSCRIPT
![Page 1: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/1.jpg)
GPU-Accelerated Innovation
USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD
Greg Crider
Senior Product Manager
NVIDIA
![Page 2: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/2.jpg)
2
NVIDIA + NIMBIX PARTNERSHIP
Nimbix was the first cloud provider to partner with NVIDIA
Has offered every NVIDIA compute GPU, including latest Volta V100 GPU
Only public cloud provider in the Americas to offer NVIDIA DGX-1 systems
Working Together to Deliver Accelerated Computing
![Page 3: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/3.jpg)
3
CHALLENGES WITH COMPLEX SOFTWARE
Current DIY GPU-accelerated AI and HPC deployments are complex and time consuming to build, test and maintain
Development of software frameworks by the community is moving very fast
Requires high level ofexpertise to manage driver, library, framework dependencies
NVIDIA Deep
Learning Libraries
NVIDIA Container
Runtime for Docker
NVIDIA Driver
NVIDIA GPU
Applications or
Frameworks
![Page 4: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/4.jpg)
4
NGC DELIVERS A GPU OPTIMIZED ENVIRONMENT
Integrates the deep learning SDK, libraries, drivers and OS into a single environment
Removes all the DIY complexity of managing dependencies, updates
Stack runs in a VM locally or in the cloud
![Page 5: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/5.jpg)
5
WHY CONTAINERS?
Benefits of Containers:
Simplify deployment of GPU-accelerated software, eliminating time-consuming software integration work
Isolate individual deep learning frameworks and applications
Share, collaborate, and test applications across different environments
5
![Page 6: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/6.jpg)
6
NVIDIA GPU CLOUD
Discover 30 GPU-Accelerated ContainersDeep learning, HPC, and partner applications
Innovate in Minutes, Not WeeksGet up and running quickly
Access from AnywhereSupports NVIDIA Volta or Pascal™ architecture GPUs on NVIDIA DGX Systems and supported cloud providers
Simple access to GPU-accelerated software
![Page 7: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/7.jpg)
7
NGC CONTAINER REGISTRY
Deep Learning Frameworks, drivers, OS, all pre-configured, tested, and optimized, updated monthly
Curated HPC and third-party applications
Updated monthly to deliver the highest performance frameworks in the industry
One stop shop for GPU optimized containers
![Page 8: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/8.jpg)
8
CURRENT NGC CONTAINERS
PARAVIEW-HOLODECK
PARAVIEW-INDEX
PARAVIEW-OPTIX
INDEX
VMD
H2O
MAPD
CHAINER
PADDLEPADDLE
KINETICA
GAMESS
GROMACS
LAMMPS
NAMD
CHROMA
MILC
RELION
CANDLE
LATTICE MICROBES
CAFFE CAFFE2 CNTK CUDA DIGITS MXNET PYTORCH TENSORFLOW TENSORRTTHEANO TORCH
DEEP
LEARNINGHPC VIZ HPC PARTNER
![Page 9: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/9.jpg)
9
MAXIMIZING PERFORMANCE ON VOLTAGreater than 10x Performance on Volta vs K80
0
2
4
6
8
10
12
K80 V100 TC
GPU Generational Training Scaling
Frameworks on NGC have the latest NVIDIA optimizations for Volta
Cloud images from NVIDIA are tuned for maximum performance
Volta is >10x faster than K80
ResNet-152 Training, 8x K80 (16 GPUs total) compared with 8x V100 NVLink GPUs using NVIDIA 17.10 containers
![Page 10: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/10.jpg)
10
NGC CONTAINERS RUNNING ON A CSP CLOUD
NGC Container Registry
CSP Cloud
User registers independently
with NGC and CSP Cloud
NGC
image
Cloud Marketplace
![Page 11: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/11.jpg)
11
DOWNLOAD NGC CONTAINERS
CREATE A CSP CLOUD ACCOUNT AND RUN A
GPU INSTANCE
CREATE A NGC ACCOUNT
3 STEPS TO USING NGC ON A CSP CLOUD
User creates a free NGC account on NVIDIA’s web site running in the US
www.nvidia.com/ngcsignup
User running a GPU instance in the CSP Cloud downloads no-cost containers from the NGC Container Registry
User creates a CSP Cloud account and starts a GPU instance using the NGC image
![Page 12: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/12.jpg)
12
NVIDIA GPU CLOUDGPU-accelerated containers for deep learning, HPC, and HPC visualization
Innovate In Minutes, Not Weeks
Access from Anywhere
GPU-Accelerated Containers
![Page 13: USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD · 2018-06-12 · NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in](https://reader030.vdocuments.mx/reader030/viewer/2022041014/5ec5a0f156bfdd7f9a5b6359/html5/thumbnails/13.jpg)