Using-NVIDIA-GPU-Cloud-Containers-on-the-Nimbix-Cloud-NVIDIA.pdf
- 1. GPU-Accelerated Innovation USING NVIDIA GPU CLOUD CONTAINERS ON NIMBIX CLOUD Greg Crider Senior Product Manager NVIDIA
- 2. 2 NVIDIA + NIMBIX PARTNERSHIP Nimbix was the first cloud provider to partner with NVIDIA Has offered every NVIDIA compute GPU, including latest Volta V100 GPU Only public cloud provider in the Americas to offer NVIDIA DGX-1 systems Working Together to Deliver Accelerated Computing
- 3. 3 CHALLENGES WITH COMPLEX SOFTWARE Current DIY GPU-accelerated AI and HPC deployments are complex and time consuming to build, test and maintain Development of software frameworks by the community is moving very fast Requires high level of expertise to manage driver, library, framework dependencies NVIDIA Deep Learning Libraries NVIDIA Container Runtime for Docker NVIDIA Driver NVIDIA GPU Applications or Frameworks
- 4. 4 NGC DELIVERS A GPU OPTIMIZED ENVIRONMENT Integrates the deep learning SDK, libraries, drivers and OS into a single environment Removes all the DIY complexity of managing dependencies, updates Stack runs in a VM locally or in the cloud
- 5. 5 WHY CONTAINERS? Benefits of Containers: Simplify deployment of GPU-accelerated software, eliminating time-consuming software integration work Isolate individual deep learning frameworks and applications Share, collaborate, and test applications across different environments 5
- 6. 6 NVIDIA GPU CLOUD Discover 30 GPU-Accelerated Containers Deep learning, HPC, and partner applications Innovate in Minutes, Not Weeks Get up and running quickly Access from Anywhere Supports NVIDIA Volta or Pascal™ architecture GPUs on NVIDIA DGX Systems and supported cloud providers Simple access to GPU-accelerated software
- 7. 7 NGC CONTAINER REGISTRY Deep Learning Frameworks, drivers, OS, all pre-configured, tested, and optimized, updated monthly Curated HPC and third-party applications Updated monthly to deliver the highest performance frameworks in the industry One stop shop for GPU optimized containers
- 8. 8 CURRENT NGC CONTAINERS PARAVIEW-HOLODECK PARAVIEW-INDEX PARAVIEW-OPTIX INDEX VMD H2O MAPD CHAINER PADDLEPADDLE KINETICA GAMESS GROMACS LAMMPS NAMD CHROMA MILC RELION CANDLE LATTICE MICROBES CAFFE CAFFE2 CNTK CUDA DIGITS MXNET PYTORCH TENSORFLOW TENSORRT THEANO TORCH DEEP LEARNING HPC VIZ HPC PARTNER
- 9. 9 MAXIMIZING PERFORMANCE ON VOLTA Greater than 10x Performance on Volta vs K80 0 2 4 6 8 10 12 K80 V100 TC GPU Generational Training Scaling Frameworks on NGC have the latest NVIDIA optimizations for Volta Cloud images from NVIDIA are tuned for maximum performance Volta is >10x faster than K80 ResNet-152 Training, 8x K80 (16 GPUs total) compared with 8x V100 NVLink GPUs using NVIDIA 17.10 containers
- 10. 10 NGC CONTAINERS RUNNING ON A CSP CLOUD NGC Container Registry CSP Cloud User registers independently with NGC and CSP Cloud NGC image Cloud Marketplace
- 11. 11 DOWNLOAD NGC CONTAINERS CREATE A CSP CLOUD ACCOUNT AND RUN A GPU INSTANCE CREATE A NGC ACCOUNT 3 STEPS TO USING NGC ON A CSP CLOUD User creates a free NGC account on NVIDIA’s web site running in the US www.nvidia.com/ngcsignup User running a GPU instance in the CSP Cloud downloads no-cost containers from the NGC Container Registry User creates a CSP Cloud account and starts a GPU instance using the NGC image
- 12. 12 NVIDIA GPU CLOUD GPU-accelerated containers for deep learning, HPC, and HPC visualization Innovate In Minutes, Not Weeks Access from Anywhere GPU-Accelerated Containers