nVidia Presentation in OpenPOWER workshop Brazil
- 1. 1
- 2. 2 Agenda -Accelerating Computing -NVIDIA CUDA-X -Data Science -Super Computer vs Hyperscale -NVIDIA AI Momentum
- 3. 3 NVIDIA ACCELERATED COMPUTING GROWTH 0 100 CRYOSPARC Cryo GROMACS Chemistry MICROVOLUTION Microscopy WRF Weather 600+ CUDA APPS FUN3D CFD PARABRICKS Genomics #1 World, US — ORNL Summit #1 Europe — CSCS Piz Daint #1 Japan — AIST ABCI 22 of Top 25 Energy-Efficient 50% GROWTH IN TOP50050% GROWTH OF NVIDIA DEVELOPERS 2018 2019 1.2M DEVELOPERS +50%800K 2018 2019 13M CUDA DOWNLOADS +60% 8M 2018 2019 25X 40X AMBER CHROMA LAMMPS MILC NAMD Quantum Espresso SF3D MORE PERF 2010 2012 2014 2016 2018
- 4. 4 NVIDIA CUDA-X AI ECOSYSTEM FRAMEWORKS CLOUD ML SERVICES DEPLOYMENT Workstation CloudServer DA GRAPH DL TRAINML DL INFERENCE Serving Amazon SageMaker Neo CUDA-X AI CUDA Amazon SageMaker Google Cloud ML Azure Machine Learning Announcing Tensor Core Mixed-Precision Automatically Supported in TensorFlow, PyTorch, MXNet
- 5. 5 DATA SCIENCE – A NEW PILLAR OF DISCOVERY PREDICTIVE MODELFEATURES PREDICTIONDATA ETL, Pandas, Spark, Graph TensorFlow, PyTorch MXNet, Scikit-Learn, XGBoost TensorFlow Serving ONNX, SageMaker NEO CSV, PARQ, HDFS ML DL CVNLU AI DATA ANALYTICS INFERENCE
- 6. 6 DATA SCIENCE – A NEW PILLAR OF DISCOVERY PREDICTIVE MODELFEATURES PREDICTIONDATA cuIO cuDF cuGraph cuDNN cuML TensorRT TRTIS ML DL CVNLU AI DATA ANALYTICS INFERENCE
- 7. 7 ANNOUNCING WORLD’S LEADING TECH COMPANIES Voice Search | Image Search Recommendations | Home Assistant News Feed | Translation | eCommerce Adopt CUDA-X AI to Accelerate Model Deployment 6X TensorRT Downloads 2017 2018 300K 50K
- 8. 10 SUPER COMPUTER VS. HYPERSCALE COMPUTEREQUIREMENT 1T PF 1B PF 1M PF 1K PF 1PF 1TF 1K 1M 1B #CCU SUPERCOMPUTER HYPERSCALE Supercomputer | Capability Machine Scale-up Architecture
- 9. 11 SUPER COMPUTER VS. HYPERSCALE COMPUTEREQUIREMENT 1T PF 1B PF 1M PF 1K PF 1PF 1TF 1K 1M 1B #CCU SUPERCOMPUTER HYPERSCALE … Supercomputer | Capability Machine | Scale-up Architecture Hyperscale | Capacity Machine Scale-out Architecture
- 10. 12 DATA SCIENCE – THE NEW HPC CHALLENGE COMPUTEREQUIREMENT 1T PF 1B PF 1M PF 1K PF 1PF 1TF 1K 1M 1B #CCU SUPERCOMPUTER HYPERSCALE … DATA SCIENCE Supercomputer | Capability Machine | Scale-up Architecture Hyperscale | Capacity Machine | Scale- out Architecture
- 11. 13 DATA SCIENCE – THE NEW HPC CHALLENGE COMPUTEREQUIREMENT 1T PF 1B PF 1M PF 1K PF 1PF 1TF 1K 1M 1B #CCU SUPERCOMPUTER HYPERSCALE DATA SCIENCE IBM Power9 AC922 … Hyperscale | Capacity Machine | Scale- out Architecture
- 12. 14 DATA SCIENCE – THE NEW HPC CHALLENGE COMPUTEREQUIREMENT 1T PF 1B PF 1M PF 1K PF 1PF 1TF 1K 1M 1B #CCU SUPERCOMPUTER HYPERSCALE … DATA SCIENCE Hyperscale | Capacity Machine | Scale- out Architecture IBM Power9 AC922
- 13. 15 DATA SCIENCE – THE NEW HPC CHALLENGE COMPUTEREQUIREMENT 1T PF 1B PF 1M PF 1K PF 1PF 1TF 1K 1M 1B #CCU SUPERCOMPUTER HYPERSCALE DATA SCIENCE Data Science Server 4x T4 | 260 TF FP16 | 64GB GDDR6 MLNX or BRCM EN IBM Power9 AC922
- 14. 16 DATACENTER BECOMES A COMPUTE ENGINE
- 15. 17 NVIDIA AI MOMENTUM Image Tagging Video Analysis Advertising Impact Video Captioning Visual Search Finding Music Sports Performance Customer Service Visual Search Industrial Inspection Voice Recognition Cybersecurity
- 16. 18 UIUC & NCSA: ASTROPHYSICS 5,000X LIGO Signal Processing U. FLORIDA & UNC: DRUG DISCOVERY 300,000X Molecular Energetics Prediction SLAC: ASTROPHYSICS Gravitational Lensing: From Weeks to 10ms AI ACCELERATES SCIENTIFIC DISCOVERY U.S. DoE: CLEAN ENERGY 33% More Accurate Neutrino Detection PRINCETON & ITER: PARTICLE PHYSICS 90% Accuracy for Fusion Sustainment U. PITT: DRUG DISCOVERY 35% Higher Accuracy for Protein Scoring
- 17. 19 A RADIOLOGY LIBRARY FOR THE WORLD AI holds enormous promise for advancing medical imaging, but well-annotated datasets are hard to come by. Researchers at the National Institutes of Health have created an auto-annotation system leveraging deep learning, NVIDIA GPUs and the CUDA programming model. The NIH research could lead to the creation of a global library of datasets for medical researchers.
- 18. 20 Billions of Facebook users enjoy experiences made possible with artificial intelligence, including personalized News Feeds, trending topics, search results, and much more. Facebook data center is powered by more than 40 PFLOP/s of GPU-accelerated performance, enabling them to perform over 6M predictions per second. Apart from event prediction Facebook uses AI for machine translation, natural language processing, and computer vision. Today over 25% of Facebook engineers use the AI to develop smarter services.
- 19. 21 Pinterest is a leading social networking site with over 100 million active users sharing over 75 billion photos, generating nearly 25% of global sales driven by social media. Powered by deep learning, Pinterest enables users to visually search for similar objects and styles they see in other pinned images. AI- powered visual search has resulted in 50% higher user engagement. Pinterest uses NVIDIA GPUs in Amazon AWS cloud service to train smarter AI models and to deliver responsive user experiences with faster inferencing with GPUs.
- 20. 22 DEEP LEARNING FOR FRAUD DETECTION AND CUSTOMER ALERTING In 2016, Capital One launched customer account access on Amazon’s Alexa platform, allowing users to check their balances, pay their bills etc. March 2017 — AI - Natural language processing (NLP), an industry-first rollout of a NLP Chatbot named “ENO” Shifts the medium from voice to text — Ken Dodelin VP of digital product management “97% of smartphone users text, allows the Bank to interact in a format people find convenient” https://venturebeat.com/2017/04/25/how-capital-one-transformed-into-a-tech-and-ai-company/
- 21. 23 IMPACT OF AI IS HUGE FOR ENTERPRISES Google: Hundreds of millions of dollars in power savings with AI-operated data center Netflix: $1 billion savings per year with AI- assisted recommendation engine AdTheorent: 300% higher user engagement for mobile advertisers during shopping season
- 22. 24 ACCELERATED COMPUTING — THE PATH FORWARD | “PRADA”
- 23. 25