Nvidia and ibm presentation feb18
0 likes303 views
The document discusses the evolution and impact of GPU computing and AI technologies, particularly focusing on their applications across various industries from 1980 to 2020. It highlights significant advancements, such as GPU-accelerated deep learning used in customer service, logistics, and healthcare, emphasizing the growing integration of AI in daily operations. The document also outlines predictions for AI's role in enhancing customer experiences and boosting business revenues.
![8
PLATFORM BUILT FOR AI
Delivering 125 TFLOPS of DL Performance with Volta
TENSOR CORE
VOLTA-OPTIMIZED cuDNN
MATRIX DATA OPTIMIZATION:
Dense Matrix of Tensor Compute
TENSOR-OP CONVERSION:
FP32 to Tensor Op Data for
Frameworks
TENSOR CORE
VOLTA TENSOR CORE
4x4 matrix processing array
D[FP32] = A[FP16] * B[FP16] + C[FP32]
Optimized For Deep Learning
ALL MAJOR FRAMEWORKS](https://image.slidesharecdn.com/nvidiaandibmpresentationfeb18-180212132443/85/Nvidia-and-ibm-presentation-feb18-8-320.jpg)
Nvidia and ibm presentation feb18
- 1. DANNY KIERNAN|AI on IBM POWERAI| Feb. 7th, 2018 THE ACCELERATED DATACENTER WITH IBM
- 2. 2 Democratizing AI Autonomous MachinesInference Acceleration Self-driving Cars Accelerated Computing Gaming 1980 1990 2000 2010 2020 GPU-Computing perf 1.5X per year 1000X by 2025 102 103 104 105 106 107 Single-threaded perf 1.5X per year 1.1X per year concat Batch nm batch nm batch nm batch nm max pool input relu relu relu relu 1x1 conv 3x3 conv 5x5 conv 1x1 conv relu batch nm 1x1 conv relu batch nm 1x1 conv next input next input 3x3 CR 5x5 CR batch nm max pool input copy 1x1 CR NVIDIA
- 3. 3 1980 1990 2000 2010 2020 GPU-Computing perf 1.5X per year 1000X by 2025 RISE OF GPU COMPUTING Original data up to the year 2010 collected and plotted by M. Horowitz, F. Labonte, O. Shacham, K. Olukotun, L. Hammond, and C. Batten New plot and data collected for 2010-2015 by K. Rupp 102 103 104 105 106 107 Single-threaded perf 1.5X per year 1.1X per year APPLICATIONS SYSTEMS ALGORITHMS CUDA ARCHITECTURE
- 4. 4 TWELVE YEARS OF GPU COMPUTING 2010 Fermi: World’s First HPC GPU World’s First Atomic Model of HIV Capsid GPU-Trained AI Machine Beats World Champion in Go 2014 Stanford Builds AI Machine using GPUs World’s First 3-D Mapping of Human Genome Google Outperforms Humans in ImageNet 2012 Discovered How H1N1 Mutates to Resist Drugs Oak Ridge Deploys World’s Fastest Supercomputer w/ GPUs 2008 World’s First GPU Top500 System 2006 CUDA Launched AlexNet beats expert code by huge margin using GPUs Top 13 Greenest Supercomputers Powered by NVIDIA GPUs 2017
- 5. 5 3000 AI MOMENTUM TODAY BY 2020 AI startups 85% $47B 20% of all customer service interactions will be powered by AI bots spend on AI technologies of companies will dedicate workers to monitor and guide neural networks
- 6. 6 AI REVOLUTIONIZING OUR WORLD Search, Assistants, Translation, Recommendations, Shopping, Photos… Detect, Diagnose and Treat Diseases Powering Breakthroughs in Agriculture, Manufacturing, EDA
- 7. 7 EVERY INDUSTRY HAS AWOKEN TO AI 2014 2017 1,549 26,895 Higher Ed Internet Healthcare Finance Automotive Others Government Developer Tools Organizations engaged with NVIDIA on Deep Learning
- 8. 8 PLATFORM BUILT FOR AI Delivering 125 TFLOPS of DL Performance with Volta TENSOR CORE VOLTA-OPTIMIZED cuDNN MATRIX DATA OPTIMIZATION: Dense Matrix of Tensor Compute TENSOR-OP CONVERSION: FP32 to Tensor Op Data for Frameworks TENSOR CORE VOLTA TENSOR CORE 4x4 matrix processing array D[FP32] = A[FP16] * B[FP16] + C[FP32] Optimized For Deep Learning ALL MAJOR FRAMEWORKS
- 9. 9 TESLA V100 WITH IBM POWER9 The Fastest and Most Productive GPU for AI and HPC Volta Architecture Most Productive GPU Tensor Core 125 Programmable TFLOPS Deep Learning Improved SIMT Model New Algorithms Volta MPS Inference Utilization Improved NVLink & HBM2 Efficient Bandwidth
- 10. 10 VOLTA ARCHITECTURE WITH IBM POWER9
- 11. 11 NEXT GEN NVLINK WITH IBM POWER9 10
- 13. 13 The number of mobile banking users is estimated to reach 2 billion by the year 2021. So it’s not surprising to see the rising popularity of Chatbots in the finance industry. Through convenience and ease-of-use, Chatbots optimize digital services at scale. Capital One is piloting an SMS text-based intelligent assistant named Eno. Eno uses GPU-powered deep learning to respond to natural language text messages from customers inquiring about their accounts. Customers text Eno to track their balance, recent charges, or to pay their bill. Eno takes mobile banking to the next level, which is just a text message away. AI CHATBOT THAT SPEAKS EMOJI
- 14. 14 AI TOOL BOOSTS CUSTOMER SERVICE KLM’s 350 social media service agents engage in 15K conversations each week on channels like Facebook Messenger, Twitter and Whatsapp, 24/7. To support the overwhelming volume of messages, KLM uses GPU-accelerated deep learning with CUDA from DigitalGenius, to predict the best response to an incoming message and shows it to a contact center agent for approval or personalization before sending it to the customer. The resulting time savings for KLM service agents means they can focus on customers with more pressing needs and handle a greater volume of questions while still maintaining a high degree of customer satisfaction.
- 15. 15 AI IMPROVES THE CUSTOMER EXPERIENCE AI is dramatically changing the online shopping experience with tangible improvements to retailers and consumers. In 2016 online British grocery giant Ocado improved customer service with their AI- enhanced contact center, and is applying machine learning and NVIDIA GPUs with CUDA to develop humanoid robotics to assist maintenance technicians, and advanced computer vision for image classification and recognition to replace barcode systems. Computer vision will expedite the picking process and better ensure orders are filled correctly so customers receive exactly what they ordered.
- 16. 16 IDC predicts that by 2021 AI will boost global business revenue by $1.1 trillion. Businesses are embracing AI to optimize processes, decrease costs, and remain competitive. SalesHero's AI assistant, Robin, performs tedious sales tasks that detract from productivity. Using GPUs for deep learning and inference, Robin learns from CRM systems, customer interactions, and SalesHero’s Account Graph database to automate sales processes such as updating sales records, prospect mining, and predicting close dates. With the time savings Robin delivers, sales teams can increase productivity up to 30%. AI SALES ASSISTANT INCREASES PRODUCTIVITY
- 17. 17 The United States Post Office delivers >1.5 billion pieces of mail each year but increases in demand and complexity of route management had introduced costly inefficiencies. Analyzing and optimizing routes using geographic data of 200,000+ mail carriers in real-time required an advanced computing infrastructure so the USPS turned to Kinetica and its GPU-accelerated data analytics platform to accurately provide immediate visibility to the location of carriers and the status of deliveries. The USPS can now modify routes for optimal efficiencies—it’s using fewer trucks, handling a greater number of deliveries, and narrowing delivery windows. AI-ANALYTICS OPTIMIZES LOGISTICS MANAGEMENT
- 18. 18 Even more than its meticulous engineering, Mercedes-Benz is defined by its continuous innovation. Since inventing the car in 1886, the company has never stopped reinventing it. And now Mercedes-Benz is using AI to enhance the user experience behind the wheel by having its cars predict where drivers want to go. Trained on driver behavior data from 24,000 road trips, the NVIDIA GPU-accelerated destination prediction AI learns the driver’s habits over time in order to make better suggestions. AI-POWERED DESTINATION PREDICTION AND ROUTE PLANNING
- 19. 19 NVIDIA DEEP LEARNING INSTITUTE WITH IBM Helping the world to solve challenging problems using AI and deep learning Online training and on-site workshops presented by certified instructors Covering complete workflows for proven application use cases Autonomous Vehicles, Healthcare, Intelligent Video Analytics, IoT/Robotics, Finance and more www.nvidia.com/dli Hands-on Training for Data Scientists, Developers and Researchers VALIDAT E
- 20. Thank you!