SlideShare a Scribd company logo
Jen-Hsun Huang, Co-Founder & CEO, NVIDIA | Jan. 4, 2016
ACCELERATING THE RACE
TO SELF-DRIVING CARS
2
SELF-DRIVING IS A
MAJOR COMPUTER SCIENCE CHALLENGE
SOFTWARE SUPERCOMPUTER
DEEP LEARNING
3
NVIDIA DRIVE PX 2
12 CPU cores | Pascal GPU | 8 TFLOPS | 24 DL TOPS | 16nm FF | 250W | Liquid Cooled
World’s First AI Supercomputer for Self-Driving Cars
4
THE SELF-DRIVING REVOLUTION
Safer Driving New Mobility Services Urban Redesign
5
TWO VISIONS
6
LOCALIZE
MAP
THE BASIC SELF-DRIVING LOOP
CONTROLSENSE
PLAN
PERCEIVE
7
SELF-DRIVING IS HARD
The world is complex The world is unpredictable The world is hazardous
8
DEEP LEARNING TO THE RESCUE
“The GPU is the workhorse of modern A.I.”
DNN GPUBIG DATA
9
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
2009 2010 2011 2012 2013 2014 2015 2016
THE AI RACE IS ON
IBM Watson Achieves Breakthrough
in Natural Language Processing
Facebook
Launches Big Sur
Baidu Deep Speech 2
Beats Humans
Google
Launches TensorFlow
Microsoft & U. Science & Tech, China
Beat Humans on IQ
Toyota Invests $1B
in AI Labs
IMAGENET
Accuracy Rate
Traditional CV Deep Learning
10
EDUCATION
START-UPS
CNTKTENSORFLOW
DL4J
THE ENGINE OF MODERN AI
NVIDIA GPU PLATFORM
*U. Washington, CMU, Stanford, TuSimple, NYU, Microsoft, U. Alberta, MIT, NYU Shanghai
VITRUVIAN
SCHULTS
LABORATORIES
TORCH
THEANO
CAFFE
MATCONVNET
PURINEMOCHA.JL
MINERVA MXNET*
CHAINER
BIG SUR WATSON
OPENDEEPKERAS
11
DEEP LEARNING EVERYWHERE
NVIDIA Titan X
NVIDIA Jetson
NVIDIA Tesla
NVIDIA DRIVE PX
12
END-TO-END DEEP LEARNING PLATFORM
FOR SELF-DRIVING CARS
DNN TRAINING
PLATFORM
IN-CAR AI
SUPERCOMPUTER
DEEP NEURAL NETWORK
13
39%
55%
72%
88%
30%
40%
50%
60%
70%
80%
90%
100%
7/2015 8/2015 9/2015 10/2015 11/2015 12/2015
Top Score
9 inception layers
3 convolutional layers
37M neurons
40B operations
Single and multi-class detection
Segmentation
KITTI Dataset: Object Detection
NVIDIA DRIVENet
14KITTI dataset
15Courtesy of Cityscapes dataset project
16Courtesy of Cityscapes dataset project
17Courtesy of Audi
18
“Using NVIDIA DIGITS deep
learning platform, in less than
four hours we achieved over 96%
accuracy using Ruhr University
Bochum’s traffic sign database.
While others invested years of
development to achieve similar
levels of perception with
classical computer vision
algorithms, we have been able
to do it at the speed of light.”
Matthias Rudolph, Director of Architecture,
Driver Assistance Systems, Audi
19
“Due to deep learning,
we brought the vehicle’s
environment perception a
significant step closer to human
performance and exceeded the
performance of classic computer
vision.”
Ralf G. Herrtwich
Director of Vehicle Automation, Daimler
20
Image from ZMP
[Sahin]
“Deep learning technology can
dramatically improve accuracy
of detection and decision-
making algorithms for
autonomous driving. ZMP is
achieving remarkable results
using deep neural networks on
NVIDIA GPUs for pedestrian
detection. We will expand our
use of deep learning on NVIDIA
GPUs to realize our driverless
Robot Taxi service.”
Hisashi Taniguchi
CEO, ZMP Inc.
21
“BMW is exploring the use of
deep learning for a wide range
of automotive use cases, from
autonomous driving to quality
inspection in manufacturing.
The ability to rapidly train deep
neural networks on vast amounts
of data is critical. Using an NVIDIA
GPU cluster with NVIDIA DIGITS,
we are achieving excellent results.”
Uwe Higgen
Head of BMW Group Technology Office (USA)
22
“With the NVIDIA deep learning
platform, we have greatly
improved performance on a variety
of image recognition applications
for cars, surveillance cameras and
robotics. The remarkable thing is
that we did it all with a single
NVIDIA GPU-powered deep neural
network, in a very short time.”
Daisuke Okanohara
Founder & SVP, Preferred Networks
Distributed Cooperative Deep Learning
23
“Deep learning on NVIDIA DIGITS
has allowed for a 30x enhancement
in training pedestrian detection
algorithms, which are being
further tested and developed as
we move them onto the NVIDIA
DRIVE PX.”
Dragos Maciuca, Technical Director,
Ford Research and Innovation Center
24
MANY THINGS TO LEARN
25
END-TO-END DEEP LEARNING PLATFORM
FOR SELF-DRIVING CARS
NVIDIA DRIVE PX 2NVIDIA DIGITS
NVIDIA DRIVENET
Localization
Planning
Visualization
Perception
DRIVEWORKS
26
27
28
NVIDIA DRIVE PX 2
TITAN X DRIVE PX 2
Process 28nm 16nm FinFET
CPU —
12 CPU cores
8-core A57 +
4-core Denver
GPU Maxwell Pascal
TFLOPS 7 8
DL TOPS 7 24
AlexNet 450 images / sec 2,800 images / sec
29
150 MACBOOK PROS IN YOUR TRUNK
6 TITAN X = 42 TFLOPS, Core i7 = 280 GFLOPS, 42 / 0.28 = 150 MacBook Pros
30
2 NEXT-GEN TEGRA PROCESSORS
31
2 NEXT-GEN PASCAL GPUS
32
LIQUID COOLING
250W | Operation up to 80C (175F) ambient | 256 cubic inches
33
NVIDIA DRIVE PX 2
34
NVIDIA’s Deep Learning
Car Computer Selected by
Volvo on Journey Towards
a Crash-Free Future
35
NVIDIA DRIVE PX
SELF-DRIVING CAR PLATFORM
NVIDIA DRIVE PX 2NVIDIA DIGITS
NVIDIA DRIVENET
Localization
Planning
Visualization
Perception
DRIVEWORKS
NVIDIA CES 2016 Press Conference

More Related Content

PDF
Skia & Freetype - Android 2D Graphics Essentials
PPTX
What is IVI (In Vehicle Infotainment)?
PDF
Android IPC Mechanism
PDF
Linux Internals - Part II
PDF
Android Automotive
PPTX
Android bootup process
PDF
Power optimization for Android apps
PPT
Basic Linux Internals
Skia & Freetype - Android 2D Graphics Essentials
What is IVI (In Vehicle Infotainment)?
Android IPC Mechanism
Linux Internals - Part II
Android Automotive
Android bootup process
Power optimization for Android apps
Basic Linux Internals

What's hot (20)

PDF
Kdump and the kernel crash dump analysis
PDF
Windows guest debugging presentation from KVM Forum 2012
ODP
Inter-process communication of Android
PDF
Bootloaders
PDF
QNX Software Systems
PPSX
Install ubuntu
PPTX
Android Booting Sequence
PDF
Using the Presentation API and external screens on Android
PPTX
Simultaneously Leveraging Linux and Android in a GENIVI compliant IVI System
PPTX
Android internals By Rajesh Khetan
DOCX
Mac os casestudy
PDF
Hacking Android OS
PDF
Part 03 File System Implementation in Linux
PDF
Introduction to Linux Drivers
PDF
An Introduction to the Android Framework -- a core architecture view from app...
PDF
RISC-V : Berkeley Boot Loader & Proxy Kernelのソースコード解析
PDF
05.2 virtio introduction
PDF
Linux Char Device Driver
PPTX
Fuchsia operating system by google presentation
PDF
COMPUTER GRAPHICS PROJECT REPORT
Kdump and the kernel crash dump analysis
Windows guest debugging presentation from KVM Forum 2012
Inter-process communication of Android
Bootloaders
QNX Software Systems
Install ubuntu
Android Booting Sequence
Using the Presentation API and external screens on Android
Simultaneously Leveraging Linux and Android in a GENIVI compliant IVI System
Android internals By Rajesh Khetan
Mac os casestudy
Hacking Android OS
Part 03 File System Implementation in Linux
Introduction to Linux Drivers
An Introduction to the Android Framework -- a core architecture view from app...
RISC-V : Berkeley Boot Loader & Proxy Kernelのソースコード解析
05.2 virtio introduction
Linux Char Device Driver
Fuchsia operating system by google presentation
COMPUTER GRAPHICS PROJECT REPORT
Ad

Similar to NVIDIA CES 2016 Press Conference (20)

PDF
2016 06 nvidia-isc_supercomputing_car_v02
PDF
NVIDIA CES 2016 Highlights
PDF
車載組み込み用ディープラーニング・エンジン NVIDIA DRIVE PX
PDF
GTC World Tour 2017 highlights
PDF
Enabling Artificial Intelligence - Alison B. Lowndes
PDF
GTC 2016 Opening Keynote
PDF
NVIDIA – Inventor of the GPU
PPTX
The AI Era Ignited by GPU Deep Learning
PDF
Introduction to Deep Learning (NVIDIA)
PDF
NVIDIA Deep Learning Institute 2017 基調講演
DOCX
GT C Tour 2018 Highlights
PDF
Phi Week 2019
PDF
PDF
GTC 2018: A New AI Era Dawns
PDF
GTC2016highlights
PDF
Aplicações Potenciais de Deep Learning à Indústria do Petróleo
PDF
GTC 2015 Highlights
PPTX
GTC 2015 Highlights
PPTX
GTC 2017: The AI Revolution
PDF
GTC 2018 で発表された自動運転最新情報
2016 06 nvidia-isc_supercomputing_car_v02
NVIDIA CES 2016 Highlights
車載組み込み用ディープラーニング・エンジン NVIDIA DRIVE PX
GTC World Tour 2017 highlights
Enabling Artificial Intelligence - Alison B. Lowndes
GTC 2016 Opening Keynote
NVIDIA – Inventor of the GPU
The AI Era Ignited by GPU Deep Learning
Introduction to Deep Learning (NVIDIA)
NVIDIA Deep Learning Institute 2017 基調講演
GT C Tour 2018 Highlights
Phi Week 2019
GTC 2018: A New AI Era Dawns
GTC2016highlights
Aplicações Potenciais de Deep Learning à Indústria do Petróleo
GTC 2015 Highlights
GTC 2015 Highlights
GTC 2017: The AI Revolution
GTC 2018 で発表された自動運転最新情報
Ad

More from NVIDIA (20)

PDF
NVIDIA Story 2023.pdf
PDF
NVIDIA GTC2022 Spring Highlights
PDF
NVIDIA Brochure 2021 Company Overview
PDF
NVIDIA GTC 2020 October Summary
PPTX
The Best of AI and HPC in Healthcare and Life Sciences
PDF
NVIDIA CEO Jensen Huang Presentation at Supercomputing 2019
PPTX
NLP for Biomedical Applications
PPTX
Top 5 Deep Learning and AI Stories - August 30, 2019
PPTX
Seven Ways to Boost Artificial Intelligence Research
PPTX
NVIDIA Developer Program Overview
PDF
NVIDIA at Computex 2019
PDF
Top 5 DGX Sessions From GTC 2019
PDF
DGX POD Top 4 Sessions From GTC 2019
PDF
Top 5 Data Science Sessions from GTC 2019
PPTX
This Week in Data Science - Top 5 News - April 26, 2019
PDF
GTC 2019 Keynote in Silicon Valley
PPTX
CUDA DLI Training Courses at GTC 2019
PPTX
DGX Sessions You Won't Want to Miss at GTC 2019
PPTX
Transforming Healthcare at GTC Silicon Valley
PPTX
OpenACC Monthly Highlights February 2019
NVIDIA Story 2023.pdf
NVIDIA GTC2022 Spring Highlights
NVIDIA Brochure 2021 Company Overview
NVIDIA GTC 2020 October Summary
The Best of AI and HPC in Healthcare and Life Sciences
NVIDIA CEO Jensen Huang Presentation at Supercomputing 2019
NLP for Biomedical Applications
Top 5 Deep Learning and AI Stories - August 30, 2019
Seven Ways to Boost Artificial Intelligence Research
NVIDIA Developer Program Overview
NVIDIA at Computex 2019
Top 5 DGX Sessions From GTC 2019
DGX POD Top 4 Sessions From GTC 2019
Top 5 Data Science Sessions from GTC 2019
This Week in Data Science - Top 5 News - April 26, 2019
GTC 2019 Keynote in Silicon Valley
CUDA DLI Training Courses at GTC 2019
DGX Sessions You Won't Want to Miss at GTC 2019
Transforming Healthcare at GTC Silicon Valley
OpenACC Monthly Highlights February 2019

Recently uploaded (20)

PPTX
Fire Fighting Unit IV industrial safety.pptx
PPTX
Gayatri Cultural Educational Society.pptx
PDF
Caterpillar CAT 311B EXCAVATOR (8GR00001-UP) Operation and Maintenance Manual...
PPTX
Robot_ppt_YRG[1] [Read-Only]bestppt.pptx
PDF
Journal Meraj.pdfuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu
PDF
Caterpillar Cat 315C Excavator (Prefix CJC) Service Repair Manual Instant Dow...
PPT
Mettal aloys and it's application and theri composition
PDF
Honda Dealership SNS Evaluation pdf/ppts
PDF
computer system to create, modify, analyse or optimize an engineering design.
PPTX
Chapter-1.pptxhhhhhhhhhhhhhhhhhhhhhhhhhh
PDF
Diagnose and Repair Transmission Sound Issues in Volkswagen Vehicles
PDF
industrial engineering and safety system
PDF
3-REasdfghjkl;[poiunvnvncncn-Process.pdf
PDF
How much does a e145 excavator weight.pdf
PPTX
G8-IA.pptx. Industrial arts. welding. automotive
PPTX
Lecture 3b C Library xnxjxjxjxkx_ ESP32.pptx
PPTX
Type of Sentence & SaaaaaaaaaadddVA.pptx
PPTX
TOEFL ITP Grammar_ Clausessssssssssssssssss.pptx
PDF
How much horsepower does a Volvo EC210Cl have.pdf
PPTX
Materi Kuliah Umum Prof. Hsien Tsai Wu.pptx
Fire Fighting Unit IV industrial safety.pptx
Gayatri Cultural Educational Society.pptx
Caterpillar CAT 311B EXCAVATOR (8GR00001-UP) Operation and Maintenance Manual...
Robot_ppt_YRG[1] [Read-Only]bestppt.pptx
Journal Meraj.pdfuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu
Caterpillar Cat 315C Excavator (Prefix CJC) Service Repair Manual Instant Dow...
Mettal aloys and it's application and theri composition
Honda Dealership SNS Evaluation pdf/ppts
computer system to create, modify, analyse or optimize an engineering design.
Chapter-1.pptxhhhhhhhhhhhhhhhhhhhhhhhhhh
Diagnose and Repair Transmission Sound Issues in Volkswagen Vehicles
industrial engineering and safety system
3-REasdfghjkl;[poiunvnvncncn-Process.pdf
How much does a e145 excavator weight.pdf
G8-IA.pptx. Industrial arts. welding. automotive
Lecture 3b C Library xnxjxjxjxkx_ ESP32.pptx
Type of Sentence & SaaaaaaaaaadddVA.pptx
TOEFL ITP Grammar_ Clausessssssssssssssssss.pptx
How much horsepower does a Volvo EC210Cl have.pdf
Materi Kuliah Umum Prof. Hsien Tsai Wu.pptx

NVIDIA CES 2016 Press Conference

  • 1. Jen-Hsun Huang, Co-Founder & CEO, NVIDIA | Jan. 4, 2016 ACCELERATING THE RACE TO SELF-DRIVING CARS
  • 2. 2 SELF-DRIVING IS A MAJOR COMPUTER SCIENCE CHALLENGE SOFTWARE SUPERCOMPUTER DEEP LEARNING
  • 3. 3 NVIDIA DRIVE PX 2 12 CPU cores | Pascal GPU | 8 TFLOPS | 24 DL TOPS | 16nm FF | 250W | Liquid Cooled World’s First AI Supercomputer for Self-Driving Cars
  • 4. 4 THE SELF-DRIVING REVOLUTION Safer Driving New Mobility Services Urban Redesign
  • 6. 6 LOCALIZE MAP THE BASIC SELF-DRIVING LOOP CONTROLSENSE PLAN PERCEIVE
  • 7. 7 SELF-DRIVING IS HARD The world is complex The world is unpredictable The world is hazardous
  • 8. 8 DEEP LEARNING TO THE RESCUE “The GPU is the workhorse of modern A.I.” DNN GPUBIG DATA
  • 9. 9 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% 2009 2010 2011 2012 2013 2014 2015 2016 THE AI RACE IS ON IBM Watson Achieves Breakthrough in Natural Language Processing Facebook Launches Big Sur Baidu Deep Speech 2 Beats Humans Google Launches TensorFlow Microsoft & U. Science & Tech, China Beat Humans on IQ Toyota Invests $1B in AI Labs IMAGENET Accuracy Rate Traditional CV Deep Learning
  • 10. 10 EDUCATION START-UPS CNTKTENSORFLOW DL4J THE ENGINE OF MODERN AI NVIDIA GPU PLATFORM *U. Washington, CMU, Stanford, TuSimple, NYU, Microsoft, U. Alberta, MIT, NYU Shanghai VITRUVIAN SCHULTS LABORATORIES TORCH THEANO CAFFE MATCONVNET PURINEMOCHA.JL MINERVA MXNET* CHAINER BIG SUR WATSON OPENDEEPKERAS
  • 11. 11 DEEP LEARNING EVERYWHERE NVIDIA Titan X NVIDIA Jetson NVIDIA Tesla NVIDIA DRIVE PX
  • 12. 12 END-TO-END DEEP LEARNING PLATFORM FOR SELF-DRIVING CARS DNN TRAINING PLATFORM IN-CAR AI SUPERCOMPUTER DEEP NEURAL NETWORK
  • 13. 13 39% 55% 72% 88% 30% 40% 50% 60% 70% 80% 90% 100% 7/2015 8/2015 9/2015 10/2015 11/2015 12/2015 Top Score 9 inception layers 3 convolutional layers 37M neurons 40B operations Single and multi-class detection Segmentation KITTI Dataset: Object Detection NVIDIA DRIVENet
  • 15. 15Courtesy of Cityscapes dataset project
  • 16. 16Courtesy of Cityscapes dataset project
  • 18. 18 “Using NVIDIA DIGITS deep learning platform, in less than four hours we achieved over 96% accuracy using Ruhr University Bochum’s traffic sign database. While others invested years of development to achieve similar levels of perception with classical computer vision algorithms, we have been able to do it at the speed of light.” Matthias Rudolph, Director of Architecture, Driver Assistance Systems, Audi
  • 19. 19 “Due to deep learning, we brought the vehicle’s environment perception a significant step closer to human performance and exceeded the performance of classic computer vision.” Ralf G. Herrtwich Director of Vehicle Automation, Daimler
  • 20. 20 Image from ZMP [Sahin] “Deep learning technology can dramatically improve accuracy of detection and decision- making algorithms for autonomous driving. ZMP is achieving remarkable results using deep neural networks on NVIDIA GPUs for pedestrian detection. We will expand our use of deep learning on NVIDIA GPUs to realize our driverless Robot Taxi service.” Hisashi Taniguchi CEO, ZMP Inc.
  • 21. 21 “BMW is exploring the use of deep learning for a wide range of automotive use cases, from autonomous driving to quality inspection in manufacturing. The ability to rapidly train deep neural networks on vast amounts of data is critical. Using an NVIDIA GPU cluster with NVIDIA DIGITS, we are achieving excellent results.” Uwe Higgen Head of BMW Group Technology Office (USA)
  • 22. 22 “With the NVIDIA deep learning platform, we have greatly improved performance on a variety of image recognition applications for cars, surveillance cameras and robotics. The remarkable thing is that we did it all with a single NVIDIA GPU-powered deep neural network, in a very short time.” Daisuke Okanohara Founder & SVP, Preferred Networks Distributed Cooperative Deep Learning
  • 23. 23 “Deep learning on NVIDIA DIGITS has allowed for a 30x enhancement in training pedestrian detection algorithms, which are being further tested and developed as we move them onto the NVIDIA DRIVE PX.” Dragos Maciuca, Technical Director, Ford Research and Innovation Center
  • 25. 25 END-TO-END DEEP LEARNING PLATFORM FOR SELF-DRIVING CARS NVIDIA DRIVE PX 2NVIDIA DIGITS NVIDIA DRIVENET Localization Planning Visualization Perception DRIVEWORKS
  • 26. 26
  • 27. 27
  • 28. 28 NVIDIA DRIVE PX 2 TITAN X DRIVE PX 2 Process 28nm 16nm FinFET CPU — 12 CPU cores 8-core A57 + 4-core Denver GPU Maxwell Pascal TFLOPS 7 8 DL TOPS 7 24 AlexNet 450 images / sec 2,800 images / sec
  • 29. 29 150 MACBOOK PROS IN YOUR TRUNK 6 TITAN X = 42 TFLOPS, Core i7 = 280 GFLOPS, 42 / 0.28 = 150 MacBook Pros
  • 30. 30 2 NEXT-GEN TEGRA PROCESSORS
  • 32. 32 LIQUID COOLING 250W | Operation up to 80C (175F) ambient | 256 cubic inches
  • 34. 34 NVIDIA’s Deep Learning Car Computer Selected by Volvo on Journey Towards a Crash-Free Future
  • 35. 35 NVIDIA DRIVE PX SELF-DRIVING CAR PLATFORM NVIDIA DRIVE PX 2NVIDIA DIGITS NVIDIA DRIVENET Localization Planning Visualization Perception DRIVEWORKS