SlideShare a Scribd company logo
Boolan machine learning summit
Who are we?
This slide shows that GPUs should complement the big data stack on the Hadoop ecosystem, rather than trying to
replace Hadoop etc. outright. Wholesale replacement of the big data stack will be cost-prohibitive to many clients. We
believe the right approach is to sell GPUs for accelerated computation and a few other use cases. That’s our beach
head. (Obviously, the widening functionality of the Volta will change the GPU ecosystem.)
Founded 2014
Distributed worldwide
Lots of activity in china
Skymind in China
Most deep learning frameworks
● Python based
● Symbolic variables with automatic differentiation in a computation graph
● Low level, focus on flexibility
● Supplemented by the ecosystem in python
● Run on cpu and gpu. Usually roll own distributed compute
● Big emphasis on research
Dl4j
Integrated in
Connectors via datavec (data types)
Supported Languages:
Mandarin
English
Japanese
Korean
Transform Process
Data Parallelism
Reinforcement Learning
UI
Nd4j Parameter Server
Aeron: More stable latency than GRPC and way faster
(25x!) than TF
Python support
PyJNIus
Jumpy (no copy
numpy nd4j
integration!)
Pretrained models/Transfer Learning
Model Zoo
Keras model
import
Explicit TL API
Upcoming
Nd4j Autodiff (yes it looks like what you’d expect)
Nd4j sparse arrays
Pipeline api
Boolan machine learning summit

More Related Content

PDF
Advanced deeplearning4j features
PDF
Strata Beijing 2017: Jumpy, a python interface for nd4j
PDF
Deep Learning with GPUs in Production - AI By the Bay
PDF
Berlin Buzzwords 2019 - Taming the language border in data analytics and scie...
PDF
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
KEY
MongoDB SF Ruby
PDF
Netflix machine learning
PDF
PyCon.DE / PyData Karlsruhe keynote: "Looking backward, looking forward"
Advanced deeplearning4j features
Strata Beijing 2017: Jumpy, a python interface for nd4j
Deep Learning with GPUs in Production - AI By the Bay
Berlin Buzzwords 2019 - Taming the language border in data analytics and scie...
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
MongoDB SF Ruby
Netflix machine learning
PyCon.DE / PyData Karlsruhe keynote: "Looking backward, looking forward"

What's hot (20)

PDF
Building an open data platform with apache iceberg
PDF
DevOps Fest 2020. Даніель Яворович. Data pipelines: building an efficient ins...
PDF
More Data Science with Less Engineering: Machine Learning Infrastructure at N...
PDF
Ursa Labs and Apache Arrow in 2019
PDF
MLconf 2022 NYC Event-Driven Machine Learning at Scale.pdf
PDF
Introduction to Data Engineer and Data Pipeline at Credit OK
PDF
Discover some "Big Data" architectural concepts with Redis
PPTX
Case study- Real-time OLAP Cubes
PDF
Apache Arrow -- Cross-language development platform for in-memory data
ODP
Javantura v3 - Real-time BigData ingestion and querying of aggregated data – ...
PDF
Graph Processing with Apache TinkerPop and Gremlin
PDF
Scalable Clusters On Demand
PDF
Presto Summit 2018 - 07 - Lyft
PDF
Presto Summit 2018 - 10 - Qubole
PDF
Druid meetup @ Netflix (11/14/2018 )
PDF
Spark stack for Model life-cycle management
PDF
Apache Arrow at DataEngConf Barcelona 2018
PDF
Why You Definitely Don’t Want to Build Your Own Time Series Database
PDF
Rust is for "Big Data"
PDF
Presto talk @ Global AI conference 2018 Boston
Building an open data platform with apache iceberg
DevOps Fest 2020. Даніель Яворович. Data pipelines: building an efficient ins...
More Data Science with Less Engineering: Machine Learning Infrastructure at N...
Ursa Labs and Apache Arrow in 2019
MLconf 2022 NYC Event-Driven Machine Learning at Scale.pdf
Introduction to Data Engineer and Data Pipeline at Credit OK
Discover some "Big Data" architectural concepts with Redis
Case study- Real-time OLAP Cubes
Apache Arrow -- Cross-language development platform for in-memory data
Javantura v3 - Real-time BigData ingestion and querying of aggregated data – ...
Graph Processing with Apache TinkerPop and Gremlin
Scalable Clusters On Demand
Presto Summit 2018 - 07 - Lyft
Presto Summit 2018 - 10 - Qubole
Druid meetup @ Netflix (11/14/2018 )
Spark stack for Model life-cycle management
Apache Arrow at DataEngConf Barcelona 2018
Why You Definitely Don’t Want to Build Your Own Time Series Database
Rust is for "Big Data"
Presto talk @ Global AI conference 2018 Boston
Ad

Similar to Boolan machine learning summit (20)

PPTX
Deep Learning with Spark and GPUs
PDF
Deep Learning with Apache Spark and GPUs with Pierce Spitler
PDF
Big Data Analytics (ML, DL, AI) hands-on
PDF
How to Run TensorFlow Cheaper in the Cloud Using Elastic GPUs
PPTX
Distributed Deep learning Training.
PDF
PyTorch vs TensorFlow: The Force Is Strong With Which One? | Which One You Sh...
PDF
AirBNB's ML platform - BigHead
PDF
Bighead: Airbnb’s End-to-End Machine Learning Platform with Krishna Puttaswa...
PDF
Keynote at Converge 2019
PDF
Hopsworks at Google AI Huddle, Sunnyvale
PDF
TensorFlow meetup: Keras - Pytorch - TensorFlow.js
PDF
Os Lamothe
PDF
How pig and hadoop fit in data processing architecture
PDF
How to Choose a Deep Learning Framework
PPTX
Deep Learning on Qubole Data Platform
PDF
Jeremy Nixon, Machine Learning Engineer, Spark Technology Center at MLconf AT...
PDF
RAPIDS – Open GPU-accelerated Data Science
PPTX
GPU and Deep learning best practices
PPTX
Oct 2011 CHADNUG Presentation on Hadoop
PDF
ETL Practices for Better or Worse
Deep Learning with Spark and GPUs
Deep Learning with Apache Spark and GPUs with Pierce Spitler
Big Data Analytics (ML, DL, AI) hands-on
How to Run TensorFlow Cheaper in the Cloud Using Elastic GPUs
Distributed Deep learning Training.
PyTorch vs TensorFlow: The Force Is Strong With Which One? | Which One You Sh...
AirBNB's ML platform - BigHead
Bighead: Airbnb’s End-to-End Machine Learning Platform with Krishna Puttaswa...
Keynote at Converge 2019
Hopsworks at Google AI Huddle, Sunnyvale
TensorFlow meetup: Keras - Pytorch - TensorFlow.js
Os Lamothe
How pig and hadoop fit in data processing architecture
How to Choose a Deep Learning Framework
Deep Learning on Qubole Data Platform
Jeremy Nixon, Machine Learning Engineer, Spark Technology Center at MLconf AT...
RAPIDS – Open GPU-accelerated Data Science
GPU and Deep learning best practices
Oct 2011 CHADNUG Presentation on Hadoop
ETL Practices for Better or Worse
Ad

More from Adam Gibson (20)

PDF
End to end MLworkflows
PDF
World Artificial Intelligence Conference Shanghai 2018
PPTX
Deploying signature verification with deep learning
ODP
Self driving computers active learning workflows with human interpretable ve...
PDF
Anomaly Detection and Automatic Labeling with Deep Learning
PDF
Big Data Analytics Tokyo
PDF
Wrangleconf Big Data Malaysia 2016
PDF
Distributed deep rl on spark strata singapore
PDF
Deep learning in production with the best
PPTX
Dl4j in the wild
PDF
SKIL - Dl4j in the wild meetup
PDF
Strata Beijing - Deep Learning in Production on Spark
PPTX
Anomaly detection in deep learning (Updated) English
PPTX
Skymind - Udacity China presentation
PDF
Anomaly Detection in Deep Learning (Updated)
PPTX
Hadoop summit 2016
PDF
Anomaly detection in deep learning
PPTX
Brief introduction to Distributed Deep Learning
PPTX
Advanced spark deep learning
PPTX
Skymind Open Power Summit ISV Round Table
End to end MLworkflows
World Artificial Intelligence Conference Shanghai 2018
Deploying signature verification with deep learning
Self driving computers active learning workflows with human interpretable ve...
Anomaly Detection and Automatic Labeling with Deep Learning
Big Data Analytics Tokyo
Wrangleconf Big Data Malaysia 2016
Distributed deep rl on spark strata singapore
Deep learning in production with the best
Dl4j in the wild
SKIL - Dl4j in the wild meetup
Strata Beijing - Deep Learning in Production on Spark
Anomaly detection in deep learning (Updated) English
Skymind - Udacity China presentation
Anomaly Detection in Deep Learning (Updated)
Hadoop summit 2016
Anomaly detection in deep learning
Brief introduction to Distributed Deep Learning
Advanced spark deep learning
Skymind Open Power Summit ISV Round Table

Recently uploaded (20)

PPTX
climate analysis of Dhaka ,Banglades.pptx
PDF
Introduction to Business Data Analytics.
PPTX
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
PPTX
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
PPT
Reliability_Chapter_ presentation 1221.5784
PDF
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
PPTX
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
PPT
Quality review (1)_presentation of this 21
PPTX
Data_Analytics_and_PowerBI_Presentation.pptx
PPTX
Major-Components-ofNKJNNKNKNKNKronment.pptx
PPT
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
PPTX
Supervised vs unsupervised machine learning algorithms
PDF
.pdf is not working space design for the following data for the following dat...
PPTX
05. PRACTICAL GUIDE TO MICROSOFT EXCEL.pptx
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPTX
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
PPTX
IB Computer Science - Internal Assessment.pptx
PPTX
Introduction to Knowledge Engineering Part 1
PDF
Galatica Smart Energy Infrastructure Startup Pitch Deck
PPTX
Database Infoormation System (DBIS).pptx
climate analysis of Dhaka ,Banglades.pptx
Introduction to Business Data Analytics.
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
Reliability_Chapter_ presentation 1221.5784
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
Quality review (1)_presentation of this 21
Data_Analytics_and_PowerBI_Presentation.pptx
Major-Components-ofNKJNNKNKNKNKronment.pptx
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
Supervised vs unsupervised machine learning algorithms
.pdf is not working space design for the following data for the following dat...
05. PRACTICAL GUIDE TO MICROSOFT EXCEL.pptx
IBA_Chapter_11_Slides_Final_Accessible.pptx
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
IB Computer Science - Internal Assessment.pptx
Introduction to Knowledge Engineering Part 1
Galatica Smart Energy Infrastructure Startup Pitch Deck
Database Infoormation System (DBIS).pptx

Boolan machine learning summit