SlideShare a Scribd company logo
Lysandre DEBUT, Sylvain GUGGER, Quentin LHOEST, OSS @ 🤗
PyTorch Ecosystem Day
lysandre@huggingface.co
sylvain@huggingface.co
quentin@huggingface.co
🤗
Pytorch Ecosystem Day: The 珞 Ecosystem
🤗
🙏
🗞
🗞
🗞
🗞
The Hub:
- Largest hub of ready-to-use datasets
- 800+ Datasets available
- 450+ languages and dialects supported
🗞
The python library:
- Load any dataset in one line
- Supports huge datasets without RAM limitations
- Fast iterations and querying
🗞
🗞
- 50+ Model architectures
- Used by more than 5000 companies
- Simple API across all architectures
🗞
🗞
🗞
🗞
- Python API
- Simple mixin for your PyTorch Module
- Supports Transformers, ESPNet, Pyannote, Flair,
Asteroid …
Model Hub Tokenizers & Transformers Model Hub
Load a model from the hub
or initialize it from scratch
Datasets
Train it using one or several
datasets
Upload it on the hub once
done
Transformers Model Hub
a model from the hub
tialize it from scratch
Datasets
Train it using one or several
datasets
Upload it on the hub once
done
Inference API
Other deployment options
🗞
Transformers Model Hub
a model from the hub
tialize it from scratch
Datasets
Train it using one or several
datasets
Upload it on the hub once
done
Inference API
Other deployment options
Model Hub Transformers Model Hub
Load a model from the hub
or initialize it from scratch
Datasets
Train it using one or several
datasets
Upload it on the hub once
done
Pytorch Ecosystem Day: The 珞 Ecosystem
Pytorch Ecosystem Day: The 珞 Ecosystem
🗞
Pytorch Ecosystem Day: The 珞 Ecosystem
🗞
Pytorch Ecosystem Day: The 珞 Ecosystem
🗞
🗞
🗞
- Add five lines of codes
- Have your script run on any distributed setup
- Launch your script in AWS SageMaker
🗞
🗞
🗞
Model
- Wrap it in the proper container
- Put in on the right device
Optimizer
- Wrap it in the proper container
- Put in on the right device
DataLoader
- Where most of the magic happens
- Only grab the indices relevant to the current
process in the sampler
- Synchronizes all RNG
🗞
🗞
Currently supported:
- Training
- Evaluation
- CPU, GPU, Multi GPU, TPU, Mixed
precision
- AWS Sagemaker
Upcoming:
- Horovod
- FairScale
- DeepSpeed
- Others? 🤗
🤗

More Related Content

PDF
Elasticwulf Pycon Talk
PDF
Prototyping Data Intensive Apps: TrendingTopics.org
PDF
Introduction to Apache Storm - Concept & Example
PDF
pandas.(to/from)_sql is simple but not fast
PPS
Storm presentation
PPTX
Google colab installing ml libraries
PPTX
Tensorflow vs MxNet
PDF
Hadoopsummit16 myui
Elasticwulf Pycon Talk
Prototyping Data Intensive Apps: TrendingTopics.org
Introduction to Apache Storm - Concept & Example
pandas.(to/from)_sql is simple but not fast
Storm presentation
Google colab installing ml libraries
Tensorflow vs MxNet
Hadoopsummit16 myui

What's hot (20)

PDF
SciPy 2019: How to Accelerate an Existing Codebase with Numba
PPTX
C# - Raise the bar with functional & immutable constructs (Dutch)
PPTX
2013.09.10 Giraph at London Hadoop Users Group
PPTX
2013 06-03 berlin buzzwords
PPTX
Deep-Dive into Deep Learning Pipelines with Sue Ann Hong and Tim Hunter
PDF
Recommender Systems at Scale
PDF
Mathias Brandewinder, Software Engineer & Data Scientist, Clear Lines Consult...
PPTX
Scaling Python to CPUs and GPUs
PDF
Scale up and Scale Out Anaconda and PyData
PPTX
Jake Mannix, Lead Data Engineer, Lucidworks at MLconf SEA - 5/20/16
PPTX
Project: OpenStack, #OSATH
PPTX
Rx- Reactive Extensions for .NET
PPTX
Weld Strata talk
PDF
Introduction to Hivemall
PPT
Drupal and Elasticsearch
PPTX
TensorFrames: Google Tensorflow on Apache Spark
PPTX
High Availability in OpenStack
PDF
The evolution of array computing in Python
PPTX
EuroPython - Building a Pet Detector in Notebooks
PDF
Snorkel: Dark Data and Machine Learning with Christopher Ré
SciPy 2019: How to Accelerate an Existing Codebase with Numba
C# - Raise the bar with functional & immutable constructs (Dutch)
2013.09.10 Giraph at London Hadoop Users Group
2013 06-03 berlin buzzwords
Deep-Dive into Deep Learning Pipelines with Sue Ann Hong and Tim Hunter
Recommender Systems at Scale
Mathias Brandewinder, Software Engineer & Data Scientist, Clear Lines Consult...
Scaling Python to CPUs and GPUs
Scale up and Scale Out Anaconda and PyData
Jake Mannix, Lead Data Engineer, Lucidworks at MLconf SEA - 5/20/16
Project: OpenStack, #OSATH
Rx- Reactive Extensions for .NET
Weld Strata talk
Introduction to Hivemall
Drupal and Elasticsearch
TensorFrames: Google Tensorflow on Apache Spark
High Availability in OpenStack
The evolution of array computing in Python
EuroPython - Building a Pet Detector in Notebooks
Snorkel: Dark Data and Machine Learning with Christopher Ré
Ad

Similar to Pytorch Ecosystem Day: The 珞 Ecosystem (20)

PDF
Pytorch A Detailed Overview Agladze Mikhail
PDF
PyTorch - an ecosystem for deep learning with Soumith Chintala (Facebook AI)
PDF
Scaling Up AI Research to Production with PyTorch and MLFlow
PPTX
Soumith Chintala - Increasing the Impact of AI Through Better Software
PDF
Scaling AI in production using PyTorch
PDF
pytdddddddddddddddddddddddddddddddddorch.pdf
PDF
Machine learning from software developers point of view
PDF
INTERFACE by apidays 2023 - Open Source ML, Omar Sanseviero, Hugging Face
PDF
Reproducible AI using MLflow and PyTorch
PDF
TensorFlow meetup: Keras - Pytorch - TensorFlow.js
PDF
"PyTorch Deep Learning Framework: Status and Directions," a Presentation from...
PDF
pytorch-cheatsheet.pdf for ML study with pythroch
PPTX
Serving BERT Models in Production with TorchServe
PDF
Julien Simon - Deep Dive: Compiling Deep Learning Models
PPTX
Transfer Leaning Using Pytorch synopsis Minor project pptx
PPTX
ONNX - The Lingua Franca of Deep Learning
PDF
Machine learning with py torch
PPTX
Keras_Core_introduction.pptx
PDF
Deep Learning for Computer Vision: Software Frameworks (UPC 2016)
PDF
Deploy PyTorch models in Production on AWS with TorchServe
Pytorch A Detailed Overview Agladze Mikhail
PyTorch - an ecosystem for deep learning with Soumith Chintala (Facebook AI)
Scaling Up AI Research to Production with PyTorch and MLFlow
Soumith Chintala - Increasing the Impact of AI Through Better Software
Scaling AI in production using PyTorch
pytdddddddddddddddddddddddddddddddddorch.pdf
Machine learning from software developers point of view
INTERFACE by apidays 2023 - Open Source ML, Omar Sanseviero, Hugging Face
Reproducible AI using MLflow and PyTorch
TensorFlow meetup: Keras - Pytorch - TensorFlow.js
"PyTorch Deep Learning Framework: Status and Directions," a Presentation from...
pytorch-cheatsheet.pdf for ML study with pythroch
Serving BERT Models in Production with TorchServe
Julien Simon - Deep Dive: Compiling Deep Learning Models
Transfer Leaning Using Pytorch synopsis Minor project pptx
ONNX - The Lingua Franca of Deep Learning
Machine learning with py torch
Keras_Core_introduction.pptx
Deep Learning for Computer Vision: Software Frameworks (UPC 2016)
Deploy PyTorch models in Production on AWS with TorchServe
Ad

Recently uploaded (20)

PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Electronic commerce courselecture one. Pdf
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Encapsulation theory and applications.pdf
PPTX
Cloud computing and distributed systems.
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Approach and Philosophy of On baking technology
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Machine learning based COVID-19 study performance prediction
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Spectral efficient network and resource selection model in 5G networks
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
Spectroscopy.pptx food analysis technology
PPTX
Machine Learning_overview_presentation.pptx
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
Unlocking AI with Model Context Protocol (MCP)
Electronic commerce courselecture one. Pdf
The Rise and Fall of 3GPP – Time for a Sabbatical?
Encapsulation theory and applications.pdf
Cloud computing and distributed systems.
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Approach and Philosophy of On baking technology
Review of recent advances in non-invasive hemoglobin estimation
Digital-Transformation-Roadmap-for-Companies.pptx
Encapsulation_ Review paper, used for researhc scholars
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
MYSQL Presentation for SQL database connectivity
Reach Out and Touch Someone: Haptics and Empathic Computing
Machine learning based COVID-19 study performance prediction
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Spectral efficient network and resource selection model in 5G networks
“AI and Expert System Decision Support & Business Intelligence Systems”
Spectroscopy.pptx food analysis technology
Machine Learning_overview_presentation.pptx
Advanced methodologies resolving dimensionality complications for autism neur...

Pytorch Ecosystem Day: The 珞 Ecosystem