[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이터 사이언티스트

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Adding ML feature into your application
using AutoGluon with no ML expertise
Muhyun Kim
Senior Data Scientist
Amazon ML Solutions Lab, AWS

Common ML problems
Regression Classification
Tabular
Prediction
Image
Classification
Object
Detection
Text
Classification

How to solve ML problems

Required skills in building ML models
Data science for feature engineering
Machine Learning and Deep Learning for modeling
Model tuning experience
ML and DL toolkits such as scikit-learn, TensorFlow, PyTorch, MXNet

Do I need to learn
machine learning or deep learning
and
ML/DL framework
as an application developer or data analysist?

AutoML
“Automated machine learning (AutoML) is the process of automating the
process of applying machine learning to real-world problems. AutoML covers the
complete pipeline from the raw dataset to the deployable machine learning
model.” - Wikipedia
Automated Machine Learning provides methods and processes to make
Machine Learning available for non-Machine Learning experts, to improve
efficiency of Machine Learning and to accelerate research on Machine
Learning. - AutoML.org
- Hyperparameter optimization
- Meta-learning (learning to learn)
- Neural architecture search

AutoGluon - AutoML Toolkit for Deep Learning
https://autogluon.mxnet.io

AutoGluon for “All”
Developers/Analysists
with no ML skill
Automating all ML pipeline
- feature engineering
- model selection
- model training
- hyperparameter optimization
ML Experts
• Quick model prototyping for baseline
• Hyperparameter optimization
• Optimizing custom models
Researchers
• Model optimization
• Searching for new architectures

What you can do with AutoGluon
• Quick prototyping achieving the state-of-the-art performance for
• Tabular prediction
• Image classification
• Object detection
• Text classification
• Customizing model searching
• Hyperparameter optimization on model training in Python or PyTorch
• Neural Architecture Searching

Simple 3 steps to get the best ML model
Step 1. Prepare your dataset
Step 2. Load the dataset for training ML
Step 3. Call fit() to get the best ML model

What happens behind the scene
Loading the dataset for training ML
- ML problem defined (binary/multiple classification or regression)
- Feature engineering for each model being trained
- Missing value handling
- Splitting dataset into training and validation
Calling fit() to get the best ML model
- Training models
- Hyperparameter optimization
- Model selection

ML algorithms for Tabular prediction
• Random Forest
• https://scikit-
learn.org/stable/modules/generated/sklearn.ensemble.RandomForestClassifier.html
• XT (Extremely randomized trees)
• https://scikit-
learn.org/stable/modules/generated/sklearn.ensemble.ExtraTreesClassifier.html
• K-nearest neighbors
• https://scikit-
learn.org/stable/modules/generated/sklearn.neighbors.KNeighborsClassifier.html
• CatBoost - gradient boosting on decision trees
• https://catboost.ai/
• LightGBM
• https://lightgbm.readthedocs.io
• Neural Network

Let’s prepare a tabular dataset
A structured data stored in CSV format where
• each row represents an example and
• each column presents the measurements of some variable or feature
Files stored either in an Amazon S3 bucket or the local file system
Some data found in “Adult data set (https://archive.ics.uci.edu/ml/datasets/adult)”

# CUDA 10.0 and a GPU for object detection is recommended
# We install MXNet to utilize deep learning models
# For Linux with GPU installed
pip install --upgrade mxnet-cu100
# For Linux without GPU
pip install --upgrade mxnet
# Install AutoGluon package
pip install autogluon
Step 0: Install AutoGluon

from autogluon import TabularPrediction as task
train_path = 'https://autogluon.s3.amazonaws.com/datasets/AdultIncomeBinaryClassification/train_data.csv’
train_data = task.Dataset(file_path=train_path)
Step 1: Loading dataset
file_path
df
feature_types
subsample
name

predictor = task.fit(train_data, label='class', output_directory='ag-example-out/')
Step 2: Training ML models

parameters of fit()
https://autogluon.mxnet.io/api/autogluon.task.html#autogluon.task.TabularPrediction.fit
‘random’ (random search), ‘skopt’ (SKopt Bayesian
optimization), ‘grid’ (grid search), ‘hyperband’
(Hyperband), ‘rl’ (reinforcement learner)
‘mxboard’, ‘tensorboard’, ‘none’

test_path = 'https://autogluon.s3.amazonaws.com/datasets/AdultIncomeBinaryClassification/test_data.csv'
test_data = task.Dataset(file_path=test_path)
leaderboard = predictor.leaderboard(test_data)
Step 3: Evaluate the model

predictor = task.load('ag-example-out/’)
test_path = 'https://autogluon.s3.amazonaws.com/datasets/AdultIncomeBinaryClassification/test_data.csv'
test_data = task.Dataset(file_path=test_path)
y_test = test_data['class']
test_data_nolabel = test_data.drop(labels=['class'],axis=1)
y_pred = predictor.predict(test_data_nolabel)
Step 4: Use the model in your app

parameters of predict()
https://autogluon.mxnet.io/api/autogluon.task.html#autogluon.task.tabular_prediction.TabularPredictor.predict
dataset : `TabularDataset` or `pandas.DataFrame`
The dataset to make predictions for. Should contain same column names as training Dataset and follow same format
model : str (optional)
The name of the model to get predictions from. Defaults to None, which uses the highest scoring model on the
validation set.
as_pandas : bool (optional)
Whether to return the output as a pandas Series (True) or numpy array (False)
use_pred_cache : bool (optional)
Whether to used previously-cached predictions for table rows we have already predicted on before
add_to_pred_cache : bool (optional)
Whether these predictions should be cached for reuse in future `predict()` calls on the same table rows

Image classification
from autogluon import ImageClassification as task
# Loading dataset
dataset = task.Dataset('./data/shopeeiet/train’)
# Train image classification models
time_limits = 10 * 60 # 10mins
classifier = task.fit(dataset,
time_limits=time_limits,
ngpus_per_trial=1)
# Test the trained model
test_dataset = task.Dataset('./data/shopeeiet/test')
inds, probs, probs_all = classifier.predict(test_dataset)
shopeeiet/train
├── BabyBibs
├── BabyHat
├── BabyPants
├── ...
shopeeiet/test
├── ...

For advanced features of AutoGluon
Other AutoML tasks
- Image classification
- Object detection
- Text classification
Hyperparameter optimization
- Hyperparameter search space and search algorithm customization
- Distributed search
Neural architecture search
- ENAS/ProxylessNAS

Efficient NAS on Target Hardware: ProxylessNAS
https://autogluon.mxnet.io/tutorials/nas/enas_mnist.html
(Source) PROXYLESSNAS: DIRECTNEURALARCHITECTURESEARCH ONTARGETTASK ANDHARDWARE

More toolkits for developers

Resources
AutoGluon (https://autogluon.mxnet.io)
GluonCV (https://gluon-cv.mxnet.io)
AWS Computer Vision: Getting started with GluonCV
(https://www.coursera.org/learn/aws-computer-vision-gluoncv)
Deep Java Library (https://djl.ai)
Dive into Deep Learning (https://d2l.ai, https://ko.d2l.ai)
Machine Learning on AWS (https://ml.aws)
Amazon Machine Learning Solutions Lab (https://aws.amazon.com/ml-solutions-lab)

AWS 머신러닝(ML) 교육 및 자격증
Amazon의 개발자와 데이터 과학자를 교육하는 데 직접 활용 되었던 커리큘럼을 기반으로 학습하세요!
전체 팀을 위한
머신러닝 교육
원하는 방법으로!
교육 유연성 제공
전문성에 대한
검증
비즈니스 의사 결정자,
데이터 과학자, 개발자,
데이터 플랫폼 엔지니어 등
역할에 따라 제공되는
맞춤형 학습 경로를
확인하세요.
약 65개 이상의
온라인 과정 및
AWS 전문 강사를 통해
실습과 실적용의 기회가
제공되는 강의실 교육이
준비되어 있습니다.
업계에서 인정받는
‘AWS 공인 머신러닝 – 전문분야’
자격증을 통해
머신러닝 모델을 구축, 학습, 튜닝
및 배포하는 데 필요한
전문 지식이 있음을
입증할 수 있습니다.
https://aws.amazon.com/ko/training
/learning-paths/machine-learning/

Thank you!
Muhyun Kim
muhyun@amazon.com

[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이터 사이언티스트

More Related Content

What's hot (19)

Similar to [AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이터 사이언티스트 (14)

More from Amazon Web Services Korea (20)

Recently uploaded (20)

[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이터 사이언티스트