Amazon SageMaker
1 like719 views
Amazon SageMaker is a fully-managed platform that simplifies the process of building, training, and deploying machine learning models at scale. It features one-click training, hyperparameter optimization, and support for various machine learning algorithms, enabling faster training and deployment without extensive engineering effort. Additionally, the platform allows for the use of pre-built notebook instances and custom algorithms while providing cost-effective options for large datasets.
Amazon SageMaker
- 1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker Sunil Mallya Sr. AI Solutions Architect/ ML Solutions Lab / Amazon Web Services
- 2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. One-click training for ML, DL, and custom algorithms Easier training with hyperparameter optimization Highly-optimized machine learning algorithms Deployment without engineering effort Fully-managed hosting at scale Build Pre-built notebook instances Deploy Train Amazon SageMaker
- 3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Training code • Matrix Factorization • Regression • Principal Component Analysis • K-Means Clustering • Gradient Boosted Trees • And More! Amazon provided Algorithms Bring Your Own Container Bring Your Own Script IM Estimators in Apache Spark Amazon SageMaker: model options
- 4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Streaming datasets, for cheaper training Train faster, in a single pass Greater reliability on extremely large datasets Choice of several ML algorithms Amazon SageMaker: 10x better algorithms
- 5. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Infinitely scalable algorithms
- 6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. GPU State Streaming
- 7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Data Size Memory Data Size Time/Cost Streaming
- 8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. GPU State GPU State GPU State Distributed
- 9. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Shared State GPU GPU GPU Local State Shared State Local State Local State
- 10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cost vs. Time $$$$ $$$ $$ $ Minutes Hours Days Weeks Months Best Alternative Amazon SageMaker
- 11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Linear Learner Regression (mean squared error) SageMaker Other 1.02 1.06 1.09 1.02 0.332 0.183 0.086 0.129 83.3 84.5 Classification (F1 Score) SageMaker Other 0.980 0.981 0.870 0.930 0.997 0.997 0.978 0.964 0.914 0.859 0.470 0.472 0.903 0.908 0.508 0.508 30 GB datasets for web-spam and web-url classification 0 0.2 0.4 0.6 0.8 1 1.2 0 5 10 15 20 25 30 CostinDollars Billable time in Minutes sagemaker-url sagemaker-spam other-url other-spam
- 12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 0 1 2 3 4 5 6 7 8 10 100 500 BillableTimeinMinutes Number of Clusters sagemaker other K-Means Clustering k SageMaker Other Text 1.2GB 10 1.18E3 1.18E3 100 1.00E3 9.77E2 500 9.18.E2 9.03E2 Images 9GB 10 3.29E2 3.28E2 100 2.72E2 2.71E2 500 2.17E2 Failed Videos 27GB 10 2.19E2 2.18E2 100 2.03E2 2.02E2 500 1.86E2 1.85E2 Advertising 127GB 10 1.72E7 Failed 100 1.30E7 Failed 500 1.03E7 Failed Synthetic 1100GB 10 3.81E7 Failed 100 3.51E7 Failed 500 2.81E7 Failed Running Time vs. Number of Clusters ~10x Faster!
- 13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DeepAR: Time Series Forecasting Mean absolute percentage error P90 Loss DeepAR R DeepAR R traffic Hourly occupancy rate of 963 Bay Area freeways 0.14 0.27 0.13 0.24 electricity Electricity use of 370 homes over time 0.07 0.11 0.08 0.09 pageviews Page view hits of websites 10k 0.32 0.32 0.44 0.31 180k 0.32 0.34 0.29 NA One hour on p2.xlarge, $1 Input Network
- 14. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Built in Algorithm Demo
- 15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Image Classification • ResNet implementation with Apache MXNet. • More networks to come. • Transfer learning: begin with a model already trained on ImageNet! 0 0.5 1 1.5 2 2.5 3 3.5 0 1 2 3 4 5 Speedup Number of Machines (P2) Linear Speedup with Horizontal Scaling
- 16. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Customer Stories
- 17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker Customers
- 18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker to automatically map buildings in Vietnam
- 19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. End-to-End Machine Learning Platform Zero setup Flexible Model Training Pay by the second $ Amazon SageMaker Build, train, and deploy machine learning models at scale
- 20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS DeepLens • Intel Atom Processor • Gen9 graphics • Ubuntu OS- 16.04 LTS • 100 GFLOPS performance • Dual band Wi-Fi • 8 GB RAM • 16 GB Storage (eMMC) • 32 GB SD card • 4 MP camera with MJPEG • H.264 encoding at 1080p resolution • 2 USB ports • Micro HDMI • Audio out • AWS Greengrass preconfigured • clDNN Optimized for MXNet
- 21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
- 22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Resources https://aws.amazon.com/machine-learning https://aws.amazon.com/blogs/ai https://aws.amazon.com/sagemaker (free tier available) https://github.com/awslabs/amazon-sagemaker-examples An overview of Amazon SageMaker https://www.youtube.com/watch?v=ym7NEYEx9x4
- 23. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Thank You