Sql server machine learning
Download as PPTX, PDF1 like80 views
This document discusses machine learning capabilities in SQL Server. It notes that SQL Server 2016 and above support R and Python for machine learning directly on the database. This allows modeling without moving data and leveraging database security. Stored procedures can operationalize models. SQL Server also supports high-performance predictive scoring using the PREDICT function on trained RevoScaleR/Python models. The document outlines how data scientists can develop models and application developers can operationalize them using stored procedures. It also discusses multi-platform options for machine learning on SQL Server including Microsoft R Server and SQL Server 2019 big data cluster capabilities.
Sql server machine learning
- 1. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Server Machine Learning Maximiliano Accotto (MVP Data Platform) Owner TriggerDB Consulting SRL www.triggerdb.com
- 2. October 4th, 5th & 6th 2018.NET Conf AR v2018 Regular Database + App Intelligence Database + App Llevar la inteligencia a donde están los datos Application + Intelligence Database Application Intelligence + Database VS
- 3. October 4th, 5th & 6th 2018.NET Conf AR v2018 ¿Porque ML en SQL Server? Eliminar el movimiento de datos Aprovechar la seguridad de la base de datos Ejecutar los calculos de ML en la base de datos Operación ML scripts y modelos Usar store Procedures de T-SQL Manejar los modelos en el SQL Server Performance y escalabilidad Enterprise Escalar con R y Python analytics usando multi-threading y parallel processing. SQL Server security, compliance, resource governance, query performance, always on secondaries Data Scientist Interacts directly with data SQL Developer/ DBA Manage data and analytics together SQL Transformations 010010 100100 010101 Relational data Analytics library R integration 010010 100100 010101 010010 100100 010101 Python integration
- 4. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Machine Learning Services • SQL Server 2016 • R support (3.2.2 version) • Microsoft R Server • SQL Server 2017 • Scoring native en TSQL usando PREDICT function • EXTERNAL LIBRARY DDL para el manejo de paquetes R • Ejecución en batch para la entrada de datos • Soporte para R (3.3.3 version) • Soporte para Python (Anaconda 3.5.2)
- 5. October 4th, 5th & 6th 2018.NET Conf AR v2018 Any R/Python IDE Data Scientist Workstation Script Results Execution 1 3 Data Scientists - Exploración de Datos y Desarrollo de Modelos SQL Server 2 R/Python Runtime Machine Learning Services train <- RxSqlServerData(query, connectionString, computeContext) rxLogit(formula, train)
- 6. October 4th, 5th & 6th 2018.NET Conf AR v2018 Application exec sp_execute_external_script @language = ‘Python’ , @script = -- Python code -- The stored procedure contains R or Python code and executes in-database Application Developer - Operacionalización de modelos Stored Proc call Results 1 3 Execution SQL Server 2 R/Python Runtime Machine Learning Services
- 7. October 4th, 5th & 6th 2018.NET Conf AR v2018 Trabajo del DBA: Habilitar ML en SQL Server Enable External scripts – Exec sp_configure ‘external scripts enabled’, 1 – RCONFIGURE SQL Server 2016 O superior
- 8. October 4th, 5th & 6th 2018.NET Conf AR v2018 sp_execute_external_script
- 9. October 4th, 5th & 6th 2018.NET Conf AR v2018 Tipos de salida 1. Dataset • Standard resultset of rows and columns • Data types will vary 2. Plot • Static images • Binary 3. Model • Trained models such as linear regression, naïve bayes, etc. • Binary
- 10. October 4th, 5th & 6th 2018.NET Conf AR v2018 Realtime Predictions usando Scoring nativo • PREDICT function • No depende de R o Python runtime • Habilitado on SQL Server tanto en Windows como Linux • Uso • Single or small number of rows scoring • Highly concurrent scoring scenarios • Predict during INSERT, UPDATE, MERGE statements • Requirements • Models built using RevoScaleR or revoscalepy • rxLinMod, rxLogit, rxBTrees, rxDTree, rxDForest • Serialized using rxSerializeModel (R) or rx_serialize_model (Python)
- 11. October 4th, 5th & 6th 2018.NET Conf AR v2018 PREDICT syntax
- 12. October 4th, 5th & 6th 2018.NET Conf AR v2018 1,000,000 predictions per second https://blogs.technet.microsoft.com/dataplatforminsider/2016/10/11/1000000-predictions-per-second/
- 13. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Machine Learning Server • Soporte Multi-plataforma • Windows, Linux, Hadoop, SQL Server • Microsoft R Server • RevoScaleR, MicrosoftML, olapR, sqlrutils packages • Uso de Web services para operar. • Microsoft Machine Learning Server • Soporte de R & Python • revoscalepy, microsoftml python libraries • rxExecBy
- 14. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Machine Learning Server • Setup one-box configuration > az ml admin boostrap • Jupyter notebook deploy, and consume
- 15. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Machine Learning Server – Multi Server Configuration
- 16. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Server 2019 y ML (big data Cluster)
- 17. October 4th, 5th & 6th 2018.NET Conf AR v2018 Demos
- 18. October 4th, 5th & 6th 2018.NET Conf AR v2018 Muchas gracias http://blog.triggerdb.com/maxi maxiaccotto Maxi@triggerdb.com Maximiliano Accotto