Webinar slides: Severalnines & MariaDB present: Automation & Management of MariaDB 10.2 with the new ClusterControl 1.5
1 like297 views
The document introduces ClusterControl 1.5, highlighting its support for MariaDB 10.2 and various management features such as automated deployments, monitoring, and recovery for databases. It details new functionalities in MariaDB including enhanced SQL capabilities, data security measures, and improved performance metrics. The presentation also emphasizes ClusterControl's integration with cloud services and its ongoing enhancements for better user experience and database management.
Webinar slides: Severalnines & MariaDB present: Automation & Management of MariaDB 10.2 with the new ClusterControl 1.5
- 1. December 5, 2017 Introducing ClusterControl 1.5 With MariaDB 10.2 support β¦ and more! Johan Andersson, CTO Severalnines Presenter johan@severalnines.com
- 2. Copyright 2017 Severalnines AB I'm Jean-JΓ©rΓ΄me from the Severalnines Team and I'm your host for today's webinar! Feel free to ask any questions in the Questions section of this application or via the Chat box. You can also contact me directly via the chat box or via email: jj@severalnines.com during or after the webinar. Your host & some logistics
- 3. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB About Severalnines and ClusterControl
- 4. Copyright 2017 Severalnines AB What we do Manage Scale MonitorDeploy
- 5. Copyright 2017 Severalnines AB Provisioning Deploy a cluster in minutes On-premises or in the cloud (AWS) Monitoring Systems view 1sec resolution DB / OS stats & performance advisors Configurable dashboards Query Analyzer Real-time / historical ClusterControl Automation & Management Management Multi cluster/data-center Automate repair/recovery Database upgrades Backups Configuration management Cloning One-click scaling
- 6. Copyright 2017 Severalnines AB Supported Databases
- 7. Copyright 2017 Severalnines AB Customers
- 8. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB MariaDB 10.2 Ralf Gebhardt, Product Manager MariaDB Presenter ralf.gebhardt@mariadb.com
- 9. MariaDB TX 2.0 Overview Ralf Gebhardt
- 10. MariaDB TX 2.0 MariaDB Services Remote Administration Enterprise Architecture Migration Management Technical Support MariaDB Tools MariaDB Admin MariaDB Monitor MariaDB Backup MariaDB Notifications Pluggable Storage Replication MariaDB Server Pluggable Storage Replication MariaDB Server Pluggable Storage Replication MariaDB Server MariaDB Cluster MariaDB Connectors MariaDB MaxScale (Proxy) Failover Sharding Streaming Caching Security Routing Transaction Platform
- 11. Enterprise Reliability High Availability Disaster Recovery Scalability Performance Security Open Development Extensible Architecture Community Collaboration Flexible Data Model Streaming Integration Community Innovation
- 12. MariaDB TX 2.0 Whatβs new in MariaDB Server 10.2
- 13. SQL Completeness Common Table Expressions Helps make complex queries easier to read and maintain by breaking them down into simpler building blocks Window Functions Helps eliminate expensive subqueries and self-joins, improving query performance, and helps make queries easier to read JSON and GeoJSON functions Helps developers read and write native JSON documents using SQL functions. GeoJSON functions transfer spatial data types to/from JSON Window function example SELECT depname, empno, salary, avg(salary) OVER (PARTITION BY depname) FROM empsalary; With CTEs and Window functions as well as JSON functions, MariaDB Server delivers comprehensive SQL that can handle multiple data models depname empno salary avg Engineering 11 5200 4700 Engineering 8 4200 4700 HR 9 6000 5000 HR 5 4000 5000 Sales 2 7000 5500 Sales 4 4000 5500
- 14. Schema Compatibility Check constraints Helps a DBA to enforce data consistency on the database server level without the need to implement triggers Multiple triggers of the same type (BEFORE, AFTER) can be created per table Decimal point Increased decimal point from 30 to 38 . A requirement especially in Finance. Check constraints example Schema compatibility features allow MariaDB Server to be a practical alternative to legacy enterprise databases CREATE TABLE jsontable ( id INTEGER NOT NULL PRIMARY KEY AUTO_INCREMENT, jsonfield VARCHAR(1024), category VARCHAR(20) as (JSON_VALUE(jsonfield,'$.category')), KEY jsonkey (category), CHECK (JSON_VALID(jsonfield)));
- 15. Performance and Scalability Indexes for virtual columns With supporting indexes, virtual columns can be used efficiently for searching on computed columns, like for JSON attributes. MyRocks β’ Storage Engine developed by Facebook as a more efficient alternative to InnoDB, based on RocksDB β’ 2x better compression, 10x less write amplification, faster replication, faster data loading MariaDB MaxScale Query Cache Helps improve the performance of repeat queries by caching the results within the proxy, either in memory or on disk (2.8x performance improvement) Indexed virtual Columns, new storage engine and enhanced database proxy for a high performance and scalable database Database Size Test Iteration (1 hour/iteration) Size(GB) InnoDB (uncompressed) InnoDB (compressed) MyRocks (compressed)
- 16. Security Data Masking Helps meet HIPAA/PCI requirements by masking sensitive data on a per-column, per-user basis Binary Log based Rollback Helps DBAs recovery faster (minutes instead of hours) by rolling back recent transactions based on a point in time rather than restoring data from a backup, can apply to specific tables or the entire database Data masking example Tighter security with the most capable database firewall for data masking, DoS protection SELECT name, ssn FROM tbl_customers WHERE id = 100; name ssn ------------------------------- Shane Johnson XXX-XX-XXXX
- 17. Recovery and Replication Compressed Replication Helps to reduce binary log size and network traffic Delay between Master and Slave A delay between master and slave can be configured on the slave and will be enforced by the replication sql threads. Binary Log based Rollback Helps DBAs recovery faster (minutes instead of hours) by rolling back recent transactions based on a point in time rather than restoring data from a backup, can apply to specific tables or the entire database Data masking example Enhanced replication options for the most used read scaling solution and fast disaster recovery CHANGE MASTER TO master_delay=3600;
- 19. Overview MariaDB Server 10.3 Temporal Data processing β’ System Versioned Tables include timestamped version of the data in a table. Database Compatibility Enhancements β’ PL/SQL compatibility parser β’ PL/SQL style packages β’ Sequences β’ INTERSECT and EXCEPT to complement UNION β’ Invisible Columns β’ New ROW type and type of for stored functions Performance β’ ADD INSTANT COLUMN for InnoDB β’ Statement based lock wait timeouts Flexibility β’ User defined aggregate functions β’ Compressed Columns β’ Proxy protocol support Scalability β’ Spider storage engine updated to the latest release Removed limitations β’ DELETE statement can delete from the table that is used in a subquery in the WHERE clause β’ UPDATE statements can use same source and target
- 20. Thank you
- 21. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB About ClusterControl
- 22. ClusterControl Platform Copyright 2017 Severalnines AB ClusterControl CC Clients Notifications Email PagerDuty VictorOps OpsGenie Slack TeleGram Webhooks Web UI S9s CLI JSON RPC Support 24/7 KeepAlived HAProxy ProxySQL MaxScale Galera MariaDb Percona Replication MariaDb Percona MongoDb MongoDb Inc Percona PostgreSql PgSQL Codership Cloud Backup
- 23. What Problems do we Address? Copyright 2017 Severalnines AB Deploy Deploy MySQL, Postgres or MongoDB - single instances or entire clusters Monitor Get a unified view of all clusters across all your datacenters Scale Add/remove nodes, resize instances & clone your production clusters Manage Automatically repair & recover broken nodes or clusters. Test & automate upgrades
- 24. Deployment Features in ClusterControl Copyright 2017 Severalnines AB β Each Cluster can be deployed and existing Clusters can be imported. β Web UI β Deployment Wizard β CLI β Allows easy integration with e.g Ansible s9s cluster --create --cluster-type=galera --nodes='10.10.10.26;10.10.10.27;10.10.10.28' --vendor=percona --cluster-name=PXC_CENTOS7 --provider-version=5.7 --os-user=vagrant --wait β Supports multiple NICs and templated configurations.
- 25. Monitoring Features in ClusterControl Copyright 2017 Severalnines AB β Database specific stats and Health status β Graphs and Dashboards β Host statistics β E.g Predictive disk space usage monitoring β Query Monitoring β E.g Top Queries, Outlier detection β Advisors β Developer Studio with JS like syntax β Notifications β Email, Pagerduty, VictorOps etc β Operational Reports
- 26. Management Features in ClusterControl Copyright 2017 Severalnines AB β Availability β Node/Cluster Recovery β Backup and Restore β MySQL: mysqldump, xtrabackup β Postgres: pg_dump, pg_basebackup β MongoDb: Mongdump, MongoDb Consistent Backup β Configuration β Upgrades β Loadbalancer β HAProxy, ProxySQL, MaxScale β KeepAlived
- 27. Scaling Features in ClusterControl Copyright 2017 Severalnines AB β Horizontal Scaling β Add / Remove Nodes β Load Balancers are updated automatically Load Balancer Load Balancer Load Balancer Load Balancer Load Balancer Load Balancer Load Balancer
- 28. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB ClusterControl 1.5
- 29. Support for New Technologies Copyright 2017 Severalnines AB MySQL Cluster (NDB) v7.5 support MariaDB v10.2 support (Galera and MySQL Replication) PostgreSQL v10 support
- 30. Improved Cloud Services Copyright 2017 Severalnines AB β Cloud Services (AWS S3 and Google Cloud Storage) β Manual upload or schedule backups to be uploaded after completion to the cloud. β Download and restore backups from a cloud storage.
- 31. New Backup Features for MySQL Copyright 2017 Severalnines AB β Backups (MySQL) β Backup individual databases separately (mysqldump only). β Upload, download and restore backups stored in the cloud. β Trigger a verification and restore of a backup after N hours of completion. β Rebuild a replication slave by staging it from an existing backup. β Add a new replication slave by staging it from an existing backup.
- 32. Improved PostgreSQL Support Copyright 2017 Severalnines AB β PostgreSQL β New backup method pg_basebackup which makes a binary copy of the database files. β Synchronous replication failover (support for synchronous_standby_names). β Support for HAProxy with Keepalived. β Support for PostgreSql 10.
- 33. Improved ProxySQL Support Copyright 2017 Severalnines AB β ProxySQL β Mass import existing database users into ProxySQL. β Add and modify scheduler scripts.
- 34. Other New Features Copyright 2017 Severalnines AB β Further Highlights β Added support to show and filter DB status variables for MongoDB nodes. β HTML formatted alarm and digest emails. β Multiple NICs supports when deploying Load balancers (HAProxy). β Continuous improvements to UX/UI and performance. β New cmon-cloud process and clud client to handle cloud services. β New Report: Database Growth
- 35. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB ClusterControl DEMO
- 36. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB Q&A
- 37. End of Year Promotion Get Three Months Free with an Annual Contract Our Best Offer Ever!Just Sign By December 31st!
- 38. Additional Resources Copyright 2017 Severalnines AB β ClusterControl 1.5 release announcement β Download ClusterControl β ClusterControl for MariaDB 10.2 β End of year promotion: get 3 additional months free if you sign up for annual ClusterControl subscriptions by December 31st 2017: sales@severalnines.com