Under the hood: SkySQL monitoring
1 like571 views
Skysql is the first database-as-a-service (DBaaS) offering the full power of the MariaDB platform in the cloud, combining enterprise features, security, and world-class support. Skysql Monitoring, an observability tool, allows real-time tracking of database performance and includes capabilities for retrospective monitoring and alerts. It is built on Prometheus and Grafana, providing comprehensive dashboards for database performance statistics and monitoring custom metrics tailored to user needs.
Under the hood: SkySQL monitoring
- 1. UNDER THE HOOD: SKYSQL MONITORING IVAN ZLATOUSTOV Product Manager MariaDB Corporation 1
- 2. OVERVIEW OF THE ULTIMATE MARIADB CLOUD 2 SKYSQL
- 3. SKYSQL - ULTIMATE MARIADB CLOUD 1. SkySQL is the first and only database-as-a-service (DBaaS) to bring the full power of MariaDB Platform to the cloud. 2. Combining powerful enterprise features, MariaDB expertise and world-class support. 3. Whether it’s a single development database or thousands of production databases. 4. Secure by default. 5. Works out of the box. 6. Includes SkySQL Monitoring SKYSQL MONITORING 3
- 4. SKYSQL MONITORING 4 https://mariadb.com/products/skysql/get-started/ Sign up for SkySQL today and get a $500 credit toward up to three databases of any size and any type (transactional, analytical or hybrid).
- 5. For more SkySQL SKYSQL MONITORING 5 Introducing the ultimate MariaDB cloud, SkySQL Shane Johnson, Senior Director of Product Marketing, MariaDB Watch the recording
- 6. The SkySQL Monitoring Solution 6 SKYSQL MONITORING Tech Preview
- 7. SKYSQL MONITORING … is the observability and monitoring service SkySQL providers to the customers. SKYSQL MONITORING 7
- 8. SKYSQL MONITORING Database services are vital component of your applications. Tracking of the availability and the database performance is key to your business operations. We understand that. We added SkySQL Monitoring as observability tool to our SkySQL product. It provides single pane of glass for monitoring your database services. SKYSQL MONITORING 8
- 9. LIVE MONITORING 1. Provides real time database statistics for the DB Administrators and Application Developers 2. Allows focusing on a specific component or specific measure. 3. Detection of problems introduced by external factors. SKYSQL MONITORING 9
- 10. LIVE MONITORING 1. Provides real time database statistics for the DB Administrators and Application Developers 2. Allows focusing on a specific component or specific measure. 3. Detection of problems introduced by external factors. SKYSQL MONITORING 10
- 11. RETROSPECTIVE MONITORING 1. Historical trends of all metrics. 2. Comparison between two separate periods in time. 3. Comparison between two separate services. 4. Comparison between two separate version of the application, database or database configuration. SKYSQL MONITORING 11
- 12. UNDER THE HOOD 1. SkySQL Monitoring utilizes the same monitoring infrastructure used by our own support teams. 2. It is built on top of the already proven and supported Prometheus and Grafana products. 3. Extensible. Allows addition of new features. SKYSQL MONITORING 12
- 13. PROMETHEUS SKYSQL MONITORING 1. Open Source monitoring and alerting platform. 2. Widely supported and has very active community. 3. Supports Kubernetes and auto discovery of pods. 4. Flexible dimensional query language. 5. Pull based monitoring agents. 6. Supports Prometheus Alert Manager to handle alerts. 13
- 14. GRAFANA SKYSQL MONITORING 1. Open Source system for observability and analysis. 2. Great for presenting and analysing time series and especially metrics data 3. Widely supported, very active community. 4. Highly customisable dashboards and chart panels. 5. Pluggable architecture, allows development of visualisation plugins. 6. Works great wit Prometheus & PromQL. 14
- 15. SKYSQL MONITORING 15 SKYSQL MONITORING ARCHITECTURE
- 16. SkySQL Architecture SKYSQL MONITORING 16 The architecture of SkySQL Sameer Tiwari, Infrastructure CTO, MariaDB
- 17. MONITORING AGENTS MariaDB Prometheus Exporter Collects the monitoring data from all MariaDB Products. It is designed and optimised specifically for the MariaDB components used in SkySQL ● MariaDB Enterprise Server ● MariaDB MaxScale ● MariaDB ColumnStore ● MariaDB Platform MariaDB Prometheus Exporter is supported by MariaDB and updated with the new features as soon as they are developed in our database products. SKYSQL MONITORING 17
- 18. MONITORING AGENTS Kubernetes Exporters (kube-state-metrics) Export relevant pod metrics from the kubernetes infrastructure. ● Pod statuses ● Pod system metrics Container Exporter (cAdvisor) Export relevant system metrics from the containers. ● Container system metrics SKYSQL MONITORING 18
- 19. MONITORING INFRASTRUCTURE ● Collects, stores and optimizes collected database metrics. ● Starts collecting metrics as soon as the database is created. ● Stores the stats optimized for further use. ● Ensures monitoring data is collected only once with minimal impact on the database performance. ● Serves the metrics data as often as needed for the monitoring dashboards SKYSQL MONITORING 19
- 20. MONITORING DASHBOARDS ● Present all database service performance statistics as a glance. ● Focus on a database service or deep dive to a specific server. ● Fullscreen (NOC) View to monitor live mission critical applications. ● Modern Web Application which supports all modern browsers on pc and most tablets. SKYSQL MONITORING 20
- 21. SKYSQL MONITORING Tech Preview Getting Started - LIVE DEMO 21
- 22. OPEN SKYSQL MONITOR 1. Create at least one database service in SkySQL 2. Add your IP to the SkySQL Monitoring whitelist. This allows you to control the IP access to your monitoring. You can change the whitelist any time. 3. You can open SkySQL Monitor for the first time, pressing the “Dashboard” button from the “Monitoring” menu. SKYSQL MONITORING 22
- 24. User Interface Components 24 SKYSQL MONITORING Tech Preview
- 25. SERVICE CATALOG SCREEN WHAT’S NEW IN MARIADB 3.0 25 Service Catalog Service Line Server Line
- 26. DASHBOARDS SCREEN WHAT’S NEW IN MARIADB 3.0 26 Service Name Topology Type And server Info Server Dashboards Time Filter NOC View Dashboard Tabs Metric Charts
- 27. SERVICE OVERVIEW DASHBOARDS Status Tab Set of dashboards vital for the whole database service. Charts ● Current SQL Commands ● QPS ● CPU Load ● Used Connections ● Aborted Connections ● Replication Status SKYSQL MONITORING 27
- 28. SERVICE OVERVIEW DASHBOARDS Database Tab Displays information about the database as historical charts. Charts ● MaxScale Service Connections ● MaxScale Server Connections ● Aborted Connections ● Table Locks ● Open Tables ● Tables Opened SKYSQL MONITORING 28
- 29. SERVICE OVERVIEW DASHBOARDS Queries Tab Displays information about queries as historical charts. Charts ● Top Commands (Recent/Hourly) ● Queries per Second ● Questions per Second SKYSQL MONITORING 29
- 30. SERVICE OVERVIEW DASHBOARDS Replication Lags Displays replication lags in historical charts. Charts ● GTID Replication Lag ● Seconds behind primary ● Questions per Second SKYSQL MONITORING 30
- 31. SERVICE OVERVIEW DASHBOARDS System Tab Displays system metrics in historical charts. Charts ● Top Commands (Recent/Hourly) ● Queries per Second ● Questions per Second SKYSQL MONITORING 31
- 32. SERVER DASHBOARDS Status Tab Presents current server overview. Charts ● SQL Commands Mix ● Queries per Second ● Current CPU, RAM, Buffer Pools ● Database and Network throughput. SKYSQL MONITORING 32
- 33. SERVER DASHBOARDS Caches Tab Displays historical charts about the caches. Charts ● Thread Cache ● Table Open Cache ● Table Definition Cache ● Query Cache and Activity. SKYSQL MONITORING 33
- 34. SERVER DASHBOARDS Database Tab Displays historical charts about MariaDB database parameters. Charts ● MariaDB Active Connections ● MariaDB Aborted Connections ● Thread Activity ● Temporary Objects Created ● Table Locs ● Open Tables ● Open Files SKYSQL MONITORING 34
- 35. SERVER DASHBOARDS Queries Tab Displays historical charts about MariaDB running queries. Charts ● Top commands by type ● Select and Sorts by Type ● Handler and Transactions ● Queries ● Slow Queries SKYSQL MONITORING 35
- 36. SERVER DASHBOARDS Queries Tab Displays historical charts for the system metrics. Charts ● Memory distribution and overview ● CPU ● InnoDB MB/sec ● I/O and IOPS ● Networks SKYSQL MONITORING 36
- 37. SKYSQL MONITORING END OF THE DEMO 37
- 38. FOR EVERY DATABASE SERVICE SKYSQL MONITORING 38 1. Available for all SkySQL customers. 2. Works out of the box 3. Based on recommendations from our MariaDB Remote DBAs. 4. Monitor all characteristic metrics for all standard SkySQL database services. Foundation Monitoring
- 39. EVERY DATABASE IS UNIQUE SKYSQL MONITORING 39 Power Monitoring - Custom 1. Extends foundation tier. 2. Tailored monitoring solution to match the customer tailored power tier service. 3. Supports custom topologies that might not be available for SkySQL foundation tier. 4. Can support Alerts and Notifications.
- 42. THANK YOU 42