SlideShare a Scribd company logo
Integrate
Percona Monitoring and Management
With a Monitoring system
Rachid Zarouali
C.I.O
SYNOLIA
1
PERCONA PMM
Helps SysAdmin managing DB Server/Clusters
Helps Devs optimizing/analyzing queries
Works perfectly out of the box
2
WHY SHOULD YOU
INTEGRATE PMM ?
3
MONITORING INFRASTRUCTURE
Graphite
Grafana
Cabot
4
MYSQL
5
6
THE GOOD
integration method
THE BAD
THE UGLY
7
PERCONA PMM BUNDLE
QAN / Grafana / Prometheus / Orchestrator ( pmm 1.0.5)
used in
Monitoring systems
8
MONITORING INFRASTRUCTURE
Graphite
Grafana
Cabot
pmm-server
9
PROS CONS
Duplicated features
Significant overhead
Noisy and untested system
pull metrics (security issue)
Fastest deployment ever
great dashboards
immediate benefits
percona supported since GA
UGLY: WHY
10
BETTER SOLUTION ?
Perhaps ......
11
MONITORING INFRASTRUCTURE
Graphite
Cabot
Grafana
12
PROS CONS
Cut from the upstream
Rewrite all dashboards
How about QAN ?
Lowest overhead
No more duplicated system
Unified and simple platform
BAD: WHY
13
BETTER SOLUTION ?
Still not the best :(
Again YES !
14
MONITORING INFRASTRUCTURE
Graphite
Cabot
pmm-server
15
Production server overhead
"locked-in" in prometheus world
New system to use/manage
Pull mecanism for metrics
no docker container for pmm-client
BUT NOT THE BEST: WHY
16
ONE MORE THING!
DON'T PUT PMM IN PRODUCTION
UNLESS YOU KNOW WHAT YOU'RE DOING
BUT .....
I'LL SHOW YOU HOW ANYWAY :)
17
HOW TO ANYWAY ?!
Extending Monitoring capabilities
Staying as close as possible to PMM Upstream
Removing most of duplicate features
18
HOW ?!
Remove everything but the specific (i.e: Apache,Php)
Inject in Pmm's Grafana :
dashboards
datasources
19
HOW ?! HOW ?! HOW ?!
FROM percona/pmm-server:latest
MAINTAINER Rachid Zarouali <rzarouali@gmail.com>
RUN apt-get install wget -qqy
# ############################# #
# Add several custom dashboards #
# ############################# #
WORKDIR /var/lib/grafana/dashboards
RUN wget https://raw.githubusercontent.com/infinityworksltd/graf-db/master/dashboards/Rancher_Stats.json
RUN wget https://raw.githubusercontent.com/xinity/graf-db/master/dashboards/Container_Stats.json
# ############################## #
# Add specific scrapping options #
# ############################## #
COPY conf/tweak-prom.yml /tmp
RUN cat /tmp/tweak-prom.yml >> /opt/prometheus/prometheus.yml
# ######################## #
# Activate dashboards.json #
# ######################## #
COPY conf/grafana-dashs.yml /tmp
RUN cat /tmp/grafana-dashs.yml >> /etc/grafana/grafana.ini
DOCKER INSIDE !
20
HOW ?! HOW ?! HOW ?!
[dashboards.json]
enabled = true
path = /var/lib/grafana/dashboards
GRAFANA-DASHS.YML
TWEAK-PROM.YML
- job_name: 'HostsMetrics'
dns_sd_configs:
- names:
- node-exporter
refresh_interval: 15s
type: A
port: 9100
- job_name: 'ContainerMetrics'
dns_sd_configs:
- names:
- ranch-eye
refresh_interval: 15s
type: A
port: 9104
- job_name: 'rancher-api'
dns_sd_configs:
- names:
- 'prometheus-rancher-exporter'
refresh_interval: 15s
type: A
port: 9010
21
NEXT STEPS ?
22
NEXT STEPS
wait for / contribute to prometheus
backup/restore
Seperate TSDB from apps
other TSDB interfaces
replace collectd by prometheus exporter
maybe !
maybe not !
23

More Related Content

PPTX
PMM database open source monitoring solution
PPTX
The Case for Chaos
PDF
VMware Tanzu Introduction- June 11, 2020
PPTX
Adopting OpenTelemetry
PDF
Virtualization - An Introduction (Study Notes)
PPTX
Distributed Tracing in Practice
PDF
ClickHouse Intro
PDF
Observability
PMM database open source monitoring solution
The Case for Chaos
VMware Tanzu Introduction- June 11, 2020
Adopting OpenTelemetry
Virtualization - An Introduction (Study Notes)
Distributed Tracing in Practice
ClickHouse Intro
Observability

What's hot (20)

PDF
ProxySQL Cluster - Percona Live 2022
PPTX
Redis and it's data types
PDF
High Availability PostgreSQL with Zalando Patroni
PPT
MySQL Atchitecture and Concepts
PDF
VMware Virtual SAN Presentation
PPTX
이것이 레디스다.
PDF
Zabbix Performance Tuning
PDF
Twitch Plays Pokémon: Twitch's Chat Architecture
PPTX
vSAN architecture components
PDF
VMware vCloud and vRealize Operations
DOCX
Linux admin interview questions
PDF
The Patterns of Distributed Logging and Containers
PDF
Ansible Automation Platform.pdf
PPTX
Introduction to OpenStack Trove & Database as a Service
PDF
memcached Binary Protocol in a Nutshell
PPTX
Veeam presentation
PDF
How to Split Your System into Microservices
PPTX
Prometheus and Grafana
PDF
Stream Processing – Concepts and Frameworks
ProxySQL Cluster - Percona Live 2022
Redis and it's data types
High Availability PostgreSQL with Zalando Patroni
MySQL Atchitecture and Concepts
VMware Virtual SAN Presentation
이것이 레디스다.
Zabbix Performance Tuning
Twitch Plays Pokémon: Twitch's Chat Architecture
vSAN architecture components
VMware vCloud and vRealize Operations
Linux admin interview questions
The Patterns of Distributed Logging and Containers
Ansible Automation Platform.pdf
Introduction to OpenStack Trove & Database as a Service
memcached Binary Protocol in a Nutshell
Veeam presentation
How to Split Your System into Microservices
Prometheus and Grafana
Stream Processing – Concepts and Frameworks
Ad

Similar to Percona: Integrate PMM within an existing monitoring platform (20)

PDF
Prometheus and Docker (Docker Galway, November 2015)
PPTX
Camunda BPM 7.13 Webinar
PPTX
Using the Command Line: Bash and WP-CLI
PPT
Monitoring using Prometheus and Grafana
PDF
Monitor your Java application with Prometheus Stack
PDF
OSMC 2012 | PMp - another approach to configure Nagios by Pierre Waellemacq
PDF
Chicago Docker Meetup Presentation - Mediafly
ODP
Performance: Observe and Tune
PDF
AMDGPU ROCm Deep dive
PDF
Server monitoring using grafana and prometheus
PDF
Getting more juice out from your Raspberry Pi GPU
PDF
Free radius billing server with practical vpn exmaple
PDF
How to Configure the CA Workload Automation System Agent agentparm.txt File
PPTX
What’s Mule 4.3? How Does Anytime RTF Help? Our insights explain.
PDF
Set up a Development Environment in 5 Minutes
PDF
IDNOG 4 Lightning Talks - Documenting your Network in 3 Simple Steps
PDF
LT04 IDNOG04 - Affan Basalamah (ITB) - Documenting your network
PDF
Automate Oracle database patches and upgrades using Fleet Provisioning and Pa...
PDF
Raw Iron to Enterprise Server: Installing Domino on Linux
PDF
Building The Modern IT
Prometheus and Docker (Docker Galway, November 2015)
Camunda BPM 7.13 Webinar
Using the Command Line: Bash and WP-CLI
Monitoring using Prometheus and Grafana
Monitor your Java application with Prometheus Stack
OSMC 2012 | PMp - another approach to configure Nagios by Pierre Waellemacq
Chicago Docker Meetup Presentation - Mediafly
Performance: Observe and Tune
AMDGPU ROCm Deep dive
Server monitoring using grafana and prometheus
Getting more juice out from your Raspberry Pi GPU
Free radius billing server with practical vpn exmaple
How to Configure the CA Workload Automation System Agent agentparm.txt File
What’s Mule 4.3? How Does Anytime RTF Help? Our insights explain.
Set up a Development Environment in 5 Minutes
IDNOG 4 Lightning Talks - Documenting your Network in 3 Simple Steps
LT04 IDNOG04 - Affan Basalamah (ITB) - Documenting your network
Automate Oracle database patches and upgrades using Fleet Provisioning and Pa...
Raw Iron to Enterprise Server: Installing Domino on Linux
Building The Modern IT
Ad

More from Rachid Zarouali (10)

PPTX
devopsrex 2024 (Rachid Zarouali): ca passe ou ca kaas ?
PPTX
Les containers docker vu par un chef cuisinier et un mécanicien
PPTX
Containers explained as for cook and a mecanics
PDF
Start your container journey safely
PPTX
Devops rex tales of container security
PDF
Securité des container
PPTX
Kit de Developpement Synolia
PDF
Docker to the Rescue of an Ops Team
PDF
ContainerDays Hamburg 2017: Deploy Resilient E-Commerce Platform
PDF
Meetup afup 21/09/16: monitoring à SYNOLIA
devopsrex 2024 (Rachid Zarouali): ca passe ou ca kaas ?
Les containers docker vu par un chef cuisinier et un mécanicien
Containers explained as for cook and a mecanics
Start your container journey safely
Devops rex tales of container security
Securité des container
Kit de Developpement Synolia
Docker to the Rescue of an Ops Team
ContainerDays Hamburg 2017: Deploy Resilient E-Commerce Platform
Meetup afup 21/09/16: monitoring à SYNOLIA

Recently uploaded (20)

PPTX
IB Computer Science - Internal Assessment.pptx
PPTX
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
PPTX
Computer network topology notes for revision
PPTX
Data_Analytics_and_PowerBI_Presentation.pptx
PDF
Mega Projects Data Mega Projects Data
PPTX
climate analysis of Dhaka ,Banglades.pptx
PPTX
STERILIZATION AND DISINFECTION-1.ppthhhbx
PPTX
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
PPT
Predictive modeling basics in data cleaning process
PPTX
Supervised vs unsupervised machine learning algorithms
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PPT
Reliability_Chapter_ presentation 1221.5784
PDF
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
PDF
.pdf is not working space design for the following data for the following dat...
PPT
Quality review (1)_presentation of this 21
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PDF
Optimise Shopper Experiences with a Strong Data Estate.pdf
PDF
Introduction to the R Programming Language
IB Computer Science - Internal Assessment.pptx
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
Computer network topology notes for revision
Data_Analytics_and_PowerBI_Presentation.pptx
Mega Projects Data Mega Projects Data
climate analysis of Dhaka ,Banglades.pptx
STERILIZATION AND DISINFECTION-1.ppthhhbx
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
Predictive modeling basics in data cleaning process
Supervised vs unsupervised machine learning algorithms
Acceptance and paychological effects of mandatory extra coach I classes.pptx
Reliability_Chapter_ presentation 1221.5784
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
.pdf is not working space design for the following data for the following dat...
Quality review (1)_presentation of this 21
IBA_Chapter_11_Slides_Final_Accessible.pptx
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
Optimise Shopper Experiences with a Strong Data Estate.pdf
Introduction to the R Programming Language

Percona: Integrate PMM within an existing monitoring platform

  • 1. Integrate Percona Monitoring and Management With a Monitoring system Rachid Zarouali C.I.O SYNOLIA 1
  • 2. PERCONA PMM Helps SysAdmin managing DB Server/Clusters Helps Devs optimizing/analyzing queries Works perfectly out of the box 2
  • 6. 6
  • 8. PERCONA PMM BUNDLE QAN / Grafana / Prometheus / Orchestrator ( pmm 1.0.5) used in Monitoring systems 8
  • 10. PROS CONS Duplicated features Significant overhead Noisy and untested system pull metrics (security issue) Fastest deployment ever great dashboards immediate benefits percona supported since GA UGLY: WHY 10
  • 13. PROS CONS Cut from the upstream Rewrite all dashboards How about QAN ? Lowest overhead No more duplicated system Unified and simple platform BAD: WHY 13
  • 14. BETTER SOLUTION ? Still not the best :( Again YES ! 14
  • 16. Production server overhead "locked-in" in prometheus world New system to use/manage Pull mecanism for metrics no docker container for pmm-client BUT NOT THE BEST: WHY 16
  • 17. ONE MORE THING! DON'T PUT PMM IN PRODUCTION UNLESS YOU KNOW WHAT YOU'RE DOING BUT ..... I'LL SHOW YOU HOW ANYWAY :) 17
  • 18. HOW TO ANYWAY ?! Extending Monitoring capabilities Staying as close as possible to PMM Upstream Removing most of duplicate features 18
  • 19. HOW ?! Remove everything but the specific (i.e: Apache,Php) Inject in Pmm's Grafana : dashboards datasources 19
  • 20. HOW ?! HOW ?! HOW ?! FROM percona/pmm-server:latest MAINTAINER Rachid Zarouali <rzarouali@gmail.com> RUN apt-get install wget -qqy # ############################# # # Add several custom dashboards # # ############################# # WORKDIR /var/lib/grafana/dashboards RUN wget https://raw.githubusercontent.com/infinityworksltd/graf-db/master/dashboards/Rancher_Stats.json RUN wget https://raw.githubusercontent.com/xinity/graf-db/master/dashboards/Container_Stats.json # ############################## # # Add specific scrapping options # # ############################## # COPY conf/tweak-prom.yml /tmp RUN cat /tmp/tweak-prom.yml >> /opt/prometheus/prometheus.yml # ######################## # # Activate dashboards.json # # ######################## # COPY conf/grafana-dashs.yml /tmp RUN cat /tmp/grafana-dashs.yml >> /etc/grafana/grafana.ini DOCKER INSIDE ! 20
  • 21. HOW ?! HOW ?! HOW ?! [dashboards.json] enabled = true path = /var/lib/grafana/dashboards GRAFANA-DASHS.YML TWEAK-PROM.YML - job_name: 'HostsMetrics' dns_sd_configs: - names: - node-exporter refresh_interval: 15s type: A port: 9100 - job_name: 'ContainerMetrics' dns_sd_configs: - names: - ranch-eye refresh_interval: 15s type: A port: 9104 - job_name: 'rancher-api' dns_sd_configs: - names: - 'prometheus-rancher-exporter' refresh_interval: 15s type: A port: 9010 21
  • 23. NEXT STEPS wait for / contribute to prometheus backup/restore Seperate TSDB from apps other TSDB interfaces replace collectd by prometheus exporter maybe ! maybe not ! 23