SlideShare a Scribd company logo
OpentsdbRobert Chenrobertchen117@gmail.com
Opentsdb architectureTSDTSDTSDHbasehadoop
HBase Architecture
Opentsdb Architecture II
Opentsdb POC
How to Start & Stop opentsdbStart opentsdb:Start hadoop environmentStart hbase (use internal zookeeper or outside zookeeper)Start TSDStop Opentsdb:Stop tsdStop hbaseStop hadoop
Sample scenarioThis scenario is about how to insert CPU metrics of a host to opentsdb:Add these metrics to hbase first:./src/tsdbmkmetricproc.loadavg.1m proc.loadavg.5m 2. Collect on the client and post to the tsd socket:cat >loadavg-collector.sh <<\EOF #!/bin/bash set -e while true; do awk -v now=`date +%s` -v host=`hostname` \ '{ print "put proc.loadavg.1m " now " " $1 " host=" host; print "put proc.loadavg.5m " now " " $2 " host=" host }' /proc/loadavg sleep 15 done | nc -w 30  node1 8080 EOF chmod+x loadavg-collector.sh nohup./loadavg-collector.sh &3. Put Metrics data like these:[root@node1 /]# ./vendor/stumbleupon-opentsdb-33dff14/src/loadavg-collector-result.shput proc.loadavg.1m 1310023344 0.14 host=node1put proc.loadavg.5m 1310023344 0.11 host=node2
Need to do:Collection metrics scripts: change from saving into RRD to save to Hbase;Graphs pages on how to extract data in opentsdb and better looking

More Related Content

PPTX
HBaseCon 2013: OpenTSDB at Box
PPTX
Monitoring MySQL with OpenTSDB
PPTX
To Hire, or to train, that is the question (Percona Live 2014)
PDF
OpenTSDB for monitoring @ Criteo
PDF
OpenTSDB: HBaseCon2017
PDF
Gnocchi v3 brownbag
PDF
Gnocchi v4 (preview)
PDF
Gnocchi Profiling 2.1.x
HBaseCon 2013: OpenTSDB at Box
Monitoring MySQL with OpenTSDB
To Hire, or to train, that is the question (Percona Live 2014)
OpenTSDB for monitoring @ Criteo
OpenTSDB: HBaseCon2017
Gnocchi v3 brownbag
Gnocchi v4 (preview)
Gnocchi Profiling 2.1.x

What's hot (20)

PPTX
Update on OpenTSDB and AsyncHBase
PDF
OpenTSDB 2.0
PDF
Gnocchi v3
PDF
Gnocchi v4 - past and present
PDF
"Metrics: Where and How", Vsevolod Polyakov
PDF
Как понять, что происходит на сервере? / Александр Крижановский (NatSys Lab.,...
PDF
Anatomy of an action
PDF
Tweaking performance on high-load projects
PDF
HBaseCon2017 gohbase: Pure Go HBase Client
PDF
Deep dive into PostgreSQL statistics.
PDF
Advanced Apache Cassandra Operations with JMX
PDF
Handling 20 billion requests a month
PDF
10 things i wish i'd known before using spark in production
PPT
JVM performance options. How it works
PDF
Tarantool как платформа для микросервисов / Антон Резников, Владимир Перепели...
PDF
ScyllaDB: NoSQL at Ludicrous Speed
PPTX
Keynote: Apache HBase at Yahoo! Scale
PDF
Object Storage with Gluster
PPTX
Bucket Your Partitions Wisely (Markus Höfer, codecentric AG) | Cassandra Summ...
PPTX
Cassandra Backups and Restorations Using Ansible (Joshua Wickman, Knewton) | ...
Update on OpenTSDB and AsyncHBase
OpenTSDB 2.0
Gnocchi v3
Gnocchi v4 - past and present
"Metrics: Where and How", Vsevolod Polyakov
Как понять, что происходит на сервере? / Александр Крижановский (NatSys Lab.,...
Anatomy of an action
Tweaking performance on high-load projects
HBaseCon2017 gohbase: Pure Go HBase Client
Deep dive into PostgreSQL statistics.
Advanced Apache Cassandra Operations with JMX
Handling 20 billion requests a month
10 things i wish i'd known before using spark in production
JVM performance options. How it works
Tarantool как платформа для микросервисов / Антон Резников, Владимир Перепели...
ScyllaDB: NoSQL at Ludicrous Speed
Keynote: Apache HBase at Yahoo! Scale
Object Storage with Gluster
Bucket Your Partitions Wisely (Markus Höfer, codecentric AG) | Cassandra Summ...
Cassandra Backups and Restorations Using Ansible (Joshua Wickman, Knewton) | ...
Ad

Viewers also liked (20)

PDF
HBaseCon 2012 | Lessons learned from OpenTSDB - Benoit Sigoure, StumbleUpon
PDF
openTSDB - Metrics for a distributed world
PPTX
HBaseCon 2015: OpenTSDB and AsyncHBase Update
DOC
000 proyecto tesis ccss jfcc ultimo12
PPT
Exposicion plataforma de monitoreo zabbix
PDF
4Linux - Monitoramento de Redes com o Zabbix
PDF
[FR] Timeseries appliqué aux couches de bébé
PPTX
Monitoreo Atraves de GLpi
DOCX
Proyecto maestria
PDF
Developing for Android (The movie)
PDF
Criando Mapas de rede para monitoramento com Zabbix
PPSX
Java Persistence Api (Jpa)
ODP
instalacion e intregracion de OcsInventory-NG y GLPI
PPTX
Work at GlobalLogic Latin America
PDF
Gerência de redes com Zabbix: conhecendo a ferramenta
KEY
Monitoring solutions comparison
PDF
Sistema de monitorización open nms
PDF
Debian Jessie (8.0) + GLPI 9.0 + FusionInventory
PDF
Plantilla para realizar un manual de usuario de software
ODT
Implantación y monitorización con SNMP
HBaseCon 2012 | Lessons learned from OpenTSDB - Benoit Sigoure, StumbleUpon
openTSDB - Metrics for a distributed world
HBaseCon 2015: OpenTSDB and AsyncHBase Update
000 proyecto tesis ccss jfcc ultimo12
Exposicion plataforma de monitoreo zabbix
4Linux - Monitoramento de Redes com o Zabbix
[FR] Timeseries appliqué aux couches de bébé
Monitoreo Atraves de GLpi
Proyecto maestria
Developing for Android (The movie)
Criando Mapas de rede para monitoramento com Zabbix
Java Persistence Api (Jpa)
instalacion e intregracion de OcsInventory-NG y GLPI
Work at GlobalLogic Latin America
Gerência de redes com Zabbix: conhecendo a ferramenta
Monitoring solutions comparison
Sistema de monitorización open nms
Debian Jessie (8.0) + GLPI 9.0 + FusionInventory
Plantilla para realizar un manual de usuario de software
Implantación y monitorización con SNMP
Ad

Similar to opentsdb in a real enviroment (8)

PDF
OSMC 2013 | openTSDB - metrics for a distributed world
PDF
Open TSDB Lightning Talk
PPTX
A Billion Points of Data Pressure
PDF
Hadoop and OpenStack
PDF
Hadoop and OpenStack - Hadoop Summit San Jose 2014
PDF
hbaseconasia2019 OpenTSDB at Xiaomi
PDF
OrientDB
ODP
HBase introduction talk
OSMC 2013 | openTSDB - metrics for a distributed world
Open TSDB Lightning Talk
A Billion Points of Data Pressure
Hadoop and OpenStack
Hadoop and OpenStack - Hadoop Summit San Jose 2014
hbaseconasia2019 OpenTSDB at Xiaomi
OrientDB
HBase introduction talk

Recently uploaded (20)

PPTX
TLE Review Electricity (Electricity).pptx
PDF
2021 HotChips TSMC Packaging Technologies for Chiplets and 3D_0819 publish_pu...
PDF
Developing a website for English-speaking practice to English as a foreign la...
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PPTX
Modernising the Digital Integration Hub
PPTX
cloud_computing_Infrastucture_as_cloud_p
PDF
Architecture types and enterprise applications.pdf
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PPTX
1. Introduction to Computer Programming.pptx
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
STKI Israel Market Study 2025 version august
PPTX
Tartificialntelligence_presentation.pptx
PDF
WOOl fibre morphology and structure.pdf for textiles
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
Zenith AI: Advanced Artificial Intelligence
PPTX
O2C Customer Invoices to Receipt V15A.pptx
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
TLE Review Electricity (Electricity).pptx
2021 HotChips TSMC Packaging Technologies for Chiplets and 3D_0819 publish_pu...
Developing a website for English-speaking practice to English as a foreign la...
Assigned Numbers - 2025 - Bluetooth® Document
Modernising the Digital Integration Hub
cloud_computing_Infrastucture_as_cloud_p
Architecture types and enterprise applications.pdf
Final SEM Unit 1 for mit wpu at pune .pptx
1. Introduction to Computer Programming.pptx
NewMind AI Weekly Chronicles - August'25-Week II
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
Programs and apps: productivity, graphics, security and other tools
STKI Israel Market Study 2025 version august
Tartificialntelligence_presentation.pptx
WOOl fibre morphology and structure.pdf for textiles
A comparative study of natural language inference in Swahili using monolingua...
Zenith AI: Advanced Artificial Intelligence
O2C Customer Invoices to Receipt V15A.pptx
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game

opentsdb in a real enviroment

  • 6. How to Start & Stop opentsdbStart opentsdb:Start hadoop environmentStart hbase (use internal zookeeper or outside zookeeper)Start TSDStop Opentsdb:Stop tsdStop hbaseStop hadoop
  • 7. Sample scenarioThis scenario is about how to insert CPU metrics of a host to opentsdb:Add these metrics to hbase first:./src/tsdbmkmetricproc.loadavg.1m proc.loadavg.5m 2. Collect on the client and post to the tsd socket:cat >loadavg-collector.sh <<\EOF #!/bin/bash set -e while true; do awk -v now=`date +%s` -v host=`hostname` \ '{ print "put proc.loadavg.1m " now " " $1 " host=" host; print "put proc.loadavg.5m " now " " $2 " host=" host }' /proc/loadavg sleep 15 done | nc -w 30 node1 8080 EOF chmod+x loadavg-collector.sh nohup./loadavg-collector.sh &3. Put Metrics data like these:[root@node1 /]# ./vendor/stumbleupon-opentsdb-33dff14/src/loadavg-collector-result.shput proc.loadavg.1m 1310023344 0.14 host=node1put proc.loadavg.5m 1310023344 0.11 host=node2
  • 8. Need to do:Collection metrics scripts: change from saving into RRD to save to Hbase;Graphs pages on how to extract data in opentsdb and better looking