Nex clipper 1905_summary_eng
2 likes1,198 views
Nexclipper is an open-source solution for monitoring Kubernetes clusters, addressing complexities associated with Kubernetes deployment and management. It provides features like global views, multi-tenancy, long-term data storage, and integration with Prometheus while automating processes like application deployment and resource allocation. The architecture includes tools for alert management, data collection, and integration with third-party storage solutions, enhancing monitoring capabilities in enterprise environments.
![Kubernetes Monitoring
3. Long Term Data – Prometheus with 3rd party storage
Prometheus's local storage is limited by single nodes in its scalability and durability. Instead of trying to solve clustered storage
in Prometheus itself, Prometheus has a set of interfaces that allow integrating with remote storage systems.
[Source] Prometheus Docs: https://prometheus.io/docs/prometheus/latest/storage/
Remote storage integrations
•AppOptics: write
•Chronix: write
•Cortex: read and write
•CrateDB: read and write
•Elasticsearch: write
•Gnocchi: write
•Graphite: write
•InfluxDB: read and write
•IRONdb: read and write
•Kafka: write
Prometheus
Adaptor
Custom
Protocol
3rd party
Long Term
DataStorage
Write
sample
Request
receive
•M3DB: read and write
•OpenTSDB: write
•PostgreSQL/TimescaleDB: read and write
•SignalFx: write
•Splunk: write
•TiKV: read and write
•VictoriaMetrics: write
•Wavefront: write](https://image.slidesharecdn.com/nexclipper1905summaryeng-190512074644/85/Nex-clipper-1905_summary_eng-13-320.jpg)
Nex clipper 1905_summary_eng
- 1. NexClipper : Global and Enterprise Monitoring for Kubernetes http://www.nexclipper.io nexclipper@nexclipper.io
- 2. Background Cloud Native Application refer to • Microservice Oriented • Container Packaged • Dynamically Scheduled • Predominantly Open Source
- 3. Background
- 4. Kubernetes Problems solved and problems created by Kubernetes • COMPLEXITY – Kubernetes itself is quite complex to install, configure, and manage • Unknowingly over or under-allocating the available resources with negative results • Pods might not start at all • Pods might crash at really bad times – under high workload 🙁 • Using/configuring external load balancers to access your applications via the internet – yet another technology to learn and manage • Creating health checks for every component • Integration into build pipeline – running Kubernetes at scale requires integration and automation • Learning YAML 🙁 • Monitoring – Kubernetes requires unique monitoring tooling especially if you want to understand the relationships between infrastructure, K8s, and application services • Automatic deployment of application services • Automatic configuration of application network • Automatic distribution of services across infrastructure • Automatic resource allocation for application services • Automatic load balancing between application components • Automatic replication of application components • Automatic failover of application components • Easily scale out application services when required • Sharing of storage across multiple containers Problems Solved Using Kubernetes Problems Created Using Kubernetes Source: https://www.instana.com/blog/problems-solved-and-problems-created-by-kubernetes/
- 5. Kubernetes – Need for Kubernetes Monitoring (1) Increased components and service to be monitored
- 6. Host Host Host Host App1 App2 App5App4App3 App3 App4 Kubernetes – Need for Kubernetes Monitoring (2) Need for continues monitoring for applications which are constantly moving Applications are constantly moving.
- 7. Kubernetes – Need for Kubernetes Monitoring (3) For Tag, Label (4) For multi cluster
- 8. App App App App Host 2 1 3 4 O R C H E S T R A T E Kubernetes – Need for Kubernetes Monitoring Kubernetes Monitoring Components Kubernetes Cluster Cluster Health(API, etcd, Controller) Workload status Cluster level resource monitoring Application Log Apm POD/Container monitoring Kubernetes Pods monitoring Native Docker Container support Node/Host level monitoring Kubernetes Node monitoring Infrastructure(Baremeteal, VM) resource monitoring
- 9. Prometheus Prometheus 2.0 A monitoring & alerting system. Open Source, now part of the CNCF Reliable operational model Powerful query language Scraping capabilities beyond the casual usage Local metric storage
- 10. Kubernetes Monitoring 1. Scale up and out – Prometheus Cluster-nCluster-1 Alertmanager Grafana Exporters Exporters Scaled out By each Prometheus Server & each dashboard (case1) One Prometheus server 4 cores and 26GB of RAM for 200 machines (case2) 12 CPUs and 102GB of RAM to monitor ~1200 machines. (Source): https://www.perimeterx.com/blog/scaling-out-with prometheus/?fbclid=IwAR26VWx85Pt5E5xjbiAFIetRWaUrQ6Zqe5gk11LHxgFXlJN3YcjCZyo9teE Cluster-nCluster-1 Alertmanager Grafana Single Prometheus Server For Multi cluster/endpoints Scape Scale out
- 11. Kubernetes Monitoring 2. Global View – Prometheus with Federation Cluster-nCluster-1 Multiple data source at Grafana But no global view Cluster-nCluster-1 Configure global view by local Prometheus Federation But in practice only propagate aggregates, have to preconfigure rules, hard to scale etc. Alertmanager Grafana Alertmanager Grafana Global Prometheus By Federation
- 12. Kubernetes Monitoring 2. Global View – NexClipper for global view and multi tenancy Cluster-nCluster-1 Alert Manager Dashboard Cluster-nCluster-1 Alertmanager Grafana Global Prometheus By Federation NexAgent Global NexClipper Integrated Dashboard & alert manager Global NexClipper from multi cluster Global view without Prometheus federation Support cluster without Prometheus Integrated dashboard and alert manager
- 13. Kubernetes Monitoring 3. Long Term Data – Prometheus with 3rd party storage Prometheus's local storage is limited by single nodes in its scalability and durability. Instead of trying to solve clustered storage in Prometheus itself, Prometheus has a set of interfaces that allow integrating with remote storage systems. [Source] Prometheus Docs: https://prometheus.io/docs/prometheus/latest/storage/ Remote storage integrations •AppOptics: write •Chronix: write •Cortex: read and write •CrateDB: read and write •Elasticsearch: write •Gnocchi: write •Graphite: write •InfluxDB: read and write •IRONdb: read and write •Kafka: write Prometheus Adaptor Custom Protocol 3rd party Long Term DataStorage Write sample Request receive •M3DB: read and write •OpenTSDB: write •PostgreSQL/TimescaleDB: read and write •SignalFx: write •Splunk: write •TiKV: read and write •VictoriaMetrics: write •Wavefront: write
- 14. Kubernetes Monitoring 3. Long Term Data - NexClipper Prometheus InfluxDB OepnTSDB …… Main Central Database Optional InfluxDB OepnTSDB …… • Central and consolidated database (InfluxDB, OpenTSDB,etc) • Long term data storage • HA • Backup • Prometheus optional – need Long term storage Cluster-nCluster-1 NexAgent Adaptor
- 15. NexClipper - Kubernetes Monitoring NexClipper is open source for Kubernetes monitoring in an enterprise environments by complementing and integration with Prometheus NexClipper Agent K8S cluster x n Alert Manager Dashboard Storage NexClipper Agent NexAgent Event Alarm NexClipper Dashboard API Client K8S cluster x n w/Prometheus …… Cluster Manager AI & Analytics Comparison to Prometheus • Global View for multi cluster • Multi Tenancy • Horizontal Scalable • Long term data storage • Integrated dashboard and alert manager • Rest API for customer dashboard Comparison to (Thanos & Cortex) • Enhanced k8s dashboard • Deployment manager • Support cluster without Prometheus And More • Integration with AI & Analytics • Cluster Manager for provisioning, service catalog and deploy manager.(To-Be) • Integration with Log analysis & APM tool (To-Be)
- 16. NexClipper Dashboard NexClipper - Kubernetes Monitoring
- 17. NexClipper - Kubernetes Monitoring NexClipper Architecture WorkflowCollector Service Message Queue K8s Dashboard UI Ruleset manager Rest API (Metric,Event) Multi Tenancy WorkloadManagement Catalogservice Storage Redis MySQL (MariaDB) Slack Email …… GrafanaNexClipperUI RabbitMQ (Kafka) Notify Alert Manager Store API Snapshotdata Account,Rule, Alert, Event, Access API Clients Metric Collect Store API TSDB InfluxDB (Prometheus) Main Metrics Kubernetes Cluster-1 Master Node Worker Node Worker Node Agent Agent Agent …… Metrics Collect Metric ( Cluster ,Docker Host) Exporters Prometheus Server Kubernetes Cluster-n DC/OS,Mesosphere Cluster-n Your Apps Exporters Exporters NexClipper ComponentDeploy workload
- 18. Contact us Website: https://www.nexclipper.io Service: https://server.nexclipper.com Email: nexclipper@nexclipper.io Follow us https://www.facebook.com/nexclipper https://www.linkedin.com/company/nexcloud https://github.com/NexClipper/NexClipper