From the course: Complete Guide to Apache Kafka for Beginners

Unlock the full course today

Join today to access over 24,700 courses taught by industry experts.

Kafka monitoring and operations

Kafka monitoring and operations - Kafka Tutorial

From the course: Complete Guide to Apache Kafka for Beginners

Start my 1-month free trial Buy for my team

Kafka monitoring and operations

“

Hi, this is Stephane from Conduktor and welcome to this lecture. So once you have set up a Kafka cluster, you need to enable monitoring and also master operations. So first let's talk about monitoring. So Kafka is exposing all the Kafka metrics through JMX, which is an interface to get these metrics. And these metrics are very, very important to monitor Kafka and to ensure that your brokers are behaving correctly on their load, because sometimes you can have issues and so the metrics will help you understand what part of Kafka is failing. And so there are common places to host your Kafka metrics. For example, it could be the ELK stack, such as ElasticSearch and Kibana or Datadog, NewRelic, Confluent Control Center, Prometheus and many others. So Kafka monitoring overall have some very important metrics. And this is just a sampler. There is a lot more than what I'm giving you right now, but to give you an idea of some metrics that are important. So the first one is URP or under…

Contents