We use VMWare Wavefront for monitoring and visualization. We use telegraf agent as metrics collector. As part of Kafka monitoring, we have created alerts for Zookeeper availability. It was working fine initially but stopped working after a Kafka upgrade. We checked telegraf agent and zookeeper logs but could not find Continue Reading
kafka
How to monitor Kafka Consumer Lag
There are couple of ways to monitor Kafka consumer Lag. There is an open source project called Apache Burrow which has lot of features and easy to set up. It filters out lot of false positives too. If there are an limitations of using it in your project, we can Continue Reading
Kafka Consumer CLI Error: Timed out waiting for a node assignment
This post is more of a personal note than a perfect analysis. I have applied lot of workarounds and still not able to identify exactly what caused issue. Writing this blog so it will act as future reference if similar issue happens and add more details about the issue. We Continue Reading
Kafka Broker Refusing to Start – Timed out waiting for connection
As part of regular maintenance, we shutdown Kafka. When we tried to start it, it failed with below error: [2021-11-15 05:01:03,824] INFO Socket connection established to mykafka-a1.abc.com/10.0.95.100:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2021-11-15 05:01:03,824] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection Continue Reading