Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
48 changes: 48 additions & 0 deletions kafka/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
# Kafka Monitoring Dashboard - OTLP

## Data Ingestion

### Integrate KEDA with OpenTelemetry Collector

Add the following code to the receiver section of the OpenTelemetry Collector configuration file:

```
kafkametrics:
brokers: <KAFKA_ENDPOINT> # Ensure this is the correct address
protocol_version: 2.0.0
scrapers:
- brokers
- topics
- consumers
```

and ```kafkametrics``` to the list of receivers in metrics/internal.


## Dashboard panels

## Variables

- `{{deployment.environment}}`: Development enviroment
- `{{kafka.cluster.alias}}`: Kafka cluster alias

### Sections

- Broker Metrics
![Broker Section](assets/broker-section.png)
- Broker Count - kafka_brokers
- Consumer Metrics
![Consumer Section](assets/consumer-section.png)
- Consumer Group Members - kafka_consumer_group_members
- Consumer Lag - kafka_consumer_group_lag
- Consumer Offset - kafka_consumer_group_offset
- Topic Metrics
![Topic Section](assets/topic-section.png)
- Topic Count - kafka_topic_partitions
- Partition Metrics
![Partition Section](assets/partition-section.png)
- Partition Count per Topic - kafka_topic_partitions
- Current Offest (Partition) - kafka_partition_current_offset
- Oldest Offset (Partition) - kafka_partition_oldest_offset
- In-Sync Replicas (ISR) - kafka_partition_replicas_in_sync
- Replicas per Partition - kafka_partition_replicas
Binary file added kafka/assets/broker-section.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added kafka/assets/consumer-section.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added kafka/assets/partition-section.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added kafka/assets/topic-section.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading