Skip to content

Latest commit

 

History

History

cp-community-monitoring

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
config
config
 
 
Readme.md
Readme.md
 
 
docker-compose.yml
docker-compose.yml
 
 

Readme.md

Confluent Platform Community Edition - monitoring demo.

This sample demonstrates how to monitor Confluent Platform Community Edition components and visualize metrics in Grafana dashboards.

Grafana dashboards used in this demo can be found here

Components

Dashboards

Kafka Overview Kafka Topics Kafka Connect Overview
Schema Registry Overview ksqldb Overview Zookeeper Overview
Kafka Lag Exporter

Getting Started

Prerequisites

  • Java 11
  • Docker

Build

  • Build sample Kafka application using below command: 
    ./gradlew bootBuildImage

Usage

  • Run the docker compose stack.

    cd ./docker/cp-community-monitoring
docker compose up -d

  • Check if all components are running.

    docker compose ps

# NAME                   SERVICE                STATUS              PORTS
# connect                connect                running (healthy)   0.0.0.0:8083->8083/tcp, :::8083->8083/tcp, 9092/tcp
# grafana                grafana                running (healthy)   0.0.0.0:3000->3000/tcp, :::3000->3000/tcp
# kafka                  kafka                  running             0.0.0.0:9092->9092/tcp, :::9092->9092/tcp, 0.0.0.0:9101->9101/tcp, :::9101->9101/tcp
# kafka-lag-exporter     kafka-lag-exporter     running             0.0.0.0:8000->8000/tcp, :::8000->8000/tcp
# kafka-monitoring-app   kafka-monitoring-app   running             0.0.0.0:7777->7777/tcp, :::7777->7777/tcp
# ksqldb-cli             ksqldb-cli             running             
# ksqldb-server          ksqldb-server          running             0.0.0.0:8088->8088/tcp, :::8088->8088/tcp
# prometheus             prometheus             running (healthy)   0.0.0.0:9090->9090/tcp, :::9090->9090/tcp
# rest-proxy             rest-proxy             running             0.0.0.0:8082->8082/tcp, :::8082->8082/tcp
# schema-registry        schema-registry        running             0.0.0.0:8081->8081/tcp, :::8081->8081/tcp

  • Open your web browser and go to Grafana login page.

    • Username: admin
    • Password: password

  • Investigate Grafana dashboards:

    • Kafka Overview
    • Kafka Topics
    • Kafka Connect Overview
    • Schema Registry Overview
    • ksqldb Overview
    • Zookeeper Overview
    • Kafka Lag Exporter

  • Stop docker compose stack.

    docker compose down -v

Important Endpoints

Name Endpoint
Grafana http://localhost:3000/
Prometheus http://localhost:9090/

References