Kafka is a wicket fast and reliable message queue.
Kafka solves the problem of having multiple data sources sending into the same pipeline. It acts as a staging area to allow Logstash to keep up with things.
Kafka is deployed as a systemd unit, called kafka. Normal systemd procedures apply here:
sudo systemctl start kafka
sudo systemctl status kafka
sudo systemctl stop kafka
sudo systemctl restart kafka
It can also be managed using the rockctl command.
etc/kafka/server.properties - primary config file
Continue to Kibana