Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

NMS-12987: Improve Observability #27

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from
Draft

NMS-12987: Improve Observability #27

wants to merge 2 commits into from

Conversation

swachter
Copy link
Contributor

@swachter swachter commented Jun 4, 2021 •
edited
Loading

Issue: https://issues.opennms.org/browse/NMS-12987

  • Do not use distributions for the drift metrics (because they are not supported for the Beam/Flink/Prometheus combination) but gauges instead
  • Use (now - flow.lastSwitched) for calculating Kafka drift. (Watermarks are based on lastSwitched, too.)
  • The metric name for the Kafka drift metric is: flink_taskmanager_job_task_operator_flows_from_kafka_drift. Prometheus can be used to calculate some stats about that metric. In particular, in addition to avg, min and max would be interesting.

swachter added 2 commits June 29, 2021 08:46
@swachter
NMS-12987: use gauges instead of distributions (distributions are not…
d17664a 
… supported by the combination Beam/Flink/Prometheus)
@swachter
NMS-12987: report currentTimeMillis - flow.lastSwitched as kafka_drif…
5d60229 
…t (watermarks are also based on lastSwitched)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@swachter