Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add kinesis timestamp #12

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Conversation

phoebe-canva
Copy link

@phoebe-canva phoebe-canva commented Mar 21, 2023

Context

  • Currently, it is difficult to know which shards are being consumed and how far back it is being consumed
  • We want to submit a metric to know which shards are being processed and how behind they are when consuming from kinesis.
  • This metric is not possible with the current information that we have as the ApproximateArrivalTimestamp is not being sent as metadata. Additionally, it is more accurate if the calculation is done at the start rather than at the end.

Intent

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant