Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Query backtracking improvements #70

Open
pvlugter opened this issue Aug 14, 2024 · 0 comments
Open

Query backtracking improvements #70

pvlugter opened this issue Aug 14, 2024 · 0 comments

Comments

@pvlugter
Copy link
Contributor

Should we fully safeguard against queries getting too far ahead of backtracking? By limiting the end timestamp or filtering events when too far ahead. Noting that it also still needs to handle gaps bigger than the backtracking window in some way, otherwise will be stuck.

Possible optimisation to disable backtracking while queries have fallen behind. We would expect any delayed writes to already be there, when queries are further behind the backtracking window from current time already, so backtracking could be disabled to reduce load and give queries more opportunity to catch up, and then reactivate backtracking when query results are closer to current time again.

See #69 (comment) for discussion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant