Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add live tail support #503

Closed
nitisht opened this issue Sep 14, 2023 · 0 comments · Fixed by #516
Closed

add live tail support #503

nitisht opened this issue Sep 14, 2023 · 0 comments · Fixed by #516
Assignees
@trueleo
Labels
enhancement New feature or request hacktoberfest
Milestone
Release v0.7.1

Comments

@nitisht
Copy link
Member

nitisht commented Sep 14, 2023 •
edited
Loading

Add support for a live tail approach where a client like pb or console can hookup to a Parseable instance and live stream all the logs for a given stream.

The stream will start the moment client hooks on and will end when client stops listening. Server will simply send all the events received in the log stream for this live tail. Client will be responsible for filtering etc.

Relevant client side issues:
@nitisht nitisht added the enhancement New feature or request label Sep 14, 2023
This was referenced Sep 14, 2023
Closed
Closed
@nitisht nitisht added this to the Release v0.7.1 milestone Sep 19, 2023
@nitisht nitisht mentioned this issue Sep 26, 2023
Merged
3 tasks
nitisht pushed a commit that referenced this issue Oct 13, 2023
@trueleo
add live tail support for stream (#516)
7f4da55 
This PR adds support for live tailing a stream. With this PR,
server exposes a gRPC server on a configurable port (default 8001)
and uses Arrow Flight as the communication protocol. 

As live tail is requested for a stream, Server sends events from 
that steam, before the local staging and parquet conversion. 
This means, server will use the event record batch to create a
flight stream and send over to the client.

fixes #503
@nitisht nitisht mentioned this issue Jan 10, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@trueleo trueleo

Labels
enhancement New feature or request hacktoberfest
Projects
None yet
Milestone
Release v0.7.1
Development

Successfully merging a pull request may close this issue.

Flight livetail trueleo/parseable
2 participants
@nitisht @trueleo