Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CHANGE] consider JSONL output to the console #139

Open
ross-spencer opened this issue Jan 10, 2025 · 2 comments
Open

[CHANGE] consider JSONL output to the console #139

ross-spencer opened this issue Jan 10, 2025 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@ross-spencer
Copy link

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

The current workflow requires export of data to tsv and then parsing of those files in a rather undynamic way, e.g. one might open them in LibreOffice and then analyze them there. There may be ways to make the workflow more ergonomic for users adept with the command line.

Describe the solution you'd like
A clear and concise description of what you want to happen.

Offer an export to JSONL via the session ID so that it can be piped to a file or straight to JQ.

JSONL is a good format for this as there are different schemas for directory/file/exif/session and so on. JQ is also adept at handling JSONL enabling querying and remapping into other JSON schemas if required.

Connected to #138 this would give the user a streamlined scan -> export -> analyze with JQ workflow.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

As the tool matures other export formats may also be desirable but JSON feels too static with the heterogeneous schema currently being made use of. That being said, making it easy to extend options in future would be a good approach.

@ross-spencer ross-spencer added the enhancement New feature or request label Jan 10, 2025
@steffenfritz
Copy link
Owner

That is indeed a question I have been asking myself for a long time. Thanks for the input! JSONL looks interesting. Can this also be transferred well to visualization tools, e.g. Kibana/Open Dashboard? I think that would be an exciting path for analysts.

@ross-spencer
Copy link
Author

Can this also be transferred well to visualization tools, e.g. Kibana/Open Dashboard?

I believe it can because Kibana (at least) will often be working on line by line input, e.g. logs. That being said, those two tools are gaps I need to fill in my knowledge.

If I can find capacity again in the coming weeks I'll also try and take a look.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants