Real time progress and logging

[jamesst20]

Similar to https://github.com/kenaniah/sidekiq-status

You can set your Job progress and it is displayed like this

You can also display any kind of information so let's say your Job is syncing 1000 items, you can log stuffs like

1/1000: Already up to date
2/1000: Pushed to the API
....

[mbajur]

That would be awesome to have it and it seems to be relatively easy to implement. I would personally even prefer the store/retrieve API in order to be able to save some sort of artifact data to investigate after job completed but that would probably be part of the same API :) Progress part might be accomplished with Batches towards which i usually gravitate to every time i need to track progress.

I think it might be implemented as a plugin, not part of the core (and merged into core eventually, if author is interested in that). I might play around with that in upcoming days.

[bensheldon]

I'm supportive if you wanted to try to add something like this.

I wonder if the value could be inserted directly into the serialized_params rather than requiring a new database column. As long as it's not being queried/filtered by on the dashboard (aka display only) that could be sufficient

[mbajur]

Wouldn't that be a bit unexpected to keep variables defined/assigned during runtime in the column which name suggests these are input attributes and column which is indeed used exclusively for that? Just thinking...I can imagine getting confused by this 🤔

On one hand, obviously simplicity which is great. But on the other hand one might end up with massive amounts of data assigned on runtime in the column which also holds input params which might be confusing