Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Catch and restore vids on quota error #62

Open
victorjzsun opened this issue Jan 31, 2020 · 6 comments
Open

Catch and restore vids on quota error #62

victorjzsun opened this issue Jan 31, 2020 · 6 comments

Comments

@victorjzsun
Copy link
Collaborator

Catch vids not added to playlist on error and store somewhere.

Then add vids first on next run

@JesperDramsch
Copy link
Collaborator

These come back as error in the debugger and should therefore not update the timestamp, which means we add them on the next execution.

@victorjzsun
Copy link
Collaborator Author

Should also handle videos that can't be found (private) as described in #92

@Fabian42
Copy link
Contributor

Fabian42 commented Feb 4, 2024

These come back as error in the debugger and should therefore not update the timestamp, which means we add them on the next execution.

Yes, but that could mean adding the first few over and over again. It would be better if the script noticed the error, stopped the process and updated the timestamp to just after the last video that was added, so that it does not produce a thousand error messages, but only one, and can resume without user input the next time. This would also make the currently somewhat hardcoded limit of 200 videos unnecessary in many situations (but it could be nice to keep for other usecases).
Possible problem: If the script checks for new videos in one channel, adds them all and only then checks the next channel, older videos on the later channels would be skipped. If that is the current logic, it would have to be changed to query all channels first and then add videos in chronological order. I have no idea how complicated that would be to implement.

@victorjzsun
Copy link
Collaborator Author

That is possible at least for getting videos for a channel. With an extra API call, we can retrieve the publish timestamp for each video and as you said, add videos in chronological order. This would require an extra quota usage of 200, aka 4 videos worth, but could be combined with other video-related filters (excluding shorts) that require the API call.
For videos added to a playlist, there still needs to be a custom solution to catch those videos.

@davisjk
Copy link

davisjk commented Apr 10, 2024

I think I've finished implementing this feature here !127, but I would still like to do more testing since I can only really test quota exceeded stuff once a day ;(

@davisjk
Copy link

davisjk commented Apr 10, 2024

My implementation "stores" vids failed due to quota by dynamically updating last updated timestamp and making sure we always add videos to playlist oldest first.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants