Skip to content
This repository has been archived by the owner on Jul 5, 2024. It is now read-only.

Add dates to history #884

Merged
merged 1 commit into from
Apr 19, 2024
Merged

Add dates to history #884

merged 1 commit into from
Apr 19, 2024

Conversation

mullertremolo
Copy link
Contributor

Not sure if this is something you're interested in, but I figured I'd toss it your way in case you were. I added this in my fork so that I could find the recently downloaded files without having to recrawl the filesystem every time.


This adds created_at and completed_at columns to the DB.

Uses

This is useful for several possible future uses. For example:

Finding files for cleanup

Bad files are sometimes downloaded during an outage. Such as when Bunker creates a new maintenance video before cyberdrop-dl knows the new path or Etag. If you know when the issue was occurring, this allows one to find which files might be bad and need to be redownloaded.

Prioritizing recently added items

Items that have been incomplete for a long time will most likely never finish, so trying them first just burns through your rate limit. If the more recently added items are tried first they are more likely to succeed before the rate limit is hit.

Details

Column Description
created_at When the item was added to the DB
completed_at When the item was marked completed

The columns are obviously unset for items that predate these additions.

This adds `created_at` and `completed_at` columns to the DB. This is useful for several possible future uses.

# Uses

There are several uses for this info, but the one that comes up pretty often is when bad files are downloaded during an outage before cyberdrop-dl knows about the new Etag (such as when Bunkr creates a new maintenance video). If you know when the issue was occurring, this could help you find which files might be bad and need to be redownloaded.

Knowing when the item was added to the DB can be used to prioritize downloads that are more recently added and therefore more likely to succeed first. Items that have been incomplete for a long time will most likely never finish, so trying them first just burns through your rate limit.

# Details

| Column | Description
|:--------|:-------------
| `created_at` | When the item was added to the DB
| `completed_at` | When the item was marked completed

The columns are obviously unset for items that predate these additions.
@Jules-WinnfieldX Jules-WinnfieldX merged commit 96c7f9a into Jules-WinnfieldX:master Apr 19, 2024
2 checks passed
@mullertremolo mullertremolo deleted the add_created_at_column branch April 19, 2024 18:25
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants