Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Coomer & Kemono to work with new API #326

Merged
merged 6 commits into from
Nov 27, 2024
Merged

Fix Coomer & Kemono to work with new API #326

merged 6 commits into from
Nov 27, 2024

Conversation

jbsparrow
Copy link
Owner

This PR uses the new Coomer & Kemono APIs to get profile information. It also simplifies four functions into one that serves the same purpose.

@NTFSvolume NTFSvolume self-requested a review November 27, 2024 12:02
Copy link
Collaborator

@NTFSvolume NTFSvolume left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Drop the last commit and then force push.

For this PR ignore the ruff errors on any file that is not the crawlers, to prevent merge conflicts with master

@jbsparrow
Copy link
Owner Author

Sounds good. I was thinking I should also just release this as 5.7.3 before merging into master because we need to finish tests on the stuff on master.

@NTFSvolume
Copy link
Collaborator

That's fine. I will merge the bunkr PR into this first so it gets included in 5.7.3 as well

* refactor: update CDN logic + add soup cdn

* fix: parse custom name for files

bunkr now uses a random uuid for every file as its filename. We can get the actual file name from the soup or from the query parameter `n` on direct links (CDNs)

* fix: remove bunkr from domains to apply `remove_file_id` on

* refactor: give priority to `n` query parameter over file page title

Some old page details may have the uuid as the title instead of the filename. We need to actual filename from `get.bunkr.su`, at the expense of one additional request.
@NTFSvolume NTFSvolume merged commit 3ff244e into master Nov 27, 2024
4 of 6 checks passed
@NTFSvolume
Copy link
Collaborator

You have to push the update manually to pypi from this branch cause the gh-action only works on the master branch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] AttributeError: 'NoneType' object has no attribute 'text'
2 participants