Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimize fetching of related categories with "clcontinue" #53

Open
j-sal opened this issue Sep 12, 2022 · 1 comment
Open

Optimize fetching of related categories with "clcontinue" #53

j-sal opened this issue Sep 12, 2022 · 1 comment
Assignees
@j-sal
Labels
backburner enhancement It would be nice to have this feature!

Comments

@j-sal
Copy link
Collaborator

j-sal commented Sep 12, 2022

Related-category fetching currently supports up to 500 related categories per api call. Using the clcontinue parameter will allow to fetch all related categories of a given group of titles (up to 50 titles) per api call.
@j-sal j-sal self-assigned this Sep 12, 2022
@j-sal j-sal added enhancement It would be nice to have this feature! backburner labels Sep 12, 2022
@trnstlntk trnstlntk moved this to To be triaged in Structured Data on Commons Sep 27, 2022
@trnstlntk trnstlntk moved this from To be triaged to 🛣 Out of WMF grant scope but on our radar in Structured Data on Commons Sep 27, 2022
@trnstlntk trnstlntk moved this from 🛣 Out of WMF grant scope but on our radar to Smaller feature requests for "later" (tackle somewhere after Oct 2022) in Structured Data on Commons Sep 29, 2022
@j-sal
Copy link
Collaborator Author

j-sal commented Oct 18, 2022

As a workaround while we wait for this pending optimization, we'll decrease from 50 to 10 the limit of files per api call (API_TITLES_LIMIT) to fetch related categories for.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@j-sal j-sal

Labels
backburner enhancement It would be nice to have this feature!
Projects
Structured Data on Commons
Status: Smaller feature requests for "later" (tackle somewhere after Oct 2022)
Milestone
No milestone
Development

No branches or pull requests
1 participant
@j-sal