Skip to content
This repository has been archived by the owner on Sep 4, 2024. It is now read-only.

Build hierarchical source model #5

Open
duhaime opened this issue Jan 5, 2018 · 0 comments
Open

Build hierarchical source model #5

duhaime opened this issue Jan 5, 2018 · 0 comments

Comments

@duhaime
Copy link
Member

duhaime commented Jan 5, 2018

Right now if a user queries for a term that appears more than 3000 times in a single day of their requested source, the wsk module gives up, as its only strategy for reducing the number of responses to a given query is is subdivide the date range (e.g. reduce the number of days to query until we hit the quantum, a single day).

We could instead provide a workaround for queries that have > 3000 hits in a single day. Given a request for a source id, we can find all of the publications in that source. Then we can identify the other source ids that contain the same publications, and can query those instead. In this way we can piece together the publication titles that comprise a source id.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant