large

[monashjg]

Hello Jadchaar,

I want to make an inquiry about downloading from Edgar. I use the CIKs generated from your mapping coding and want to extract all CIKs' 10-k filings. However, python reports an error below: May I know how to possibly fix it? Thank you!

EdgarSearchApiError: Edgar Search API encountered an error: Result window is too large, from + size must be less than or equal to: [10000] but was [10100]. See the scroll api for a more efficient way to request large data sets. This limit can be set by changing the [index.max_result_window] index level setting.. Request payload:
{'dateRange': 'custom', 'startdt': '2000-01-01', 'enddt': '2023-05-23', 'entityName': 'CIK', 'forms': ['10-K'], 'from': 10000, 'q': ''}

[bcambel]

This error returns from Edgar saying that your query returns too many results (more than 10K) so refuses to send it back.
I would suggest to split the work by shorter dates (e.g per request 1y and do 23 queries) rather than 1