Skip to content
This repository has been archived by the owner on Sep 30, 2021. It is now read-only.

Fix overjump of entries #6

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Fix overjump of entries #6

wants to merge 1 commit into from

Conversation

sarahtartaruga
Copy link

@sarahtartaruga sarahtartaruga commented Dec 10, 2020

There is a bug which shrinks the scraped results down to the floored half amount of results. E.g. for an Instagram channel with 75 entries, only 37 results are scraped. This is due to the double access of the Iterator "chunk": by using access for looping through the Iterator, and by using the next() function, the Iterator drops 2 items instead of 1. This way, only every second result gets scraped. I resolved it by using the for-loop's iterator from the Iterator item instead of calling next().

@stijn-uva
Copy link
Member

stijn-uva commented Dec 10, 2020

Ouch, classic mistake. Thanks a lot! I'll merge this when I have a moment to test the revised version.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants