-
|
Title. By scrape limit I mean the number of pages the script scrapes from the 3 sources in a single run. Why is the default 5? Is it likely that one of the sites (incl. Udemy) detects the bot if I increase it? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
|
Default is 5 because after 5 pages you are most likely going to hit links that are expired. You can increase the limit for first run. |
Beta Was this translation helpful? Give feedback.
-
|
I see, thanks! |
Beta Was this translation helpful? Give feedback.
-
|
Glad to be of help. |
Beta Was this translation helpful? Give feedback.
Default is 5 because after 5 pages you are most likely going to hit links that are expired.
You can increase the limit for first run.