Skip to content

Commit

Permalink
Merge pull request #115 from jbsparrow/SimpCity-Scraping-Disclaimer-Docs
Browse files Browse the repository at this point in the history
Simp city scraping disclaimer docs
  • Loading branch information
jbsparrow authored Sep 21, 2024
2 parents bfd8d64 + bde4259 commit 42c002f
Showing 1 changed file with 10 additions and 9 deletions.
19 changes: 10 additions & 9 deletions docs/simpcity-support-dropped.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,21 +8,22 @@ description: >-

### Removal of SimpCity Scraping Support

Support for scraping _SimpCity_ has been removed temporarily. I understand this may disappoint some users, but hopefully after reading this, you will understand why I made this decision. Following the recent DDOS attacks, SimpCity has implemented the following security measures to protect their website:

* _SimpCity_ has implemented a DDOS-Guard browser check.
Support for scraping SimpCity has been removed temporarily. I understand this may disappoint some users, but hopefully after reading this, you will understand why I made this decision. Following the recent DDOS attacks, SimpCity has implemented the following security measures to protect their website:

* SimpCity has implemented a DDOS-Guard browser check.
* Access is now restricted to [whitelisted email domains](https://simpcity.su/threads/emails-august-2024.365869/).
* [New rate limits](https://simpcity.su/threads/rate-limit-429-error.397746/) have been introduced to protect the site.

### Why Scraping _SimpCity_ Has Been Disabled
### Why Scraping SimpCity Has Been Disabled

_Cyberdrop-DL_ allows users to scrape a model’s entire thread quickly, downloading large amounts of content. While convenient, this has created several issues:
Cyberdrop-DL allows users to scrape a model’s entire thread quickly, downloading large amounts of content. While convenient, this has created several issues:

* Large-scale scraping can result in downloading content you may never view.
* Such scraping puts a significant strain on _SimpCity_’s servers, particularly during DDOS attacks.
* Scraping provides no direct benefit to _SimpCity_, and in light of these attacks, they have chosen not to support automated scraping.
* Such scraping puts a significant strain on SimpCity’s servers, particularly during DDOS attacks.
* Scraping provides no direct benefit to SimpCity, and in light of these attacks, they have chosen not to support automated scraping.

For these reasons, _SimpCity_ has removed the _Cyberdrop-DL_ thread, and I have disabled scraping for their site in order to reduce the strain on their servers.
For these reasons, SimpCity has removed the Cyberdrop-DL thread, and I have disabled scraping for their site in order to reduce the strain on their servers.

### How to Reduce the Impact of Cyberdrop-DL Usage

Expand All @@ -34,12 +35,12 @@ Additionally, I have made adjustments to the default rate-limiting settings to f

### Usage Best Practices

I encourage you to be mindful of how you use _Cyberdrop-DL_. Here are some tips to minimize the strain on websites:
I encourage you to be mindful of how you use Cyberdrop-DL. Here are some tips to minimize the strain on websites:

* Avoid running multiple scraping sessions repeatedly in a short span of time.
* Regularly clean up your URLs file by removing links you no longer need, and reducing how often you run the program.
* Be selective with what you download. It’s helpful to quickly scan content to avoid downloading files you'll delete later.

### Alternative to Scraping SimpCity

If you wish to continue downloading from _SimpCity_, you can use a Tampermonkey script like this one: [SimpCity Tampermonkey Forum Downloader](https://simpcity.su/threads/forum-post-downloader-tampermonkey-script.96714/).
If you wish to continue downloading from SimpCity, you can use a Tampermonkey script like this one: [SimpCity Tampermonkey Forum Downloader](https://simpcity.su/threads/forum-post-downloader-tampermonkey-script.96714/).

0 comments on commit 42c002f

Please sign in to comment.