wga-scraper

A bot that automatically downloads all the images listed in the .xlsx Excel-Sheet and then lables them accordingly.

The source for the images can be found here.

Usage 📲

Head over to the Releases Page and download the latest .zip
Proceed to unzip an open up a terminal
Move into the directory you unzipped the file into and run the following:

java -jar .\wga-scraper-0.2-jar-with-dependencies.jar

^{^{Note: This has only been tested with Java 17 (recommended) and Java 8. Other versions might behave differently.}}

Building from Source 🧱

git clone the repo
Navigate into ./studio.optinux.scraper/
Make sure that you have Maven installed
Open up a terminal and run mvn package to compile the application
You will find the result in ./studio.optinux.scraper/target

TODO: 📝

Implement the optional use of proxies in order to circumvent ratelimiting / ip-banning
Make it use the entire database in its raw form instead of relying on an already trimmed down version

^{^{see branch currently_broken for my failed attempts regarding this}}

this somehow took ~8h to do due to me having to pretty much learn 80% of this from scratch lol