animal-crossing-scraper

Python webscraper to extract various data of the game Animal Crossing - New Horizons.

Data source: https://animalcrossing.fandom.com/wiki/

Feel free to use the JSON files! Some of the pages on the wiki are incomplete, so if some data is missing please check back later.

Output

All JSON files are stored in /data

-- Completed --
/museums

bugs.json
fish.json
fossils.json
artwork.json

/characters

villagers.json

/flowers

availability.json
genetics_others.json
genetics_rose.json
hybridization_advanced.json
hybridization_simple.json

/music

-- Incomplete --
/crafting

tools.json
equipments.json
housewares.json
miscellaneous.json
wallMounteds.json
wallpaperRugsFloorings.json
others.json

/clothing

tops.json
bottoms.json
dresses.json
hats.json
accessories.json
socks.json
shoes.json
bags.json
umbrellas.json

JSON fields

Price: -1 indicates the data is not available yet.

Set Up

In the animal-crossing-scraper root directory, clone the project using

git clone https://github.com/sungyeonu/animal-crossing-scraper.git

Set up a virtual environment

python -m venv venv

Activate the virtual environment

Windows: venv\Scripts\activate
Linux/Mac: source venv/bin/activate

Install required packages

pip install -r requirements.txt

Usage

To run:

python scrapy.py

To test:

python test_scrapy.py