A simple script to maintain a collection of illustrations of your favorite anime character.
This script implements a web crawler, resource downloader and resource manager. By running the script, you can update and maintain a specific collection of illustrations by setting related parameters such as keywords.
What the does script do can be discribed as follows.
First, information of the target illustration is scanned by the crawler (using the pixivpy App-api). Then, a CSV file (illust_data.csv) is used to track all the illustrations that have already been downloaded, which means the illustrations will not be downloaded twice. After that, a download task is generated, and the task is performed by the thread pool. Finally, the CSV file will bem updated and a summary will be displayed.
It's worth mentioning that this script simply implements some lightweight features, just as an automated script designed to maintain a small image collection. There are a lot of problems that are not well solved, just use some 'patches' to make the function work for now.
The idea is merely craw and download some illustrations from pixiv, so it is far from being a reliable and decent tool. So, just use it as a simple wheelbarrow.
- 1. Install related dependencies (pixivpy, etc.).
- 2. Create a new folder and save the script in it.
- 3. Modify the keywords (support multiple keywords). Modify the user name and password used for login (no priority account required).
- 4. Run the script. The illustration will be saved in the illustration subfolder.
- 5. When you need to update the illustration collection, run the script again.
Feel free to upload your code and pull a request. More than anything, please share your idea and give me some precious advices.
For more please check out website: Celestial Tech
Copyright © 2019 Celestial Tech