Utilizing web scraping packages for python and cheap database hosting at AWS, this script crawls fandom wikis for relevant links to other pages in that wiki, captures them in a python list, then goes one-by-one through that list capturing the HTML of the page and extracting relevant information. Github Actions runs the script.
-
Notifications
You must be signed in to change notification settings - Fork 0
Trinitui/wiki-spider
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Wiki Crawling
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published