I used the AutoScraper package to do the web scraping. It takes into account the input which includes the different types of text boxes that the user wants to scrape, and find the similar type of text. Then we group them accordingly, and create a dataframe. We do the same for the webpages that contain the rest of the contractors' information, and keep concatenating the dataframes. In the end, a csv file is created which contains all the information.
-
Notifications
You must be signed in to change notification settings - Fork 0
aryantandon01/Web-Scraping
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published