Scrapy the detail and lowest price of amazon best seller product by python spider
In developing........, welcome to join !
Some code has apply to pricejot.com, I will update the project in next month; https://www.pricejot.com/
install python3.6 pip install -r requirements.txt
if you are contributer recommend to php install pipreqs run "pipreqs /path/to/project" if you add some packages in your code
- list page https://www.amazon.com/Best-Sellers/zgbs/ update every two hours.
- price detail page https://www.amazon.com/gp/offer-listing/B01FCTAEK4
- Scrapy the reviews by asin https://www.amazon.com/Libratone-ONE-Click-Caribbean-Green/product-reviews/B00ZU33BBC
- Scrapy the detail by asin pool(50%)
- Find the bad comment customer·s email and order id（considering to open source）
- Scrapy the category of level 1 from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
- Scrapy the asin in the best seller asin from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
- Scrapy the keywords rank by asin
- python https://bop.molun.net/
- scrapy https://docs.scrapy.org/en/latest/
Email：[email protected] Wechat:dzdzhuang
Based on Python 3.6
The MIT License(http://opensource.org/licenses/MIT)
Please feel free to use and contribute to the development.
If you have any ideas or suggestions to improve Amazon-scrapy, welcome to submit an issue/pull request.