-
git clone https://github.com/chaituprakash06/price-web-scraper.git
-
cd price-web-scraper/
-
npm install
-
Update env variables with Groq and Supabase keys
-
Command or control F "await page.goto('https://www.liquorland.com.au" - line 58. Replace number at end with page you want to scrape (there are 60 results per page, 10 pages total)
-
npm start
Script does not duplicate records, only add news ones and updates old ones. Product id taken from HTML tag on site.