Skip to content

Latest commit

 

History

History
16 lines (9 loc) · 709 Bytes

README.md

File metadata and controls

16 lines (9 loc) · 709 Bytes

Ad Sites Crawler

This is a site crawler written based on crawling the iranian ad sites. For now, it only supports Divar.

Run

  • Install docker and docker-compose.
  • Run sysctl vm.overcommit_memory=1 or set vm.overcommit_memory=1 in /etc/sysctl.conf on your host and reboot your system.
  • Copy .env.sample file to .env and change the values as you want.
  • Run docker-compose up --build.

Note

  • You should create a IFTTT webhook (3 value option) and set your account information on .env to get a notification when the crawler finds a new/changed ad.