Skip to content

Latest commit

 

History

History
16 lines (13 loc) · 499 Bytes

README.md

File metadata and controls

16 lines (13 loc) · 499 Bytes

scrapweb-to-postgre

  • Python
  • Django
  • Postgres
  • BeautifulSoup4
  • nginx
  • gunicorn

Primary reason was to collect and analyze data as well as get familiar with the tools used.

check_deptford.py collects the data once a day and submits it to the server.

Server then stores:
  • RawData - raw data with timestamp as unique key.
  • UnitInformation - apartment specific data with apartment name as unique key.
  • UnitHistory - unit name with price and status. [when status or price has changed]