The purpose of this project is to create a more accessible source of records for San Diego DSD Code Violations. The City of San Diego uses a proprietary web application to submit and provide access to various city violations e.g. barking dogs, unpermitted structures, loud music. This project will allow you to:
- Import/Update them into an SQL database
- Automate webscraping of APN(property id) information from the city website
- Allow some tools to export the database into csv format
Installation:
- Install Selenium hint: https://tecadmin.net/setup-selenium-chromedriver-on-ubuntu/
$> pip3 install mysql-connector
$> pip3 install selenium
Run Import:
Step 1: Download all "complaint" records(csv) from https://aca.accela.com/SANDIEGO/Welcome.aspx
Step 2: Import records into the database. Records status will be updated if they already exist. This allows you to keep old records that were deleted and update the status on current records.
$> python3 sddsdce_import.py -f path/to/[CSVFILENAME] -u
Step 3: Now it's time to scrape the site for each records APN number.
$> python3 sddsdce.py
Now that you have a local copy of citations, you can do some analysis with SQL queries. For Example, find all active noise complaints:
mysql $> SELECT * FROM sddsdce WHERE Application Name LIKE "Noise%" AND Status IN ('New','Active Enforcement', 'Active Investigation') ORDER BY Date DESC
Having the APN for each records lets you easily JOIN other records.
@TODO: Create script that exports a nicely formatted csv file to upload to Google Maps.
For Example: https://www.google.com/maps/d/edit?mid=1SQYMWcEzAaNwBHTkds08-RitDERTLalz&usp=sharing