Skip to content

Commit

Permalink
Updates
Browse files Browse the repository at this point in the history
  • Loading branch information
SudhaUKumar committed Nov 3, 2023
1 parent 4f4f90c commit 8db3fe2
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions backend/census_to_gsafac/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,6 @@ This is implemented as a django app to leverage existing management commands and
* load raw census data as csv files into an S3 bucket
* create postgres tables from these csv files
* perform any data clean up required to create a table from a csv file
* perforn any ither validations or cleansing, such as verifying the integrity of df files, of data coming into FAC from Census

## Infrastructure changes

Expand All @@ -29,7 +28,7 @@ manage.py raw_to_pg --folder data
manage.py raw_to_pg --clean True
```

* models.py These ought to correspons to the incoming csv files
* models.py These ought to correspond to the incoming csv files
* routers.py This tells django to use a different postgres instance.

* data A folder that contains sample data that we can use for development.
Expand All @@ -40,7 +39,8 @@ manage.py raw_to_pg --clean True

## How to load test Census data into postgres?

1. Download test Census data from https://drive.google.com/drive/folders/1TY-7yWsMd8DsVEXvwrEe_oWW1iR2sGoy into census_to_gsafac/data folder.
1. Download test Census data from https://drive.google.com/drive/folders/1TY-7yWsMd8DsVEXvwrEe_oWW1iR2sGoy into census_to_gsafac/data folder.
NOTE: Never checkin the census_to_gsafac/data folder into github.

2. In the FAC/backend folder, run the following to load csv files from census_to_gsafac/data folder into fac-c2g-s3 bucket.
```bash
Expand Down

0 comments on commit 8db3fe2

Please sign in to comment.