This is the project root for the Data Refinery Foreman. This project is responsible for surveying a list of sources to discover new data, scheduling those surveying tasks, queuing jobs for downloading and processing, and managing those jobs.
To run the surveyor in a Docker container just run ./run_management_command.sh
.
You can also start an interactive python interpreter by running ../scripts/run_shell.sh
.
This interpreter will actually be running within the surveyor Docker container
with the environment configured appropriately.
To run all tests for the project just run ./run_tests.sh
. This script will
accept any arguments that are valid for python -m unittest
.