Skip to content

Commit

Permalink
docker.yml update for downloader
Browse files Browse the repository at this point in the history
Adding entries for downloader in parallel with the other containered components.
  • Loading branch information
craigsteffen committed Jul 19, 2024
1 parent 1e807b1 commit dac343c
Show file tree
Hide file tree
Showing 2 changed files with 21 additions and 2 deletions.
7 changes: 6 additions & 1 deletion .github/workflows/docker.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,8 @@ jobs:
- cdrhook
- uploader
- monitor
include:
- downloader
include:
- name: cdrhook
FOLDER: cdrhook
PLATFORM: "linux/amd64,linux/arm64"
Expand All @@ -34,6 +35,10 @@ jobs:
FOLDER: monitor
PLATFORM: "linux/amd64,linux/arm64"
IMAGE: criticalmaas-monitor
- name: downloader
FOLDER: downloader
PLATFORM: "linux/amd64,linux/arm64"
IMAGE: criticalmaas-downloader

steps:
- uses: actions/checkout@v4
Expand Down
16 changes: 15 additions & 1 deletion downloader/CM_B_downloader.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,21 @@
# file system

#my_data_dir="/projects/bbym/shared/CDR_processing/pipeline_processing_003"
my_data_dir="/data"
try:
my_local_dir=os.environ['CMAAS_LOCAL_DATA_DIR']
my_data_dir=my_local_dir
except KeyError:
my_data_dir="/data"

print(f'Data dir is {my_data_dir}')

try:
test_file_filename=os.environ['CMAAS_LOCAL_DIR_TEST_FILE']
dir_test_file=os.path.join(my_data_dir,test_file_filename)
open(dir_test_file,'a')
except KeyError:
a='2'


print("")
print("CriticaMAAS B-stage downloader")
Expand Down

0 comments on commit dac343c

Please sign in to comment.