Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

downloader import and development #11

Merged
merged 29 commits into from
Aug 16, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
ea1ca90
prelim (hard coded) downloader
craigsteffen Jul 16, 2024
afa0093
dockerfile and requirementt (not tested)
craigsteffen Jul 16, 2024
a5ab899
containerize: work from /data
Jul 18, 2024
5fb48dc
adding downloader
Jul 18, 2024
37fb1e2
adding /data to volumes
Jul 18, 2024
c98e38f
docker.yml update for downloader
craigsteffen Jul 19, 2024
8f0ff95
adjusted indention
asaxton Jul 22, 2024
d4a8790
another adjusted indention
asaxton Jul 22, 2024
ac6ed7f
yet another adjusted indention
asaxton Jul 22, 2024
15a9a9a
hopfully the last adjusted indention
asaxton Jul 22, 2024
3c2b7f5
map_data.json filename fix
craigsteffen Aug 6, 2024
fd35028
downloader working local; tested
craigsteffen Aug 13, 2024
1748d32
downloader URI from env
craigsteffen Aug 13, 2024
edf9dcd
rm cruft in main
craigsteffen Aug 13, 2024
62202b9
fix exeption flow
craigsteffen Aug 13, 2024
9e728b8
URI def cleanup
craigsteffen Aug 13, 2024
8b843ae
removed extra pika calls in process model loop
asaxton Aug 15, 2024
040f1a0
adding some logging
asaxton Aug 15, 2024
639b0ab
print -> logging
craigsteffen Aug 15, 2024
4d6e017
full print cleanup
craigsteffen Aug 15, 2024
d1707f8
wget output -> /dev/null
craigsteffen Aug 15, 2024
123d7c1
making image and json path in rabbit message relative to first two of…
asaxton Aug 15, 2024
feaf6fc
Merge branch 'downloader_initial' of github.com:DARPA-CRITICALMAAS/ui…
asaxton Aug 15, 2024
5ff8149
/dev/null -> /tmp/trash.out
craigsteffen Aug 15, 2024
1ba559e
base location "data" -> ""
craigsteffen Aug 15, 2024
86aba50
wget -> wget -q
craigsteffen Aug 15, 2024
b43dc40
remove redirects
craigsteffen Aug 15, 2024
1f3ac0e
merge main before merging
craigsteffen Aug 16, 2024
0aa400f
Aug 16 release
craigsteffen Aug 16, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions .github/workflows/docker.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ jobs:
- cdrhook
- uploader
- monitor
- downloader
include:
- name: cdrhook
FOLDER: cdrhook
Expand All @@ -35,6 +36,10 @@ jobs:
FOLDER: monitor
PLATFORM: "linux/amd64,linux/arm64"
IMAGE: criticalmaas-monitor
- name: downloader
FOLDER: downloader
PLATFORM: "linux/amd64,linux/arm64"
IMAGE: criticalmaas-downloader

steps:
- uses: actions/checkout@v4
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/pylint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ jobs:
fail-fast: false
matrix:
python-version: ["3.10", "3.11"]
lint-directories: ["./cdrhook", "./tests", "./uploader", "./monitor"]
lint-directories: ["./cdrhook", "./tests", "./uploader", "./monitor", "./downloader"]
steps:
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
Expand Down
5 changes: 5 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,11 @@ All notable changes to this project will be documented in this file.
The format is based on [Keep a Changelog](http://keepachangelog.com/)
and this project adheres to [Semantic Versioning](http://semver.org/).

## [unreleased] - 2024-08-16

### Added
- Added downloader

## [0.8.0] - 2024-08-06

### Added
Expand Down
Loading
Loading