Release 0.1.0
What's Changed
- Update build script by @williamputraintan in #1
- Pre commit hook Added by @williamputraintan in #3
- Improve project setup by @victorskl in #10
- Refactor setup schemaregistry by @reisingerf in #18
- Implemented externalise config constants pass-down as props pattern by @victorskl in #19
- Bumped dependencies and fixed lints by @victorskl in #20
- Refactored project setup on initial structure by @victorskl in #13
- Reinforced DevSecOps setup with scanners TruffleHog & GGShield by @victorskl in #21
- Serverless MySQL by @williamputraintan in #22
- Refactored OrcaBus Stateless component with MicroService by @victorskl in #23
- Init CDK-Pipeline by @williamputraintan in #24
- Updated pipeline to use UMCCR AWS accounts by @victorskl in #25
- Improved Django template skel profile by @victorskl in #26
- Updated SequenceRunStateChange Event schema with proper envelope by @victorskl in #29
- Implemented Sequence Run Manager microservice app by @victorskl in #28
- FileManager microservice Rust skel by @brainstorm in #27
- Improved SequenceRunStateChange Event schema by @victorskl in #30
- Improved Django Skel by removing base setting as default by @victorskl in #31
- Rust skel fixups by @brainstorm in #33
- Improved GHA CI build and local dev DX by @victorskl in #32
- Implemented Sequence Run Manager BSSH event processing by @victorskl in #36
- Bumped baseline toolchain Python and Node dependencies by @victorskl in #41
- Init Metadata Manager by @williamputraintan in #35
- Initial dev for the Metadata Manager by @williamputraintan in #42
- Bump webpki from 0.22.0 to 0.22.1 in /skel/rust-api by @dependabot in #43
- Bump webpki from 0.22.1 to 0.22.2 in /skel/rust-api by @dependabot in #44
- Filemanager: S3 events persistence by @brainstorm in #37
- Bump django from 4.2.3 to 4.2.7 in /skel/django-api/src by @dependabot in #51
- Bump werkzeug from 2.3.6 to 3.0.1 in /skel/django-api/src by @dependabot in #48
- Bump axios from 1.4.0 to 1.6.1 in /lib/workload/stateless/metadata_manager/src by @dependabot in #52
- Bump django from 4.2.3 to 4.2.7 in /lib/workload/stateless/sequence_run_manager/src by @dependabot in #50
- Bump @babel/traverse from 7.21.4 to 7.23.2 by @dependabot in #46
- Bump django from 4.2.3 to 4.2.7 in /skel/django-proc/src by @dependabot in #49
- Bump @babel/traverse from 7.22.8 to 7.23.2 in /lib/workload/stateless/metadata_manager/src by @dependabot in #45
- Bump werkzeug from 2.3.6 to 2.3.8 in /lib/workload/stateless/sequence_run_manager/src by @dependabot in #55
- Rust skel bump by @brainstorm in #56
- Refresh and fix some AWS Rust SDK API changes by @brainstorm in #58
- Remove _deprecated by @brainstorm in #59
- Fix SQS events, update localstack, speed up compilte/test cycle w/ sc… by @brainstorm in #61
- Fix sqs events upgrade localstack by @brainstorm in #62
- Bump rustix from 0.38.13 to 0.38.21 in /lib/workload/stateful/filemanager by @dependabot in #60
- [doc] Add Rust SCCACHE to speed up local builds by @brainstorm in #63
- Simplify local development and debugging setup by @brainstorm in #65
- More idempotent scripts by @brainstorm in #66
- Bump openssl from 0.10.59 to 0.10.60 in /skel/rust-api by @dependabot in #64
- Init for MetadataManager by @williamputraintan in #67
- Filemanager: fix ingestion/deployment by @brainstorm in #74
- filemanager: setup testing by @mmalenic in #75
- Remove the lock and bump up the toml by @brainstorm in #78
- filemanager: deploy changes and fixes by @mmalenic in #79
- Added Swagger UI and Dependencies Bumped by @williamputraintan in #83
- Gitpod by @andrewpatto in #80
- Project setup refactor by @victorskl in #87
- Metadata Manager Restructuring by @williamputraintan in #89
- feat: de-duplicate events at the database level by @mmalenic in #88
- Update RDS Construct by @williamputraintan in #91
- build(deps): bump h2 from 0.3.21 to 0.3.24 in /lib/workload/stateful/filemanager by @dependabot in #84
- Initiate CDK Pipeline by @williamputraintan in #92
- feat(filemanager): move SQS and DLQ to stateful stack by @mmalenic in #101
- feat(filemanager): ensure events are ingested in the correct order by @mmalenic in #93
- refactor: filemanager deployment code and Makefile by @mmalenic in #98
- build(deps): bump django from 4.2.7 to 4.2.10 in /skel/django-proc/src by @dependabot in #95
- build(deps): bump django from 4.2.7 to 4.2.10 in /lib/workload/stateless/sequence_run_manager by @dependabot in #96
- build(deps): bump django from 4.2.7 to 4.2.10 in /skel/django-api/src by @dependabot in #97
- build(deps): bump undici from 5.25.2 to 5.28.3 in /lib/workload/stateless/metadata_manager by @dependabot in #105
- build(deps): bump ip from 2.0.0 to 2.0.1 by @dependabot in #107
- build(deps): bump ip from 2.0.0 to 2.0.1 in /lib/workload/stateless/metadata_manager by @dependabot in #108
- fix: event source name rule should be an array by @mmalenic in #112
- fix: queue service name and secret name by @mmalenic in #118
- fix(filemanager): deserialize event bridge messages by @mmalenic in #121
- fix(filemanager): correctly deal with null version_id by @mmalenic in #125
- postgres-manager: Initiate postgres-manager by @williamputraintan in #126
- fix(postgres-manager): failing unit test from
cdk-nag
by @williamputraintan in #128 - fix(filemanager): re-run sqlx prepare with all targets by @mmalenic in #124
- fix(filemanager): sqlx queries by @mmalenic in #134
- Fix: Codebuild UnitTest by @williamputraintan in #132
- codepipeline notication by @williamputraintan in #130
- fix(filemanager): ingest constraints by @mmalenic in #136
- fix(filemanager): query files by @mmalenic in #142
- Postgres Manager Enhancement by @williamputraintan in #149
- Added sequence_run_manager database config by @victorskl in #151
- refactor: swap rust function by @mmalenic in #152
- fix(pipeline): install Rust for unit tests by @mmalenic in #154
- fix: pipeline error caused by filemanager containerized build by @mmalenic in #156
- Implemented SequenceRunManager app deployment by @victorskl in #155
- Fixed SequenceRunManager architecture to ARM64 by @victorskl in #163
- Update Readme and Refactor Pipeline Code by @williamputraintan in #157
- Trimmed down the sequence_run_manager by @victorskl in #171
- Fixed deployment by removing sequence_run_manager HttpStage by @victorskl in #172
- build(deps): bump postgres versions to match RDS instance by @mmalenic in #173
- fix: filemanager uuids by @mmalenic in #161
- Improved sequence_run_manager API Gateway setup by @victorskl in #175
- Fixed sequence_run_manager endpoint unit test by @victorskl in #181
- refactor: filemanager stack by @mmalenic in #180
- fix(filemanager): let docker decide on container names by @mmalenic in #183
- fix(filemanager): use docker run to get unique containers by @mmalenic in #184
- fix(filemanager): silence Makefile output and trim lines by @mmalenic in #187
- fix(filemanager): add uuid to target directory to avoid concurrency errors by @mmalenic in #189
- Update Stateless Pipeline Test by @williamputraintan in #194
- feat(filemanager): iam rds credentials by @mmalenic in #196
- build(deps): bump h2 from 0.3.25 to 0.3.26 in /lib/workload/stateless/filemanager by @dependabot in #198
- fix(filemanager): ssm parameter in tests by @mmalenic in #200
- Metadata Manager Depoyment by @williamputraintan in #199
- Implemented TokenService stack as stateful deployable artefact by @victorskl in #197
- Feature/ica event pipe by @reisingerf in #193
- Added Token Service policy construct by @victorskl in #203
- Fixed Token Service policy syntax by @victorskl in #205
- Fix SNS ARN format by @reisingerf in #206
- Fixed Token Service policy for Lambda VPC by @victorskl in #207
- Fixed Token Service Python import arrangement by @victorskl in #210
- Fixed Token Service initial value json parsing by @victorskl in #211
- Rotatable Db Secret Manager by @williamputraintan in #209
- Fix Stateful Test by @williamputraintan in #212
- feat: provider construct and filemanager migration by @mmalenic in #213
- build(deps): bump tar from 6.2.0 to 6.2.1 by @dependabot in #215
- Finalised Token Service fixes and improvement by @victorskl in #214
- chore: Split Stateful Single Stack to Multi Stack by @williamputraintan in #216
- fix: test-stateful by @williamputraintan in #220
- fix(filemanager) change i32 to i64 to support bigger sizes by @mmalenic in #218
- Fixed Token Service initial value json parsing by @victorskl in #227
- chore: remove parent (of µ-app) stack in
cdk.Stage
and Refactor by @williamputraintan in #221 - chore: splitting config file by @williamputraintan in #231
- fix: property naming by @williamputraintan in #232
- Updated Token Service documentation by @victorskl in #234
- Updated SequenceRunManager deployment by @victorskl in #235
- Update SQS policy to allow ICA to send notifications. by @reisingerf in #236
- Create TES Basespace Upload manager service by @alexiswl in #186
- build(deps): bump rustls from 0.21.10 to 0.21.11 in /lib/workload/stateless/stacks/filemanager by @dependabot in #239
- add universal events archiver function by @raylrui in #226
- feat(filemanager): add external id and attribute column by @mmalenic in #228
- Fix docker options for filemanager by @alexiswl in #242
- Added feature icav2 copy batch state machine by @alexiswl in #143
- Fixed ARM architecture for bs-upload & icav2-batch-copy stacks by @victorskl in #246
- Fix event duplication And Remove Server access logs when archiving to bucket by @raylrui in #247
- Fixed cdk-nag for bs-upload & icav2-batch-copy stacks by @victorskl in #248
- feature: Custom Resourcing PSQL commands by @williamputraintan in #249
- fix: postgres manager test by @williamputraintan in #251
- fix(PostgresManager): 2nd attempt fix dependencies issue by @williamputraintan in #252
- fix(PostgresManager): yarn.lock update by @williamputraintan in #253
- Disable Postgres Manager Test by @williamputraintan in #255
- Objects apigw API by @brainstorm in #115
- build(deps): bump django from 4.2.10 to 4.2.11 in /skel/django-api/src by @dependabot in #164
- build(deps): bump django from 4.2.10 to 4.2.11 in /skel/django-proc/src by @dependabot in #165
- event archive bucket policy modification according different env by @raylrui in #250
- custom event bus archiver props and stateful unit testing fixing by @raylrui in #256
- build(deps): bump idna from 3.6 to 3.7 in /lib/workload/stateless/stacks/bs-runs-upload-manager/layers by @dependabot in #240
- build(deps): bump idna from 3.6 to 3.7 in /lib/workload/stateless/stacks/icav2-copy-batch-utility/layers by @dependabot in #243
- build(deps): bump django from 5.0.0 to 5.0.3 in /lib/workload/stateless/stacks/metadata-manager/deps by @dependabot in #230
- chore: Pipeline Refactor by @williamputraintan in #254
- (hotfix): filemanager stack static name, otherwise goes 'OrcaBusAPI-u… by @brainstorm in #261
- Feature/bssh icav2 fastq copy manager by @alexiswl in #144
- build(deps): bump idna from 3.6 to 3.7 in /lib/workload/stateless/stacks/bssh-icav2-fastq-copy-manager/layers by @dependabot in #262
- Deprecated initial POC event schemas by @victorskl in #258
- Fixed basespace runs upload input field typo
run_volume_name
by @victorskl in #263 - Fix: PG-Manager Build Install by @williamputraintan in #264
- Refactored and deployed event schema stack by @victorskl in #266
- Fixed stateful unittest constants
schemaRegistryName
by @victorskl in #267 - fix(metadata-manager): Fix API GW && Custom Resource for Migration Lambda by @williamputraintan in #268
- Fix(MetadataManager): Deployment Test Supression by @williamputraintan in #269
- Fix(metadata-manager): Custom Resource Deployment by @williamputraintan in #271
- Implemented WorkflowRunStateChange schema by @victorskl in #272
- Feature/cttso icav2 step function branch by @alexiswl in #145
- Use 'currentVersion' for lambda object to resolve the cdk nag issue by @alexiswl in #281
- build(deps-dev): bump idna from 3.6 to 3.7 in /lib/workload/stateless/stacks/cttso-v2-pipeline-manager/layers by @dependabot in #280
- build(deps): bump werkzeug from 2.3.8 to 3.0.3 in /lib/workload/stateless/stacks/sequence-run-manager/deps by @dependabot in #273
- Bumped SequenceRunManager dependencies by @victorskl in #278
- build(deps): bump werkzeug from 3.0.1 to 3.0.3 in /skel/django-api/src by @dependabot in #275
- build(deps): bump werkzeug from 2.3.8 to 3.0.3 in /lib/workload/stateless/stacks/metadata-manager/deps by @dependabot in #274
- Remove cdk.out assets to prevent synth output by @alexiswl in #286
- Updated Basespace Runs Upload Manager to align with SequenceRunStateChange schema by @victorskl in #279
- Updated SequenceRunManager service to align with SequenceRunStateChange by @victorskl in #277
- Updated django-api skel profile by @victorskl in #288
- Revert "Remove cdk.out assets to prevent synth output" by @alexiswl in #287
- Fixed WorkflowRunStateChange schema required field by @victorskl in #291
- feat: Refine Testing Configuration by @williamputraintan in #290
- icav2 event translator by @raylrui in #204
- Fix ica event translator build issue by @raylrui in #292
- Feat: Limit PR Testing by @williamputraintan in #296
- Refined WorkflowManager database models by @victorskl in #306
- feat: filemanager inventory by @mmalenic in #304
- Updated SequenceRunStateChange schema by @victorskl in #309
- feat(filemanager): add Parquet and Orc support to inventory by @mmalenic in #310
- Updated WorkflowRunStateChange schema by @victorskl in #308
- Added documentation on Event Schema and Namespace guide by @victorskl in #307
- Feature/data schema by @reisingerf in #311
- Deprecated skel profile DJANGO_PROC by @victorskl in #318
- Added data schema registry and data schema deployment stack by @victorskl in #320
- fix: filemanager delete marker by @mmalenic in #321
- Add request for workflow manager database by @reisingerf in #324
- Feature/workflow manager by @reisingerf in #325
- Update libumccr version to 0.4.0rc3 by @reisingerf in #327
- update translator service to bclconvert manager by @alexiswl in #328
- Fix workflow manager issues when handling WRSC events by @reisingerf in #329
- Refactored schemas to JSON Schema by @victorskl in #330
- update translator service to bclconvert manager by @raylrui in #299
- update the dynamodb table name for conflict by @raylrui in #334
- update docs for bcl convert manger data by @raylrui in #335
- fix bugs for non-succeed event and update unit by @raylrui in #336
- Bugfix, workflow run statechange omitted workflowRunName from workflowmanager event by @alexiswl in #333
- Move from trial project to dev project for umccr-development account by @alexiswl in #340
- Stacky Glue / BCLConvert InteropQC / cttsoV2 Fixes / Deprecate ICAv2 Copy Batch Utility by @alexiswl in #337
- Updated the sscheck api url from the ssm parameter by @alexiswl in #338
- Convert api-url to api-domain by @alexiswl in #341
- fix generate-db-uuid params issue by @raylrui in #342
- Fixed WorkflowManager allow WRSC Payload nullable by @victorskl in #343
- User reference will always start with 'umccr__automated__workflowName` by @alexiswl in #345
- refactor: filemanager ingest by @mmalenic in #346
- Updated BasespaceRunsUploadManager event rule with SequenceRunManager convention by @victorskl in #348
- Updated SequenceRunManager with latest convention change request by @victorskl in #347
- Added FileManager EventSource with ICAv2 BYOB pipeline cache buckets by @victorskl in #351
- build(deps-dev): bump requests from 2.31.0 to 2.32.2 in /lib/workload/stateless/stacks/cttso-v2-pipeline-manager/layers by @dependabot in #319
- build(deps): bump requests from 2.31.0 to 2.32.0 in /lib/workload/stateless/stacks/bs-runs-upload-manager/layers by @dependabot in #312
- Bump braces from 3.0.2 to 3.0.3 in /lib/workload/stateless/stacks/postgres-manager by @dependabot in #352
- Use hyphens over underscores when generating icav2 paths by @alexiswl in #350
- fix(filemanager): make
HeadObject
optional by @mmalenic in #355 - Bump urllib3 from 2.2.1 to 2.2.2 in /lib/workload/stateless/stacks/bs-runs-upload-manager/layers by @dependabot in #356
- Bump urllib3 from 2.2.1 to 2.2.2 in /lib/workload/stateless/stacks/bssh-icav2-fastq-copy-manager/layers by @dependabot in #358
- Upgraded yarn v4 and bumped dependencies by @victorskl in #360
- Bump urllib3 from 2.2.1 to 2.2.2 in /lib/workload/stateless/stacks/cttso-v2-pipeline-manager/layers by @dependabot in #363
- Feature(metadata-manager): Scheduled Sync from Metadata-Manager by @williamputraintan in #362
- Remove wrongly commented clean target by @brainstorm in #364
- Custom Domain for Microservice by @williamputraintan in #365
- Fixed BclConvertManager runtime requirement config by @victorskl in #368
- Fixed ICAv2 event handle StepFunction Payload schema by @victorskl in #370
- Fixed ICAv2 event rule prefix matching by @victorskl in #371
- Fixed ctTSOv2 workflowVersion to 2.5.0 by @victorskl in #369
- Fixed WorkflowManager WRSC event processing to handle optional Payload by @victorskl in #367
- Fixed Token Service JWT validation logic by @victorskl in #379
- feat: filemanager sea-orm entities by @mmalenic in #357
- Fix: add-CDK-context-for-role-assumption-across-accounts by @raylrui in #381
- Use instrument run id instead of run id for bclconvert interop qc pipeline by @alexiswl in #374
- Promotion for
postgres-manager
to the stateful stack group (from stateless) by @williamputraintan in #382 - Fix: STG Deployment by @williamputraintan in #383
- feat: basic filemanager query API by @mmalenic in #372
- fix(filemanager): avoid using to_url_lossy when loading database credentials by @mmalenic in #385
- Feat: Deploy Stateless to Gamma by @williamputraintan in #386
- Fixed WorkflowManager event rule syntax by @victorskl in #387
- feat: deploy filemanager API and add OpenAPI docs by @mmalenic in #388
- Released Stateful Pipeline to Production by @victorskl in #389
- Released Stateless Pipeline to Production by @victorskl in #390
- feat: filemanager pagination by @mmalenic in #392
- fix(filemanager): sequencer ordering by @mmalenic in #396
- fix: filemanager e_tag quoting by @mmalenic in #399
- Fixed ICAv2 JWT secret name production by @victorskl in #400
New Contributors
- @reisingerf made their first contribution in #18
- @brainstorm made their first contribution in #27
- @andrewpatto made their first contribution in #80
- @raylrui made their first contribution in #226
Full Changelog: poc...0.1.0