Skip to content
upload-and-deploy

Decouple S3 to JSON workflow from JSON to Parquet workflow #407

Sign in to view logs

Decouple S3 to JSON workflow from JSON to Parquet workflow

Decouple S3 to JSON workflow from JSON to Parquet workflow #407

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Run pre-commit hooks against all files
11s
Runs unit tests that are not dependent on aws-glue package resources
1m 14s
Upload files to S3 bucket in development
1m 48s
Build and push testing docker images to the pytest ECR repository. (aws_glue_3, tests/Dockerfile....
2m 23s
Build and push testing docker images to the pytest ECR repository. (aws_glue_4, tests/Dockerfile....
4m 3s
Run Pytest unit tests for AWS glue (aws_glue_3)
2m 11s
Run Pytest unit tests for AWS glue (aws_glue_4)
6m 24s
Deploys branch using sceptre
2m 22s
Triggers ETL workflow with S3 test files
2m 2s
Deploys to staging of prod using sceptre
0s
Triggers staging workflow with production data
0s
22m 38s