ci: replace build-artifact-s3 with new workflow, add local tpch benches #3864
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds a few things:
publish-dev-s3.yml
workflow to replacebuild-artifact-s3.yml
with one that uses the unified build process inbuild-wheel.yml
as well as serve a Python simplified repository API through Cloudfrontbenchmark-local-tpch.yml
which runs benchmarks for local TPC-H at 100SF. It will automatically build and publish if necessary, and is run both manually and as a nightly testnightlies-tests.yml
and add local TPC-H benchmarksEventually I plan on moving all of our current nightly benchmarks to our main repo, and get them publishing to Google sheets. Then we can deprecate our postgres/looker setup as well as our K8s ray cluster