Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create lambda infrastructure #3830

Merged
merged 56 commits into from
Jan 18, 2024
Merged

Create lambda infrastructure #3830

merged 56 commits into from
Jan 18, 2024

Conversation

rdettai
Copy link
Contributor

@rdettai rdettai commented Sep 13, 2023 •
edited
Loading

Description

Closes #3862

How was this PR tested?

  • comparison between custom Docker image and provided Amazon Linux: much lower latency and faster builds with the later, so we'll continue with that one only for now
  • Deployed and running for multiple days
  • Benchmarks that will serve for an upcoming blogpost

@rdettai rdettai self-assigned this Sep 13, 2023
@rdettai rdettai added the biggy Large feature, that is not well designed yet label Sep 13, 2023
@rdettai rdettai marked this pull request as draft September 13, 2023 20:02
@rdettai rdettai force-pushed the lambda-infra branch 4 times, most recently from fc7b230 to 25e441b Compare September 20, 2023 15:34
@rdettai rdettai changed the base branch from main to object-source September 29, 2023 07:06
Base automatically changed from object-source to main October 5, 2023 13:11
@rdettai rdettai force-pushed the lambda-infra branch 4 times, most recently from f626e47 to 5a2a67c Compare October 6, 2023 20:24
@rdettai rdettai force-pushed the lambda-infra branch 3 times, most recently from 25ce27b to 26015e5 Compare November 22, 2023 12:42
rdettai and others added 24 commits January 18, 2024 09:39
@rdettai @fmassot
Address review regarding hdfs index config
3df2583
@rdettai @fmassot
Fix rebase errors
581b703
@rdettai @fmassot
Fix CI errors
7073480
@rdettai @fmassot
Add mypy linter
7c462d3
@rdettai @fmassot
Improve release tag name
448d9cd
@rdettai @fmassot
Try using package pip install in CI
ca8434f
@rdettai @fmassot
Update lambda package version
1780671
@rdettai @fmassot
Enable download using uploaded artifact
8e769d5
@rdettai @fmassot
Add API Gateway construct and refactor cdk code
2566aa1
@rdettai @fmassot
Add staging lifecycle rule
d6255fb
@rdettai @fmassot
Fix SpawnPipeline field after rebase
81b2267
@rdettai @fmassot
Fix unused rust-toolchain.toml
77cb5d3
@rdettai @fmassot
Add tutorial
a1e5db1
@rdettai @fmassot
Final cleanup
fd0ffa2
@rdettai @fmassot
Fix after rebase
79b7f8d
@fmassot
Fix fmt in quickwit-lambda
daffc47
@fmassot
Handle gzip file source.
b7baa3d
@fmassot
Fix clippy.
aee6bd0
@fmassot
Update github action.
3c4aedb
@fmassot
Add telemetry.
8d1bc2e
@rdettai @fmassot
Apply new versioning and skip hdfs decompression
b697f44
@fmassot
Add comment in file source.
6550b56
@fmassot
Add test on skip reader.
10f90e7
@fmassot
Take review comments into account.
7463436
@fmassot fmassot enabled auto-merge (squash) January 18, 2024 09:21
@fmassot fmassot merged commit 1088e57 into main Jan 18, 2024
4 checks passed
@fmassot fmassot deleted the lambda-infra branch January 18, 2024 09:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@fmassot fmassot fmassot left review comments

@fulmicoton fulmicoton fulmicoton approved these changes

Assignees

@rdettai rdettai

Labels
biggy Large feature, that is not well designed yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Create lambda infrastructure
3 participants
@rdettai @fmassot @fulmicoton