Skip to content

Navigation Menu

Explore
By company size
By use case
By industry
View all solutions
Topics
- AI
- DevOps
- Security
- Software Development
- View all
Explore
- GitHub Sponsors
  Fund open source developers
- The ReadME Project
  GitHub community articles
Repositories
- Enterprise platform
  AI-powered developer platform
Available add-ons
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

quickwit-oss / quickwit Public

Notifications You must be signed in to change notification settings
Fork 415
Star 9.5k

Code
Issues 624
Pull requests 53
Discussions
Actions
Projects 1
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Security
Insights

Add File source with SQS notifications#5148

Merged

rdettai merged 51 commits intomainquickwit-oss/quickwit:mainfrom sqsquickwit-oss/quickwit:sqsCopy head branch name to clipboard

Jul 31, 2024

+4,968-773

Conversation Commits51 (51)Checks Files changed

Commits

Commits on Jul 31, 2024

Refactor file source
rdettai
committed
More explicit reponse for read_batch
rdettai
committed
Fix clippy
rdettai
committed
Remove batch logic from DocFileReader
rdettai
committed
Address styling comments
rdettai
committed
Replace FileSourceParams path with URI
rdettai
committed
Additional URI related cleanup
rdettai
committed
Fix unit tests to now use the URI
rdettai
committed
Add queue source with SQS implementation
rdettai
committed
Fix the publish_token strategy
rdettai
committed
Fix never-used warnings
rdettai
committed
Fix unit tests
rdettai
committed
Abort visibility task after acknowledging
rdettai
committed
Address smaller review comments
rdettai
committed
Shorten visibility extension task
rdettai
committed
Fix pulsar tests
rdettai
committed
Adjustments after rebase
rdettai
committed
Move object backed source to file source
rdettai
committed
Simpler flow for adhoc file processing
rdettai
committed
Fix tests and refactor batch creation to BatchReader
rdettai
committed
Add max_messages param to Queue.receive
rdettai
committed
Move use_shard_api to the metastore crate
rdettai
committed
Dedup within batches
rdettai
committed
Improve visibility task
rdettai
committed
Re-acquire partitions aggressively
rdettai
committed
Address simpler review comments
rdettai
committed
Add test for visibility actor (failing)
rdettai
committed
Fix visibility actor drop
rdettai
committed
Fix reader edge case
rdettai
committed
Add end to end tests
rdettai
committed
Improve integration test scenario
rdettai
committed
Chunk receive future to avoid hanging actor
rdettai
committed
Improve error handling
rdettai
committed
Fix flaky test
rdettai
committed
New SourceConfig format with notifications field
rdettai
committed
Improvements to error handling
rdettai
committed
Clarification of Queue contract
rdettai
committed
Address new round of review comments
rdettai
committed
Remove SqsSource for now
rdettai
committed
Fix panic
rdettai
committed
Revert to forbidding any adhoc file source through the API
rdettai
committed
Add docs
rdettai
committed
Fix panic on empty file
rdettai
committed
Documentation improvments
rdettai
committed
Improve documentation
rdettai
committed
Improve error handling code and associated docs
rdettai
committed
Nitpic and TODO cleanup
rdettai
committed
Add tip about ingests directly from object stores
rdettai
committed
Ack notifications of undesired type
rdettai
committed
Add docs about situations where messages require a DLQ
rdettai
committed
Fix integ test after rebase
rdettai
committed

Footer

© 2025 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Docs
Contact

You can’t perform that action at this time.