Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve IndexWriter customisation via builder #2562

Merged

Conversation

ChillFish8
Copy link
Collaborator

Recently been hacking the index writer apart to do some mildly questionable thing, as part of that I found myself wanting to customise some more parts of the writer but adding another method with more config options was starting to get unwieldy. Especially since #2535

This PR adds a builder notibly IndexWriterOptions which improves the ergonomics of configuring the writer.

However, I did also make the options another method to avoid making it a huge breaking change, but maybe a breaking change of the create API fine.

Also sorry, I accidentally wrapped some of the work I did around deferring indexer threads being spawned until required, will remove at a later point.

@ChillFish8 ChillFish8 force-pushed the chillfish8/poc-index-writer-options branch from 2c34a0d to 0e3a658 Compare December 26, 2024 22:29
@ChillFish8 ChillFish8 force-pushed the chillfish8/poc-index-writer-options branch from 0e3a658 to 2269845 Compare December 26, 2024 22:30
Copy link
Collaborator

@fulmicoton fulmicoton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see comment

src/index/index.rs Show resolved Hide resolved
@ChillFish8 ChillFish8 changed the title WIP: Improve IndexWriter customisation via builder Improve IndexWriter customisation via builder Jan 1, 2025
@fulmicoton fulmicoton merged commit 148594f into quickwit-oss:main Jan 2, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants