Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add modes for migrating data to SS #84

Open
kurtisnelson opened this issue Feb 11, 2021 · 0 comments
Open

Add modes for migrating data to SS #84

kurtisnelson opened this issue Feb 11, 2021 · 0 comments
Labels
enhancement New feature or request
Milestone

Comments

@kurtisnelson
Copy link
Contributor

When migrating to SS, you often have a step where writes go to both SS and the legacy storage. In this state, the SS is rarely used for performant read operations and you likely have some sort of memory cache in the legacy storage. If the data is especially big, writes greatly outnumber reads, or the legacy storage framework is causing OOMs, a mode turning off in-memory write caching is useful.

I propose two new configurations are added:
NamespaceConfig.WRITE_HEAVY
NamespaceConfig.WRITE_HEAVY_CACHE

In this mode, a write invalidates the LruCache entry instead of updating it. Reads would still populate the (likely small) cache.

@kurtisnelson kurtisnelson added the enhancement New feature or request label Feb 11, 2021
@kurtisnelson kurtisnelson added this to the 1.0 Polish milestone Feb 11, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant