Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow loading the lindera dictionaries at runtime instead of compiling them in #322

Open
slatian opened this issue Jan 7, 2025 · 0 comments · May be fixed by #326
Open

Allow loading the lindera dictionaries at runtime instead of compiling them in #322

slatian opened this issue Jan 7, 2025 · 0 comments · May be fixed by #326

Comments

@slatian
Copy link

slatian commented Jan 7, 2025

Currently charabia uses lindera with the option to download the dictionary (~150MB) at build time from a CDN at build time which causes problems on multiple occasions, bot in terms of binary size and in terms of running a pretty complicated build script, that does what many build pipelines intentionally forbid (#265).

My concrete feature request would be some additional code that if enabled via feature flag allows loading the required dictionaries at runtime from external files, that can be managed decoupled from the software. (especially helpful when for example a backend tool and server are split up, but both need charabia + dictionaries as a dependencies)

Related: Meilisearch Discussion #800: [Charabia] Add possibility to load dictionaries from external files

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
1 participant