Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[EPIC] - New chunking strategies #30

Open
2 tasks
amirhouieh opened this issue Dec 6, 2023 · 0 comments
Open
2 tasks

[EPIC] - New chunking strategies #30

amirhouieh opened this issue Dec 6, 2023 · 0 comments
Assignees
@jeangovil
Labels
feature supported feature p:low

Comments

@amirhouieh
Copy link
Member

amirhouieh commented Dec 6, 2023 •
edited
Loading

Store chunks based on the type of model. This will help a much better semantic search and generative search.
We currently have block-base chunking which is default and not-optional.

  • Section base (optional)
  • Semantic base (optional)
@amirhouieh amirhouieh added the feature supported feature label Dec 6, 2023
@amirhouieh amirhouieh added this to the Q4 2023 milestone Dec 6, 2023
@amirhouieh amirhouieh modified the milestones: Q4 2023, Jan 2024 Jan 13, 2024
@amirhouieh amirhouieh added the p:high High Priority label Jan 13, 2024
@amirhouieh amirhouieh moved this to In Progress in Roadmap Jan 13, 2024
@amirhouieh amirhouieh moved this from In Progress to Todo in Roadmap Jan 13, 2024
@amirhouieh amirhouieh added p:medium and removed p:high High Priority labels Jan 13, 2024
@amirhouieh amirhouieh moved this from Todo to Backlog in Roadmap Feb 12, 2024
@jeangovil jeangovil removed this from the Feb 2024 milestone Jun 21, 2024
@jeangovil jeangovil added p:low and removed p:medium labels Jun 21, 2024
@amirhouieh amirhouieh changed the title Store chunks based on the type of model New chunking strategies Jun 21, 2024
@amirhouieh amirhouieh changed the title New chunking strategies [EPIC] - New chunking strategies Jun 21, 2024
@amirhouieh amirhouieh moved this from Backlog to Done in Roadmap Jun 21, 2024
@amirhouieh amirhouieh moved this from Done to In Progress in Roadmap Jun 21, 2024
@amirhouieh amirhouieh moved this from In Progress to Todo in Roadmap Jun 21, 2024
@amirhouieh amirhouieh moved this from Todo to Icebox in Roadmap Jun 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jeangovil jeangovil

Labels
feature supported feature p:low
Projects
Roadmap
Status: Icebox
Milestone
No milestone
Development

No branches or pull requests
2 participants
@amirhouieh @jeangovil