Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: show how much of the raw repo map fits in the token budget #1780

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

jbellis
Copy link
Contributor

@jbellis jbellis commented Sep 27, 2024

this helps the user make a more informed choice about whether to override --map-tokens

@paul-gauthier
Copy link
Collaborator

I'm not sure it's that useful to compare to the size of the "full" repo map. The goal isn't to include "all" the repo map. But to include a highly relevant portion that doesn't use too many tokens.

@jbellis
Copy link
Contributor Author

jbellis commented Sep 27, 2024

That's true, and it does work well when you have the right files added as a starting point. I'm using this for when you are trying to find the right place to start. Unless you have a good intuition already for how many tokens your map should take, it's useful to have an indication when the repo map is only a small fraction of the code and hence increasing map-tokens could help the LLM give a more useful answer to /ask instead of hallucinating.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants