Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Agents - too long function description with medium size RAG knowledge base #4745

Open
1 task done
thingersoft opened this issue Nov 18, 2024 · 1 comment
Open
1 task done
Labels
bug Something isn't working

Comments

@thingersoft
Copy link
Contributor

What happened?

Agents RAG tool generated function description exceeding the 1024 maximum length allowed by OpenAI API.

I can provide a sample knowledge base if needed.

Steps to Reproduce

  1. configure RAG
  2. configure an agent
  3. enable file search for the agent
  4. upload documents for a small/medium size knowledge base (let's say 50000 words)
  5. start a chat with the agent

What browsers are you seeing the problem on?

No response

Relevant log output

error: [api/server/controllers/agents/client.js #sendCompletion] Unhandled error type 400 Invalid 'tools[1].function.description': string too long. Expected a string with maximum length 1024, but got a string with length 1775 instead.

Screenshots

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
@thingersoft thingersoft added the bug Something isn't working label Nov 18, 2024
@thingersoft
Copy link
Contributor Author

Upon further investigation the problem seems related to the attached file names, not to the knowledge base length.
I guess file names are included in the function description.

While not ideal you can collapse the kb in a single document as a workaround.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant