-
Notifications
You must be signed in to change notification settings - Fork 8.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Modify to make rerank provider works to llama.cpp rerank API #9159
Comments
I have verify using latest llama.cpp, run with below option Test use local-ai provider . It works well. slot launch_slot_: id 0 | task 92 | processing task |
Self Checks
1. Is this request related to a challenge you're experiencing? Tell me about your story.
Recently, llama.cpp support rerank , I modify provider to solve llama.cpp API problem not return text.
See llama.cpp issue
2. Additional context or comments
No response
3. Can you help us with this feature?
The text was updated successfully, but these errors were encountered: