You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
A clear and concise description of what the bug is.
Self-deployed large models will automatically inject system-level prompts, resulting in incorrect answers.
It should be that only gpt api injects the default system prompt.
自部署大模型会默认注入系统提示 导致回答错误
应该是只有gpt api注入才对 #3684
这个pull似乎没有考虑到自部署大模型的情况
V2.10.1 To Reproduce
Steps to reproduce the behavior:
Go to '...'
Click on '....'
Scroll down to '....'
See error
docker deployment and add environment variables.
docker部署并添加环境变量
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Deployment
[y] Docker
Vercel
Server
Desktop (please complete the following information):
OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]
Smartphone (please complete the following information):
Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]
Additional Logs
Add any logs about the problem here. {"messages":[{"role":"system","content":"\nYou are ChatGPT, a large language model trained by OpenAI.\nKnowledge cutoff: 2021-09\nCurrent model: Balanced-g4t-offline\nCurrent time: 2024/1/31 20:21:45\nLatex inline: $x^2$ \nLatex block: $$e=mc^2$$\n\n"},{"role":"user","content":"hi"}],"stream":true,"model":"Balanced-g4t-offline","temperature":0.5,"presence_penalty":0,"frequency_penalty":0,"top_p":1}
The text was updated successfully, but these errors were encountered:
Describe the bug
A clear and concise description of what the bug is.
Self-deployed large models will automatically inject system-level prompts, resulting in incorrect answers.
It should be that only gpt api injects the default system prompt.
自部署大模型会默认注入系统提示 导致回答错误
应该是只有gpt api注入才对
#3684
这个pull似乎没有考虑到自部署大模型的情况
V2.10.1
To Reproduce
Steps to reproduce the behavior:
docker deployment and add environment variables.
docker部署并添加环境变量
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Deployment
Desktop (please complete the following information):
Smartphone (please complete the following information):
Additional Logs
Add any logs about the problem here.
{"messages":[{"role":"system","content":"\nYou are ChatGPT, a large language model trained by OpenAI.\nKnowledge cutoff: 2021-09\nCurrent model: Balanced-g4t-offline\nCurrent time: 2024/1/31 20:21:45\nLatex inline: $x^2$ \nLatex block: $$e=mc^2$$\n\n"},{"role":"user","content":"hi"}],"stream":true,"model":"Balanced-g4t-offline","temperature":0.5,"presence_penalty":0,"frequency_penalty":0,"top_p":1}
The text was updated successfully, but these errors were encountered: