Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] max_tokens 参数理解有误 #5451

Open
jiangying000 opened this issue Sep 16, 2024 · 3 comments
Open

[Bug] max_tokens 参数理解有误 #5451

jiangying000 opened this issue Sep 16, 2024 · 3 comments
Assignees
Labels
bug Something isn't working

Comments

@jiangying000
Copy link
Contributor

jiangying000 commented Sep 16, 2024

📦 Deployment Method

Vercel

📌 Version

all

💻 Operating System

Windows

📌 System Version

all

🌐 Browser

Chrome

📌 Browser Version

all

🐛 Bug Description

image
上图中是错误的理解,正确的是:模型本次可以生成的最多token数 或者说 一次大模型调用生成的令牌数量的上限,包括可见输出token和 推理token


参见:
image

https://community.openai.com/t/clarification-for-max-tokens/19576/4


另外
https://platform.openai.com/docs/api-reference/chat/create#chat-create-max_tokens
image

📷 Recurrence Steps

No response

🚦 Expected Behavior

No response

📝 Additional Information

No response

@jiangying000 jiangying000 added the bug Something isn't working label Sep 16, 2024
@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Title: [Bug] Wrong understanding of max_tokens parameter

@lloydzhou
Copy link
Contributor

@Dogtiti
看看按正确的逻辑,更新一下这里的文案,需要多语言翻译

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


@Dogtiti
Let’s look at the correct logic and update the copy here. Multi-language translation is needed.

@Dogtiti Dogtiti assigned DDMeaqua and unassigned Dogtiti and Leizhenpeng Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

6 participants