Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

通义千问2-VL-2B-Instruct-GPTQ-Int4不支持多轮图片识别 #529

Open
HaoWang81 opened this issue Nov 12, 2024 · 1 comment
Open

Comments

@HaoWang81
Copy link

通义千问2-VL-2B-Instruct-GPTQ-Int4不支持多轮图片识别
错误提示:
{
"object": "error",
"message": "At most 1 image(s) may be provided in one request.",
"type": "BadRequestError",
"param": null,
"code": 400
}

@HaoWang81
Copy link
Author

HaoWang81 commented Nov 12, 2024

vllm 请求地址
http://127.0.0.1:9999/v1/chat/completions
请求入参

{
    "model": "Qwen2-VL-2B-Instruct-GPTQ-Int4",
    "stream": true,
    "messages": [
        {
            "role": "user",
            "content": [
                {
                    "type": "image_url",
                    "image_url": {
                        "url": "https://modelscope.oss-cn-beijing.aliyuncs.com/resource/qwen.png"
                    }
                },
                {
                    "type": "text",
                    "text": "这张图片描述的什么内容"
                }
            ]
        },
        {
            "role": "assiant",
            "content": "这张图片包含“TONGYI Qwen”两个文字"
        },
        {
            "role": "user",
            "content": [
                {
                    "type": "image_url",
                    "image_url": {
                        "url": "https://modelscope.oss-cn-beijing.aliyuncs.com/resource/qwen.png"
                    }
                },
                {
                    "type": "text",
                    "text": "这张图片描述的什么内容"
                }
            ]
        },
        {
            "role": "assiant",
            "content": ""
        }
    ]
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant