Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

qwen2Vl+vllm框架如何添加视频内容 #540

Open
zhangzhiyuan303 opened this issue Nov 18, 2024 · 0 comments
Open

qwen2Vl+vllm框架如何添加视频内容 #540

zhangzhiyuan303 opened this issue Nov 18, 2024 · 0 comments

Comments

@zhangzhiyuan303
Copy link

QWen2VL是支持这个type调用视频,但是我用vllm框架+qwen2vl 7b 权重,那边返回报错。
{'object': 'error', 'message': 'Unknown part type: video_url', 'type': 'BadRequestError', 'param': None, 'code': 400}
{'object': 'error', 'message': 'Unknown part type: video', 'type': 'BadRequestError', 'param': None, 'code': 400}
messages = [
{
"role": "user",
"content": [
{
"type": "video",
"video": [
"file:///path/to/frame1.jpg",
"file:///path/to/frame2.jpg",
"file:///path/to/frame3.jpg",
"file:///path/to/frame4.jpg",
],
},
{"type": "text", "text": "Describe this video."},
],
}
]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant