Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: 识别图片的bug? #936

Open
sanxianxiaohuntun opened this issue Nov 27, 2024 · 1 comment
Open

[Bug]: 识别图片的bug? #936

sanxianxiaohuntun opened this issue Nov 27, 2024 · 1 comment
Labels
bug? Bug或Bug修复相关

Comments

@sanxianxiaohuntun
Copy link

sanxianxiaohuntun commented Nov 27, 2024

消息平台适配器

aiocqhttp(使用 OneBot 协议接入的)

运行环境

Windows

LangBot 版本

[bot] 当前版本: v3.4.0.2

异常情况

在使用图片功能时会出现异常(发送图片给bot)

[11-27 18:01:50.523] chat.py (94) - [ERROR] : 对话(44)请求失败: 模型请求失败: 请求参数错误: Error code: 400 - {'error': {'message': "* [12].parts[0].data: required oneof field 'data' must have one initialized field\n  (request id: 20241127180146162454006EwMGL0Vt)", 'code': 400}}
[11-27 18:01:51.056] controller.py (98) - [ERROR] : 模型请求失败: 请求参数错误: Error code: 400 - {'error': {'message': "* [12].parts[0].data: required oneof field 'data' must have one initialized field\n  (request id: 20241127180146162454006EwMGL0Vt)", 'code': 400}}

复现步骤
1、使用前序叫bot比如ai 、/ai
2、ai后面带上图片 识别失败报错, ai后面带上图片+文本会导致文本吞掉部分如下:

[11-27 18:01:21.265] process.py (42) - [INFO] : 处理 group_xxxx 的请求(41): [图片]得见吗
[11-27 18:01:26.498] chat.py (80) - [INFO] : 对话(41)响应: assistant: 唔...不可以的哦...

原文应该是图片 看得见吗
3、使用@方法激活AI情况下单独发送图片为正常

可能原因
1、
[Text]: 馄饨喵 | [Image: 240x240] [图片] 932093E1F4B0C73695A0BCD7049E543A.jpg 11283 https://multimedia.nt.qq.com.cn/download?appid=1407&fileid=EhSZIhz98-vQuXjixinEhmBuWuYruhiTWCD_CijV7puIofyJAzIEcHJvZFCAvaMBWhDsu2_QA9ojoXsV1y6IyAWl&rkey=CAQSKDhbt4PfkGhOLY83Nb9lAqhqXhnxnLUCMDrJmpU5ZK95RNc1q6zyzOk
以上出现报错
2、 [Text]: 馄饨喵 | [Image: 240x240] [图片] 932093E1F4B0C73695A0BCD7049E543A.jpg 11283 https://multimedia.nt.qq.com.cn/download?appid=1407&fileid=EhSZIhz98-vQuXjixinEhmBuWuYruhiTWCD_Cij1kcGzofyJAzIEcHJvZFCAvaMBWhA0mCt8OOdbPLNPhMCMgK2l&rkey=CAESKK4DJFVxjpK-Lfsjd0eks5BMq-hUn6uMO6yyZFxQdRi6gRmQd-Q_zWA | [Text]: 摸摸头
以上出现报错
3、 [Mention]: @XXXXX(XXXXXXXX) | [Text]: | [Image: 240x240] [图片] 932093E1F4B0C73695A0BCD7049E543A.jpg 11283 https://multimedia.nt.qq.com.cn/download?appid=1407&fileid=EhSZIhz98-vQuXjixinEhmBuWuYruhiTWCD_CiiT283_o_yJAzIEcHJvZFCAvaMBWhDz4XnWS-4T2ZIwU6nL9zXU&rkey=CAESKK4DJFVxjpK-_WyZieDN6BEaQk7f9X6RcX2Je3xfpoRfQTylhWtceks
正常未报错
4、 [Mention]: @XXXXXXX(XXXXXX) | [Text]: 摸摸头 | [Image: 240x240] [图片] 932093E1F4B0C73695A0BCD7049E543A.jpg 11283 https://multimedia.nt.qq.com.cn/download?appid=1407&fileid=EhSZIhz98-vQuXjixinEhmBuWuYruhiTWCD_Ciii7biOpPyJAzIEcHJvZFCAvaMBWhAg7LDgoQT3fxPYP4AYHEbS&rkey=CAESKK4DJFVxjpK-gfA20tsjC-BX8Hb6MjpSjwtfzY3Y0xbm3RTIMEyPAFc
未识别图片,文本正常识别

启用的插件

为单独测试环境,未启用插件

@sanxianxiaohuntun sanxianxiaohuntun added the bug? Bug或Bug修复相关 label Nov 27, 2024
@sanxianxiaohuntun
Copy link
Author

sanxianxiaohuntun commented Nov 27, 2024

补充:
1、模型为gemini 1.5 pro
2、使用正则表达后正常(.*XXXXX.*)

@sanxianxiaohuntun sanxianxiaohuntun changed the title [Bug]: [Bug]: 识别图片的bug? Nov 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug? Bug或Bug修复相关
Projects
None yet
Development

No branches or pull requests

1 participant