Feature request: InternVL2 support?

[XyzzyMoon]

Any chance to get support for https://internvl.github.io/blog/2024-07-02-InternVL-2.0/ ?

[Sana-A-E]

+1. Specifically, 40b version would be great, because 8b one is reported to be censored. And since it is large a way to run it on 12-16 gb vram should be added, either by offloading/cpu running or quantization or however else it might be possible.

https://huggingface.co/OpenGVLab/InternVL2-40B

[XyzzyMoon]

Also according to mostly reliable resources. https://github.com/InternLM/lmdeploy/blob/main/docs/en/multi_modal/internvl.md game out not too long ago with official support, and will work with the 4bit version of InternVL2 without too much quality lost and 40B should fit in a 24GB GPU (At batch 1, but still)