You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The new version of Starcoder is out (about 4 months ago).
Can you include it to the supported models.
This comes when I try to start the server with this model:
RuntimeError: Failed to determine config class for bigcode/starcoder2-15b. Got ['Starcoder2ForCausalLM'], which is not yet supported (Supported: ['BaichuanForCausalLM', 'ChatGLMModel', 'CohereForCausalLM', 'DbrxForCausalLM', 'GPTNeoXForCausalLM', 'FalconForCausalLM', 'GemmaForCausalLM', 'LlamaForCausalLM', 'MistralForCausalLM', 'MixtralForCausalLM', 'MPTForCausalLM', 'OPTForCausalLM', 'Phi3ForCausalLM', 'QWenLMHeadModel', 'GPTBigCodeForCausalLM', 'YiForCausalLM'])
Feature request
The new version of Starcoder is out (about 4 months ago).
Can you include it to the supported models.
This comes when I try to start the server with this model:
This is surprising, since vllm should have no problems loading the new model: https://docs.vllm.ai/en/latest/models/supported_models.html
Motivation
No response
Other
No response
The text was updated successfully, but these errors were encountered: