New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: MobileLLM #51

Open

1 of 6 tasks

hahuyhoang411 opened this issue Nov 1, 2024 · 1 comment

Assignees

Labels

type: model request

Collaborator

hahuyhoang411 commented Nov 1, 2024

Model Name

mobilellm

Model Source

facebook/MobileLLM-1B

Model Cortexso HuggingFace Repo

https://huggingface.co/cortexso/mobilellm

Model Description

MobileLLM is introduced: "MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases", published in ICML 2024.

Requested Formats

GGUF (llama.cpp)
TensorRT (TensorRT-LLM)
ONNX (Onnx Runtime)

Additional Information

No response

Confirmation

I have created model.yml and metadata.yml files on cortex.so HugginFace repo
I have run the model through the model conversion pipeline
I have tested the model

hahuyhoang411 added the type: model request label

Collaborator Author

hahuyhoang411 commented Nov 1, 2024

Error: #52

dan-homebrew added this to Jan & Cortex

github-project-automation bot moved this to Investigating in Jan & Cortex

hahuyhoang411 moved this from Investigating to In Progress in Jan & Cortex

hahuyhoang411 self-assigned this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment