Skip to content

Commit

Permalink
feat: add 2 more inference engine from HF and MS
Browse files Browse the repository at this point in the history
  • Loading branch information
paolomainardi authored Jul 27, 2024
1 parent f33b013 commit 0a9103b
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions projects
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,8 @@ ggerganov/llama.cpp
vllm-project/vllm
BlinkDL/RWKV-LM
AutoGPTQ/AutoGPTQ
huggingface/text-generation-inference
microsoft/DeepSpeed-MII
mlc-ai/mlc-llm
janhq/jan
vercel/ai
Expand Down

0 comments on commit 0a9103b

Please sign in to comment.