GPUStack

All

9 repositories

gpustack.github.io
Public
HTML
•1•0•0•0•Updated Dec 20, 2024Dec 20, 2024
gpustack
Public
Manage GPU clusters for running AI models
Python
•
Apache License 2.0
•81•895•104•2•Updated Dec 20, 2024Dec 20, 2024
llama-box
Public
LM inference server implementation based on llama.cpp.
cpp transformer diffusion gguf openai-compatible-api
C++
•
MIT License
•7•46•3•0•Updated Dec 20, 2024Dec 20, 2024
gpustack-ui
Public
TypeScript
•
Apache License 2.0
•6•4•0•0•Updated Dec 20, 2024Dec 20, 2024
vox-box
Public
A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
python text-to-speech tts speech-to-text stt audio-processing asr openai-compatible-api
Python
•
Apache License 2.0
•1•15•4•0•Updated Dec 18, 2024Dec 18, 2024
.github
Public
Meta-Github repository for all GPUStack repositories.
github-metadata
Apache License 2.0
•0•0•0•0•Updated Dec 12, 2024Dec 12, 2024
gguf-parser-go
Public
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
go llama-cpp gguf stable-diffusion-cpp llama-box
Go
•
MIT License
•4•56•0•0•Updated Dec 12, 2024Dec 12, 2024
fastfetch
Public
Like neofetch, but much faster because written mostly in C.
C
•
MIT License
•430•0•0•0•Updated Oct 24, 2024Oct 24, 2024
gguf-packer-go
Public
Deliver LLMs of GGUF format via Dockerfile.
go llama gguf
Go
•
MIT License
•1•5•0•0•Updated Oct 24, 2024Oct 24, 2024