Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. orbax orbax Public

   Forked from google/orbax

   Orbax provides common utility libraries for JAX users.

   Python

3. llama llama Public

   Forked from meta-llama/llama

   Inference code for LLaMA models

   Python

4. JetStream JetStream Public

   Forked from AI-Hypercomputer/JetStream

   JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

   Python

5. DeepSeek-V3 DeepSeek-V3 Public

   Forked from deepseek-ai/DeepSeek-V3

   Python

6. llama-models llama-models Public

   Forked from meta-llama/llama-models

   Utilities intended for use with Llama models.

   Python