Pinned Loading

1. large_language_monkeys large_language_monkeys Public

   Python 55 9

2. Archon Archon Public

   Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.

   Python 129 8

3. CATS CATS Public

   Python 20 5

4. hydragen hydragen Public

   Hydragen: High-Throughput LLM Inference with Shared Prefixes

   Python 25 3