Popular repositories Loading

1. StarGemm StarGemm Public

   实践与比较Cuda中的高性能矩阵通用乘

   Cuda 3

2. StarFlashAttention StarFlashAttention Public

   复现实践FlashAttention高性能算子

   Cuda 1

3. SZUThesis SZUThesis Public

   Forked from liuchengxu/szuthesis

   Shenzhen University Undergraduate Thesis: High-Performance Inference System Based on the Llama Large Model

   PostScript

4. diffusers diffusers Public

   Forked from huggingface/diffusers

   🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

   Python

5. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++