Pinned Loading

1. triton-inference-server/server triton-inference-server/server Public

   The Triton Inference Server provides an optimized cloud and edge inferencing solution.

   Python 8.4k 1.5k

2. triton-inference-server/core triton-inference-server/core Public

   The core library and APIs implementing the Triton Inference Server.

   C++ 107 105

3. triton-inference-server/python_backend triton-inference-server/python_backend Public

   Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

   C++ 556 146

4. triton-inference-server/tensorrt_backend triton-inference-server/tensorrt_backend Public

   The Triton backend for TensorRT.

   C++ 64 29

5. triton-inference-server/vllm_backend triton-inference-server/vllm_backend Public

   Python 196 20

6. triton-inference-server/model_analyzer triton-inference-server/model_analyzer Public

   Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

   Python 435 75