Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Spin up a complete internal developer platform with only Docker required as a dependency.

DoEKS is a tool to build, deploy and scale Data & ML Platforms on Amazon EKS

This project provides a framework that runs Slurm in Kubernetes.

🏃🏿‍♀️🏃🏽‍♀️🏃🏻‍♂️🕒CNCF Technical Advisory Group for Runtime

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

A high-throughput and memory-efficient inference and serving engine for LLMs

This is the reference implementation of CNOE and its toolings on AWS

Machine Learning Toolkit for Kubernetes

Repository for out-of-tree scheduler plugins based on scheduler framework.

A repository for Kustomize manifests

An Argo CD plugin to retrieve secrets from Secret Management tools and inject them into Kubernetes secrets

Prometheus community Helm charts

Training operators on Kubernetes.

Terminals served by tornado websockets

Serverless Inferencing on Kubernetes

Python SDK for building, training, and deploying ML models

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Mangos Four is an *Early Alpha* server for World of Warcraft: Mists of Pandaria. The server serves full world content including authentication & scripts support. Compatible with World of Warcraft c…

An Open Source Machine Learning Framework for Everyone

Moby Project - a collaborative project for the container ecosystem to assemble container-based systems

Distributed training framework for TensorFlow.