Pinned Loading

1. kubernetes-sigs/lws kubernetes-sigs/lws Public

   LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving

   Go 908 211

2. kubeflow/trainer kubeflow/trainer Public

   Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

   Go 2.3k 1.1k

3. InftyAI/llmaz InftyAI/llmaz Public

   ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

   Go 313 48

4. llm-d/llm-d-inference-sim llm-d/llm-d-inference-sim Public

   A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

   Go 236 188

5. kubernetes-sigs/inference-perf kubernetes-sigs/inference-perf Public

   GenAI inference performance benchmarking tool

   Python 273 152

6. volcano-sh/volcano volcano-sh/volcano Public

   A Cloud Native Batch System (Project under CNCF)

   Go 6.1k 1.6k