Pinned Loading

1. kubernetes-sigs/lws kubernetes-sigs/lws Public

   LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

   Go 753 159

2. kubeflow/trainer kubeflow/trainer Public

   Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

   Go 2.1k 981

3. InftyAI/llmaz InftyAI/llmaz Public

   ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

   Go 307 46

4. llm-d/llm-d-inference-sim llm-d/llm-d-inference-sim Public

   A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

   Go 160 106

5. kubernetes-sigs/inference-perf kubernetes-sigs/inference-perf Public

   GenAI inference performance benchmarking tool

   Python 204 105

6. volcano-sh/volcano volcano-sh/volcano Public

   A Cloud Native Batch System (Project under CNCF)

   Go 5.7k 1.4k