Pinned Loading

1. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 96.8k 24.7k

3. afdEP/afdEP-comm afdEP/afdEP-comm Public

   Expert-parallel communication for Attention–FFN Disaggregation (AFD), built on DeepEP V2

   Python 16