Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 96.8k 24.7k

2. smg-project/smg smg-project/smg Public

   Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…

   Rust 717 217

3. Espresso Espresso Public

   让 Mac 通宵跑 coding agent:防休眠一键开关,UI + CLI,免密码 / Keep your Mac awake so coding agents run all night — one-click no-sleep toggle, UI + CLI, passwordless

   Shell 2 1

4. pytorch/pytorch pytorch/pytorch Public

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python 105k 30.7k

5. triton-chat triton-chat Public

   Real-time C++ Chat Server based on muduo, MySQL, Redis, nginx.

   C++ 4