Pinned Loading

1. vllm-project/semantic-router vllm-project/semantic-router Public

   An open, programmable decision layer for models and compute.

   Go 6.5k 1.1k

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 96.8k 24.7k

3. vllm-project/vllm-omni vllm-project/vllm-omni Public

   A framework for efficient model inference with omni-modality models

   Python 7.7k 2.1k

4. zai-org/GLM-OCR zai-org/GLM-OCR Public

   GLM-OCR: Accurate × Fast × Comprehensive

   Python 7.6k 676