Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 96.8k 24.7k

2. trainweights trainweights Public

   Quantizing and packing training checkpoints to shrink disk usage

   C++

3. delphi delphi Public

   A simple inference engine, server, and chatbot for GPT-NeoX models

   Python

4. comparator comparator Public

   Evaluate models and compare their scores

   C++