Pinned Loading

1. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python 15.1k 2.9k

2. torchprune torchprune Public

   A research library for pytorch-based neural network pruning, compression, and more.

   Shell 163 24