Pinned Loading

1. InternLM/lmdeploy InternLM/lmdeploy Public

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python 8.1k 778

2. open-mmlab/mmdeploy open-mmlab/mmdeploy Public

   OpenMMLab Model Deployment Framework

   Python 3.2k 719

3. torch2trt_dynamic torch2trt_dynamic Public

   A pytorch to tensorrt convert with dynamic shape support

   Python 266 35

4. mmdetection-to-tensorrt mmdetection-to-tensorrt Public

   convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.

   Python 595 83