An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

python data-science machine-learning deep-learning neural-network tensorflow machine-learning-algorithms pytorch distributed hyperparameter-optimization feature-engineering nas bayesian-optimization hyperparameter-tuning automl automated-machine-learning model-compression neural-architecture-search deep-neural-network mlops

• Updated Jul 3, 2024
• Python

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

tensorflow pytorch transformer imagenet convolutional-neural-networks pretrained-models model-compression efficient-inference ghostnet vision-transformer

• Updated Mar 15, 2025
• Python

Awesome Knowledge Distillation

deep-learning knowledge-distillation teacher-student knowledge-transfer co-training model-compression distillation kd knowldge-distillation distillation-model model-distillation

• Updated Oct 26, 2026

[CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.

transformers vision pruning model-compression efficient-deep-learning llm

• Updated Sep 7, 2025
• Python

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

pretrained-models quantization knowledge-distillation model-compression large-scale-distributed

• Updated Jan 22, 2024
• Python

An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

computer-vision deep-learning mobile-app automl model-compression

• Updated Mar 31, 2023
• Python

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

deep-learning transfer-learning model-compression distillation kd knowldge-distillation

• Updated May 30, 2023

A curated list of neural network pruning resources.

awesome-list pruning model-compression model-acceleration

• Updated Apr 4, 2024

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、reg…

pytorch pruning convolutional-networks quantization xnor-net tensorrt model-compression bnn neuromorphic-computing group-convolution onnx network-in-network tensorrt-int8-python dorefa twn network-slimming integer-arithmetic-only quantization-aware-training post-training-quantization batch-normalization-fuse

• Updated May 6, 2025
• Python

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

deep-neural-networks computer-vision pytorch knowledge-distillation cifar10 dark-knowledge model-compression

• Updated Mar 25, 2023
• Python

Pytorch implementation of various Knowledge Distillation (KD) methods.

knowledge-distillation teacher-student knowledge-transfer model-compression distillation kd kd-methods

• Updated Nov 25, 2021
• Python

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

machine-learning sparsity compression deep-learning tensorflow optimization keras ml pruning quantization model-compression quantized-training quantized-neural-networks quantized-networks

• Updated Nov 11, 2026
• Python

NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego

natural-language-processing deep-learning text-classification dnn pytorch artificial-intelligence question-answering knowledge-distillation sequence-labeling text-matching qna model-compression

• Updated Jul 22, 2023
• Python

Efficient computing methods developed by Huawei Noah's Ark Lab

pruning quantization knowledge-distillation model-compression self-supervised binary-neural-networks

• Updated Nov 5, 2024
• Jupyter Notebook

Channel Pruning for Accelerating Very Deep Neural Networks (ICCV'17)

deep-neural-networks acceleration image-classification image-recognition object-detection model-compression channel-pruning

• Updated May 2, 2024
• Python

[CVPR 2024] DeepCache: Accelerating Diffusion Models for Free

model-compression efficient-inference diffusion-models stable-diffusion training-free

• Updated Jun 27, 2024
• Python

Collection of recent methods on (deep) neural network compression and acceleration.

deep-neural-networks deep-learning knowledge-distillation model-compression network-pruning efficient-deep-learning

• Updated Apr 4, 2025

TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.

deep-neural-networks deep-learning pytorch pruning model-compression model-converter quantization-aware-training post-training-quantization

• Updated Mar 3, 2026
• Python

List of papers related to neural network quantization in recent AI conferences and journals.

neural-networks awesome-list papers quantization model-compression edge-computing efficient-inference diffusion-models large-language-models

• Updated Mar 27, 2025

A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.

tensorflow pytorch hyperparameter-optimization awesome-list quantization nas automl model-compression neural-architecture-search meta-learning architecture-search quantized-training model-acceleration automated-feature-engineering quantized-neural-network

• Updated Jun 19, 2021