Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

nlp sparsity tensorflow keras pytorch deep-learning-algorithms image-classification deep-learning-library pruning object-detection transfer-learning automl computer-vision-algorithms onnx deep-learning-models sparsification pruning-algorithms smaller-models sparsification-recipes

• Updated Jun 2, 2025
• Python

A curated list for Efficient Large Language Models

compression language-model knowledge-distillation model-quantization pruning-algorithms llm llm-compression efficient-llm

• Updated Jun 17, 2025
• Python

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

bloom compression pruning llama language-model vicuna baichuan pruning-algorithms llm chatglm neurips-2023 llama-2 llama3

• Updated Oct 7, 2024
• Python

Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models

pruning merging pruning-algorithms llm

• Updated Apr 23, 2024
• Python

A curated list of papers and code on efficient diffusion models for image, video, world modeling, and language generation. Covering acceleration, quantization, compression, caching, and distillation.

caching awesome awesome-list quantization diffusion awesome-lists efficient-inference diffusion-model video-generation world-models model-compression-papers distillation-model pruning-algorithms flow-matching diffusion-language-models flow-matching-models

• Updated Oct 23, 2026

A research library for pytorch-based neural network pruning, compression, and more.

machine-learning sparsity compression deep-learning pytorch neural-networks pruning tensor-decomposition neural-architecture-search weight-pruning sparsification filter-pruning tinyml generalization-ability coresets pruning-algorithms

• Updated Nov 28, 2022
• Shell

[AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models

compression pruning llama vicuna structured-pruning pruning-algorithms llm aaai-2024

• Updated Jan 6, 2024
• Python

Model optimizer used in Adlik.

knowledge-distillation model-optimizer adlik-optimizer pruning-algorithms

• Updated May 23, 2023
• Python

Caffe/Neon prototxt training file for our Neurocomputing2017 work: Fuzzy Quantitative Deep Compression Network

computer-vision deep-learning data-compression pruning object-detection compression-algorithm object-recognition fuzzy-sets model-compression pruning-algorithms fuzzy-deep-learning

• Updated May 30, 2018
• Python

Official code for "EC-SNN: Splitting Deep Spiking Neural Networks on Edge Devices" (IJCAI2024)

distributed-computing edge spiking-neural-networks edge-computing split-learning pruning-algorithms

• Updated Sep 6, 2024
• Python

This project provides tools to load and prune large language models using a structured pruning method.

ai pruning slm model-pruning pruning-algorithms llm

• Updated Dec 2, 2024
• Python

[EMNLP 2024] Is C4 Dataset Optimal for Pruning? An Investigation of Calibration Data for LLM Pruning

sparsity pruning-algorithms llm-pruning

• Updated Oct 11, 2024
• Python

KEN: Unleash the power of large language models with the easiest and universal non-parametric pruning algorithm

transformer kernel-density-estimation pruning-algorithms llm

• Updated Jun 10, 2024
• Python

[ICCV'25 Oral] Official implementation of "Variance-Based Pruning for Accelerating and Compressing Trained Networks" by Berisha et al.

pruning structured-pruning pruning-algorithms paper-resource pruning-models variance-based-pruning

• Updated Apr 1, 2026
• Python

This project implements Genetic Programming (GP) to evolve and optimize mathematical expressions that best fit given data. It leverages tree-based evolutionary algorithms to generate, evaluate, and refine expressions using selection, crossover, and mutation.

python mathematics mutations evolutionary-algorithms expression-evaluator mathematical-modelling crossover pruning-algorithms

• Updated Feb 6, 2025
• Python

Hierarchical Ensemble Pruning

deep-learning dataset ensemble-learning pruning-algorithms

• Updated Dec 6, 2021
• Python

[CVPR 2025] "Early-Bird Diffusion: Investigating and Leveraging Timestep-Aware Early-Bird Tickets in Diffusion Models for Efficient Training" by Lexington Whalen, Zhenbang Du, Haoran You, Chaojian Li, Sixu Li, and Yingyan (Celine) Lin.

diffusion-models pruning-algorithms efficient-machine-learning

• Updated Aug 24, 2025
• Python

Code and trained models for our paper: N. Kaparinos, V. Mezaris, "B-FPGM: Lightweight Face Detection via Bayesian-Optimized Soft FPGM Pruning", Proc. IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW 2025).

bayesian-optimization network-pruning filter-pruning soft-pruning pruning-algorithms lightweight-face-detection

• Updated Feb 13, 2025
• Python

[PRL 2024] This is the code repo for our label-free pruning and retraining technique for autoregressive Text-VQA Transformers (TAP, TAP†).

transformer textvqa pruning-algorithms

• Updated Aug 14, 2024
• Python

This repository contains scripts to prune Wav2vec2 using a neuroevolution-based method. More details about this method can be found in the paper Compressing Wav2vec2 for Embedded Applications.

genetic-algorithm pytorch evolutionary-algorithms pruning evolutionary-computation asr model-compression pre-trained-model huggingface transformer-models wav2vec e2e-asr pruning-optimization wav2vec2 pruning-algorithms

• Updated Nov 8, 2023
• Shell