A game theoretic approach to explain the output of any machine learning model.

machine-learning deep-learning gradient-boosting interpretability shapley shap explainability

• Updated Nov 10, 2026
• Jupyter Notebook

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

machine-learning data-mining awesome deep-learning awesome-list interpretability privacy-preserving production-machine-learning mlops privacy-preserving-machine-learning explainability responsible-ai machine-learning-operations ml-ops ml-operations privacy-preserving-ml large-scale-ml production-ml large-scale-machine-learning

• Updated Nov 12, 2026

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

machine-learning computer-vision deep-learning grad-cam pytorch image-classification object-detection visualizations interpretability class-activation-maps interpretable-deep-learning interpretable-ai explainable-ai explainable-ml xai score-cam vision-transformers

• Updated Nov 1, 2026
• Python

Fit interpretable models. Explain blackbox machine learning.

machine-learning ai scikit-learn artificial-intelligence transparency blackbox bias differential-privacy gradient-boosting interpretability interpretable-ai interpretable-ml explainable-ai explainable-ml xai interpretable-machine-learning iml explainability interpretml

• Updated Nov 9, 2026
• C++

Model interpretability and understanding for PyTorch

interpretability feature-importance interpretable-ai interpretable-ml feature-attribution

• Updated Nov 1, 2026
• Python

A collection of infrastructure and tools for research in neural network interpretability.

visualization machine-learning tensorflow jupyter-notebook colab interpretability

• Updated Feb 6, 2023
• Jupyter Notebook

A curated list of awesome responsible machine learning resources.

python data-science machine-learning awesome r awesome-list transparency fairness ai-safety privacy-enhancing-technologies interpretability interpretable-ai interpretable-ml explainable-ml xai interpretable-machine-learning privacy-preserving-machine-learning machine-learning-interpretability secure-ml reliable-ai

• Updated Jun 3, 2026

🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models

python machine-learning transparency lime interpretability ethical-artificial-intelligence explainable-ml shap explainability

• Updated Nov 10, 2026
• Jupyter Notebook

StellarGraph - Machine Learning on Graphs

python data-science machine-learning deep-learning graphs machine-learning-algorithms networkx graph-data graph-analysis graph-machine-learning link-prediction graph-convolutional-networks gcn saliency-map interpretability geometric-deep-learning graph-neural-networks heterogeneous-networks stellargraph-library

• Updated Apr 10, 2024
• Python

Algorithms for explaining machine learning models

machine-learning interpretability counterfactual explanations xai

• Updated Oct 17, 2025
• Python

Class activation maps for your PyTorch models (CAM, Grad-CAM, Grad-CAM++, Smooth Grad-CAM++, Score-CAM, SS-CAM, IS-CAM, XGrad-CAM, Layer-CAM, Finer-CAM, LeGrad, RefineCAM)

python deep-learning grad-cam cnn pytorch saliency-map interpretability smoothgrad interpretable-deep-learning gradcam activation-maps class-activation-map gradcam-plus-plus score-cam

• Updated Nov 10, 2026
• Python

FedML - The Research and Production Integrated Federated Learning Library: https://fedml.ai

machine-learning privacy computer-vision semi-supervised-learning transfer-learning wireless-communication distributed-optimization interpretability neural-architecture-search federated-learning continual-learning vertical-federated-learning non-iid decentralized-federated-learning hierarchical-federated-learning adversarial-attack-and-defense communication-efficiency straggler-problem computation-efficiency incentive-mechanism

• Updated Sep 3, 2022

Steering-first neuron explorer for Qwen3.5-4B: push every MLP neuron, keep every rollout, browse the results

interpretability steering mechanistic-interpretability qwen

• Updated Nov 2, 2026
• Python

A JAX research toolkit for building, editing, and visualizing neural networks.

visualization neural-networks interpretability fine-tuning jax

• Updated Jun 22, 2025
• Python

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

visualization data-science machine-learning widget ui jupyter widgets ml data-visualization data-analysis machinelearning fairness interpretability error-analysis explainable-ai explainable-ml fairness-ai explainability fairness-ml responsible-ai

• Updated Nov 12, 2026
• TypeScript

[ICCV 2017] Torch code for Grad-CAM

deep-learning heatmap grad-cam convolutional-neural-networks interpretability iccv17 visual-explanation

• Updated Sep 17, 2022
• Lua

A collection of research materials on explainable AI/ML

xml interpretability explanation-system interpretable-ai explainable-ai xai counterfactual-explanations recourse

• Updated Aug 19, 2026
• Markdown

Interpretable ML package 🔍 for concise, transparent, and accurate predictive modeling (sklearn-compatible).

python rules data-science machine-learning statistics ai scikit-learn ml artificial-intelligence supervised-learning interpretability explainable-ai explainable-ml rule-learning optimal-classification-tree rulefit imodels bayesian-rule-list

• Updated Nov 6, 2026
• Jupyter Notebook

Stanford NLP Python library for Representation Finetuning (ReFT)

interpretability reft representation-finetuning

• Updated Mar 5, 2026
• Python

moDel Agnostic Language for Exploration and eXplanation

black-box data-science machine-learning predictive-modeling fairness interpretability explainable-artificial-intelligence explanations explainable-ai explainable-ml xai model-visualization interpretable-machine-learning iml dalex responsible-ai responsible-ml explanatory-model-analysis

• Updated Jul 15, 2026
• Python