Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

data-science machine-learning annotation data-validation exploratory-data-analysis weak-supervision outlier-detection labeling datasets data-cleaning active-learning data-quality data-profiling anomaly-detection data-curation data-annotation noisy-labels out-of-distribution-detection data-labeling data-centric-ai

• Updated Jan 13, 2026
• Python

Refine high-quality datasets and visual AI models

visualization python data-science machine-learning computer-vision deep-learning artificial-intelligence developer-tools image-classification object-detection data-cleaning active-learning data-quality data-curation unstructured-data vector-search data-centric-ai

• Updated Nov 12, 2026
• TypeScript

A Doctor for your data

data language-model data-curation data-centric-ai data-diagnosis data-centric-machine-learning rlhf

• Updated Jun 16, 2026
• Python

fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and video datasets. It helps enhance the quality of both images and labels, while significantly reducing data operation costs, all with unmatched scalability.

visualization python machine-learning image deep-learning image-processing dataset image-classification outlier-detection object-detection image-analysis visual-search data-augmentation data-curation visualization-tools image-similarity image-duplicate-detection novelty-detection image-classfication

• Updated Aug 23, 2026
• Python

Scalable data pre processing and curation toolkit for LLMs

python data data-processing data-preparation deduplication data-quality data-curation data-prep fine-tuning fast-data-processing data-processing-pipelines datacuration large-language-models llm llmapps large-scale-data-processing datarecipes semantic-deduplication llm-data-quality

• Updated Nov 11, 2026
• Python

Interactively explore unstructured datasets from your dataframe.

audio machine-learning video computer-vision timeseries images exploratory-data-analysis data-visualization hacktoberfest meshes data-curation unstructured-data data-centric-ai

• Updated Nov 12, 2026
• TypeScript

A curated, but incomplete, list of data-centric AI resources.

data-science machine-learning ai artificial-intelligence data-engineering data-quality data-curation data-centric data-centric-ai data-centric-machine-learning

• Updated Jun 26, 2024

一个管理电脑内资源，并提供游戏化的综合管理器

music scraper games movies database anime self-hosted data-management data-curation data-hoarder data-hoarding

• Updated Nov 8, 2026
• JavaScript

Curated list of open source tooling for data-centric AI on unstructured data.

nlp machine-learning computer-vision deep-learning data-visualization awesome-list outlier-detection feature-vector uncertainty-estimation active-learning data-versioning data-curation synthetic-data explainable-ai bias-detection robust-machine-learning noisy-labels data-drift data-centric-ai documentation-only

• Updated Nov 15, 2023

🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models

rust machine-learning image-editing image-generation deeplearning ray datapipeline data-quality vlm data-curation multimodal video-generation datapipelines data-centric-ai foundation-models llm mllm

• Updated May 12, 2026
• Python

Monitoring platform for ML teams building real‑world AI at scale.

python open-source machine-learning computer-vision deep-learning pytorch developer-tools tensorboard class-imbalance active-learning data-quality data-curation model-training lidar-point-cloud mlops data-debugging model-debugging wandb roboflow fiftyone

• Updated Oct 30, 2026
• Python

Streamline on-policy/off-policy distillation workflows in a few lines of code

data-curation distillation data-recipes

• Updated Aug 5, 2026
• Python

[ICLR 2025] Official implementation of paper "Improving Data Efficiency via Curating LLM-Driven Rating Systems"

data-curation data-efficiency large-language-models instruction-tuning

• Updated Mar 24, 2025
• Python

A simple yet versatile context engineered for scalable online data collection

awesome computational-social-science data-curation llm-agent human-ai-collaboration

• Updated Oct 23, 2026
• JavaScript

Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.

python metadata django data-warehouse data-catalog data-discovery data-curation metamapper schema-inspection

• Updated Feb 15, 2026
• Python

A library for detecting problematic data segments in structured and unstructured data with few lines of code.

visualization python data-science machine-learning deep-learning exploratory-data-analysis eda data-visualization data-analysis data-exploration data-cleaning data-curation

• Updated Jan 10, 2024
• Python

Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Cleaning

reinforcement-learning data-preprocessing automated data-cleaning data-curation data-cleaning-pipeline

• Updated Sep 16, 2026
• Python

Lesson guide and textbook for "Data as a Science" course.

data-science data-analysis jupyter-notebooks syllabus data-science-learning data-curation data-science-tutorials data-ethics data-presentation

• Updated Jun 5, 2021
• Jupyter Notebook

Data Curation Tool is a local-first dataset curation, tagging, model-management, downloader, 3D generation, media metadata, and tool-orchestration application. The current documentation set is stored in docs/wiki/

downloader detection tagging tts lora webscraping dataset-manager stt 3d captioning-images data-curation captioning-videos imageboard-grabber auto-tagger segmentation-models stable-diffusion generative-ai code-assistant agentic-ai agentic-orchestration

• Updated Jul 12, 2026
• Python

[NeurIPS 2024] 🧼🔎 A holistic self-supervised data cleaning strategy to detect irrelevant samples, near duplicates and label errors.

machine-learning deep-learning data-cleaning data-curation self-supervised-learning data-centric-ai neurips-2024

• Updated Apr 28, 2026
• Python