Learn how to develop, deploy and iterate on production-grade ML applications.

python data-science machine-learning natural-language-processing deep-learning pytorch data-engineering ray data-quality distributed-training mlops distributed-ml llms llmops

• Updated Mar 4, 2026
• Jupyter Notebook

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

search data-science machine-learning natural-language-processing reinforcement-learning computer-vision deep-learning production data-engineering data-discovery recsys data-quality applied-data-science applied-machine-learning

• Updated Jul 18, 2024

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

metadata semantics mcp context data-catalog data-discovery ontologies data-quality data-profiling metadata-management dataquality data-governance data-lineage ontologies-api data-contracts data-observability datadiscovery data-collaboration mcp-server context-layer

• Updated Nov 12, 2026
• TypeScript

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

python data-science machine-learning statistics deep-learning jupyter pandas-dataframe exploratory-data-analysis jupyter-notebook eda pandas exploration data-analysis html-report data-exploration hacktoberfest pandas-profiling data-quality data-profiling big-data-analytics

• Updated Nov 5, 2026
• Python

Always know what to expect from your data.

data-science pipeline exploratory-data-analysis eda data-engineering data-quality data-profiling datacleaner exploratory-analysis cleandata dataquality datacleaning mlops pipeline-tests pipeline-testing dataunittest data-unit-tests exploratorydataanalysis pipeline-debt data-profilers

• Updated Nov 12, 2026
• Python

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

data-science machine-learning annotation data-validation exploratory-data-analysis weak-supervision outlier-detection labeling datasets data-cleaning active-learning data-quality data-profiling anomaly-detection data-curation data-annotation noisy-labels out-of-distribution-detection data-labeling data-centric-ai

• Updated Jan 13, 2026
• Python

Refine high-quality datasets and visual AI models

visualization python data-science machine-learning computer-vision deep-learning artificial-intelligence developer-tools image-classification object-detection data-cleaning active-learning data-quality data-curation unstructured-data vector-search data-centric-ai

• Updated Nov 12, 2026
• TypeScript

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

data-science machine-learning data-validation pandas-dataframe jupyter-notebook html-report hacktoberfest data-quality mlops model-monitoring data-drift llm generative-ai llmops

• Updated Sep 29, 2026
• Jupyter Notebook

The Open Source Feature Store for AI/ML

python data-science machine-learning big-data ml data-engineering features data-quality mlops feature-store

• Updated Nov 12, 2026
• Python

lakeFS - Data version control for your data lake | Git for data

go golang apache-spark aws-s3 google-cloud-storage data-engineering data-lake azure-storage data-version-control object-storage datalake hadoop-filesystem data-quality data-versioning azure-blob-storage apache-sparksql git-for-data lakefs datalakes

• Updated Nov 11, 2026
• Go

Learn how to design, develop, deploy and iterate on production-grade ML applications.

python data-science machine-learning natural-language-processing deep-learning pytorch data-engineering ray data-quality mlops distributed-ml llms

• Updated Aug 16, 2024
• Jupyter Notebook

Compare tables within or across databases

mysql python postgres data-science data sql database postgresql snowflake data-engineering rdbms dbt oracle-database data-quality dataengineering trino dataquality data-quality-monitoring data-diffing databricks-sql

• Updated May 17, 2024
• Python

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

python data-science machine-learning analytics logging constraints dataset dataops data-pipeline data-quality calculate-statistics data-constraints mlops model-performance ml-pipelines ai-pipelines approximate-statistics statistical-properties

• Updated Jan 10, 2025
• Jupyter Notebook

Data Contracts engine for the modern data stack. https://www.soda.io

python data-validation snowflake data-engineering dbt data-quality-checks data-quality data-profiling dataquality data-governance data-monitoring data-quality-monitoring pipeline-testing data-unit-tests data-testing data-contracts datatesting data-observability data-reliability data-quality-testing

• Updated Nov 11, 2026
• Python

The Virtual Feature Store. Turn your existing data infrastructure into a feature store.

python data-science machine-learning ml embeddings feature-engineering hacktoberfest data-quality mlops feature-store vector-database embeddings-similarity

• Updated Jul 3, 2025
• Go

Feathr – A scalable, unified data and AI engineering platform for enterprise

data-science machine-learning apache-spark azure artificial-intelligence data-engineering feature-engineering data-quality mlops feature-store feature-management feature-marketplace feature-governance feature-metadata feature-platform

• Updated Apr 4, 2024
• Scala

Scalable data pre processing and curation toolkit for LLMs

python data data-processing data-preparation deduplication data-quality data-curation data-prep fine-tuning fast-data-processing data-processing-pipelines datacuration large-language-models llm llmapps large-scale-data-processing datarecipes semantic-deduplication llm-data-quality

• Updated Nov 11, 2026
• Python

re_data - fix data issues before your users & CEO would discover them 😊

data-analysis dbt data-quality-checks data-quality dataquality open-source-tooling data-monitoring data-quality-monitoring data-testing dbt-packages data-observability data-reliability

• Updated Apr 30, 2024
• HTML

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 421 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

kubernetes open-source etl mcp data-transformation self-hosted data-engineering data-integration dbt elt cdc data-pipeline data-quality connectors low-code no-code data-orchestration lakehouse duckdb reverse-etl

• Updated Nov 12, 2026
• Rust

First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

metadata data-science oss bigdata alerting data-engineering data-catalog data-discovery data-platform data-exploration data-pipelines observability lineage data-quality data-profiling metadata-management data-governance data-lineage datacatalog data-observability

• Updated Oct 19, 2026
• Java