Testing framework for Databricks notebooks

databricks databricks-notebooks azuredevops

• Updated Oct 26, 2026
• Python

Apache Spark Connector for Azure Cosmos DB

spark apache-spark connector jupyter-notebook pyspark databricks changefeed lambda-architecture azure-cosmos-db databricks-notebooks cosmos-db azure-databricks

• Updated Mar 10, 2025

Azure Databricks MLOps sample for Python based source code using MLflow without using MLflow Project.

python azure ml databricks databricks-notebooks ml-production mlops mlflow ml-ops ml-operations mlflow-projects ml-monitoring

• Updated Mar 21, 2025
• Jupyter Notebook

Analyzing the safety (311) dataset published by Azure Open Datasets for Chicago, Boston and New York City using SparkR, SParkSQL, Azure Databricks, visualization using ggplot2 and leaflet. Focus is on descriptive analytics, visualization, clustering, time series forecasting and anomaly detection.

visualization data r azure leaflet geospatial opendata eda sparksql workshop-materials sparkr anomalydiscovery time-series-analysis anomaly-detection databricks-notebooks timeseries-forecasting azure-databricks datascience-machinelearning aiforsocialgood 311-data

• Updated May 3, 2021
• R

Azure Databricks - Advent of 2020 Blogposts

python machine-learning scala sql spark notebook pyspark data-analytics mllib r-language notebooks sparkr databricks azure-data-factory databricks-notebooks spark-structured-streaming azure-databricks mlflow azure-machine-learnning data-engineerg

• Updated Sep 22, 2022
• Jupyter Notebook

code, labs and lectures for the course

python data-science machine-learning spark etl spark-streaming data-analysis databricks data-science-notebook databricks-notebooks aws-machine-learning

• Updated Apr 16, 2023
• Jupyter Notebook

Databricks DLT Apparel Pipeline Project: Learn medallion architecture, streaming, and data engineering with Delta Live Tables. Includes synthetic data, step-by-step guide, and certification prep.

etl pyspark data-engineering learning-by-doing data-pipelines databricks dlt databricks-notebooks azure-databricks lakehouse delta-live-tables medallion-architecture

• Updated Apr 18, 2026
• Python

Databricks. Incremental data processing, task orchestration, and production job monitoring.

streaming kafka big-data spark spark-streaming databricks databricks-notebooks

• Updated Feb 27, 2024
• Python

Black for Databricks notebooks

python formatter sql pre-commit databricks black databricks-notebooks pre-commit-hook

• Updated Jun 10, 2025
• Python

Databricks Data Engineer Associate Certification Lab: End-to-end hands-on project covering Auto Loader, Medallion Architecture, SCD Type 2, Unity Catalog governance, and Databricks Jobs orchestration. Build a production-grade pipeline on Databricks Free Edition.

data-engineering certification databricks databricks-notebooks hands-on medallion-architecture

• Updated Apr 18, 2026
• Python

Revolutionary AI ETL with Medallion Architecture: Zero-touch autonomous & HITL pipelines on Databricks

github end-to-end data-transformation databricks human-in-the-loop databricks-notebooks etl-pipeline hitl medallion-architecture langgraph agentic-workflow langsmith-tracing

• Updated Aug 7, 2025
• Jupyter Notebook

Databricks Add-on for Splunk

cybersecurity databricks databricks-notebooks splunk-addon

• Updated Jan 15, 2026
• Python

Repository of notebooks and related collateral used in the Databricks Demo Hub, showing how to use Databricks, Delta Lake, MLflow, and more.

pyspark spark-streaming databricks pyspark-notebook databricks-notebooks databricks-demos

• Updated May 27, 2021
• Python

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows

python airflow apache workflows databricks apache-airflow databricks-notebooks dags airflow-dags

• Updated Sep 3, 2025
• Python

Delta Lake Optimization Project: Hands‑on lab to explore partitioning, Z‑Ordering, compaction (manual & auto), Liquid Clustering, and VACUUM using a synthetic sales dataset in Databricks. Includes a step‑by‑step notebook to measure file scans, bytes read, and query performance for each optimization.

big-data pyspark data-engineering databricks z-order databricks-notebooks hands-on compaction delta-lake

• Updated Apr 18, 2026
• Python

A solution for on-demand training and serving of Machine Learning models, using Azure Databricks and MLflow

python node azure databricks databricks-notebooks mlflow

• Updated Jul 17, 2020
• Python

A data pipeline project build on databricks and azure to demostrate lifecycle of a cloud data project.

python azure jupyter-notebook adf databricks datapipeline databricks-notebooks datafactory azuredatabricks

• Updated Jan 12, 2022
• Jupyter Notebook

Are you like me , a Senior Data Scientist, wanting to learn more about how to approach DevOps, specifically when you using Databricks (workspaces, notebooks, libraries etc) ? Set up using @Azure @databricks

microsoft devops azure databricks databricks-notebooks azure-databricks azure-devops laura-edell microsoft-ml

• Updated Jun 19, 2019
• PowerShell

Databricks Real-Time Fintech Monitoring Pipeline: Hands-on lab to build a streaming fraud detection system using Auto Loader, watermarked deduplication, stream-static joins, and windowed rules engines in Databricks. Covers dual-SLA architecture for real-time alerts and batch compliance reporting.

real-time pyspark data-engineering fintech databricks structured-streaming fraud-detection databricks-notebooks hands-on watermarks delta-lake

• Updated Apr 18, 2026
• Python

Using Azure Databricks (Spark) for ML, this is the //build 2019 repository with homework examples, code and notebooks

microsoft python scala azure databricks-notebooks azure-databricks databricks-challenges build-2019

• Updated Aug 30, 2019
• Jupyter Notebook