The RaftLib C++ library, streaming/dataflow concurrency via C++ iostream-like operators

opencv c-plus-plus streaming cmake runtime hpc dsl ipc machine thread parallel pthreads dataflow dataflow-programming dataflow-structure thread-library qthreads raftlib dataflows qthread-library

• Updated Jan 2, 2024
• C++

The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.

python machine-learning analytics libraries models pipelines data-flow asyncio flow-based-programming datasets dag frameworks event-based dataflows ai-training hyperautomation dffml ai-inference swrepo ai-machine-learning

• Updated Aug 25, 2024
• Python

[ICLR 2025 Spotlight] LayerDAG: A Layerwise Autoregressive Diffusion Model of Directed Acyclic Graphs

pytorch generative-model intermediate-representation graph-generation directed-acyclic-graph graph-neural-networks dataflows synthetic-data-generation autoregressive-models ddpm

• Updated Jan 26, 2025
• Python

Big Data CONFERENCE Europe 2025 🇱🇹 AI, Cloud and Data Conference - Build Your First End-to-End Lakehouse Solution (aka.ms/fabconlake)

data-science machine-learning tutorial workshop apache-spark data-engineering warehouse parquet powerbi data-pipeline microsoft-azure data-factory dataflows delta-lake lakehouse microsoft-fabric

• Updated Nov 18, 2025
• Jupyter Notebook

This repository serves as a personal collection of Power BI Dashboard and Report sample files, along with the datasets used in the samples, tutorials, and other related content.

sample data-science data unicorns power-bi samples open-data dataset data-analysis datasets dax powerbi powerquery worldbank dataflows powerbi-report pbi m-language pbix-samples dax-expression

• Updated Sep 23, 2023
• Python

A set of libraries for rapidly developing RabbitMQ workflows/pipelines.

workflow data csharp queue rabbitmq pipelines queueing netcore dataflow net rabbit workflows tpl dataflows

• Updated Mar 24, 2026
• C#

Templated modern C++ library for implementing DataFlow programming

template cpp lambda-functions multithreading generic-programming dataflow lambda-expressions dataflow-programming cpp20 dataflows

• Updated Jan 14, 2025
• C++

How flows of data reveal the ecosystems of our planet

visualization science dataviz climate-change dataflows

• Updated Oct 19, 2022
• Jupyter Notebook

HQL — Hyper Query Language — is a statically typed language for querying, transforming, connecting and computing over data, knowledge and AI workflows.

markdown rust cli yaml json functional-programming stream-processing knowledge-graph data-integration query-language semantic-search hql static-typing ai-agents rag jq-alternative dataflows etl-pipelines ai-memory-system hypermarkdown

• Updated Oct 25, 2026
• Rust

Easy and lightweight parallelized dataflows in Python

python data-science data-engineering dag directed-acyclic-graph dataflows

• Updated Aug 6, 2025
• Python

An end-to-end data pipeline in Microsoft Fabric to process and analyze COVID-19 data.

powerbi data-pipeline dataflows semantic-model microsoft-fabric fabric-lakehouse

• Updated Oct 24, 2025
• Mathematica

DataFlows SMS plugin for Claude: send, schedule and track business SMS from your DataFlows account

mcp sms australia dataflows claude-code claude-plugin

• Updated Oct 9, 2026

Custom agentic AI Generominos cards

model pipelines generative ai-agents dataflows llms agentic-ai

• Updated Jun 20, 2026
• JavaScript

COVID 19 Data Pipeline - Azure Data Engineering: A complete end-to-end ETL pipeline to fetch COVID19 daily and weekly data from API, transform and load to SQL database in Azure using Data Factory, Databricks, Key-Vaults and Data Lake

azure pyspark data-engineering azure-storage databricks azure-data-factory dataflows covid-19

• Updated Sep 17, 2022

This project demonstrates the development of a robust batch processing pipeline designed to handle large-scale data ingestion and transformation.

data cloud spark pipeline azure data-engineering batch-processing datalake azuredatafactory etl-pipeline azurecli dataflows datamonitoring

• Updated Sep 16, 2025

Three Microsoft Fabric projects collected in one place, showcasing practical end-to-end data engineering workflows. Built primarily with Microsoft Fabric services like dataflowgen2, datafactory, pyspark-notebooks , covering ingestion, transformation, and orchestration patterns in Fabric.

etl data-engineering spark-streaming data-analytics powerbi azure-data-factory pyspark-notebook microsoft-azure azure-databricks dataflows lakehouse microsoft-fabric

• Updated Feb 20, 2026
• Jupyter Notebook

Claude Code skills for reviewing and optimizing Power Query M in legacy Power BI Dataflows Gen1, with Gen1-aware constraints and privacy-conscious code-only workflows.

etl data-transformation power-bi data-engineering power-query privacy-by-design dataflows m-language legacy-systems agent-skills claude-code query-folding dataflow-gen1

• Updated Sep 17, 2026

Incremental computation engine for Go with live what-if worlds: fork the graph into N scenarios that pin some inputs and track the rest live, all updated by one stabilization. Data-shaped topology (Bind), per-key diff collections, O(divergence) scenario cost.

go golang reactive reactive-programming dataflow dag materialized-views incremental-computation dags dataflows incremental-view-maintenance self-adjusting-computation

• Updated Jul 26, 2026
• Go

Agent Skills for Microsoft Fabric development, administration, migration, and automation, compatible with OpenAI Codex and Claude Code.

automation azure-cli power-bi ai-agents dataflows openai-codex microsoft-fabric agent-skills claude-code agentic-development fabric-data-engineering fabric-data-factory

• Updated Oct 8, 2026

small ETL library to convert MRASCO & SPAA UK energy industry dataflows into csv

csv parse dataflows etl-library

• Updated Apr 2, 2023
• Go