🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

rust distributed-systems streaming real-time serverless webassembly data-flow stream-processing data-analytics data-integration cloud-native data-pipelines stateful streaming-data stream-processing-engine event-driven-architecture streaming-analytics streaming-data-processing streaming-data-pipelines

• Updated Nov 5, 2026
• Rust

Stream Processing and Complex Event Processing Engine

library cloud cep cncf stream-processing cloud-native complex-event-processing online-learning streaming-data-processing

• Updated Oct 8, 2026
• Java

Python Streaming DataFrames for Kafka

python data-science machine-learning kafka stream-processing data-engineering streaming-data stream-processor event-driven-architecture streaming-data-processing time-series-data data-intensive-applications streaming-data-pipelines real-time-data-processing

• Updated Nov 11, 2026
• Python

A framework for Big Data Optimization with multi-objective metaheuristics

evolutionary-algorithms multi-objective-optimization metaheuristic-framework dynamic-optimization streaming-data-processing

• Updated Apr 14, 2023
• Java

[IEEE TKDE 2023] A list of up-to-date papers on streaming tensor decomposition, tensor tracking, dynamic tensor analysis

adaptive-learning tensor-factorization missing-data online-learning tensor-decomposition cp-decomposition tensor-networks tensor-train parafac hosvd tensor-analysis tucker-decomposition baysian-inference streaming-data-processing outliers-detection tensor-ring-decomposition tsvd block-term-decomposition

• Updated Aug 21, 2024

Streaming API for pandas applied to big datasets

numpy pandas python3 streaming-data streaming-data-processing

• Updated Jan 18, 2026
• Python

[IEEE ICASSP 2021] "A fast randomized adaptive CP decomposition for streaming tensors". In 46th IEEE International Conference on Acoustics, Speech, & Signal Processing, 2021.

cp-decomposition online-learning-algorithms randomized-algorithms streaming-data-processing adaptive-algorithm tensor-decomposition-algorithms

• Updated Feb 16, 2023
• MATLAB

Demonstration of streaming applications using Spring Cloud Data Flow with microservices written in Spring Cloud Stream.

microservices spring-boot spring-cloud-stream streaming-data spring-cloud-data-flow streaming-data-generator streaming-data-processing

• Updated Jul 10, 2020
• Java

Real-time crypto trading data pipeline using Apache Spark, Kafka, and Airflow. Containerized microservices architecture for streaming analytics.

python docker airflow kafka spark apache-spark docker-compose postgresql pyspark data-engineering apache-kafka data-processing data-pipeline streaming-data airflow-docker apache-airflow data-engineering-pipeline streaming-data-processing airflow-dags streaming-data-pipelines

• Updated Oct 21, 2025
• Python

A project for the module (Advanced) Distributed Systems Prototyping at the Technical University of Berlin.

kafka streaming-data-processing

• Updated Sep 18, 2023
• Jupyter Notebook

🔥👨‍💻 Build Big data pipelines with Apache Beam in any language and run it via Spark, Flink, GCP (Google Cloud Dataflow).

python data-engineering apache-beam data-pipelines data-pipeline streaming-data-processing real-time-data-pipeline

• Updated Mar 25, 2024
• Jupyter Notebook

Stream processing of AIS data with Flink

kafka apache-flink streaming-data-processing

• Updated Jul 10, 2021
• Java

e2e machine learning pipeline using a config based approach for classification problems. Supports grouping and grading classifiers in addition to online learning algorithms

machine-learning-algorithms support-vector-machine decision-tree-classifier online-learning model-evaluation gradient-boosting knearest-neighbor-classifier random-forest-classifier drift-detection streaming-data-processing k-fold-cross-validation bagging-ensemble roc-auc-curve hold-out-cross-validation

• Updated Dec 25, 2022
• Python

This repository contains a collection of Java demos presented in technical events and on the french YouTube channel 'Les Mains Dans Le Code'.

mongdb streaming-data-processing

• Updated Sep 20, 2026
• Java

Tool for efficient loading and processing of streaming data from Kafka to Elasticsearch

asynchronous kubernetes-deployment streaming-data-processing docker-compose-infra

• Updated Apr 4, 2025
• Python

a complete streaming data pipeline that ingests simulated IoT sensor data, processes it and displays in real time through a simple website

python streaming-data-processing pyflink

• Updated Oct 13, 2025
• Python

High-Performance Sequential Edge Stream Telemetry Engine

streaming-data-processing

• Updated May 28, 2026
• Python

This repository contains a collection of NodeJS/Typescript demos presented in technical events and on the french YouTube channel 'Les Mains Dans Le Code'.

mongodb streaming-data-processing

• Updated Apr 10, 2025
• TypeScript

Apache Beam stream data analytics template featuring Google PubSub and Google BigQuery

python3 data-analysis apache-beam google-cloud-platform streaming-data google-bigquery google-pubsub streaming-data-processing

• Updated Sep 5, 2023
• Python

Programmable, versioned data infrastructure for applications

sql database zig olap streaming-data htap streaming-data-processing streaming-database durable-execution

• Updated Nov 12, 2026
• Zig