A curated list of awesome big data frameworks, ressources and other awesomeness.
-
Updated
Nov 6, 2026
GeezerVisonThe World Wide Web, restored to 800 pixels of glory. |
| Home|About|Gaming cabinet|Archives|How it works|Starter sites |
GeezerVison is showing github.com — Build software better, together
#
streaming-dataHere are 701 public repositories matching this topic...Language: All
Filter by language
Sort: Most stars
Sort options
A curated list of awesome big data frameworks, ressources and other awesomeness.
data-science data awesome database data-stream bigdata series-database data-visualization data-warehouse stream-processing data-analytics awesome-list distributed-database visualize-data streaming-data
Open-Source Web UI for Apache Kafka Management
opensource kafka big-data web-ui streams kafka-connect apache-kafka kafka-producer kafka-client kafka-streams hacktoberfest streaming-data kafka-manager kafka-cluster event-streaming cluster-management kafka-ui kafka-brokers
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
tsv devops json statistics csv command-line json-data tabular-data data-reduction unix-toolkit statistical-analysis csv-format devops-tools data-regression data-processing command-line-tools data-cleaning streaming-algorithms streaming-data miller
Fancy stream processing made operationally mundane
go golang kafka cqrs etl rabbitmq amqp logs message-bus event-sourcing nats stream-processing message-queue data-engineering streaming-data stream-processor data-ops
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
mysql rust distributed-systems streaming sql sql-server database kafka postgresql data-store stream-processing cdc streaming-data materialized-view data-mesh postgresql-dialect operational-data-store
🌊 Online machine learning in Python
python data-science machine-learning streaming stream-processing online-learning streaming-data concept-drift real-time-processing incremental-learning online-machine-learning online-statistics
Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.
mysql rust caching postgres sql backend cache postgresql databases rust-lang mysql-database postgresql-database streaming-data caching-proxy
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
rust distributed-systems streaming real-time serverless webassembly data-flow stream-processing data-analytics data-integration cloud-native data-pipelines stateful streaming-data stream-processing-engine event-driven-architecture streaming-analytics streaming-data-processing streaming-data-pipelines
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Open-Source Web UI for managing Apache Kafka clusters
opensource kafka big-data foss web-ui streams kafka-connect apache-kafka kafka-producer kafka-client kafka-streams hacktoberfest streaming-data kafka-manager kafka-cluster event-streaming cluster-management kafka-ui kafka-brokers
A lightweight stream processing library for Go
redis workflow kafka pipeline etl websocket data-stream streams stream-processing pulsar windowing aerospike streaming-api kafka-streams throttling data-pipeline streaming-data nats-streaming stream-processor low-code
Python Stream Processing
python rust data-science machine-learning stream-processing data-engineering dataflow data-processing streaming-data
Pravega - Streaming as a new software defined storage primitive
Python Streaming DataFrames for Kafka
python data-science machine-learning kafka stream-processing data-engineering streaming-data stream-processor event-driven-architecture streaming-data-processing time-series-data data-intensive-applications streaming-data-pipelines real-time-data-processing
Real-time stream processing for python
Trill is a single-node query processor for temporal or streaming data.
📐 Pushing the boundaries of simplicity
c hashing cli helper time cross-platform math cpp timer coroutines tar header-only threading thread-pool memory-management zpl memory-allocation csv-parser streaming-data json5-parser
⚡ Single-pass algorithms for statistics
statistics big-data julia julia-language streaming-data online-algorithms julialang onlinestats stochastic-approximation
A machine learning package for streaming data in Python. The other ancestor of River.
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
iot distributed-systems haskell streaming real-time sql database kafka scale stream-processing distributed-database realtime-database data-processing financial-analysis streaming-data materialized-view iot-database hstreamdb streaming-database
Add this topic to your repoTo associate your repository with the streaming-data topic, visit your repo's landing page and select "manage topics." |
| You are visitor 01402503 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required. |