Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

python rust streaming real-time kafka etl machine-learning-algorithms stream-processing data-analytics dataflow data-processing data-pipelines batch-processing pathway iot-analytics etl-framework time-series-analysis

• Updated Nov 12, 2026
• Python

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

visualization html crawler scraper gui web spider frontend robotics parameters visual www data-collection batch-script batch-processing layman rpa visualprogramming code-free input-parameters

• Updated Nov 7, 2026
• JavaScript

Workflow Engine for Kubernetes

kubernetes workflow machine-learning airflow workflow-engine cncf pipelines data-engineering argo k8s cloud-native batch-processing hacktoberfest dag gitops mlops knative argo-workflows

• Updated Nov 12, 2026
• Go

Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.

mcp web-crawler web-scraping data-collection batch-processing content-extraction search-api claude llm-tools firecrawl model-context-protocol mcp-server firecrawl-ai javascript-rendering gemini-cli-extension

• Updated Nov 12, 2026
• JavaScript

Maestro: Netflix’s Workflow Orchestrator

java workflow data-science machine-learning automation etl analytics workflow-engine scheduler orchestration data-engineering elt data-pipelines batch-processing dag mlops data-ops workflow-orchestration data-orchestrator agentic-workflow

• Updated Nov 6, 2026
• Java

Fast, free and customizable picture viewer

desktop-app windows xaml gui csharp dotnet image-gallery mvvm desktop reactive-programming avalonia image-viewer convert-images batch-processing comics-reader picture-viewer macos-app

• Updated Nov 12, 2026
• C#

Spring Batch is a framework for writing batch applications using Java and Spring

java spring batch batch-processing

• Updated Nov 11, 2026
• Java

Serverless batch computing made simple.

javascript library typescript serverless faas batch batch-processing

• Updated Nov 12, 2026
• TypeScript

Simple API, Complex Emails (Jakarta Mail smtp wrapper)

java oauth2 email high-performance proxy conversion smtp dkim outlook configurable batch-processing dmarc smime smtp-client cli-support javamail java-mail spring-support builder-api jakarta-mail

• Updated Nov 11, 2026
• Java

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

orchestration stream-processing cloud-native microservices-architecture predictive-analytics batch-processing datapipelines

• Updated Apr 30, 2025
• Java

Distributed Stream and Batch Processing

java kafka big-data stream-processing low-latency batch-processing cdc hacktoberfest event-processing

• Updated Dec 19, 2024
• Java

Squish - Batch Browser-based Image Compression

image-processing batch image-compression batch-processing

• Updated Jan 16, 2025
• TypeScript

BIMP. Batch Image Manipulation Plugin for GIMP.

plugin c gimp image-manipulation batch-processing

• Updated Aug 15, 2024
• C

🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | 𝗟𝗲𝗮𝗿𝗻 𝗠𝗟𝗘 & 𝗠𝗟𝗢𝗽𝘀 for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 2.5 𝘩𝘰𝘶𝘳𝘴 𝘰𝘧 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 & 𝘷𝘪𝘥𝘦𝘰 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

python docker airflow poetry gcp cicd batch-processing data-versioning mlops feature-store github-actions fastapi model-registry streamlit weights-and-biases sktime great-expectations ml-monitoring hopsworks 3-pipeline-design

• Updated Apr 3, 2024
• Python

Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.

iot data-science decentralized orchestration-framework p2p distributed data-engineering bioinformatics-pipeline video-processing data-analysis batch-processing logging-framework ai-pipeline ai-art gene-sequencing ai-data-collection insulators decentralized-computing

• Updated Nov 8, 2026
• Go

The simple, stupid batch framework for Java

java batch batch-processing

• Updated Mar 20, 2023
• Java

Easy-to-use image converter for modern formats. Supports fast parallel encoding, lossless JPEG transcoding, JPEG XL, AVIF, JPEGLI, ExifTool, and more.

converter png jpeg images webp image-resizer batch-processing jxl avif jpeg-xl

• Updated Sep 6, 2026
• Python

Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.

python stream optimization binning batch-processing credit-scoring scorecard streaming-data woe woebinning counterfactual-explanations mdlp

• Updated Nov 12, 2026
• Python

开源 AI 电商图片工作台：商品主图与详情页、批量图片翻译、小红书图文、LangGraph Agent。支持 Windows / macOS 和本地部署，使用自己的模型 API。Open-source e-commerce image generator, translation & agent workspace.

electron windows macos typescript nextjs self-hosted image-editing e-commerce image-generation batch-processing image-translation ai-agents xiaohongshu product-images product-photography langgraph model-context-protocol openai-compatible deterministic-workflow product-detail-page

• Updated Oct 31, 2026
• TypeScript

Self-hosted DeepSeek-OCR-2 WebUI & API — vLLM / transformers on NVIDIA, Apple Silicon & CPU, per-page quality checks, PDF streaming, MCP

python ocr computer-vision mcp web-ui pytorch image-recognition responsive-design batch-processing modern-ui fastapi apple-silicon document-parsing vllm deepseek deepseek-ocr-2

• Updated Nov 7, 2026
• TypeScript