Peer 2 peer distributed/serverless computing solution.Define the problem , the way workers to solve it, code dependencies. Then the most difficult part is to find more workers/peers.. Example usecase : distributed web scraper

nodejs processing peer2peer queue distributed-computing task-runner task-queue dist distributed-scraper distributed-queue distribute-job distributed-scraping dynamic-code-execution push-work distributed-computation serverless-distributed-computing distributed-task-queue queuexec

• Updated Sep 5, 2025
• JavaScript

local delayQueue implemented by JDK & two kinds of distributed delayQueue based redis

redis delay-queue distributed-queue

• Updated May 25, 2018
• Java

Durable per-application work queue with named queues, fenced leases, and atomic follow-up tasks.

python docker distributed-systems rest-api postgresql background-jobs openapi retry job-queue task-queue long-polling work-queue idempotency background-processing distributed-queue dead-letter-queue cloudevents at-least-once-delivery transactional-outbox durable-execution

• Updated Nov 6, 2026
• Python

Worker part of queue-xec , can runs jobs - install required dependencies dynamically on demand.All required data with master exchanged with encryption.

distributed-systems task-queue distributed-task-processing distributed-queue queuexec

• Updated Sep 11, 2025
• JavaScript

⚡ Distributed job queue & DAG workflow engine for Java 17+ & Java 21 Loom with Redis. BullMQ wire-compatible with Spring Boot 3.

redis distributed-systems background-jobs rate-limiting message-queue job-queue task-scheduler redis-queue distributed-queue bullmq project-loom java17 spring-boot-3 bull-board virtual-threads java21 dag-workflows

• Updated Nov 1, 2026
• Java

A concurrent web crawler built from scratch in Go with Redis-backed frontier/visited set, worker pool, and Docker Compose. Learning project for distributed systems.

go web-crawler distributed-queue

• Updated Sep 11, 2026
• Go

Distributed Queue with Shards/Partitions and Broker Manager

distributed-systems sharding distributed-queue pubsubplatform

• Updated Mar 15, 2023
• Python

Distributed queue system for image processing using Node.js, BullMQ, Sharp and Redis

nodejs pipeline worker-queue distributed-queue github-oauth2

• Updated Dec 7, 2025
• JavaScript

Redis Single File - Distributed Execution Synchronization

ruby redis synchronization semaphore mutex distributed-lock redlock distributed-queue mutex-lock mutex-synchronization

• Updated Nov 6, 2026
• Ruby

Laboratory works for Distributed Systems course: introduction to Hazelcast and two-phase transactions

distributed-systems hazelcast postgresql distributed-lock two-phase-commit distributed-queue distributed-map

• Updated May 10, 2019
• Jupyter Notebook

Distributed work queue operations using mpi4py.

mpi distributed-computing mpi-applications mpi4py distributed-queue

• Updated Nov 7, 2026
• Python

Distributed queues implemented in Go, A practical evaluation of several Go-based distributed queue systems tested for their performance under load and their suitability for managing real-time user requests during high-demand periods.

docker golang rabbitmq reddis distributed-queue

• Updated Jan 28, 2026
• Go