📍 Seattle | 💼 SDE @ Amazon | 🎓 MS CS, Indiana University Bloomington
Engineer. Airflow contributor. Perpetual learner. I write about what I learn at shivamrastogi.com.
- 🟦 Airflow TypeScript Task SDK — Enabling TypeScript task execution in Apache Airflow (in development)
- 🔍 claude-code-search — Local semantic search over Claude Code conversation history
- 🛠️ openapi-cli-gen — Generate typed Python CLIs from OpenAPI specs with Pydantic model flattening into CLI flags
- ⚙️ miniflow — Build a workflow orchestrator from scratch — distributed systems, scheduling, and state machines
- 🚀 airflow-ec2 — Deploy Apache Airflow 3.x on EC2 in minutes with AWS CDK
- 🚇 eks-pipeline-cdk — CI/CD pipeline for deploying applications to Amazon EKS with AWS CDK
A deep-dive learning project exploring Apache Pulsar, Kubernetes, TLS/PKI, and AWS infrastructure end-to-end. See the babblebox README for architecture diagrams and a writeup of the K8s and cert-manager setup.
- 💬 babblebox — Async audio chat with Whisper transcription, Django, and Apache Pulsar
- 📦 babblebox-cdk-pipeline — AWS CDK CodePipeline to build, test, and ship the Django app
- 🎙️ whisper-pulsar-consumer — Python Whisper consumer for the Pulsar audio topic
- 🏗️ whisper-pulsar-consumer-cdk — Infra-as-code for the Whisper consumer using AWS CDK
- 🎬 one-take — Cross-platform video recording and editing app
- 📱 onetake-ios — iOS client for One Take built with Swift
- 🏆 daily-wins-progress-tracker — Daily wins and progress tracking app
- 🩺 therapy-site — Therapist portfolio and booking website
Active contributor to Apache Airflow (12 merged PRs, 5 in review) — focused on AWS providers, scheduler reliability, UI, and developer tooling.
- 🔧 Fix duplicate deadline callbacks with HA scheduler replicas — fixed race condition causing duplicate alerts across scheduler replicas
- 🔍 Improve debuggability of SQS, Lambda, EC2, and RDS hooks — added debug logging and exception chaining to 4 AWS hooks
- 🤖 Auto-triage: flag UI PRs missing screenshots from new contributors — GitHub Actions bot for PR quality
- 🐛 Fix AwsBaseWaiterTrigger losing error details on deferred task failure — error messages were being swallowed silently
- 🐛 Fix backfill marked complete before DagRuns are created — backfills were lying about being done
- 🌙 Add dark theme support for FAB Security pages — dark mode for the security UI
- Fixing duplicate deadline callbacks in Airflow's HA scheduler — a three-line fix, a subtle Postgres lock mode, and why HA bugs hide in single-session tests
- Over-engineering an async AI voice chat app, on purpose — seven repos, four languages, Apache Pulsar on Kubernetes — and the honest reason the architecture looks like this
- Apache Airflow — contributing to the scheduler and AWS provider packages
- Airflow TypeScript Task SDK — enabling TypeScript task execution in Airflow
- GenAI developer tools — claude-code-search, openapi-cli-gen
- Writing — technical blog at shivamrastogi.com