LRK-412Token bucket store on Redis with per-key TTL
Done
High
Idle
02:14
LRK-413Middleware: 429 with Retry-After and RateLimit-* headers
In Progress
High
Running
now
LRK-414Per-tenant overrides read from the plans table
In Progress
Medium
Running
now
LRK-415Load test: 12k rps burst, p99 under 40 ms
To Do
Medium
Blocked by 413
01:52
LRK-416Docs: rate limits page and SDK retry examples
To Do
Low
Idle
01:52
+ Add issue
larkspur-cloud-12 agents running1 command runningK for commands
Set it up once. It keeps shipping
What a normal day looks like, three months after setup.
up 94 days since setup212 missions1,486 PRs merged
09:14Tue
Priya mentions @ForgeCode in a Slack thread
P
D
Dev Malhotra
Gateway p99 back to normal after the 08:00 spike.
P
Priya Raghunathan
Rate limiter is still the old in-memory one...
1 reply Last reply 9:16 AM
Message #api-platform
P
Priya Raghunathan
Rate limiter is still the old in-memory one, so it resets on every deploy and customers on the Scale plan keep hitting 429s at 08:00 UTC. @ForgeCode rewrite it on Redis, keep the public headers, per-tenant overrides from the plans table, and load test it before you open a PR.
👀 2✅ 1
1 reply
ForgeCodeAPP
On it. Opened mission LRK-410 on larkspur-cloud-1 with 5 issues. I will report back in this thread when a PR is ready.
Reply...
Rate limiter rewrite for the public API (5 of 5)
All issuesOpenSearch issues
Issue
Status
Priority
Runs
Updated
LRK-412Token bucket store on Redis with per-key TTL
In Progress
High
Running
09:16
LRK-413Middleware: 429 with Retry-After and RateLimit-* headers
In Progress
High
Running
09:16
LRK-414Per-tenant overrides read from the plans table
In Progress
Medium
Running
09:16
LRK-415Load test: 12k rps burst, p99 under 40 ms
To Do
Medium
Blocked by 412, 413
09:16
LRK-416Docs: rate limits page and SDK retry examples
31 files, +1,412 / -688. Tests 212 passed. Clippy clean. Reviewer agent: 2 findings fixed before opening. Merge policy for this repo is ask me, so #1187 waits for you. Want a walkthrough of the Redis bucket before you review? Reply here and I will post one.
🎉 3👀 1
Reply...
Automations (7)
All 7Triggers 4Watchers 3Search automations
Title
Trigger
Last run
Next run
Production alert: open incident, find root cause, open PR
alert sentry prod
02:10
on alert
Nudge stalled issues: rerun from checkpoint after 6h idle
watch: issue idle 6h
03:35
on stall
Remind reviewer when a PR waits more than 8h
watch: PR waiting 8h
07:00
on wait
GitHub bug report: triage, reproduce, open issue
github issues
Mon 16:48
on event
Forum post tagged bug: reproduce and reply
forum discourse
Mon 11:02
on post
Slack message in #api-platform
slack @ForgeCode
09:14
on message
Nightly flaky test sweep, escalate if above 1%
schedule 02:00
02:00
Thu 02:00
02:10 alert: NullPointer in billing/invoice.rs:212, 38 events in 4 min. LRK-419 opened. 02:33 RCA: refunded invoices have no customer since PR #1174 dropped the join. PR #1188 opened; merge policy merge when gates pass for hotfix/*: merged 02:41. 02:44 posted for Dev Okonkwo (owns billing): what changed, why, and how to verify.
Rate limiter rewrite for the public API (6 of 6)
All issuesOpenSearch issues
Issue
Status
Priority
Runs
Updated
LRK-412Token bucket store on Redis with per-key TTL
Done
High
Idle
11:02
LRK-413Middleware: 429 with Retry-After and RateLimit-* headers
Done
High
Idle
12:48
LRK-414Per-tenant overrides read from the plans table
Done
Medium
Idle
15:20
LRK-415Load test: 12k rps burst, p99 under 40 ms
Done
Medium
Idle
18:19
LRK-416Docs: rate limits page and SDK retry examples
In Review
Low
Idle
18:31
LRK-419Incident: NullPointer in billing/invoice.rs (alert). PR #1188 merged by factory
Done
High
Idle
02:41
In ReviewPR #1187Rate limiter on Redis, ready for Priya since 18:32
Staged demopr-1187.staging.larkspur.devVideo proof429 and Retry-After walkthrough, 1:48Load test report12,400 rps for 5 min, p99 31 ms
Verifications completed 6 of 6
Tests: 212 passed
Clippy: 0 warnings
Load test: p99 31 ms
Security scan: 0 findings
Staging smoke: 18 of 18
Reviewer agent: 2 fixed
reminder Priya: PR #1187 has waited 12h for your review. Demo and video are ready
Weekly summary larkspur-cloud-1, last 7 dayssent to #eng-leads 07:05
Executive summaryThroughputQualityIncidents
Shipped108+14% vs last week
Missions done16/171 in review
Trigger to PR, median3h 40mwas 5h 10m
Gates passed first time87%13% reworked before review
You are visitor 01402503 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.