GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — bench: add reproducible engine and context shaping workload by milanb17 · Pull Request #103 · devdotfast/diffr

This repository was archived by the owner on Oct 9, 2026. It is now read-only.

Conversation

@milanb17

@milanb17 milanb17 commented Oct 8, 2026

Copy link
Copy Markdown

Summary

Add a reproducible Criterion workload for investigating engine/context-folding performance:

cargo bench --locked --bench engine
├── init/queries/{default,no_context}
├── engine/pr998/{default,no_context}
└── shape/pr998/context

Bundles four TypeScript/TSX before/after pairs from Whiteboard PR #998 (215,152 bytes), with provenance, hashes, and their MIT license. The benchmark reuses the actual CLI component host; the only host-source edit makes a module path explicit so it can also compile in the bench target.

docs/benchmarks.md describes baseline comparisons, timing boundaries, and rebuilding bundled plugin components after changing their Rust sources. These are native CLI/Wasmtime measurements, not browser-WASM timings. No-context also removes its query contributions; isolated shaping uses fresh clones of the same default-query trees.

Evidence

  • Before: no checked-in cargo bench workload for this regression; reproducing the earlier measurement required an external fixture/harness.
  • After: all five benchmarks completed in an optimized build on Rust 1.99.0. Initial Criterion point estimates: query compilation 616 ms default / 100 ms without context; four-file processing 2.266 s default / 161 ms without context; isolated context shaping 1.849 s. These are local observations, not hardware-independent thresholds.
  • Passed cargo bench --locked --bench engine -- --save-baseline initial and cargo bench --locked --bench engine -- --test (all five report success).
  • Passed formatting, diff whitespace checks, and all eight fixture hash/byte-count checks. Preflight rejects structural fallbacks, plugin failures, and source-text changes.

Merge Danger

Door: two-way. Blast Radius: development-only benchmark/dependency/fixture additions and one equivalent module-path annotation; no intended engine behavior change. Initial compilation includes Wasmtime and parser dependencies; full sampling takes longer than the quick --test check.

AI-assisted: OpenAI Codex.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
@milanb17
bench: add reproducible engine and context shaping workload
f0aa34d
Benchmark query compilation, full core/shape processing, and isolated context shaping with Criterion and bundled PR998 inputs. Document timing boundaries and plugin rebuild requirements.

AI-assisted: OpenAI Codex.
This was referenced Oct 8, 2026
diffr: index the plugin cursor devdotfast/whiteboard#1011
Merged
bench: add reproducible engine and context shaping workload devdotfast/whiteboard#1013
Merged
sidkmenon pushed a commit to devdotfast/whiteboard that referenced this pull request Oct 8, 2026
@milanb17 @sidkmenon
bench: add reproducible engine and context shaping workload
29ef2b3
Benchmark query compilation, full core/shape processing, and isolated context shaping with Criterion and bundled PR998 inputs. Document timing boundaries and plugin rebuild requirements.

Imported from devdotfast/diffr#103.

AI-assisted: OpenAI Codex.
Agent-Session: fb96350b-c19e-48f0-b364-31e9ad2b72f4
Agent-Session: 01a1196d-bad4-7f61-bafc-f63d12217676
Agent-Session: 7d7ac281-cc4b-4437-9e1e-3872651e8bcf
Agent-Session: a7af3b88-3bb7-48a2-ae20-7626a83628a1
Agent-Session: 01a11aca-5007-7b80-ad35-c0a0f746a05d
Agent-Session: 01a11c34-48e4-7ec1-bb72-2c496acb90dc
Agent-Session: 01a11c3d-70b4-7df1-be1a-f0e12840fadf
sidkmenon added a commit to devdotfast/whiteboard that referenced this pull request Oct 8, 2026
@sidkmenon @milanb17
bench: add reproducible engine and context shaping workload (#1013)
81c422d
Imports devdotfast/diffr#103 by @milanb17 into the monorepo, unchanged
except for the `diffr/` path.

`cargo bench --bench engine` in `diffr/`. See
`diffr/docs/benchmarks.md`.

Co-authored-by: Milan Bhandari <[email protected]>

This branch has not been deployed

No deployments
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

No reviews

Uh oh!

There was an error while loading. Please reload this page.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

1 participant

@milanb17
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402520 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.