benchmarks: reusable registry, new model types, new phases, CI smoke#735

Draft

FBumann wants to merge 68 commits into

benchmark-suite-charter

Commits on May 27, 2026

docs: update benchmark readme
FBumann
committed

Commits on May 28, 2026

Commits on May 29, 2026

benchmarks: bump pinned numpy 1.26.4 → 2.4.6

FBumann
and
claude
committed
benchmarks: relax numpy pin to <2.0 for wider sweep coverage

FBumann
and
claude
committed
benchmarks: pin numpy back to ==1.26.4 (last 1.x)

FBumann
and
claude
committed
benchmarks: fix sweep silently measuring dev linopy + getattr SOLVER_HANDOFFS

FBumann
and
claude
committed
benchmarks: pin xarray to 2025.1.2 to extend sweep coverage to 0.4.4

FBumann
and
claude
committed
benchmarks: shim write_lp for linopy <0.4.1, extending sweep floor to 0.2.0

FBumann
and
claude
committed
benchmarks: add --as-of <DATE> for cross-time-reproducible sweeps

FBumann
and
claude
committed
benchmarks: harden the sweep isolation seam (preflight + no bytecode)

FBumann
and
claude
committed
benchmarks: copy harness into sweep venvs instead of symlinking

FBumann
and
claude
committed
benchmarks: add ad-hoc `bench` helper for arbitrary callables

FBumann
and
claude
committed
benchmarks: make the suite mypy-clean

FBumann
and
claude
committed
benchmarks: extract snapshot.py + calibrate bench.time

FBumann
and
claude
committed
benchmarks: split sweep orchestration out of cli.py

FBumann
and
claude
committed
benchmarks: drop the "Other CLI surfaces" table from the walkthrough

FBumann
and
claude
committed
benchmarks: show load_long_df from-file diff in the walkthrough

FBumann
and
claude
committed
benchmarks: label sweep snapshots by ref/sha for git/file specs

FBumann
and
claude
committed