[RNE Rewrite] test: add an on-device performance regression harness - #1363

Draft

msluszniak wants to merge 12 commits into

rne-rewritefrom

@ms/perf-benchmarks

Commits on Aug 27, 2026

test(bench): add an on-device performance regression harness
msluszniak
committed
871448d
test(bench): type case definitions against the pipelines they drive
msluszniak
committed
15c4405
test(bench): make the synthetic waveform actually trigger the VAD
msluszniak
committed
bab8497
test(bench): stop long runs from losing their results
msluszniak
committed
7b48048
test(bench): record the ExecuTorch 1.3.1 baseline
msluszniak
committed
440ab36
test(bench): calibrate the comparator against two runs of identical code
msluszniak
committed
eab78cd
test(bench): detect thermal throttling, which invalidates a comparison
msluszniak
committed
8415106
test(bench): follow the library's schema and constants exports
msluszniak
committed
ffa673d
test(bench): cover instance segmentation, OCR and Kokoro TTS
msluszniak
committed
763585d
test(bench): pin the CPU clock for the duration of a run
msluszniak
committed
ddce0b0
test(bench): wait for the device to be cool instead of sleeping a guess
msluszniak
committed
a81e5b1
test(bench): segment with RF-DETR, not FastSAM
msluszniak
committed
df61e4d