It seems like https://github.com/vortex-data/vortex/pull/8742 did not successfully stamp out all flaky benchmarks <!-- __CODSPEED_PERFORMANCE_REPORT_COMMENT__ --> ## Merging this PR will **improve performance by 11.55%** <details> <summary>:warning: <b>Unknown Walltime execution environment detected</b></summary> > Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. > > For the most accurate results, we recommend using [CodSpeed Macro Runners](https://codspeed.io/docs/instruments/walltime): bare-metal machines fine-tuned for performance measurement consistency. </details> `⚡ 2` improved benchmarks `✅ 1710` untouched benchmarks `⏩ 10` skipped benchmarks[^skipped] ### Performance Changes | | Mode | Benchmark | `BASE` | `HEAD` | Efficiency | | --- | ---- | --------- | ------ | ------ | ---------- | | ⚡ | Simulation | [`` compress[(100000, 4)] ``](https://app.codspeed.io/vortex-data/vortex/branches/ct%2Fnuke-v2-bench-website?uri=encodings%2Frunend%2Fbenches%2Frun_end_compress.rs%3A%3Acompress%5B%28100000%2C+4%29%5D&runnerMode=Simulation&utm_source=github&utm_medium=comment-v2&utm_content=benchmark) | 1.8 ms | 1.6 ms | +11.93% | | ⚡ | Simulation | [`` true_count_vortex_buffer[128] ``](https://app.codspeed.io/vortex-data/vortex/branches/ct%2Fnuke-v2-bench-website?uri=vortex-buffer%2Fbenches%2Fvortex_bitbuffer.rs%3A%3Atrue_count_vortex_buffer%5B128%5D&runnerMode=Simulation&utm_source=github&utm_medium=comment-v2&utm_content=benchmark) | 580.6 ns | 522.2 ns | +11.17% | > [!TIP] > Curious why this is faster? Comment `@codspeedbot explain why this is faster` on this PR, or directly use the [CodSpeed MCP](https://codspeed.io/docs/ai/mcp?utm_source=github&utm_medium=comment-v2&utm_content=mcp_tip_improvement) with your agent. --- <sub>Comparing <code>ct/nuke-v2-bench-website</code> (49b2b3f) with <code>develop</code> (17f843a)</sub> <a href="https://app.codspeed.io/vortex-data/vortex/branches/ct%2Fnuke-v2-bench-website?utm_source=github&utm_medium=comment-v2&utm_content=button"> <picture> <source media="(prefers-color-scheme: dark)" srcset="https://codspeed.io/pr-report/open-in-codspeed-dark.svg"> <source media="(prefers-color-scheme: light)" srcset="https://codspeed.io/pr-report/open-in-codspeed-light.svg"> <img alt="Open in CodSpeed" src="https://codspeed.io/pr-report/open-in-codspeed-light.svg" width="169" height="32"> </picture> </a> [^skipped]: 10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, [click here and archive them to remove them from the performance reports](https://app.codspeed.io/vortex-data/vortex/branches/ct%2Fnuke-v2-bench-website?q=is%3Askipped&utm_source=github&utm_medium=comment-v2&utm_content=archive). _Originally posted by @codspeed-hq[bot] in https://github.com/vortex-data/vortex/issues/8805#issuecomment-4996186535_
It seems like #8742 did not successfully stamp out all flaky benchmarks
Merging this PR will improve performance by 11.55%
⚡ 2improved benchmarks✅ 1710untouched benchmarks⏩ 10skipped benchmarks1Performance Changes
BASEHEADcompress[(100000, 4)]true_count_vortex_buffer[128]Tip
Curious why this is faster? Comment
@codspeedbot explain why this is fasteron this PR, or directly use the CodSpeed MCP with your agent.Comparing
ct/nuke-v2-bench-website(49b2b3f) withdevelop(17f843a)Originally posted by @codspeed-hq[bot] in #8805 (comment)
Footnotes
10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩