Skip to content

Revert "Add extension constant pushdown rule and fix InnerProduct rule"#7520

Closed
joseph-isaacs wants to merge 1 commit intodevelopfrom
revert-7507-ct/extension-constant
Closed

Revert "Add extension constant pushdown rule and fix InnerProduct rule"#7520
joseph-isaacs wants to merge 1 commit intodevelopfrom
revert-7507-ct/extension-constant

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

Reverts #7507

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 17, 2026
@joseph-isaacs joseph-isaacs enabled auto-merge (squash) April 17, 2026 17:56
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 17, 2026
@connortsui20
Copy link
Copy Markdown
Contributor

we only want to revert the rule, not the other changes

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 17, 2026

Merging this PR will degrade performance by 23.81%

❌ 24 regressed benchmarks
✅ 1139 untouched benchmarks
⏩ 1457 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation take_search[(0.005, 0.05)] 132 µs 168.7 µs -21.75%
Simulation take_search[(0.01, 0.1)] 268.5 µs 341.6 µs -21.4%
Simulation take_search[(0.005, 1.0)] 2.3 ms 3.1 ms -23.81%
Simulation take_search[(0.01, 0.05)] 143 µs 179.7 µs -20.42%
Simulation take_search[(0.01, 0.5)] 1.3 ms 1.6 ms -22.22%
Simulation take_search[(0.005, 0.1)] 247.7 µs 320.8 µs -22.79%
Simulation take_search[(0.005, 0.5)] 1.2 ms 1.5 ms -23.68%
Simulation take_search[(0.01, 1.0)] 2.5 ms 3.3 ms -22.34%
Simulation take_search[(0.1, 0.5)] 1.8 ms 2.2 ms -16.94%
Simulation take_search[(0.1, 0.1)] 386 µs 459.1 µs -15.92%
Simulation take_search[(0.1, 1.0)] 3.5 ms 4.3 ms -17.1%
Simulation take_search_chunked[(0.005, 1.0)] 3.1 ms 3.7 ms -16.78%
Simulation take_search[(0.1, 0.05)] 212.8 µs 249.5 µs -14.71%
Simulation take_search_chunked[(0.005, 0.1)] 322.4 µs 384.4 µs -16.15%
Simulation take_search_chunked[(0.1, 1.0)] 4.2 ms 4.9 ms -12.73%
Simulation take_search_chunked[(0.005, 0.5)] 1.5 ms 1.9 ms -16.7%
Simulation take_search_chunked[(0.1, 0.05)] 248.9 µs 279.9 µs -11.1%
Simulation take_search_chunked[(0.01, 0.05)] 182.8 µs 213.9 µs -14.54%
Simulation take_search_chunked[(0.1, 0.5)] 2.1 ms 2.4 ms -12.63%
Simulation take_search_chunked[(0.005, 0.05)] 169.9 µs 201 µs -15.49%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing revert-7507-ct/extension-constant (2f9a5e2) with develop (4d73f97)

Open in CodSpeed

Footnotes

  1. 1457 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

auto-merge was automatically disabled April 17, 2026 18:02

Pull request was closed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 17, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 2f9a5e2 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.937x ➖


datafusion / vortex-file-compressed (0.937x ➖, 1↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 129029022 137208967 0.94
polarsignals_q01/datafusion:vortex-file-compressed 387572755 420910989 0.92
polarsignals_q02/datafusion:vortex-file-compressed 24256301 25224673 0.96
polarsignals_q03/datafusion:vortex-file-compressed 389714950 403683256 0.97
polarsignals_q04/datafusion:vortex-file-compressed 11788272 12623151 0.93
polarsignals_q05/datafusion:vortex-file-compressed 16171787 17968147 0.90
polarsignals_q06/datafusion:vortex-file-compressed 19858529 19474944 1.02
polarsignals_q07/datafusion:vortex-file-compressed 14457997 15507126 0.93
polarsignals_q08/datafusion:vortex-file-compressed 474551735 508883156 0.93
polarsignals_q09/datafusion:vortex-file-compressed 🚀 10479766 11994454 0.87

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.2%
Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.037x ➖
Shifts: Parquet (control) +3.7% · Median polish +1.1%


datafusion / vortex-file-compressed (0.995x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5575397 5193523 1.07
fineweb_q01/datafusion:vortex-file-compressed 26502624 26623758 1.00
fineweb_q02/datafusion:vortex-file-compressed 26009525 28151228 0.92
fineweb_q03/datafusion:vortex-file-compressed 83090937 89783390 0.93
fineweb_q04/datafusion:vortex-file-compressed 250801325 254962519 0.98
fineweb_q05/datafusion:vortex-file-compressed 220477177 243901228 0.90
fineweb_q06/datafusion:vortex-file-compressed 63433549 63012926 1.01
fineweb_q07/datafusion:vortex-file-compressed 67417611 67281150 1.00
fineweb_q08/datafusion:vortex-file-compressed 🚨 26317579 22520920 1.17
datafusion / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5541127 5612524 0.99
fineweb_q01/datafusion:vortex-compact 165428074 164783755 1.00
fineweb_q02/datafusion:vortex-compact 164844596 164430205 1.00
fineweb_q03/datafusion:vortex-compact 1469307596 1447333241 1.02
fineweb_q04/datafusion:vortex-compact 1578673646 1554435451 1.02
fineweb_q05/datafusion:vortex-compact 1239297773 1233561020 1.00
fineweb_q06/datafusion:vortex-compact 700586026 694570911 1.01
fineweb_q07/datafusion:vortex-compact 740025725 731557981 1.01
fineweb_q08/datafusion:vortex-compact 23318032 24341715 0.96
datafusion / parquet (1.026x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6978051 6948613 1.00
fineweb_q01/datafusion:parquet 298496178 295243049 1.01
fineweb_q02/datafusion:parquet 299119188 295333076 1.01
fineweb_q03/datafusion:parquet 303855537 289277825 1.05
fineweb_q04/datafusion:parquet 319755048 303747784 1.05
fineweb_q05/datafusion:parquet 311369840 313002900 0.99
fineweb_q06/datafusion:parquet 302421378 296973614 1.02
fineweb_q07/datafusion:parquet 306842076 291204730 1.05
fineweb_q08/datafusion:parquet 299484481 289288021 1.04
duckdb / vortex-file-compressed (1.015x ➖, 0↑ 2↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3757327 3246315 1.16
fineweb_q01/duckdb:vortex-file-compressed 26555366 29494879 0.90
fineweb_q02/duckdb:vortex-file-compressed 🚨 27641918 24638795 1.12
fineweb_q03/duckdb:vortex-file-compressed 129517353 136964755 0.95
fineweb_q04/duckdb:vortex-file-compressed 233322708 229433703 1.02
fineweb_q05/duckdb:vortex-file-compressed 223740116 217871950 1.03
fineweb_q06/duckdb:vortex-file-compressed 69655545 64638159 1.08
fineweb_q07/duckdb:vortex-file-compressed 67682481 69751171 0.97
fineweb_q08/duckdb:vortex-file-compressed 25301214 26623461 0.95
duckdb / vortex-compact (1.004x ➖, 1↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4096799 3922033 1.04
fineweb_q01/duckdb:vortex-compact 114430152 108568180 1.05
fineweb_q02/duckdb:vortex-compact 117622198 117265914 1.00
fineweb_q03/duckdb:vortex-compact 880724241 862929771 1.02
fineweb_q04/duckdb:vortex-compact 918382077 907777746 1.01
fineweb_q05/duckdb:vortex-compact 819092361 818779140 1.00
fineweb_q06/duckdb:vortex-compact 476645132 462048633 1.03
fineweb_q07/duckdb:vortex-compact 482728555 478029264 1.01
fineweb_q08/duckdb:vortex-compact 🚀 21322882 24508078 0.87
duckdb / parquet (1.048x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31047372 28674406 1.08
fineweb_q01/duckdb:parquet 86885123 82067246 1.06
fineweb_q02/duckdb:parquet 85597538 82983304 1.03
fineweb_q03/duckdb:parquet 312305027 308895899 1.01
fineweb_q04/duckdb:parquet 441716432 437853714 1.01
fineweb_q05/duckdb:parquet 413942532 408858701 1.01
fineweb_q06/duckdb:parquet 201792691 197338402 1.02
fineweb_q07/duckdb:parquet 211529605 207652244 1.02
fineweb_q08/duckdb:parquet 🚨 34266053 28507143 1.20
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -1.3% +4.3% -5.3% +33.2% ➖ noise
0 datafusion:vortex-file-compressed +7.4% +4.3% +3.0% +54.9% ➖ noise
0 duckdb:vortex-compact +4.5% +4.3% +0.2% +32.7% ➖ noise
0 duckdb:vortex-file-compressed +15.7% +4.3% +11.0% +42.6% ➖ noise
1 datafusion:vortex-compact +0.4% +3.5% -3.0% +11.8% ➖ noise
1 datafusion:vortex-file-compressed -0.5% +3.5% -3.8% +17.5% ➖ noise
1 duckdb:vortex-compact +5.4% +3.5% +1.9% +25.6% ➖ noise
1 duckdb:vortex-file-compressed -10.0% +3.5% -13.0% +47.7% ➖ noise
2 datafusion:vortex-compact +0.3% +2.2% -1.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -7.6% +2.2% -9.6% +17.7% ➖ noise
2 duckdb:vortex-compact +0.3% +2.2% -1.9% +16.5% ➖ noise
2 duckdb:vortex-file-compressed +12.2% +2.2% +9.8% +17.6% ➖ noise
3 datafusion:vortex-compact +1.5% +3.1% -1.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -7.5% +3.1% -10.2% +21.2% ➖ noise
3 duckdb:vortex-compact +2.1% +3.1% -1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.4% +3.1% -8.2% +26.6% ➖ noise
4 datafusion:vortex-compact +1.6% +3.1% -1.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.6% +3.1% -4.5% +10.0% ➖ noise
4 duckdb:vortex-compact +1.2% +3.1% -1.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.7% +3.1% -1.3% +10.0% ➖ noise
5 datafusion:vortex-compact +0.5% +0.4% +0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -9.6% +0.4% -9.9% +11.4% ➖ noise
5 duckdb:vortex-compact +0.0% +0.4% -0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.7% +0.4% +2.3% +10.0% ➖ noise
6 datafusion:vortex-compact +0.9% +2.0% -1.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.7% +2.0% -1.4% +11.7% ➖ noise
6 duckdb:vortex-compact +3.2% +2.0% +1.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +7.8% +2.0% +5.6% +16.2% ➖ noise
7 datafusion:vortex-compact +1.2% +3.6% -2.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.2% +3.6% -3.3% +12.6% ➖ noise
7 duckdb:vortex-compact +1.0% +3.6% -2.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.0% +3.6% -6.3% +10.0% ➖ noise
8 datafusion:vortex-compact -4.2% +11.6% -14.1% +28.8% ➖ noise
8 datafusion:vortex-file-compressed +16.9% +11.6% +4.8% +29.3% ➖ noise
8 duckdb:vortex-compact -13.0% +11.6% -22.0% +18.7% ✅ faster
8 duckdb:vortex-file-compressed -5.0% +11.6% -14.8% +12.5% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.2%
Vortex (geomean): 1.048x ➖
Parquet (geomean): 1.018x ➖
Shifts: Parquet (control) +1.8% · Median polish +4.2%


datafusion / vortex-file-compressed (1.043x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 53421035 52079282 1.03
tpch_q02/datafusion:vortex-file-compressed 34888953 34018230 1.03
tpch_q03/datafusion:vortex-file-compressed 29065103 28088505 1.03
tpch_q04/datafusion:vortex-file-compressed 20189470 19844042 1.02
tpch_q05/datafusion:vortex-file-compressed 55677624 55966260 0.99
tpch_q06/datafusion:vortex-file-compressed 11247177 10777360 1.04
tpch_q07/datafusion:vortex-file-compressed 66279138 66787859 0.99
tpch_q08/datafusion:vortex-file-compressed 48601440 47000058 1.03
tpch_q09/datafusion:vortex-file-compressed 60399369 56745030 1.06
tpch_q10/datafusion:vortex-file-compressed 47895653 46664939 1.03
tpch_q11/datafusion:vortex-file-compressed 19154069 18278263 1.05
tpch_q12/datafusion:vortex-file-compressed 25203035 24589993 1.02
tpch_q13/datafusion:vortex-file-compressed 28215344 28365221 0.99
tpch_q14/datafusion:vortex-file-compressed 🚨 18351476 16464211 1.11
tpch_q15/datafusion:vortex-file-compressed 27533958 25350550 1.09
tpch_q16/datafusion:vortex-file-compressed 26955791 25668310 1.05
tpch_q17/datafusion:vortex-file-compressed 68975815 63201768 1.09
tpch_q18/datafusion:vortex-file-compressed 82348308 80559562 1.02
tpch_q19/datafusion:vortex-file-compressed 25993255 24332221 1.07
tpch_q20/datafusion:vortex-file-compressed 35133078 33888769 1.04
tpch_q21/datafusion:vortex-file-compressed 82227606 75232364 1.09
tpch_q22/datafusion:vortex-file-compressed 17689367 16708778 1.06
datafusion / vortex-compact (1.047x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 62065787 57462721 1.08
tpch_q02/datafusion:vortex-compact 40014842 36997048 1.08
tpch_q03/datafusion:vortex-compact 32905677 31498924 1.04
tpch_q04/datafusion:vortex-compact 24573284 22958788 1.07
tpch_q05/datafusion:vortex-compact 60019630 56032072 1.07
tpch_q06/datafusion:vortex-compact 14952956 13885978 1.08
tpch_q07/datafusion:vortex-compact 73069414 69852814 1.05
tpch_q08/datafusion:vortex-compact 50768432 49952900 1.02
tpch_q09/datafusion:vortex-compact 63883466 62659675 1.02
tpch_q10/datafusion:vortex-compact 56970187 53491053 1.07
tpch_q11/datafusion:vortex-compact 20577775 19483500 1.06
tpch_q12/datafusion:vortex-compact 35451896 33347262 1.06
tpch_q13/datafusion:vortex-compact 38182902 36422776 1.05
tpch_q14/datafusion:vortex-compact 21631906 21289394 1.02
tpch_q15/datafusion:vortex-compact 36630345 34810777 1.05
tpch_q16/datafusion:vortex-compact 30117094 30101998 1.00
tpch_q17/datafusion:vortex-compact 72926506 72575485 1.00
tpch_q18/datafusion:vortex-compact 90002434 85904567 1.05
tpch_q19/datafusion:vortex-compact 36605737 35474676 1.03
tpch_q20/datafusion:vortex-compact 41233543 39069799 1.06
tpch_q21/datafusion:vortex-compact 93299354 88255473 1.06
tpch_q22/datafusion:vortex-compact 18136689 17572159 1.03
datafusion / parquet (1.042x ➖, 2↑ 5↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 138106792 137573173 1.00
tpch_q02/datafusion:parquet 72843287 69266737 1.05
tpch_q03/datafusion:parquet 81236355 74021990 1.10
tpch_q04/datafusion:parquet 50181920 50329410 1.00
tpch_q05/datafusion:parquet 108105571 103365577 1.05
tpch_q06/datafusion:parquet 🚀 36337062 44570469 0.82
tpch_q07/datafusion:parquet 119909525 113531537 1.06
tpch_q08/datafusion:parquet 🚨 112897808 101681422 1.11
tpch_q09/datafusion:parquet 🚨 144157911 130455596 1.11
tpch_q10/datafusion:parquet 129030749 121762686 1.06
tpch_q11/datafusion:parquet 52106272 48228551 1.08
tpch_q12/datafusion:parquet 🚀 83288029 94421232 0.88
tpch_q13/datafusion:parquet 🚨 233282970 203160642 1.15
tpch_q14/datafusion:parquet 46875974 51152255 0.92
tpch_q15/datafusion:parquet 67766465 64733281 1.05
tpch_q16/datafusion:parquet 52926758 51088476 1.04
tpch_q17/datafusion:parquet 🚨 154046920 130944513 1.18
tpch_q18/datafusion:parquet 181693615 174314334 1.04
tpch_q19/datafusion:parquet 🚨 94495935 77349310 1.22
tpch_q20/datafusion:parquet 78845139 76785343 1.03
tpch_q21/datafusion:parquet 158464095 148631867 1.07
tpch_q22/datafusion:parquet 36517959 35831705 1.02
datafusion / arrow (1.099x ➖, 0↑ 10↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 54784179 52951068 1.03
tpch_q02/datafusion:arrow 22486652 21786471 1.03
tpch_q03/datafusion:arrow 🚨 36823886 32905753 1.12
tpch_q04/datafusion:arrow 🚨 30328667 27154959 1.12
tpch_q05/datafusion:arrow 🚨 83537245 75178461 1.11
tpch_q06/datafusion:arrow 20717938 19511506 1.06
tpch_q07/datafusion:arrow 🚨 122328341 108932185 1.12
tpch_q08/datafusion:arrow 47205778 44012013 1.07
tpch_q09/datafusion:arrow 77452301 72638725 1.07
tpch_q10/datafusion:arrow 🚨 56983477 51159166 1.11
tpch_q11/datafusion:arrow 12263716 11245272 1.09
tpch_q12/datafusion:arrow 58619476 54492841 1.08
tpch_q13/datafusion:arrow 52781613 49129953 1.07
tpch_q14/datafusion:arrow 🚨 26339947 22545910 1.17
tpch_q15/datafusion:arrow 🚨 51532651 43324471 1.19
tpch_q16/datafusion:arrow 22688016 20650170 1.10
tpch_q17/datafusion:arrow 76007127 69741883 1.09
tpch_q18/datafusion:arrow 151652064 142093284 1.07
tpch_q19/datafusion:arrow 🚨 41981015 36954214 1.14
tpch_q20/datafusion:arrow 🚨 43142101 37566649 1.15
tpch_q21/datafusion:arrow 🚨 174613989 150807628 1.16
tpch_q22/datafusion:arrow 20937839 20064854 1.04
duckdb / vortex-file-compressed (1.049x ➖, 0↑ 2↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 34674019 32974225 1.05
tpch_q02/duckdb:vortex-file-compressed 28983389 27695074 1.05
tpch_q03/duckdb:vortex-file-compressed 31768850 29135513 1.09
tpch_q04/duckdb:vortex-file-compressed 31289135 30230257 1.04
tpch_q05/duckdb:vortex-file-compressed 35852267 34384525 1.04
tpch_q06/duckdb:vortex-file-compressed 11317695 10941485 1.03
tpch_q07/duckdb:vortex-file-compressed 🚨 40809468 36715679 1.11
tpch_q08/duckdb:vortex-file-compressed 42950584 40473958 1.06
tpch_q09/duckdb:vortex-file-compressed 87298936 81640309 1.07
tpch_q10/duckdb:vortex-file-compressed 38988412 37036528 1.05
tpch_q11/duckdb:vortex-file-compressed 17041804 16579457 1.03
tpch_q12/duckdb:vortex-file-compressed 23621312 23544731 1.00
tpch_q13/duckdb:vortex-file-compressed 38114081 36614146 1.04
tpch_q14/duckdb:vortex-file-compressed 22135267 21377163 1.04
tpch_q15/duckdb:vortex-file-compressed 16749252 16364222 1.02
tpch_q16/duckdb:vortex-file-compressed 30909437 30054369 1.03
tpch_q17/duckdb:vortex-file-compressed 26460844 25614285 1.03
tpch_q18/duckdb:vortex-file-compressed 54533749 52362575 1.04
tpch_q19/duckdb:vortex-file-compressed 33553734 32038339 1.05
tpch_q20/duckdb:vortex-file-compressed 36169674 35412492 1.02
tpch_q21/duckdb:vortex-file-compressed 117870140 111629022 1.06
tpch_q22/duckdb:vortex-file-compressed 🚨 21772954 19037534 1.14
duckdb / vortex-compact (1.053x ➖, 0↑ 2↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 41968930 41128336 1.02
tpch_q02/duckdb:vortex-compact 41963534 38842694 1.08
tpch_q03/duckdb:vortex-compact 34913317 33347484 1.05
tpch_q04/duckdb:vortex-compact 36741041 33456421 1.10
tpch_q05/duckdb:vortex-compact 39531115 37488877 1.05
tpch_q06/duckdb:vortex-compact 14967987 14623873 1.02
tpch_q07/duckdb:vortex-compact 45468021 43410276 1.05
tpch_q08/duckdb:vortex-compact 49055718 45603498 1.08
tpch_q09/duckdb:vortex-compact 92315819 90461391 1.02
tpch_q10/duckdb:vortex-compact 42658067 41765846 1.02
tpch_q11/duckdb:vortex-compact 21229530 20648287 1.03
tpch_q12/duckdb:vortex-compact 38253812 36234841 1.06
tpch_q13/duckdb:vortex-compact 48338920 46992172 1.03
tpch_q14/duckdb:vortex-compact 🚨 33021544 29819727 1.11
tpch_q15/duckdb:vortex-compact 20177346 19199279 1.05
tpch_q16/duckdb:vortex-compact 39794261 37989925 1.05
tpch_q17/duckdb:vortex-compact 32185283 31014911 1.04
tpch_q18/duckdb:vortex-compact 54758533 50709865 1.08
tpch_q19/duckdb:vortex-compact 39043412 37528730 1.04
tpch_q20/duckdb:vortex-compact 43957277 42625387 1.03
tpch_q21/duckdb:vortex-compact 🚨 120751588 109462797 1.10
tpch_q22/duckdb:vortex-compact 22724344 20954060 1.08
duckdb / parquet (0.994x ➖, 1↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76388737 78633874 0.97
tpch_q02/duckdb:parquet 40265913 40526697 0.99
tpch_q03/duckdb:parquet 70722343 76466230 0.92
tpch_q04/duckdb:parquet 46749113 49047437 0.95
tpch_q05/duckdb:parquet 65519716 69259252 0.95
tpch_q06/duckdb:parquet 20326856 20668701 0.98
tpch_q07/duckdb:parquet 69501424 71154573 0.98
tpch_q08/duckdb:parquet 🚀 82829312 100290104 0.83
tpch_q09/duckdb:parquet 160220317 157394847 1.02
tpch_q10/duckdb:parquet 121407216 117446462 1.03
tpch_q11/duckdb:parquet 23304333 22662478 1.03
tpch_q12/duckdb:parquet 46754931 45407636 1.03
tpch_q13/duckdb:parquet 268722128 249078233 1.08
tpch_q14/duckdb:parquet 49623085 49410661 1.00
tpch_q15/duckdb:parquet 25003314 24272752 1.03
tpch_q16/duckdb:parquet 57199538 56520138 1.01
tpch_q17/duckdb:parquet 51783026 51773501 1.00
tpch_q18/duckdb:parquet 114554887 114916559 1.00
tpch_q19/duckdb:parquet 68080972 67605133 1.01
tpch_q20/duckdb:parquet 63773712 64460041 0.99
tpch_q21/duckdb:parquet 176708354 165436553 1.07
tpch_q22/duckdb:parquet 53549934 51744724 1.03
duckdb / duckdb (1.013x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16457994 16838209 0.98
tpch_q02/duckdb:duckdb 13498916 13659621 0.99
tpch_q03/duckdb:duckdb 20390630 20515771 0.99
tpch_q04/duckdb:duckdb 19738652 20229682 0.98
tpch_q05/duckdb:duckdb 20967464 21603660 0.97
tpch_q06/duckdb:duckdb 5646854 5556224 1.02
tpch_q07/duckdb:duckdb 23580093 23508501 1.00
tpch_q08/duckdb:duckdb 21375936 21041775 1.02
tpch_q09/duckdb:duckdb 59130086 57649062 1.03
tpch_q10/duckdb:duckdb 45192718 44132501 1.02
tpch_q11/duckdb:duckdb 6192107 5905367 1.05
tpch_q12/duckdb:duckdb 14430786 13693810 1.05
tpch_q13/duckdb:duckdb 38078095 38303398 0.99
tpch_q14/duckdb:duckdb 18946981 18468036 1.03
tpch_q15/duckdb:duckdb 12220740 12001758 1.02
tpch_q16/duckdb:duckdb 24105755 24776844 0.97
tpch_q17/duckdb:duckdb 14932244 13624727 1.10
tpch_q18/duckdb:duckdb 38537675 38534299 1.00
tpch_q19/duckdb:duckdb 27256886 26393854 1.03
tpch_q20/duckdb:duckdb 22740345 22987730 0.99
tpch_q21/duckdb:duckdb 61068216 57599147 1.06
tpch_q22/duckdb:duckdb 25102896 24892984 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +3.5% -1.2% +4.8% +16.6% ➖ noise
1 datafusion:vortex-compact +8.0% -1.2% +9.4% +15.7% ➖ noise
1 datafusion:vortex-file-compressed +2.6% -1.2% +3.9% +15.9% ➖ noise
1 duckdb:duckdb -2.3% -1.2% -1.0% +15.8% ➖ noise
1 duckdb:vortex-compact +2.0% -1.2% +3.3% +15.8% ➖ noise
1 duckdb:vortex-file-compressed +5.2% -1.2% +6.5% +15.3% ➖ noise
2 datafusion:arrow +3.2% +2.2% +1.0% +14.4% ➖ noise
2 datafusion:vortex-compact +8.2% +2.2% +5.8% +14.4% ➖ noise
2 datafusion:vortex-file-compressed +2.6% +2.2% +0.3% +14.4% ➖ noise
2 duckdb:duckdb -1.2% +2.2% -3.3% +14.4% ➖ noise
2 duckdb:vortex-compact +8.0% +2.2% +5.7% +14.4% ➖ noise
2 duckdb:vortex-file-compressed +4.7% +2.2% +2.4% +14.4% ➖ noise
3 datafusion:arrow +11.9% +0.7% +11.1% +14.4% ➖ noise
3 datafusion:vortex-compact +4.5% +0.7% +3.7% +14.4% ➖ noise
3 datafusion:vortex-file-compressed +3.5% +0.7% +2.7% +14.4% ➖ noise
3 duckdb:duckdb -0.6% +0.7% -1.3% +14.4% ➖ noise
3 duckdb:vortex-compact +4.7% +0.7% +3.9% +14.4% ➖ noise
3 duckdb:vortex-file-compressed +9.0% +0.7% +8.2% +14.4% ➖ noise
4 datafusion:arrow +11.7% -2.5% +14.6% +14.4% 🚨 regression
4 datafusion:vortex-compact +7.0% -2.5% +9.8% +14.4% ➖ noise
4 datafusion:vortex-file-compressed +1.7% -2.5% +4.4% +14.4% ➖ noise
4 duckdb:duckdb -2.4% -2.5% +0.1% +14.4% ➖ noise
4 duckdb:vortex-compact +9.8% -2.5% +12.6% +14.4% ➖ noise
4 duckdb:vortex-file-compressed +3.5% -2.5% +6.2% +14.4% ➖ noise
5 datafusion:arrow +11.1% -0.5% +11.7% +14.4% ➖ noise
5 datafusion:vortex-compact +7.1% -0.5% +7.7% +14.4% ➖ noise
5 datafusion:vortex-file-compressed -0.5% -0.5% +0.0% +14.4% ➖ noise
5 duckdb:duckdb -2.9% -0.5% -2.4% +14.4% ➖ noise
5 duckdb:vortex-compact +5.4% -0.5% +6.0% +14.4% ➖ noise
5 duckdb:vortex-file-compressed +4.3% -0.5% +4.8% +14.4% ➖ noise
6 datafusion:arrow +6.2% -10.5% +18.6% +14.4% 🚨 regression
6 datafusion:vortex-compact +7.7% -10.5% +20.3% +14.4% 🚨 regression
6 datafusion:vortex-file-compressed +4.4% -10.5% +16.5% +14.4% 🚨 regression
6 duckdb:duckdb +1.6% -10.5% +13.5% +14.8% ➖ noise
6 duckdb:vortex-compact +2.4% -10.5% +14.3% +15.0% ➖ noise
6 duckdb:vortex-file-compressed +3.4% -10.5% +15.5% +17.7% ➖ noise
7 datafusion:arrow +12.3% +1.6% +10.6% +14.4% ➖ noise
7 datafusion:vortex-compact +4.6% +1.6% +3.0% +14.4% ➖ noise
7 datafusion:vortex-file-compressed -0.8% +1.6% -2.3% +14.4% ➖ noise
7 duckdb:duckdb +0.3% +1.6% -1.2% +14.4% ➖ noise
7 duckdb:vortex-compact +4.7% +1.6% +3.1% +14.4% ➖ noise
7 duckdb:vortex-file-compressed +11.1% +1.6% +9.4% +14.4% ➖ noise
8 datafusion:arrow +7.3% -4.2% +12.0% +14.4% ➖ noise
8 datafusion:vortex-compact +1.6% -4.2% +6.1% +14.4% ➖ noise
8 datafusion:vortex-file-compressed +3.4% -4.2% +8.0% +14.4% ➖ noise
8 duckdb:duckdb +1.6% -4.2% +6.1% +14.4% ➖ noise
8 duckdb:vortex-compact +7.6% -4.2% +12.3% +14.4% ➖ noise
8 duckdb:vortex-file-compressed +6.1% -4.2% +10.8% +14.4% ➖ noise
9 datafusion:arrow +6.6% +6.1% +0.5% +14.4% ➖ noise
9 datafusion:vortex-compact +2.0% +6.1% -3.9% +14.4% ➖ noise
9 datafusion:vortex-file-compressed +6.4% +6.1% +0.4% +14.4% ➖ noise
9 duckdb:duckdb +2.6% +6.1% -3.3% +14.4% ➖ noise
9 duckdb:vortex-compact +2.0% +6.1% -3.8% +14.4% ➖ noise
9 duckdb:vortex-file-compressed +6.9% +6.1% +0.8% +14.4% ➖ noise
10 datafusion:arrow +11.4% +4.7% +6.4% +14.4% ➖ noise
10 datafusion:vortex-compact +6.5% +4.7% +1.8% +14.4% ➖ noise
10 datafusion:vortex-file-compressed +2.6% +4.7% -1.9% +14.4% ➖ noise
10 duckdb:duckdb +2.4% +4.7% -2.2% +14.4% ➖ noise
10 duckdb:vortex-compact +2.1% +4.7% -2.4% +14.4% ➖ noise
10 duckdb:vortex-file-compressed +5.3% +4.7% +0.6% +14.4% ➖ noise
11 datafusion:arrow +9.1% +5.4% +3.5% +14.4% ➖ noise
11 datafusion:vortex-compact +5.6% +5.4% +0.2% +14.4% ➖ noise
11 datafusion:vortex-file-compressed +4.8% +5.4% -0.6% +14.4% ➖ noise
11 duckdb:duckdb +4.9% +5.4% -0.5% +14.4% ➖ noise
11 duckdb:vortex-compact +2.8% +5.4% -2.5% +14.4% ➖ noise
11 duckdb:vortex-file-compressed +2.8% +5.4% -2.5% +14.4% ➖ noise
12 datafusion:arrow +7.6% -4.7% +12.9% +14.4% ➖ noise
12 datafusion:vortex-compact +6.3% -4.7% +11.6% +14.4% ➖ noise
12 datafusion:vortex-file-compressed +2.5% -4.7% +7.5% +14.4% ➖ noise
12 duckdb:duckdb +5.4% -4.7% +10.6% +14.4% ➖ noise
12 duckdb:vortex-compact +5.6% -4.7% +10.8% +14.4% ➖ noise
12 duckdb:vortex-file-compressed +0.3% -4.7% +5.3% +14.4% ➖ noise
13 datafusion:arrow +7.4% +11.3% -3.5% +14.4% ➖ noise
13 datafusion:vortex-compact +4.8% +11.3% -5.8% +14.4% ➖ noise
13 datafusion:vortex-file-compressed -0.5% +11.3% -10.6% +14.4% ➖ noise
13 duckdb:duckdb -0.6% +11.3% -10.7% +14.4% ➖ noise
13 duckdb:vortex-compact +2.9% +11.3% -7.6% +14.4% ➖ noise
13 duckdb:vortex-file-compressed +4.1% +11.3% -6.5% +14.4% ➖ noise
14 datafusion:arrow +16.8% -4.1% +21.8% +14.4% 🚨 regression
14 datafusion:vortex-compact +1.6% -4.1% +5.9% +14.4% ➖ noise
14 datafusion:vortex-file-compressed +11.5% -4.1% +16.2% +14.4% 🚨 regression
14 duckdb:duckdb +2.6% -4.1% +6.9% +18.0% ➖ noise
14 duckdb:vortex-compact +10.7% -4.1% +15.4% +14.4% 🚨 regression
14 duckdb:vortex-file-compressed +3.5% -4.1% +7.9% +14.4% ➖ noise
15 datafusion:arrow +18.9% +3.8% +14.5% +14.4% 🚨 regression
15 datafusion:vortex-compact +5.2% +3.8% +1.3% +14.4% ➖ noise
15 datafusion:vortex-file-compressed +8.6% +3.8% +4.6% +14.4% ➖ noise
15 duckdb:duckdb +1.8% +3.8% -1.9% +16.9% ➖ noise
15 duckdb:vortex-compact +5.1% +3.8% +1.2% +14.4% ➖ noise
15 duckdb:vortex-file-compressed +2.4% +3.8% -1.4% +14.4% ➖ noise
16 datafusion:arrow +9.9% +2.4% +7.3% +14.4% ➖ noise
16 datafusion:vortex-compact +0.1% +2.4% -2.3% +14.4% ➖ noise
16 datafusion:vortex-file-compressed +5.0% +2.4% +2.6% +14.4% ➖ noise
16 duckdb:duckdb -2.7% +2.4% -5.0% +14.4% ➖ noise
16 duckdb:vortex-compact +4.7% +2.4% +2.3% +14.4% ➖ noise
16 duckdb:vortex-file-compressed +2.8% +2.4% +0.4% +14.4% ➖ noise
17 datafusion:arrow +9.0% +8.5% +0.5% +14.4% ➖ noise
17 datafusion:vortex-compact +0.5% +8.5% -7.4% +14.4% ➖ noise
17 datafusion:vortex-file-compressed +9.1% +8.5% +0.6% +14.4% ➖ noise
17 duckdb:duckdb +9.6% +8.5% +1.0% +14.4% ➖ noise
17 duckdb:vortex-compact +3.8% +8.5% -4.3% +14.4% ➖ noise
17 duckdb:vortex-file-compressed +3.3% +8.5% -4.8% +14.4% ➖ noise
18 datafusion:arrow +6.7% +1.9% +4.7% +14.4% ➖ noise
18 datafusion:vortex-compact +4.8% +1.9% +2.8% +14.4% ➖ noise
18 datafusion:vortex-file-compressed +2.2% +1.9% +0.3% +14.4% ➖ noise
18 duckdb:duckdb +0.0% +1.9% -1.9% +14.4% ➖ noise
18 duckdb:vortex-compact +8.0% +1.9% +5.9% +14.4% ➖ noise
18 duckdb:vortex-file-compressed +4.1% +1.9% +2.2% +14.4% ➖ noise
19 datafusion:arrow +13.6% +10.9% +2.4% +14.4% ➖ noise
19 datafusion:vortex-compact +3.2% +10.9% -7.0% +14.4% ➖ noise
19 datafusion:vortex-file-compressed +6.8% +10.9% -3.7% +14.4% ➖ noise
19 duckdb:duckdb +3.3% +10.9% -6.9% +15.6% ➖ noise
19 duckdb:vortex-compact +4.0% +10.9% -6.2% +14.4% ➖ noise
19 duckdb:vortex-file-compressed +4.7% +10.9% -5.6% +14.4% ➖ noise
20 datafusion:arrow +14.8% +0.8% +13.9% +14.4% ➖ noise
20 datafusion:vortex-compact +5.5% +0.8% +4.7% +14.4% ➖ noise
20 datafusion:vortex-file-compressed +3.7% +0.8% +2.9% +14.4% ➖ noise
20 duckdb:duckdb -1.1% +0.8% -1.9% +14.4% ➖ noise
20 duckdb:vortex-compact +3.1% +0.8% +2.3% +14.4% ➖ noise
20 duckdb:vortex-file-compressed +2.1% +0.8% +1.3% +14.4% ➖ noise
21 datafusion:arrow +15.8% +6.7% +8.5% +14.4% ➖ noise
21 datafusion:vortex-compact +5.7% +6.7% -0.9% +14.4% ➖ noise
21 datafusion:vortex-file-compressed +9.3% +6.7% +2.4% +14.4% ➖ noise
21 duckdb:duckdb +6.0% +6.7% -0.6% +14.4% ➖ noise
21 duckdb:vortex-compact +10.3% +6.7% +3.4% +14.4% ➖ noise
21 duckdb:vortex-file-compressed +5.6% +6.7% -1.1% +14.4% ➖ noise
22 datafusion:arrow +4.4% +2.7% +1.6% +14.4% ➖ noise
22 datafusion:vortex-compact +3.2% +2.7% +0.5% +14.4% ➖ noise
22 datafusion:vortex-file-compressed +5.9% +2.7% +3.1% +14.4% ➖ noise
22 duckdb:duckdb +0.8% +2.7% -1.8% +14.4% ➖ noise
22 duckdb:vortex-compact +8.4% +2.7% +5.6% +14.4% ➖ noise
22 duckdb:vortex-file-compressed +14.4% +2.7% +11.4% +14.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Vortex (geomean): 0.898x ✅
Parquet (geomean): 0.881x ✅
Shifts: Parquet (control) -11.9% · Median polish -10.5%


datafusion / vortex-file-compressed (0.816x ✅, 90↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 29915696 36399382 0.82
tpcds_q02/datafusion:vortex-file-compressed 🚀 56147804 70301342 0.80
tpcds_q03/datafusion:vortex-file-compressed 🚀 21328207 25790699 0.83
tpcds_q04/datafusion:vortex-file-compressed 🚀 309414802 418021015 0.74
tpcds_q05/datafusion:vortex-file-compressed 🚀 59689139 80570135 0.74
tpcds_q06/datafusion:vortex-file-compressed 🚀 52361065 74078539 0.71
tpcds_q07/datafusion:vortex-file-compressed 🚀 53537610 73864837 0.72
tpcds_q08/datafusion:vortex-file-compressed 🚀 37418903 49352049 0.76
tpcds_q09/datafusion:vortex-file-compressed 🚀 56993462 70336370 0.81
tpcds_q10/datafusion:vortex-file-compressed 🚀 44310408 61778651 0.72
tpcds_q11/datafusion:vortex-file-compressed 🚀 174817151 224139518 0.78
tpcds_q12/datafusion:vortex-file-compressed 🚀 24326259 30244992 0.80
tpcds_q13/datafusion:vortex-file-compressed 🚀 57086042 70754267 0.81
tpcds_q14/datafusion:vortex-file-compressed 🚀 210071278 250753335 0.84
tpcds_q15/datafusion:vortex-file-compressed 🚀 36819535 45579377 0.81
tpcds_q16/datafusion:vortex-file-compressed 🚀 30237127 39024820 0.77
tpcds_q17/datafusion:vortex-file-compressed 🚀 71098814 89861816 0.79
tpcds_q18/datafusion:vortex-file-compressed 🚀 81869575 119766256 0.68
tpcds_q19/datafusion:vortex-file-compressed 🚀 31428388 47131516 0.67
tpcds_q20/datafusion:vortex-file-compressed 🚀 27030459 40583666 0.67
tpcds_q21/datafusion:vortex-file-compressed 🚀 147734046 199674041 0.74
tpcds_q22/datafusion:vortex-file-compressed 59663853 66097274 0.90
tpcds_q23/datafusion:vortex-file-compressed 🚀 156047642 177120848 0.88
tpcds_q24/datafusion:vortex-file-compressed 🚀 117815597 136710448 0.86
tpcds_q25/datafusion:vortex-file-compressed 🚀 69881818 81778103 0.85
tpcds_q26/datafusion:vortex-file-compressed 🚀 38320958 45779529 0.84
tpcds_q27/datafusion:vortex-file-compressed 🚀 126090084 151928891 0.83
tpcds_q28/datafusion:vortex-file-compressed 🚀 50167437 56107658 0.89
tpcds_q29/datafusion:vortex-file-compressed 🚀 69988552 90221378 0.78
tpcds_q30/datafusion:vortex-file-compressed 🚀 31896359 44342525 0.72
tpcds_q31/datafusion:vortex-file-compressed 🚀 97838807 128469234 0.76
tpcds_q32/datafusion:vortex-file-compressed 🚀 22226809 32361834 0.69
tpcds_q33/datafusion:vortex-file-compressed 🚀 40092939 53297067 0.75
tpcds_q34/datafusion:vortex-file-compressed 🚀 32115978 48093283 0.67
tpcds_q35/datafusion:vortex-file-compressed 🚀 57113258 80120727 0.71
tpcds_q36/datafusion:vortex-file-compressed 🚀 77406075 113488882 0.68
tpcds_q37/datafusion:vortex-file-compressed 🚀 36628715 52418189 0.70
tpcds_q38/datafusion:vortex-file-compressed 🚀 54083023 72936013 0.74
tpcds_q39/datafusion:vortex-file-compressed 🚀 156793687 192421366 0.81
tpcds_q40/datafusion:vortex-file-compressed 🚀 54851221 70720996 0.78
tpcds_q41/datafusion:vortex-file-compressed 🚀 20507491 24063090 0.85
tpcds_q42/datafusion:vortex-file-compressed 🚀 18802820 24100190 0.78
tpcds_q43/datafusion:vortex-file-compressed 🚀 32142550 39760044 0.81
tpcds_q44/datafusion:vortex-file-compressed 🚀 43221672 53996295 0.80
tpcds_q45/datafusion:vortex-file-compressed 🚀 35325239 41364590 0.85
tpcds_q46/datafusion:vortex-file-compressed 🚀 48279218 58640411 0.82
tpcds_q47/datafusion:vortex-file-compressed 🚀 215055278 266150441 0.81
tpcds_q48/datafusion:vortex-file-compressed 45164334 49777880 0.91
tpcds_q49/datafusion:vortex-file-compressed 🚀 70766043 81092784 0.87
tpcds_q50/datafusion:vortex-file-compressed 🚀 47220647 57236482 0.83
tpcds_q51/datafusion:vortex-file-compressed 🚀 89624508 108671449 0.82
tpcds_q52/datafusion:vortex-file-compressed 🚀 19341543 24447671 0.79
tpcds_q53/datafusion:vortex-file-compressed 🚀 26354196 30951662 0.85
tpcds_q54/datafusion:vortex-file-compressed 46434661 51129411 0.91
tpcds_q55/datafusion:vortex-file-compressed 🚀 18940962 22692189 0.83
tpcds_q56/datafusion:vortex-file-compressed 🚀 40759886 47674155 0.85
tpcds_q57/datafusion:vortex-file-compressed 🚀 133573026 164575178 0.81
tpcds_q58/datafusion:vortex-file-compressed 🚀 72405556 86277885 0.84
tpcds_q59/datafusion:vortex-file-compressed 🚀 76988362 88464521 0.87
tpcds_q60/datafusion:vortex-file-compressed 🚀 40850493 50470335 0.81
tpcds_q61/datafusion:vortex-file-compressed 51018756 55007851 0.93
tpcds_q62/datafusion:vortex-file-compressed 🚀 31645698 38551806 0.82
tpcds_q63/datafusion:vortex-file-compressed 🚀 26885427 31649411 0.85
tpcds_q64/datafusion:vortex-file-compressed 🚀 487471422 567529601 0.86
tpcds_q65/datafusion:vortex-file-compressed 🚀 50718390 59471325 0.85
tpcds_q66/datafusion:vortex-file-compressed 🚀 95281666 112273048 0.85
tpcds_q67/datafusion:vortex-file-compressed 🚀 120148653 164560764 0.73
tpcds_q68/datafusion:vortex-file-compressed 🚀 45502913 70845172 0.64
tpcds_q69/datafusion:vortex-file-compressed 🚀 43868177 50123788 0.88
tpcds_q70/datafusion:vortex-file-compressed 🚀 119841981 138672882 0.86
tpcds_q71/datafusion:vortex-file-compressed 🚀 32883618 40097948 0.82
tpcds_q72/datafusion:vortex-file-compressed 🚀 2905081405 3450350508 0.84
tpcds_q73/datafusion:vortex-file-compressed 36142358 38293799 0.94
tpcds_q74/datafusion:vortex-file-compressed 🚀 121314475 143172199 0.85
tpcds_q75/datafusion:vortex-file-compressed 128353280 140697520 0.91
tpcds_q76/datafusion:vortex-file-compressed 35566331 39272468 0.91
tpcds_q77/datafusion:vortex-file-compressed 🚀 53600523 61272779 0.87
tpcds_q78/datafusion:vortex-file-compressed 🚀 130276767 155358341 0.84
tpcds_q79/datafusion:vortex-file-compressed 🚀 38753900 43880285 0.88
tpcds_q80/datafusion:vortex-file-compressed 🚀 119668434 140231157 0.85
tpcds_q81/datafusion:vortex-file-compressed 🚀 39791818 44255299 0.90
tpcds_q82/datafusion:vortex-file-compressed 🚀 38779156 46128406 0.84
tpcds_q83/datafusion:vortex-file-compressed 🚀 52832854 61969200 0.85
tpcds_q84/datafusion:vortex-file-compressed 17456381 18850409 0.93
tpcds_q85/datafusion:vortex-file-compressed 🚀 106729713 120615556 0.88
tpcds_q86/datafusion:vortex-file-compressed 🚀 20220901 23026531 0.88
tpcds_q87/datafusion:vortex-file-compressed 🚀 53996027 62868000 0.86
tpcds_q88/datafusion:vortex-file-compressed 🚀 71551477 80727967 0.89
tpcds_q89/datafusion:vortex-file-compressed 🚀 38170940 45346365 0.84
tpcds_q90/datafusion:vortex-file-compressed 🚀 18956377 21272742 0.89
tpcds_q91/datafusion:vortex-file-compressed 🚀 27600479 31961092 0.86
tpcds_q92/datafusion:vortex-file-compressed 🚀 20591936 23213322 0.89
tpcds_q93/datafusion:vortex-file-compressed 🚀 34403672 43675906 0.79
tpcds_q94/datafusion:vortex-file-compressed 26950536 29861852 0.90
tpcds_q95/datafusion:vortex-file-compressed 🚀 63861069 72448477 0.88
tpcds_q96/datafusion:vortex-file-compressed 🚀 16076669 18454629 0.87
tpcds_q97/datafusion:vortex-file-compressed 🚀 32008711 36883823 0.87
tpcds_q98/datafusion:vortex-file-compressed 🚀 34185541 41080024 0.83
tpcds_q99/datafusion:vortex-file-compressed 🚀 48630314 56207492 0.87
datafusion / vortex-compact (0.835x ✅, 77↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 37645298 40713555 0.92
tpcds_q02/datafusion:vortex-compact 64349667 71466889 0.90
tpcds_q03/datafusion:vortex-compact 🚀 27094962 32628017 0.83
tpcds_q04/datafusion:vortex-compact 🚀 349647040 474158076 0.74
tpcds_q05/datafusion:vortex-compact 🚀 70174639 85681783 0.82
tpcds_q06/datafusion:vortex-compact 🚀 61053411 74254366 0.82
tpcds_q07/datafusion:vortex-compact 71816957 76603174 0.94
tpcds_q08/datafusion:vortex-compact 🚀 48542646 60411173 0.80
tpcds_q09/datafusion:vortex-compact 🚀 76475128 91378944 0.84
tpcds_q10/datafusion:vortex-compact 🚀 68310722 90809916 0.75
tpcds_q11/datafusion:vortex-compact 🚀 198688010 230373068 0.86
tpcds_q12/datafusion:vortex-compact 🚀 28481020 35283482 0.81
tpcds_q13/datafusion:vortex-compact 127203508 137481229 0.93
tpcds_q14/datafusion:vortex-compact 🚀 273351534 344476664 0.79
tpcds_q15/datafusion:vortex-compact 🚀 40545552 56049333 0.72
tpcds_q16/datafusion:vortex-compact 41918667 45647276 0.92
tpcds_q17/datafusion:vortex-compact 🚀 97041022 109123136 0.89
tpcds_q18/datafusion:vortex-compact 🚀 94189250 108956926 0.86
tpcds_q19/datafusion:vortex-compact 🚀 45766786 52127084 0.88
tpcds_q20/datafusion:vortex-compact 🚀 31822786 36038663 0.88
tpcds_q21/datafusion:vortex-compact 🚀 147017038 176047212 0.84
tpcds_q22/datafusion:vortex-compact 🚀 68522186 87645061 0.78
tpcds_q23/datafusion:vortex-compact 🚀 194268317 237073226 0.82
tpcds_q24/datafusion:vortex-compact 🚀 145326819 198245392 0.73
tpcds_q25/datafusion:vortex-compact 101025359 111693611 0.90
tpcds_q26/datafusion:vortex-compact 🚀 48117631 60645680 0.79
tpcds_q27/datafusion:vortex-compact 🚀 168215791 212089931 0.79
tpcds_q28/datafusion:vortex-compact 89344691 94867783 0.94
tpcds_q29/datafusion:vortex-compact 96060961 106122585 0.91
tpcds_q30/datafusion:vortex-compact 🚀 35713033 41405920 0.86
tpcds_q31/datafusion:vortex-compact 🚀 137556783 156020989 0.88
tpcds_q32/datafusion:vortex-compact 🚀 27963997 31116919 0.90
tpcds_q33/datafusion:vortex-compact 🚀 54971537 62235495 0.88
tpcds_q34/datafusion:vortex-compact 🚀 51711247 58537965 0.88
tpcds_q35/datafusion:vortex-compact 🚀 72618009 88590418 0.82
tpcds_q36/datafusion:vortex-compact 🚀 108184284 122962459 0.88
tpcds_q37/datafusion:vortex-compact 🚀 50972348 57923440 0.88
tpcds_q38/datafusion:vortex-compact 72547747 80470521 0.90
tpcds_q39/datafusion:vortex-compact 🚀 159499137 186270773 0.86
tpcds_q40/datafusion:vortex-compact 🚀 61446484 72920280 0.84
tpcds_q41/datafusion:vortex-compact 23695084 24385234 0.97
tpcds_q42/datafusion:vortex-compact 🚀 26154139 29315757 0.89
tpcds_q43/datafusion:vortex-compact 🚀 39883504 44470389 0.90
tpcds_q44/datafusion:vortex-compact 77175192 84243996 0.92
tpcds_q45/datafusion:vortex-compact 🚀 41929116 46776311 0.90
tpcds_q46/datafusion:vortex-compact 🚀 70978025 83892110 0.85
tpcds_q47/datafusion:vortex-compact 🚀 247801077 291971223 0.85
tpcds_q48/datafusion:vortex-compact 94135950 99785515 0.94
tpcds_q49/datafusion:vortex-compact 🚀 93804102 119596811 0.78
tpcds_q50/datafusion:vortex-compact 🚀 67258578 91005058 0.74
tpcds_q51/datafusion:vortex-compact 🚀 101684962 116881755 0.87
tpcds_q52/datafusion:vortex-compact 🚀 26448376 31925885 0.83
tpcds_q53/datafusion:vortex-compact 🚀 36974541 41575556 0.89
tpcds_q54/datafusion:vortex-compact 61997683 68046903 0.91
tpcds_q55/datafusion:vortex-compact 25560370 28227298 0.91
tpcds_q56/datafusion:vortex-compact 58861788 64523995 0.91
tpcds_q57/datafusion:vortex-compact 🚀 145992024 174609614 0.84
tpcds_q58/datafusion:vortex-compact 🚀 84744578 110616682 0.77
tpcds_q59/datafusion:vortex-compact 🚀 91067574 118271745 0.77
tpcds_q60/datafusion:vortex-compact 🚀 58696677 72459437 0.81
tpcds_q61/datafusion:vortex-compact 🚀 75818249 93059022 0.81
tpcds_q62/datafusion:vortex-compact 🚀 35673515 45631765 0.78
tpcds_q63/datafusion:vortex-compact 🚀 38576677 42881804 0.90
tpcds_q64/datafusion:vortex-compact 🚀 560922667 686444680 0.82
tpcds_q65/datafusion:vortex-compact 🚀 70954431 93866251 0.76
tpcds_q66/datafusion:vortex-compact 🚀 105656689 139382067 0.76
tpcds_q67/datafusion:vortex-compact 131186396 145568923 0.90
tpcds_q68/datafusion:vortex-compact 🚀 72264735 83835766 0.86
tpcds_q69/datafusion:vortex-compact 🚀 64204128 81655809 0.79
tpcds_q70/datafusion:vortex-compact 🚀 131841040 149859215 0.88
tpcds_q71/datafusion:vortex-compact 🚀 49426406 61970168 0.80
tpcds_q72/datafusion:vortex-compact 🚀 2878965783 3455672542 0.83
tpcds_q73/datafusion:vortex-compact 🚀 53124355 59223944 0.90
tpcds_q74/datafusion:vortex-compact 🚀 146638362 164022648 0.89
tpcds_q75/datafusion:vortex-compact 🚀 171176199 191172767 0.90
tpcds_q76/datafusion:vortex-compact 52429686 57478733 0.91
tpcds_q77/datafusion:vortex-compact 🚀 71948789 82303580 0.87
tpcds_q78/datafusion:vortex-compact 🚀 157848313 216485736 0.73
tpcds_q79/datafusion:vortex-compact 🚀 62131560 80524107 0.77
tpcds_q80/datafusion:vortex-compact 🚀 138972406 193181703 0.72
tpcds_q81/datafusion:vortex-compact 🚀 47289609 61756618 0.77
tpcds_q82/datafusion:vortex-compact 🚀 50759891 69816097 0.73
tpcds_q83/datafusion:vortex-compact 🚀 62341704 86367993 0.72
tpcds_q84/datafusion:vortex-compact 🚀 20456539 29350316 0.70
tpcds_q85/datafusion:vortex-compact 🚀 133614133 173028213 0.77
tpcds_q86/datafusion:vortex-compact 23686016 26307143 0.90
tpcds_q87/datafusion:vortex-compact 🚀 73271279 83363732 0.88
tpcds_q88/datafusion:vortex-compact 142447667 155970146 0.91
tpcds_q89/datafusion:vortex-compact 🚀 48859087 55508488 0.88
tpcds_q90/datafusion:vortex-compact 25484134 27405590 0.93
tpcds_q91/datafusion:vortex-compact 42033992 44493876 0.94
tpcds_q92/datafusion:vortex-compact 27467443 30283458 0.91
tpcds_q93/datafusion:vortex-compact 🚀 47817371 65529666 0.73
tpcds_q94/datafusion:vortex-compact 🚀 30728198 43128629 0.71
tpcds_q95/datafusion:vortex-compact 🚀 74623105 93926009 0.79
tpcds_q96/datafusion:vortex-compact 🚀 27825894 34050424 0.82
tpcds_q97/datafusion:vortex-compact 🚀 44581760 61143122 0.73
tpcds_q98/datafusion:vortex-compact 🚀 39672016 58086029 0.68
tpcds_q99/datafusion:vortex-compact 🚀 53152957 78774251 0.67
datafusion / parquet (0.866x ✅, 72↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 37806387 44527967 0.85
tpcds_q02/datafusion:parquet 49628092 52139377 0.95
tpcds_q03/datafusion:parquet 🚀 15863669 17664223 0.90
tpcds_q04/datafusion:parquet 🚀 325687620 411377019 0.79
tpcds_q05/datafusion:parquet 🚀 54844739 76197214 0.72
tpcds_q06/datafusion:parquet 🚀 64635296 74004832 0.87
tpcds_q07/datafusion:parquet 🚀 96445681 110662968 0.87
tpcds_q08/datafusion:parquet 35276594 38649252 0.91
tpcds_q09/datafusion:parquet 62294154 66402524 0.94
tpcds_q10/datafusion:parquet 88569784 98307818 0.90
tpcds_q11/datafusion:parquet 🚀 195111997 223573397 0.87
tpcds_q12/datafusion:parquet 🚀 23191325 26092700 0.89
tpcds_q13/datafusion:parquet 91517797 100985886 0.91
tpcds_q14/datafusion:parquet 🚀 196839712 230520278 0.85
tpcds_q15/datafusion:parquet 🚀 25986729 33512370 0.78
tpcds_q16/datafusion:parquet 31574575 33274869 0.95
tpcds_q17/datafusion:parquet 🚀 73961742 82806812 0.89
tpcds_q18/datafusion:parquet 🚀 134764132 156135855 0.86
tpcds_q19/datafusion:parquet 29232849 32266337 0.91
tpcds_q20/datafusion:parquet 🚀 22380788 26720786 0.84
tpcds_q21/datafusion:parquet 23787175 25554887 0.93
tpcds_q22/datafusion:parquet 172523241 188106339 0.92
tpcds_q23/datafusion:parquet 🚀 173097264 200713282 0.86
tpcds_q24/datafusion:parquet 🚀 113181301 131054617 0.86
tpcds_q25/datafusion:parquet 78063662 83584400 0.93
tpcds_q26/datafusion:parquet 🚀 76114722 94598861 0.80
tpcds_q27/datafusion:parquet 🚀 176278505 204875259 0.86
tpcds_q28/datafusion:parquet 54996267 60261396 0.91
tpcds_q29/datafusion:parquet 78546885 86586074 0.91
tpcds_q30/datafusion:parquet 🚀 46542259 53417366 0.87
tpcds_q31/datafusion:parquet 🚀 79364301 88296561 0.90
tpcds_q32/datafusion:parquet 🚀 23358209 26795724 0.87
tpcds_q33/datafusion:parquet 🚀 36363234 42535644 0.85
tpcds_q34/datafusion:parquet 🚀 27162066 35964165 0.76
tpcds_q35/datafusion:parquet 94018376 102689982 0.92
tpcds_q36/datafusion:parquet 🚀 67490467 92352196 0.73
tpcds_q37/datafusion:parquet 🚀 26298288 32971136 0.80
tpcds_q38/datafusion:parquet 🚀 53877986 60076722 0.90
tpcds_q39/datafusion:parquet 🚀 87903258 123983460 0.71
tpcds_q40/datafusion:parquet 🚀 28467626 32381319 0.88
tpcds_q41/datafusion:parquet 🚀 17402282 20676022 0.84
tpcds_q42/datafusion:parquet 🚀 14379336 16344959 0.88
tpcds_q43/datafusion:parquet 20713097 22467066 0.92
tpcds_q44/datafusion:parquet 🚀 42174581 51622108 0.82
tpcds_q45/datafusion:parquet 🚀 33849395 40442653 0.84
tpcds_q46/datafusion:parquet 🚀 40420346 50233870 0.80
tpcds_q47/datafusion:parquet 🚀 142407349 173062584 0.82
tpcds_q48/datafusion:parquet 🚀 83778937 107124904 0.78
tpcds_q49/datafusion:parquet 🚀 69778266 90056258 0.77
tpcds_q50/datafusion:parquet 🚀 51816714 58483505 0.89
tpcds_q51/datafusion:parquet 🚀 91728392 103543753 0.89
tpcds_q52/datafusion:parquet 15204418 16259113 0.94
tpcds_q53/datafusion:parquet 23841257 24719484 0.96
tpcds_q54/datafusion:parquet 44506996 49102923 0.91
tpcds_q55/datafusion:parquet 🚀 14543176 17342772 0.84
tpcds_q56/datafusion:parquet 🚀 36485648 41924144 0.87
tpcds_q57/datafusion:parquet 🚀 113154578 132719426 0.85
tpcds_q58/datafusion:parquet 🚀 60322852 69446361 0.87
tpcds_q59/datafusion:parquet 60897408 66166809 0.92
tpcds_q60/datafusion:parquet 36200759 39997730 0.91
tpcds_q61/datafusion:parquet 🚀 52970949 60295760 0.88
tpcds_q62/datafusion:parquet 🚀 24627635 34201543 0.72
tpcds_q63/datafusion:parquet 22768389 24774557 0.92
tpcds_q64/datafusion:parquet 🚀 580694837 646892837 0.90
tpcds_q65/datafusion:parquet 🚀 45925432 52713949 0.87
tpcds_q66/datafusion:parquet 🚀 74085780 86348133 0.86
tpcds_q67/datafusion:parquet 🚀 158614620 182517518 0.87
tpcds_q68/datafusion:parquet 🚀 40893624 46727586 0.88
tpcds_q69/datafusion:parquet 🚀 82283656 94214035 0.87
tpcds_q70/datafusion:parquet 🚀 104304987 116113737 0.90
tpcds_q71/datafusion:parquet 🚀 27589608 30700988 0.90
tpcds_q72/datafusion:parquet 🚀 683920122 790359894 0.87
tpcds_q73/datafusion:parquet 29184302 30912636 0.94
tpcds_q74/datafusion:parquet 🚀 109350565 132621194 0.82
tpcds_q75/datafusion:parquet 124415759 137421344 0.91
tpcds_q76/datafusion:parquet 🚀 38584858 43596899 0.89
tpcds_q77/datafusion:parquet 51512960 57132165 0.90
tpcds_q78/datafusion:parquet 🚀 129475683 146785554 0.88
tpcds_q79/datafusion:parquet 33441346 35772768 0.93
tpcds_q80/datafusion:parquet 🚀 97237727 113573740 0.86
tpcds_q81/datafusion:parquet 🚀 42317723 51484863 0.82
tpcds_q82/datafusion:parquet 🚀 24511989 28122954 0.87
tpcds_q83/datafusion:parquet 🚀 49665360 57446570 0.86
tpcds_q84/datafusion:parquet 🚀 49649963 55441402 0.90
tpcds_q85/datafusion:parquet 🚀 177639932 202503371 0.88
tpcds_q86/datafusion:parquet 🚀 17694605 22970985 0.77
tpcds_q87/datafusion:parquet 🚀 52354092 64065441 0.82
tpcds_q88/datafusion:parquet 🚀 71282634 81616545 0.87
tpcds_q89/datafusion:parquet 26391908 28932172 0.91
tpcds_q90/datafusion:parquet 20005753 22034146 0.91
tpcds_q91/datafusion:parquet 🚀 71692291 82649216 0.87
tpcds_q92/datafusion:parquet 🚀 23139030 27071204 0.85
tpcds_q93/datafusion:parquet 🚀 36575540 44372126 0.82
tpcds_q94/datafusion:parquet 🚀 26185225 30201900 0.87
tpcds_q95/datafusion:parquet 🚀 70085490 79684620 0.88
tpcds_q96/datafusion:parquet 🚀 15169194 17543183 0.86
tpcds_q97/datafusion:parquet 🚀 35531379 41503079 0.86
tpcds_q98/datafusion:parquet 🚀 27198105 33938194 0.80
tpcds_q99/datafusion:parquet 30165756 32436624 0.93
duckdb / vortex-file-compressed (0.918x ➖, 37↑ 9↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24035392 26089966 0.92
tpcds_q02/duckdb:vortex-file-compressed 🚀 31116441 41552522 0.75
tpcds_q03/duckdb:vortex-file-compressed 31573670 32866033 0.96
tpcds_q04/duckdb:vortex-file-compressed 110781462 114004543 0.97
tpcds_q05/duckdb:vortex-file-compressed 43507962 39714610 1.10
tpcds_q06/duckdb:vortex-file-compressed 38591897 40217010 0.96
tpcds_q07/duckdb:vortex-file-compressed 24644424 26780670 0.92
tpcds_q08/duckdb:vortex-file-compressed 30915278 31820005 0.97
tpcds_q09/duckdb:vortex-file-compressed 40382240 44125013 0.92
tpcds_q10/duckdb:vortex-file-compressed 47706668 44359871 1.08
tpcds_q11/duckdb:vortex-file-compressed 66633011 64540375 1.03
tpcds_q12/duckdb:vortex-file-compressed 17014553 17942999 0.95
tpcds_q13/duckdb:vortex-file-compressed 36323554 36872293 0.99
tpcds_q14/duckdb:vortex-file-compressed 114923993 121999181 0.94
tpcds_q15/duckdb:vortex-file-compressed 🚀 29327255 47400221 0.62
tpcds_q16/duckdb:vortex-file-compressed 33382515 34754000 0.96
tpcds_q17/duckdb:vortex-file-compressed 🚨 48156575 43070171 1.12
tpcds_q18/duckdb:vortex-file-compressed 51961849 51159132 1.02
tpcds_q19/duckdb:vortex-file-compressed 36322821 39532363 0.92
tpcds_q20/duckdb:vortex-file-compressed 19445365 18910394 1.03
tpcds_q21/duckdb:vortex-file-compressed 22400943 24246654 0.92
tpcds_q22/duckdb:vortex-file-compressed 🚀 79958916 123821093 0.65
tpcds_q23/duckdb:vortex-file-compressed 🚀 111327404 127283235 0.87
tpcds_q24/duckdb:vortex-file-compressed 🚀 52535721 64407279 0.82
tpcds_q25/duckdb:vortex-file-compressed 🚨 53692593 43246922 1.24
tpcds_q26/duckdb:vortex-file-compressed 45669079 44500893 1.03
tpcds_q27/duckdb:vortex-file-compressed 🚀 52449689 62084660 0.84
tpcds_q28/duckdb:vortex-file-compressed 🚀 38905093 43436586 0.90
tpcds_q29/duckdb:vortex-file-compressed 🚨 45320343 39835163 1.14
tpcds_q30/duckdb:vortex-file-compressed 27418809 30450047 0.90
tpcds_q31/duckdb:vortex-file-compressed 39170101 38080562 1.03
tpcds_q32/duckdb:vortex-file-compressed 🚀 17437023 21092003 0.83
tpcds_q33/duckdb:vortex-file-compressed 28931949 29295186 0.99
tpcds_q34/duckdb:vortex-file-compressed 🚨 25061181 21618317 1.16
tpcds_q35/duckdb:vortex-file-compressed 72283903 76871656 0.94
tpcds_q36/duckdb:vortex-file-compressed 🚀 26309897 31263877 0.84
tpcds_q37/duckdb:vortex-file-compressed 🚀 18932751 28566346 0.66
tpcds_q38/duckdb:vortex-file-compressed 42245012 41442747 1.02
tpcds_q39/duckdb:vortex-file-compressed 🚀 40880989 50056369 0.82
tpcds_q40/duckdb:vortex-file-compressed 🚀 22558693 27367590 0.82
tpcds_q41/duckdb:vortex-file-compressed 🚀 15572737 17516293 0.89
tpcds_q42/duckdb:vortex-file-compressed 13880350 13915848 1.00
tpcds_q43/duckdb:vortex-file-compressed 🚀 24627247 33545741 0.73
tpcds_q44/duckdb:vortex-file-compressed 24383994 25588057 0.95
tpcds_q45/duckdb:vortex-file-compressed 32903810 34586521 0.95
tpcds_q46/duckdb:vortex-file-compressed 58790025 56661423 1.04
tpcds_q47/duckdb:vortex-file-compressed 54118733 59026809 0.92
tpcds_q48/duckdb:vortex-file-compressed 34042898 36212830 0.94
tpcds_q49/duckdb:vortex-file-compressed 🚨 39884377 35407695 1.13
tpcds_q50/duckdb:vortex-file-compressed 37067074 39191120 0.95
tpcds_q51/duckdb:vortex-file-compressed 🚀 104941326 119143625 0.88
tpcds_q52/duckdb:vortex-file-compressed 15531916 15046066 1.03
tpcds_q53/duckdb:vortex-file-compressed 24547540 26588033 0.92
tpcds_q54/duckdb:vortex-file-compressed 33863338 36467241 0.93
tpcds_q55/duckdb:vortex-file-compressed 14871721 15646951 0.95
tpcds_q56/duckdb:vortex-file-compressed 26184636 27725967 0.94
tpcds_q57/duckdb:vortex-file-compressed 🚀 42396153 51051534 0.83
tpcds_q58/duckdb:vortex-file-compressed 37587106 38097666 0.99
tpcds_q59/duckdb:vortex-file-compressed 🚀 71236510 86186219 0.83
tpcds_q60/duckdb:vortex-file-compressed 29527590 32728396 0.90
tpcds_q61/duckdb:vortex-file-compressed 🚀 36673263 45406627 0.81
tpcds_q62/duckdb:vortex-file-compressed 🚀 20118870 25645164 0.78
tpcds_q63/duckdb:vortex-file-compressed 23647583 24632717 0.96
tpcds_q64/duckdb:vortex-file-compressed 96756430 97006244 1.00
tpcds_q65/duckdb:vortex-file-compressed 🚀 26111451 32559146 0.80
tpcds_q66/duckdb:vortex-file-compressed 🚀 35714404 42568665 0.84
tpcds_q67/duckdb:vortex-file-compressed 🚀 151180311 205288850 0.74
tpcds_q68/duckdb:vortex-file-compressed 🚀 47041011 58241407 0.81
tpcds_q69/duckdb:vortex-file-compressed 48538142 52888865 0.92
tpcds_q70/duckdb:vortex-file-compressed 🚀 30036258 34849420 0.86
tpcds_q71/duckdb:vortex-file-compressed 🚀 22905651 29918382 0.77
tpcds_q72/duckdb:vortex-file-compressed 🚀 180374147 210221464 0.86
tpcds_q73/duckdb:vortex-file-compressed 25874741 24569089 1.05
tpcds_q74/duckdb:vortex-file-compressed 🚨 104090819 72315250 1.44
tpcds_q75/duckdb:vortex-file-compressed 66963936 69594001 0.96
tpcds_q76/duckdb:vortex-file-compressed 🚀 22400521 29351750 0.76
tpcds_q77/duckdb:vortex-file-compressed 🚀 31386419 40085318 0.78
tpcds_q78/duckdb:vortex-file-compressed 🚀 85128676 105809768 0.80
tpcds_q79/duckdb:vortex-file-compressed 🚀 37710994 46605126 0.81
tpcds_q80/duckdb:vortex-file-compressed 🚀 54418683 72822692 0.75
tpcds_q81/duckdb:vortex-file-compressed 🚀 33690039 42697967 0.79
tpcds_q82/duckdb:vortex-file-compressed 🚀 20582362 31731235 0.65
tpcds_q83/duckdb:vortex-file-compressed 🚀 28935392 35397662 0.82
tpcds_q84/duckdb:vortex-file-compressed 24033026 22422528 1.07
tpcds_q85/duckdb:vortex-file-compressed 54103158 56728091 0.95
tpcds_q86/duckdb:vortex-file-compressed 21498346 20463597 1.05
tpcds_q87/duckdb:vortex-file-compressed 44261195 45710414 0.97
tpcds_q88/duckdb:vortex-file-compressed 39037836 41072201 0.95
tpcds_q89/duckdb:vortex-file-compressed 🚨 26335007 23652534 1.11
tpcds_q90/duckdb:vortex-file-compressed 15709974 15834225 0.99
tpcds_q91/duckdb:vortex-file-compressed 34735498 37242757 0.93
tpcds_q92/duckdb:vortex-file-compressed 🚨 25436061 17831261 1.43
tpcds_q93/duckdb:vortex-file-compressed 30688325 34055149 0.90
tpcds_q94/duckdb:vortex-file-compressed 30137041 28003482 1.08
tpcds_q95/duckdb:vortex-file-compressed 🚨 162270656 147238205 1.10
tpcds_q96/duckdb:vortex-file-compressed 14774229 13524197 1.09
tpcds_q97/duckdb:vortex-file-compressed 🚀 41566584 52594831 0.79
tpcds_q98/duckdb:vortex-file-compressed 🚀 20870732 28487179 0.73
tpcds_q99/duckdb:vortex-file-compressed 🚀 31390767 39226937 0.80
duckdb / vortex-compact (1.037x ➖, 17↑ 38↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 27837002 37802451 0.74
tpcds_q02/duckdb:vortex-compact 🚀 43845304 69032690 0.64
tpcds_q03/duckdb:vortex-compact 🚀 57940806 65885976 0.88
tpcds_q04/duckdb:vortex-compact 129687900 143875454 0.90
tpcds_q05/duckdb:vortex-compact 🚨 60334063 49554105 1.22
tpcds_q06/duckdb:vortex-compact 🚀 46142760 52191741 0.88
tpcds_q07/duckdb:vortex-compact 🚀 36678652 45744822 0.80
tpcds_q08/duckdb:vortex-compact 🚨 49774231 42219405 1.18
tpcds_q09/duckdb:vortex-compact 61751167 64055019 0.96
tpcds_q10/duckdb:vortex-compact 🚨 68317170 54271750 1.26
tpcds_q11/duckdb:vortex-compact 🚨 77278626 67289257 1.15
tpcds_q12/duckdb:vortex-compact 🚨 27182462 22943734 1.18
tpcds_q13/duckdb:vortex-compact 🚨 63366822 54322705 1.17
tpcds_q14/duckdb:vortex-compact 148114171 137634200 1.08
tpcds_q15/duckdb:vortex-compact 🚀 36189412 51495488 0.70
tpcds_q16/duckdb:vortex-compact 38073948 40096450 0.95
tpcds_q17/duckdb:vortex-compact 🚨 62378473 54935704 1.14
tpcds_q18/duckdb:vortex-compact 69010897 68074653 1.01
tpcds_q19/duckdb:vortex-compact 🚨 55699334 46338926 1.20
tpcds_q20/duckdb:vortex-compact 24614624 24581827 1.00
tpcds_q21/duckdb:vortex-compact 🚀 25130207 32466069 0.77
tpcds_q22/duckdb:vortex-compact 🚀 85458174 137351405 0.62
tpcds_q23/duckdb:vortex-compact 130492348 122541739 1.06
tpcds_q24/duckdb:vortex-compact 🚀 67119271 79133789 0.85
tpcds_q25/duckdb:vortex-compact 🚨 89641935 58144769 1.54
tpcds_q26/duckdb:vortex-compact 58014278 56387613 1.03
tpcds_q27/duckdb:vortex-compact 75724459 73678211 1.03
tpcds_q28/duckdb:vortex-compact 87154511 89537988 0.97
tpcds_q29/duckdb:vortex-compact 59504635 55603183 1.07
tpcds_q30/duckdb:vortex-compact 🚀 34533770 39049347 0.88
tpcds_q31/duckdb:vortex-compact 🚨 50306262 39941584 1.26
tpcds_q32/duckdb:vortex-compact 28805058 26307247 1.09
tpcds_q33/duckdb:vortex-compact 38640726 36754303 1.05
tpcds_q34/duckdb:vortex-compact 🚨 43380692 30572141 1.42
tpcds_q35/duckdb:vortex-compact 88901674 89304592 1.00
tpcds_q36/duckdb:vortex-compact 🚨 44875478 39296272 1.14
tpcds_q37/duckdb:vortex-compact 🚀 28859573 37071074 0.78
tpcds_q38/duckdb:vortex-compact 🚨 50772333 44334293 1.15
tpcds_q39/duckdb:vortex-compact 🚀 42366887 57641010 0.74
tpcds_q40/duckdb:vortex-compact 30235531 32123052 0.94
tpcds_q41/duckdb:vortex-compact 19156082 19963557 0.96
tpcds_q42/duckdb:vortex-compact 🚨 23751452 19383889 1.23
tpcds_q43/duckdb:vortex-compact 38517681 40729716 0.95
tpcds_q44/duckdb:vortex-compact 33482750 35223760 0.95
tpcds_q45/duckdb:vortex-compact 🚨 44124978 40006956 1.10
tpcds_q46/duckdb:vortex-compact 🚨 79878040 68362383 1.17
tpcds_q47/duckdb:vortex-compact 69376731 72124381 0.96
tpcds_q48/duckdb:vortex-compact 55398223 50938719 1.09
tpcds_q49/duckdb:vortex-compact 🚨 63337247 55736162 1.14
tpcds_q50/duckdb:vortex-compact 50726899 53302068 0.95
tpcds_q51/duckdb:vortex-compact 114978446 121133415 0.95
tpcds_q52/duckdb:vortex-compact 🚨 24412125 19995323 1.22
tpcds_q53/duckdb:vortex-compact 🚨 42020847 31949595 1.32
tpcds_q54/duckdb:vortex-compact 44302031 40274678 1.10
tpcds_q55/duckdb:vortex-compact 🚨 25296092 19412619 1.30
tpcds_q56/duckdb:vortex-compact 🚨 39386629 34350484 1.15
tpcds_q57/duckdb:vortex-compact 🚀 46556769 57282856 0.81
tpcds_q58/duckdb:vortex-compact 49030000 53146613 0.92
tpcds_q59/duckdb:vortex-compact 🚀 92555880 112800240 0.82
tpcds_q60/duckdb:vortex-compact 🚨 43459985 36540202 1.19
tpcds_q61/duckdb:vortex-compact 🚨 68215349 57747406 1.18
tpcds_q62/duckdb:vortex-compact 🚨 29506698 22854695 1.29
tpcds_q63/duckdb:vortex-compact 🚨 41476441 33139168 1.25
tpcds_q64/duckdb:vortex-compact 132823452 126288158 1.05
tpcds_q65/duckdb:vortex-compact 36097035 33679259 1.07
tpcds_q66/duckdb:vortex-compact 44915543 42172650 1.07
tpcds_q67/duckdb:vortex-compact 161420250 176430205 0.91
tpcds_q68/duckdb:vortex-compact 🚨 65043357 58643164 1.11
tpcds_q69/duckdb:vortex-compact 🚨 68436432 56376196 1.21
tpcds_q70/duckdb:vortex-compact 40510090 38953316 1.04
tpcds_q71/duckdb:vortex-compact 🚨 36741045 29579967 1.24
tpcds_q72/duckdb:vortex-compact 200105740 214195287 0.93
tpcds_q73/duckdb:vortex-compact 🚨 40913099 28727060 1.42
tpcds_q74/duckdb:vortex-compact 🚨 86675689 74226640 1.17
tpcds_q75/duckdb:vortex-compact 81425097 74295349 1.10
tpcds_q76/duckdb:vortex-compact 🚀 38282839 44991423 0.85
tpcds_q77/duckdb:vortex-compact 45453633 44248441 1.03
tpcds_q78/duckdb:vortex-compact 93151026 96571757 0.96
tpcds_q79/duckdb:vortex-compact 57116740 60318711 0.95
tpcds_q80/duckdb:vortex-compact 🚨 89153117 79939051 1.12
tpcds_q81/duckdb:vortex-compact 38698710 41408232 0.93
tpcds_q82/duckdb:vortex-compact 32733368 35797842 0.91
tpcds_q83/duckdb:vortex-compact 🚀 37766053 52275190 0.72
tpcds_q84/duckdb:vortex-compact 🚨 31359344 26816902 1.17
tpcds_q85/duckdb:vortex-compact 66513508 71775509 0.93
tpcds_q86/duckdb:vortex-compact 🚨 28308457 22667972 1.25
tpcds_q87/duckdb:vortex-compact 54570424 51430286 1.06
tpcds_q88/duckdb:vortex-compact 45036379 44466434 1.01
tpcds_q89/duckdb:vortex-compact 🚨 41840369 31009891 1.35
tpcds_q90/duckdb:vortex-compact 17644439 17833574 0.99
tpcds_q91/duckdb:vortex-compact 56459470 59644214 0.95
tpcds_q92/duckdb:vortex-compact 🚨 57469555 24386556 2.36
tpcds_q93/duckdb:vortex-compact 🚀 34171266 39591553 0.86
tpcds_q94/duckdb:vortex-compact 🚨 36388256 31520742 1.15
tpcds_q95/duckdb:vortex-compact 🚨 172836961 156463991 1.10
tpcds_q96/duckdb:vortex-compact 🚨 18402426 15083848 1.22
tpcds_q97/duckdb:vortex-compact 46090051 46827487 0.98
tpcds_q98/duckdb:vortex-compact 30654609 28162952 1.09
tpcds_q99/duckdb:vortex-compact 35626378 38774464 0.92
duckdb / parquet (0.896x ✅, 42↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29288087 31777266 0.92
tpcds_q02/duckdb:parquet 24284320 25816945 0.94
tpcds_q03/duckdb:parquet 🚀 11331886 12819097 0.88
tpcds_q04/duckdb:parquet 168115498 183505399 0.92
tpcds_q05/duckdb:parquet 🚀 29632971 33312103 0.89
tpcds_q06/duckdb:parquet 🚀 28152815 31826034 0.88
tpcds_q07/duckdb:parquet 22057815 22195850 0.99
tpcds_q08/duckdb:parquet 27280203 30002998 0.91
tpcds_q09/duckdb:parquet 40056520 41857866 0.96
tpcds_q10/duckdb:parquet 🚀 33760137 38736719 0.87
tpcds_q11/duckdb:parquet 92096675 99643753 0.92
tpcds_q12/duckdb:parquet 🚀 14821612 19050107 0.78
tpcds_q13/duckdb:parquet 🚀 32936651 38764197 0.85
tpcds_q14/duckdb:parquet 🚀 101525197 117829851 0.86
tpcds_q15/duckdb:parquet 🚀 31541038 42437682 0.74
tpcds_q16/duckdb:parquet 🚀 22727347 28046356 0.81
tpcds_q17/duckdb:parquet 🚀 36248660 46606356 0.78
tpcds_q18/duckdb:parquet 🚀 47052585 54828780 0.86
tpcds_q19/duckdb:parquet 🚀 29192662 36236221 0.81
tpcds_q20/duckdb:parquet 🚀 15813177 18255726 0.87
tpcds_q21/duckdb:parquet 🚀 10253036 13928918 0.74
tpcds_q22/duckdb:parquet 🚀 74995120 93496204 0.80
tpcds_q23/duckdb:parquet 82320315 90799946 0.91
tpcds_q24/duckdb:parquet 47231806 49660760 0.95
tpcds_q25/duckdb:parquet 33965212 37403528 0.91
tpcds_q26/duckdb:parquet 37676353 40879196 0.92
tpcds_q27/duckdb:parquet 50256659 53671922 0.94
tpcds_q28/duckdb:parquet 37892078 41429566 0.91
tpcds_q29/duckdb:parquet 36097242 39885783 0.91
tpcds_q30/duckdb:parquet 36138215 39144813 0.92
tpcds_q31/duckdb:parquet 24568717 27289861 0.90
tpcds_q32/duckdb:parquet 11590205 12457536 0.93
tpcds_q33/duckdb:parquet 🚀 21287949 23948902 0.89
tpcds_q34/duckdb:parquet 20858283 22080937 0.94
tpcds_q35/duckdb:parquet 🚀 58956306 67576338 0.87
tpcds_q36/duckdb:parquet 19960621 21683856 0.92
tpcds_q37/duckdb:parquet 🚀 12578858 14864205 0.85
tpcds_q38/duckdb:parquet 34759540 38201807 0.91
tpcds_q39/duckdb:parquet 🚀 28880415 32627348 0.89
tpcds_q40/duckdb:parquet 18030652 20002112 0.90
tpcds_q41/duckdb:parquet 7932633 8691353 0.91
tpcds_q42/duckdb:parquet 10359305 10797916 0.96
tpcds_q43/duckdb:parquet 15395302 16368413 0.94
tpcds_q44/duckdb:parquet 23049286 24312344 0.95
tpcds_q45/duckdb:parquet 🚀 26207189 31869288 0.82
tpcds_q46/duckdb:parquet 🚀 46641125 52864267 0.88
tpcds_q47/duckdb:parquet 🚀 45070355 50144821 0.90
tpcds_q48/duckdb:parquet 🚀 29449055 32896724 0.90
tpcds_q49/duckdb:parquet 24951539 27643781 0.90
tpcds_q50/duckdb:parquet 24078281 25892742 0.93
tpcds_q51/duckdb:parquet 95612239 103233919 0.93
tpcds_q52/duckdb:parquet 11158809 11457904 0.97
tpcds_q53/duckdb:parquet 15140525 16799763 0.90
tpcds_q54/duckdb:parquet 26443044 27995696 0.94
tpcds_q55/duckdb:parquet 10035868 10991360 0.91
tpcds_q56/duckdb:parquet 21909328 24178726 0.91
tpcds_q57/duckdb:parquet 35498326 38372243 0.93
tpcds_q58/duckdb:parquet 22541268 24600202 0.92
tpcds_q59/duckdb:parquet 35753907 37911199 0.94
tpcds_q60/duckdb:parquet 🚀 21716011 24730886 0.88
tpcds_q61/duckdb:parquet 30851170 33557992 0.92
tpcds_q62/duckdb:parquet 12699537 13452275 0.94
tpcds_q63/duckdb:parquet 14113508 15521271 0.91
tpcds_q64/duckdb:parquet 🚀 76178581 85025021 0.90
tpcds_q65/duckdb:parquet 21458371 22308927 0.96
tpcds_q66/duckdb:parquet 28085316 29671230 0.95
tpcds_q67/duckdb:parquet 🚀 143134002 159091927 0.90
tpcds_q68/duckdb:parquet 37302899 40032551 0.93
tpcds_q69/duckdb:parquet 37077372 40425802 0.92
tpcds_q70/duckdb:parquet 20209420 21027170 0.96
tpcds_q71/duckdb:parquet 19517096 20686968 0.94
tpcds_q72/duckdb:parquet 165770395 183665168 0.90
tpcds_q73/duckdb:parquet 🚀 17726356 20614409 0.86
tpcds_q74/duckdb:parquet 129428667 137223543 0.94
tpcds_q75/duckdb:parquet 🚀 52993178 59050858 0.90
tpcds_q76/duckdb:parquet 🚀 19577078 23140240 0.85
tpcds_q77/duckdb:parquet 22246774 24331717 0.91
tpcds_q78/duckdb:parquet 🚀 76077007 89428133 0.85
tpcds_q79/duckdb:parquet 🚀 27802409 31105711 0.89
tpcds_q80/duckdb:parquet 42872352 45899410 0.93
tpcds_q81/duckdb:parquet 🚀 32072671 36761741 0.87
tpcds_q82/duckdb:parquet 13992998 15386813 0.91
tpcds_q83/duckdb:parquet 17146094 18135451 0.95
tpcds_q84/duckdb:parquet 🚀 18923098 22109297 0.86
tpcds_q85/duckdb:parquet 🚀 39268382 49805496 0.79
tpcds_q86/duckdb:parquet 🚀 13192852 15289963 0.86
tpcds_q87/duckdb:parquet 🚀 37329259 42280402 0.88
tpcds_q88/duckdb:parquet 49371417 51902495 0.95
tpcds_q89/duckdb:parquet 🚀 16282382 18633937 0.87
tpcds_q90/duckdb:parquet 🚀 7509325 8473256 0.89
tpcds_q91/duckdb:parquet 🚀 22305595 25393076 0.88
tpcds_q92/duckdb:parquet 12849947 14250364 0.90
tpcds_q93/duckdb:parquet 🚀 30678242 34759107 0.88
tpcds_q94/duckdb:parquet 16824797 18667700 0.90
tpcds_q95/duckdb:parquet 🚀 130328859 157242113 0.83
tpcds_q96/duckdb:parquet 8814721 9781165 0.90
tpcds_q97/duckdb:parquet 🚀 35612606 39664796 0.90
tpcds_q98/duckdb:parquet 17771868 19359906 0.92
tpcds_q99/duckdb:parquet 19959424 21149129 0.94
duckdb / duckdb (0.906x ➖, 38↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 20216152 24395563 0.83
tpcds_q02/duckdb:duckdb 19443259 20700271 0.94
tpcds_q03/duckdb:duckdb 9344386 10102901 0.92
tpcds_q04/duckdb:duckdb 177227819 190766902 0.93
tpcds_q05/duckdb:duckdb 20596081 20618275 1.00
tpcds_q06/duckdb:duckdb 25937339 27732188 0.94
tpcds_q07/duckdb:duckdb 40762835 43072881 0.95
tpcds_q08/duckdb:duckdb 121564958 123371247 0.99
tpcds_q09/duckdb:duckdb 20467787 21055632 0.97
tpcds_q10/duckdb:duckdb 25699537 26855842 0.96
tpcds_q11/duckdb:duckdb 93867371 101323212 0.93
tpcds_q12/duckdb:duckdb 🚀 11925573 13412170 0.89
tpcds_q13/duckdb:duckdb 25551835 26201263 0.98
tpcds_q14/duckdb:duckdb 93620234 100406694 0.93
tpcds_q15/duckdb:duckdb 🚀 25909439 29516707 0.88
tpcds_q16/duckdb:duckdb 19207696 20479665 0.94
tpcds_q17/duckdb:duckdb 🚀 22987163 26519706 0.87
tpcds_q18/duckdb:duckdb 🚀 46473161 56027601 0.83
tpcds_q19/duckdb:duckdb 🚀 17399331 22746645 0.76
tpcds_q20/duckdb:duckdb 🚀 12740484 16736621 0.76
tpcds_q21/duckdb:duckdb 8881036 8681120 1.02
tpcds_q22/duckdb:duckdb 🚀 64628039 111424145 0.58
tpcds_q23/duckdb:duckdb 🚀 80245519 90031418 0.89
tpcds_q24/duckdb:duckdb 🚀 25342206 31152680 0.81
tpcds_q25/duckdb:duckdb 🚀 18032028 21303504 0.85
tpcds_q26/duckdb:duckdb 🚀 27692345 34985918 0.79
tpcds_q27/duckdb:duckdb 🚀 41217208 48577606 0.85
tpcds_q28/duckdb:duckdb 22314131 23938341 0.93
tpcds_q29/duckdb:duckdb 22751062 23376683 0.97
tpcds_q30/duckdb:duckdb 30866699 32828633 0.94
tpcds_q31/duckdb:duckdb 🚀 51340658 57478476 0.89
tpcds_q32/duckdb:duckdb 7729148 8462899 0.91
tpcds_q33/duckdb:duckdb 13279620 14146096 0.94
tpcds_q34/duckdb:duckdb 15263527 16611035 0.92
tpcds_q35/duckdb:duckdb 34057236 35319482 0.96
tpcds_q36/duckdb:duckdb 🚀 75668130 85501262 0.88
tpcds_q37/duckdb:duckdb 🚀 8341255 9786695 0.85
tpcds_q38/duckdb:duckdb 🚀 32632190 38914145 0.84
tpcds_q39/duckdb:duckdb 🚀 26681040 31681725 0.84
tpcds_q40/duckdb:duckdb 🚀 14220737 18755248 0.76
tpcds_q41/duckdb:duckdb 🚀 8929458 11013680 0.81
tpcds_q42/duckdb:duckdb 🚀 6949846 8614531 0.81
tpcds_q43/duckdb:duckdb 12625342 12758902 0.99
tpcds_q44/duckdb:duckdb 🚀 13886764 15985417 0.87
tpcds_q45/duckdb:duckdb 18948791 20385005 0.93
tpcds_q46/duckdb:duckdb 38882095 42854582 0.91
tpcds_q47/duckdb:duckdb 41851552 44750027 0.94
tpcds_q48/duckdb:duckdb 24145942 24549018 0.98
tpcds_q49/duckdb:duckdb 18082148 18241626 0.99
tpcds_q50/duckdb:duckdb 15158696 15532459 0.98
tpcds_q51/duckdb:duckdb 96779188 100378203 0.96
tpcds_q52/duckdb:duckdb 7657546 8224604 0.93
tpcds_q53/duckdb:duckdb 14397114 14117769 1.02
tpcds_q54/duckdb:duckdb 17797909 18944970 0.94
tpcds_q55/duckdb:duckdb 7399016 8101308 0.91
tpcds_q56/duckdb:duckdb 14435946 15674967 0.92
tpcds_q57/duckdb:duckdb 🚀 33289869 40508692 0.82
tpcds_q58/duckdb:duckdb 🚀 13044323 16031824 0.81
tpcds_q59/duckdb:duckdb 🚀 36686532 40885583 0.90
tpcds_q60/duckdb:duckdb 🚀 15658675 19678747 0.80
tpcds_q61/duckdb:duckdb 🚀 15398284 17471001 0.88
tpcds_q62/duckdb:duckdb 🚀 10006126 12172839 0.82
tpcds_q63/duckdb:duckdb 🚀 13113148 15475403 0.85
tpcds_q64/duckdb:duckdb 🚀 55877094 67460228 0.83
tpcds_q65/duckdb:duckdb 35133936 38935142 0.90
tpcds_q66/duckdb:duckdb 26806807 29303121 0.91
tpcds_q67/duckdb:duckdb 🚀 131691197 175651331 0.75
tpcds_q68/duckdb:duckdb 🚀 25828720 28715180 0.90
tpcds_q69/duckdb:duckdb 26291093 28074714 0.94
tpcds_q70/duckdb:duckdb 16298560 16735450 0.97
tpcds_q71/duckdb:duckdb 🚀 13392243 15449571 0.87
tpcds_q72/duckdb:duckdb 🚀 43432444 48369017 0.90
tpcds_q73/duckdb:duckdb 11683082 12384684 0.94
tpcds_q74/duckdb:duckdb 149339312 161178600 0.93
tpcds_q75/duckdb:duckdb 44046463 47213886 0.93
tpcds_q76/duckdb:duckdb 12964813 13405038 0.97
tpcds_q77/duckdb:duckdb 13369959 13181078 1.01
tpcds_q78/duckdb:duckdb 🚀 62707798 70287348 0.89
tpcds_q79/duckdb:duckdb 19656700 20786019 0.95
tpcds_q80/duckdb:duckdb 🚀 29724771 33664655 0.88
tpcds_q81/duckdb:duckdb 41491623 43796959 0.95
tpcds_q82/duckdb:duckdb 9395622 9068757 1.04
tpcds_q83/duckdb:duckdb 9941355 10282929 0.97
tpcds_q84/duckdb:duckdb 14505202 15340092 0.95
tpcds_q85/duckdb:duckdb 26052173 28283143 0.92
tpcds_q86/duckdb:duckdb 11301335 11679306 0.97
tpcds_q87/duckdb:duckdb 35630283 37308561 0.96
tpcds_q88/duckdb:duckdb 26804968 26100343 1.03
tpcds_q89/duckdb:duckdb 14867332 15725527 0.95
tpcds_q90/duckdb:duckdb 6348522 6468993 0.98
tpcds_q91/duckdb:duckdb 13667171 13758934 0.99
tpcds_q92/duckdb:duckdb 9245899 10005467 0.92
tpcds_q93/duckdb:duckdb 23883187 25740560 0.93
tpcds_q94/duckdb:duckdb 13384429 14621136 0.92
tpcds_q95/duckdb:duckdb 🚀 112918867 133125423 0.85
tpcds_q96/duckdb:duckdb 4988681 5070495 0.98
tpcds_q97/duckdb:duckdb 🚀 31384903 35444283 0.89
tpcds_q98/duckdb:duckdb 15005429 15489707 0.97
tpcds_q99/duckdb:duckdb 17242253 17934615 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.5% -11.5% +4.5% +11.2% ➖ noise
1 datafusion:vortex-file-compressed -17.8% -11.5% -7.1% +12.1% ➖ noise
1 duckdb:duckdb -17.1% -11.5% -6.3% +14.5% ➖ noise
1 duckdb:vortex-compact -26.4% -11.5% -16.8% +12.3% ✅ faster
1 duckdb:vortex-file-compressed -7.9% -11.5% +4.1% +11.2% ➖ noise
2 datafusion:vortex-compact -10.0% -5.4% -4.8% +11.2% ➖ noise
2 datafusion:vortex-file-compressed -20.1% -5.4% -15.6% +11.2% ✅ faster
2 duckdb:duckdb -6.1% -5.4% -0.7% +11.2% ➖ noise
2 duckdb:vortex-compact -36.5% -5.4% -32.9% +27.9% ✅ faster
2 duckdb:vortex-file-compressed -25.1% -5.4% -20.9% +35.8% ➖ noise
3 datafusion:vortex-compact -17.0% -10.9% -6.8% +11.2% ➖ noise
3 datafusion:vortex-file-compressed -17.3% -10.9% -7.2% +14.1% ➖ noise
3 duckdb:duckdb -7.5% -10.9% +3.8% +13.4% ➖ noise
3 duckdb:vortex-compact -12.1% -10.9% -1.3% +11.2% ➖ noise
3 duckdb:vortex-file-compressed -3.9% -10.9% +7.8% +11.2% ➖ noise
4 datafusion:vortex-compact -26.3% -14.8% -13.4% +11.2% ✅ faster
4 datafusion:vortex-file-compressed -26.0% -14.8% -13.1% +11.2% ✅ faster
4 duckdb:duckdb -7.1% -14.8% +9.1% +11.2% ➖ noise
4 duckdb:vortex-compact -9.9% -14.8% +5.8% +11.2% ➖ noise
4 duckdb:vortex-file-compressed -2.8% -14.8% +14.1% +12.4% 🚨 regression
5 datafusion:vortex-compact -18.1% -20.0% +2.4% +11.2% ➖ noise
5 datafusion:vortex-file-compressed -25.9% -20.0% -7.4% +14.4% ➖ noise
5 duckdb:duckdb -0.1% -20.0% +24.8% +16.7% 🚨 regression
5 duckdb:vortex-compact +21.8% -20.0% +52.2% +14.6% 🚨 regression
5 duckdb:vortex-file-compressed +9.6% -20.0% +36.9% +14.5% 🚨 regression
6 datafusion:vortex-compact -17.8% -12.1% -6.5% +11.2% ➖ noise
6 datafusion:vortex-file-compressed -29.3% -12.1% -19.6% +11.2% ✅ faster
6 duckdb:duckdb -6.5% -12.1% +6.4% +16.5% ➖ noise
6 duckdb:vortex-compact -11.6% -12.1% +0.6% +11.2% ➖ noise
6 duckdb:vortex-file-compressed -4.0% -12.1% +9.2% +11.2% ➖ noise
7 datafusion:vortex-compact -6.2% -6.9% +0.7% +11.2% ➖ noise
7 datafusion:vortex-file-compressed -27.5% -6.9% -22.1% +11.2% ✅ faster
7 duckdb:duckdb -5.4% -6.9% +1.7% +16.4% ➖ noise
7 duckdb:vortex-compact -19.8% -6.9% -13.8% +11.2% ✅ faster
7 duckdb:vortex-file-compressed -8.0% -6.9% -1.1% +11.2% ➖ noise
8 datafusion:vortex-compact -19.6% -8.9% -11.8% +11.2% ✅ faster
8 datafusion:vortex-file-compressed -24.2% -8.9% -16.8% +11.2% ✅ faster
8 duckdb:duckdb -1.5% -8.9% +8.2% +11.2% ➖ noise
8 duckdb:vortex-compact +17.9% -8.9% +29.4% +12.0% 🚨 regression
8 duckdb:vortex-file-compressed -2.8% -8.9% +6.6% +12.2% ➖ noise
9 datafusion:vortex-compact -16.3% -5.2% -11.7% +11.2% ✅ faster
9 datafusion:vortex-file-compressed -19.0% -5.2% -14.5% +11.2% ✅ faster
9 duckdb:duckdb -2.8% -5.2% +2.6% +11.2% ➖ noise
9 duckdb:vortex-compact -3.6% -5.2% +1.7% +11.2% ➖ noise
9 duckdb:vortex-file-compressed -8.5% -5.2% -3.4% +15.2% ➖ noise
10 datafusion:vortex-compact -24.8% -11.4% -15.1% +11.2% ✅ faster
10 datafusion:vortex-file-compressed -28.3% -11.4% -19.1% +11.2% ✅ faster
10 duckdb:duckdb -4.3% -11.4% +8.0% +11.4% ➖ noise
10 duckdb:vortex-compact +25.9% -11.4% +42.1% +11.2% 🚨 regression
10 duckdb:vortex-file-compressed +7.5% -11.4% +21.4% +13.3% 🚨 regression
11 datafusion:vortex-compact -13.8% -10.2% -4.0% +13.3% ➖ noise
11 datafusion:vortex-file-compressed -22.0% -10.2% -13.2% +11.2% ✅ faster
11 duckdb:duckdb -7.4% -10.2% +3.2% +11.2% ➖ noise
11 duckdb:vortex-compact +14.8% -10.2% +27.9% +11.2% 🚨 regression
11 duckdb:vortex-file-compressed +3.2% -10.2% +15.0% +11.2% 🚨 regression
12 datafusion:vortex-compact -19.3% -16.8% -2.9% +12.2% ➖ noise
12 datafusion:vortex-file-compressed -19.6% -16.8% -3.3% +12.9% ➖ noise
12 duckdb:duckdb -11.1% -16.8% +6.9% +12.4% ➖ noise
12 duckdb:vortex-compact +18.5% -16.8% +42.5% +11.2% 🚨 regression
12 duckdb:vortex-file-compressed -5.2% -16.8% +14.0% +11.2% 🚨 regression
13 datafusion:vortex-compact -7.5% -12.3% +5.4% +11.2% ➖ noise
13 datafusion:vortex-file-compressed -19.3% -12.3% -8.1% +11.2% ➖ noise
13 duckdb:duckdb -2.5% -12.3% +11.1% +11.2% ➖ noise
13 duckdb:vortex-compact +16.6% -12.3% +32.9% +11.2% 🚨 regression
13 duckdb:vortex-file-compressed -1.5% -12.3% +12.3% +11.2% 🚨 regression
14 datafusion:vortex-compact -20.6% -14.2% -7.5% +11.2% ➖ noise
14 datafusion:vortex-file-compressed -16.2% -14.2% -2.3% +11.2% ➖ noise
14 duckdb:duckdb -6.8% -14.2% +8.7% +11.2% ➖ noise
14 duckdb:vortex-compact +7.6% -14.2% +25.5% +11.2% 🚨 regression
14 duckdb:vortex-file-compressed -5.8% -14.2% +9.8% +11.2% ➖ noise
15 datafusion:vortex-compact -27.7% -24.1% -4.7% +15.8% ➖ noise
15 datafusion:vortex-file-compressed -19.2% -24.1% +6.4% +14.9% ➖ noise
15 duckdb:duckdb -12.2% -24.1% +15.6% +15.8% ➖ noise
15 duckdb:vortex-compact -29.7% -24.1% -7.4% +14.8% ➖ noise
15 duckdb:vortex-file-compressed -38.1% -24.1% -18.5% +12.2% ✅ faster
16 datafusion:vortex-compact -8.2% -12.3% +4.7% +14.3% ➖ noise
16 datafusion:vortex-file-compressed -22.5% -12.3% -11.6% +12.7% ✅ faster
16 duckdb:duckdb -6.2% -12.3% +7.0% +12.8% ➖ noise
16 duckdb:vortex-compact -5.0% -12.3% +8.3% +11.2% ➖ noise
16 duckdb:vortex-file-compressed -3.9% -12.3% +9.5% +11.2% ➖ noise
17 datafusion:vortex-compact -11.1% -16.7% +6.7% +11.2% ➖ noise
17 datafusion:vortex-file-compressed -20.9% -16.7% -5.1% +11.4% ➖ noise
17 duckdb:duckdb -13.3% -16.7% +4.0% +12.2% ➖ noise
17 duckdb:vortex-compact +13.5% -16.7% +36.2% +11.2% 🚨 regression
17 duckdb:vortex-file-compressed +11.8% -16.7% +34.1% +11.2% 🚨 regression
18 datafusion:vortex-compact -13.6% -13.9% +0.4% +11.2% ➖ noise
18 datafusion:vortex-file-compressed -31.6% -13.9% -20.6% +11.2% ✅ faster
18 duckdb:duckdb -17.1% -13.9% -3.6% +12.3% ➖ noise
18 duckdb:vortex-compact +1.4% -13.9% +17.8% +11.2% 🚨 regression
18 duckdb:vortex-file-compressed +1.6% -13.9% +18.0% +11.2% 🚨 regression
19 datafusion:vortex-compact -12.2% -14.6% +2.8% +11.2% ➖ noise
19 datafusion:vortex-file-compressed -33.3% -14.6% -21.9% +11.2% ✅ faster
19 duckdb:duckdb -23.5% -14.6% -10.5% +11.2% ✅ faster
19 duckdb:vortex-compact +20.2% -14.6% +40.7% +11.9% 🚨 regression
19 duckdb:vortex-file-compressed -8.1% -14.6% +7.5% +21.2% ➖ noise
20 datafusion:vortex-compact -11.7% -14.8% +3.7% +11.2% ➖ noise
20 datafusion:vortex-file-compressed -33.4% -14.8% -21.8% +11.2% ✅ faster
20 duckdb:duckdb -23.9% -14.8% -10.6% +11.2% ✅ faster
20 duckdb:vortex-compact +0.1% -14.8% +17.6% +12.6% 🚨 regression
20 duckdb:vortex-file-compressed +2.8% -14.8% +20.7% +11.2% 🚨 regression
21 datafusion:vortex-compact -16.5% -17.2% +0.9% +14.4% ➖ noise
21 datafusion:vortex-file-compressed -26.0% -17.2% -10.6% +13.4% ➖ noise
21 duckdb:duckdb +2.3% -17.2% +23.6% +24.0% ➖ noise
21 duckdb:vortex-compact -22.6% -17.2% -6.5% +12.9% ➖ noise
21 duckdb:vortex-file-compressed -7.6% -17.2% +11.6% +15.8% ➖ noise
22 datafusion:vortex-compact -21.8% -14.2% -8.8% +15.4% ➖ noise
22 datafusion:vortex-file-compressed -9.7% -14.2% +5.2% +16.7% ➖ noise
22 duckdb:duckdb -42.0% -14.2% -32.4% +16.1% ✅ faster
22 duckdb:vortex-compact -37.8% -14.2% -27.5% +15.8% ✅ faster
22 duckdb:vortex-file-compressed -35.4% -14.2% -24.7% +16.3% ✅ faster
23 datafusion:vortex-compact -18.1% -11.6% -7.3% +11.2% ➖ noise
23 datafusion:vortex-file-compressed -11.9% -11.6% -0.4% +11.2% ➖ noise
23 duckdb:duckdb -10.9% -11.6% +0.8% +15.7% ➖ noise
23 duckdb:vortex-compact +6.5% -11.6% +20.4% +11.2% 🚨 regression
23 duckdb:vortex-file-compressed -12.5% -11.6% -1.1% +11.2% ➖ noise
24 datafusion:vortex-compact -26.7% -9.4% -19.1% +11.2% ✅ faster
24 datafusion:vortex-file-compressed -13.8% -9.4% -4.9% +11.2% ➖ noise
24 duckdb:duckdb -18.7% -9.4% -10.2% +11.2% ✅ faster
24 duckdb:vortex-compact -15.2% -9.4% -6.4% +11.2% ➖ noise
24 duckdb:vortex-file-compressed -18.4% -9.4% -10.0% +11.2% ➖ noise
25 datafusion:vortex-compact -9.6% -7.9% -1.8% +14.5% ➖ noise
25 datafusion:vortex-file-compressed -14.5% -7.9% -7.2% +11.2% ➖ noise
25 duckdb:duckdb -15.4% -7.9% -8.1% +11.7% ➖ noise
25 duckdb:vortex-compact +54.2% -7.9% +67.4% +11.2% 🚨 regression
25 duckdb:vortex-file-compressed +24.2% -7.9% +34.8% +11.2% 🚨 regression
26 datafusion:vortex-compact -20.7% -13.9% -7.9% +11.2% ➖ noise
26 datafusion:vortex-file-compressed -16.3% -13.9% -2.8% +11.2% ➖ noise
26 duckdb:duckdb -20.8% -13.9% -8.1% +12.8% ➖ noise
26 duckdb:vortex-compact +2.9% -13.9% +19.5% +15.1% 🚨 regression
26 duckdb:vortex-file-compressed +2.6% -13.9% +19.2% +13.1% 🚨 regression
27 datafusion:vortex-compact -20.7% -10.2% -11.6% +11.2% ✅ faster
27 datafusion:vortex-file-compressed -17.0% -10.2% -7.5% +11.2% ➖ noise
27 duckdb:duckdb -15.2% -10.2% -5.5% +15.2% ➖ noise
27 duckdb:vortex-compact +2.8% -10.2% +14.5% +11.2% 🚨 regression
27 duckdb:vortex-file-compressed -15.5% -10.2% -5.9% +15.8% ➖ noise
28 datafusion:vortex-compact -5.8% -8.6% +3.1% +11.2% ➖ noise
28 datafusion:vortex-file-compressed -10.6% -8.6% -2.1% +11.2% ➖ noise
28 duckdb:duckdb -6.8% -8.6% +2.0% +17.8% ➖ noise
28 duckdb:vortex-compact -2.7% -8.6% +6.5% +11.2% ➖ noise
28 duckdb:vortex-file-compressed -10.4% -8.6% -2.0% +11.2% ➖ noise
29 datafusion:vortex-compact -9.5% -9.4% -0.1% +11.2% ➖ noise
29 datafusion:vortex-file-compressed -22.4% -9.4% -14.4% +11.2% ✅ faster
29 duckdb:duckdb -2.7% -9.4% +7.4% +11.2% ➖ noise
29 duckdb:vortex-compact +7.0% -9.4% +18.1% +11.2% 🚨 regression
29 duckdb:vortex-file-compressed +13.8% -9.4% +25.6% +11.9% 🚨 regression
30 datafusion:vortex-compact -13.7% -10.3% -3.8% +17.0% ➖ noise
30 datafusion:vortex-file-compressed -28.1% -10.3% -19.8% +11.9% ✅ faster
30 duckdb:duckdb -6.0% -10.3% +4.8% +11.2% ➖ noise
30 duckdb:vortex-compact -11.6% -10.3% -1.4% +18.8% ➖ noise
30 duckdb:vortex-file-compressed -10.0% -10.3% +0.4% +11.2% ➖ noise
31 datafusion:vortex-compact -11.8% -10.0% -2.0% +11.2% ➖ noise
31 datafusion:vortex-file-compressed -23.8% -10.0% -15.3% +11.2% ✅ faster
31 duckdb:duckdb -10.7% -10.0% -0.7% +14.9% ➖ noise
31 duckdb:vortex-compact +25.9% -10.0% +40.0% +11.2% 🚨 regression
31 duckdb:vortex-file-compressed +2.9% -10.0% +14.3% +11.2% 🚨 regression
32 datafusion:vortex-compact -10.1% -9.9% -0.2% +11.2% ➖ noise
32 datafusion:vortex-file-compressed -31.3% -9.9% -23.7% +11.2% ✅ faster
32 duckdb:duckdb -8.7% -9.9% +1.4% +18.5% ➖ noise
32 duckdb:vortex-compact +9.5% -9.9% +21.6% +11.2% 🚨 regression
32 duckdb:vortex-file-compressed -17.3% -9.9% -8.2% +11.2% ➖ noise
33 datafusion:vortex-compact -11.7% -12.8% +1.3% +11.2% ➖ noise
33 datafusion:vortex-file-compressed -24.8% -12.8% -13.7% +11.2% ✅ faster
33 duckdb:duckdb -6.1% -12.8% +7.7% +11.2% ➖ noise
33 duckdb:vortex-compact +5.1% -12.8% +20.6% +11.2% 🚨 regression
33 duckdb:vortex-file-compressed -1.2% -12.8% +13.3% +26.1% ➖ noise
34 datafusion:vortex-compact -11.7% -15.5% +4.6% +11.2% ➖ noise
34 datafusion:vortex-file-compressed -33.2% -15.5% -20.9% +11.2% ✅ faster
34 duckdb:duckdb -8.1% -15.5% +8.8% +11.2% ➖ noise
34 duckdb:vortex-compact +41.9% -15.5% +68.0% +11.2% 🚨 regression
34 duckdb:vortex-file-compressed +15.9% -15.5% +37.2% +12.6% 🚨 regression
35 datafusion:vortex-compact -18.0% -10.6% -8.3% +11.2% ➖ noise
35 datafusion:vortex-file-compressed -28.7% -10.6% -20.2% +11.2% ✅ faster
35 duckdb:duckdb -3.6% -10.6% +7.9% +12.3% ➖ noise
35 duckdb:vortex-compact -0.5% -10.6% +11.4% +11.2% 🚨 regression
35 duckdb:vortex-file-compressed -6.0% -10.6% +5.2% +11.2% ➖ noise
36 datafusion:vortex-compact -12.0% -18.0% +7.3% +11.2% ➖ noise
36 datafusion:vortex-file-compressed -31.8% -18.0% -16.8% +11.2% ✅ faster
36 duckdb:duckdb -11.5% -18.0% +7.9% +11.2% ➖ noise
36 duckdb:vortex-compact +14.2% -18.0% +39.2% +11.2% 🚨 regression
36 duckdb:vortex-file-compressed -15.8% -18.0% +2.6% +11.6% ➖ noise
37 datafusion:vortex-compact -12.0% -17.8% +7.1% +11.2% ➖ noise
37 datafusion:vortex-file-compressed -30.1% -17.8% -14.9% +11.2% ✅ faster
37 duckdb:duckdb -14.8% -17.8% +3.7% +11.2% ➖ noise
37 duckdb:vortex-compact -22.2% -17.8% -5.2% +11.5% ➖ noise
37 duckdb:vortex-file-compressed -33.7% -17.8% -19.3% +11.2% ✅ faster
38 datafusion:vortex-compact -9.8% -9.7% -0.2% +11.2% ➖ noise
38 datafusion:vortex-file-compressed -25.8% -9.7% -17.9% +11.2% ✅ faster
38 duckdb:duckdb -16.1% -9.7% -7.2% +15.5% ➖ noise
38 duckdb:vortex-compact +14.5% -9.7% +26.8% +17.2% 🚨 regression
38 duckdb:vortex-file-compressed +1.9% -9.7% +12.8% +16.5% ➖ noise
39 datafusion:vortex-compact -14.4% -20.8% +8.1% +11.7% ➖ noise
39 datafusion:vortex-file-compressed -18.5% -20.8% +2.9% +16.0% ➖ noise
39 duckdb:duckdb -15.8% -20.8% +6.3% +21.0% ➖ noise
39 duckdb:vortex-compact -26.5% -20.8% -7.2% +11.2% ➖ noise
39 duckdb:vortex-file-compressed -18.3% -20.8% +3.1% +22.3% ➖ noise
40 datafusion:vortex-compact -15.7% -11.0% -5.3% +11.2% ➖ noise
40 datafusion:vortex-file-compressed -22.4% -11.0% -12.9% +11.2% ✅ faster
40 duckdb:duckdb -24.2% -11.0% -14.8% +13.5% ✅ faster
40 duckdb:vortex-compact -5.9% -11.0% +5.7% +11.2% ➖ noise
40 duckdb:vortex-file-compressed -17.6% -11.0% -7.4% +13.6% ➖ noise
41 datafusion:vortex-compact -2.8% -12.4% +10.9% +11.2% ➖ noise
41 datafusion:vortex-file-compressed -14.8% -12.4% -2.8% +11.2% ➖ noise
41 duckdb:duckdb -18.9% -12.4% -7.5% +11.2% ➖ noise
41 duckdb:vortex-compact -4.0% -12.4% +9.5% +11.2% ➖ noise
41 duckdb:vortex-file-compressed -11.1% -12.4% +1.4% +11.2% ➖ noise
42 datafusion:vortex-compact -10.8% -8.1% -2.9% +11.2% ➖ noise
42 datafusion:vortex-file-compressed -22.0% -8.1% -15.1% +14.3% ✅ faster
42 duckdb:duckdb -19.3% -8.1% -12.2% +11.2% ✅ faster
42 duckdb:vortex-compact +22.5% -8.1% +33.4% +12.4% 🚨 regression
42 duckdb:vortex-file-compressed -0.3% -8.1% +8.6% +22.8% ➖ noise
43 datafusion:vortex-compact -10.3% -6.9% -3.7% +11.2% ➖ noise
43 datafusion:vortex-file-compressed -19.2% -6.9% -13.2% +11.2% ✅ faster
43 duckdb:duckdb -1.0% -6.9% +6.3% +11.2% ➖ noise
43 duckdb:vortex-compact -5.4% -6.9% +1.6% +11.2% ➖ noise
43 duckdb:vortex-file-compressed -26.6% -6.9% -21.2% +11.2% ✅ faster
44 datafusion:vortex-compact -8.4% -12.0% +4.1% +11.2% ➖ noise
44 datafusion:vortex-file-compressed -20.0% -12.0% -9.0% +11.2% ➖ noise
44 duckdb:duckdb -13.1% -12.0% -1.3% +26.4% ➖ noise
44 duckdb:vortex-compact -4.9% -12.0% +8.0% +11.7% ➖ noise
44 duckdb:vortex-file-compressed -4.7% -12.0% +8.3% +11.2% ➖ noise
45 datafusion:vortex-compact -10.4% -17.0% +8.0% +16.3% ➖ noise
45 datafusion:vortex-file-compressed -14.6% -17.0% +2.9% +11.2% ➖ noise
45 duckdb:duckdb -7.0% -17.0% +12.0% +11.9% 🚨 regression
45 duckdb:vortex-compact +10.3% -17.0% +32.9% +11.2% 🚨 regression
45 duckdb:vortex-file-compressed -4.9% -17.0% +14.7% +11.2% 🚨 regression
46 datafusion:vortex-compact -15.4% -15.7% +0.4% +11.2% ➖ noise
46 datafusion:vortex-file-compressed -17.7% -15.7% -2.3% +14.9% ➖ noise
46 duckdb:duckdb -9.3% -15.7% +7.7% +11.6% ➖ noise
46 duckdb:vortex-compact +16.8% -15.7% +38.7% +11.2% 🚨 regression
46 duckdb:vortex-file-compressed +3.8% -15.7% +23.1% +11.2% 🚨 regression
47 datafusion:vortex-compact -15.1% -14.0% -1.3% +11.2% ➖ noise
47 datafusion:vortex-file-compressed -19.2% -14.0% -6.0% +11.2% ➖ noise
47 duckdb:duckdb -6.5% -14.0% +8.7% +11.2% ➖ noise
47 duckdb:vortex-compact -3.8% -14.0% +11.8% +14.1% ➖ noise
47 duckdb:vortex-file-compressed -8.3% -14.0% +6.6% +11.2% ➖ noise
48 datafusion:vortex-compact -5.7% -16.3% +12.7% +11.2% 🚨 regression
48 datafusion:vortex-file-compressed -9.3% -16.3% +8.4% +11.2% ➖ noise
48 duckdb:duckdb -1.6% -16.3% +17.6% +11.2% 🚨 regression
48 duckdb:vortex-compact +8.8% -16.3% +30.0% +11.2% 🚨 regression
48 duckdb:vortex-file-compressed -6.0% -16.3% +12.4% +11.2% 🚨 regression
49 datafusion:vortex-compact -21.6% -16.4% -6.2% +11.7% ➖ noise
49 datafusion:vortex-file-compressed -12.7% -16.4% +4.3% +11.2% ➖ noise
49 duckdb:duckdb -0.9% -16.4% +18.5% +11.2% 🚨 regression
49 duckdb:vortex-compact +13.6% -16.4% +35.9% +11.2% 🚨 regression
49 duckdb:vortex-file-compressed +12.6% -16.4% +34.7% +17.3% 🚨 regression
50 datafusion:vortex-compact -26.1% -9.2% -18.6% +11.2% ✅ faster
50 datafusion:vortex-file-compressed -17.5% -9.2% -9.1% +15.3% ➖ noise
50 duckdb:duckdb -2.4% -9.2% +7.5% +11.2% ➖ noise
50 duckdb:vortex-compact -4.8% -9.2% +4.8% +11.2% ➖ noise
50 duckdb:vortex-file-compressed -5.4% -9.2% +4.2% +11.2% ➖ noise
51 datafusion:vortex-compact -13.0% -9.4% -4.0% +11.2% ➖ noise
51 datafusion:vortex-file-compressed -17.5% -9.4% -9.0% +11.2% ➖ noise
51 duckdb:duckdb -3.6% -9.4% +6.4% +18.8% ➖ noise
51 duckdb:vortex-compact -5.1% -9.4% +4.8% +14.2% ➖ noise
51 duckdb:vortex-file-compressed -11.9% -9.4% -2.8% +11.2% ➖ noise
52 datafusion:vortex-compact -17.2% -4.6% -13.2% +11.2% ✅ faster
52 datafusion:vortex-file-compressed -20.9% -4.6% -17.1% +12.0% ✅ faster
52 duckdb:duckdb -6.9% -4.6% -2.4% +13.0% ➖ noise
52 duckdb:vortex-compact +22.1% -4.6% +27.9% +12.2% 🚨 regression
52 duckdb:vortex-file-compressed +3.2% -4.6% +8.2% +15.5% ➖ noise
53 datafusion:vortex-compact -11.1% -6.8% -4.6% +11.2% ➖ noise
53 datafusion:vortex-file-compressed -14.9% -6.8% -8.7% +16.2% ➖ noise
53 duckdb:duckdb +2.0% -6.8% +9.4% +12.0% ➖ noise
53 duckdb:vortex-compact +31.5% -6.8% +41.1% +11.2% 🚨 regression
53 duckdb:vortex-file-compressed -7.7% -6.8% -1.0% +17.0% ➖ noise
54 datafusion:vortex-compact -8.9% -7.5% -1.5% +11.2% ➖ noise
54 datafusion:vortex-file-compressed -9.2% -7.5% -1.8% +11.2% ➖ noise
54 duckdb:duckdb -6.1% -7.5% +1.5% +11.7% ➖ noise
54 duckdb:vortex-compact +10.0% -7.5% +18.9% +11.2% 🚨 regression
54 duckdb:vortex-file-compressed -7.1% -7.5% +0.4% +11.2% ➖ noise
55 datafusion:vortex-compact -9.4% -12.5% +3.5% +11.2% ➖ noise
55 datafusion:vortex-file-compressed -16.5% -12.5% -4.6% +11.2% ➖ noise
55 duckdb:duckdb -8.7% -12.5% +4.4% +12.7% ➖ noise
55 duckdb:vortex-compact +30.3% -12.5% +48.9% +11.2% 🚨 regression
55 duckdb:vortex-file-compressed -5.0% -12.5% +8.6% +14.3% ➖ noise
56 datafusion:vortex-compact -8.8% -11.2% +2.7% +11.2% ➖ noise
56 datafusion:vortex-file-compressed -14.5% -11.2% -3.7% +11.2% ➖ noise
56 duckdb:duckdb -7.9% -11.2% +3.7% +11.2% ➖ noise
56 duckdb:vortex-compact +14.7% -11.2% +29.1% +11.2% 🚨 regression
56 duckdb:vortex-file-compressed -5.6% -11.2% +6.3% +11.2% ➖ noise
57 datafusion:vortex-compact -16.4% -11.2% -5.9% +11.2% ➖ noise
57 datafusion:vortex-file-compressed -18.8% -11.2% -8.6% +11.2% ➖ noise
57 duckdb:duckdb -17.8% -11.2% -7.5% +13.8% ➖ noise
57 duckdb:vortex-compact -18.7% -11.2% -8.5% +16.4% ➖ noise
57 duckdb:vortex-file-compressed -17.0% -11.2% -6.5% +13.3% ➖ noise
58 datafusion:vortex-compact -23.4% -10.8% -14.1% +11.2% ✅ faster
58 datafusion:vortex-file-compressed -16.1% -10.8% -5.9% +11.2% ➖ noise
58 duckdb:duckdb -18.6% -10.8% -8.8% +11.2% ➖ noise
58 duckdb:vortex-compact -7.7% -10.8% +3.4% +11.2% ➖ noise
58 duckdb:vortex-file-compressed -1.3% -10.8% +10.6% +15.5% ➖ noise
59 datafusion:vortex-compact -23.0% -6.8% -17.4% +11.2% ✅ faster
59 datafusion:vortex-file-compressed -13.0% -6.8% -6.6% +11.2% ➖ noise
59 duckdb:duckdb -10.3% -6.8% -3.7% +11.2% ➖ noise
59 duckdb:vortex-compact -17.9% -6.8% -11.9% +11.2% ✅ faster
59 duckdb:vortex-file-compressed -17.3% -6.8% -11.3% +11.2% ✅ faster
60 datafusion:vortex-compact -19.0% -10.9% -9.1% +11.2% ➖ noise
60 datafusion:vortex-file-compressed -19.1% -10.9% -9.2% +11.7% ➖ noise
60 duckdb:duckdb -20.4% -10.9% -10.7% +11.2% ✅ faster
60 duckdb:vortex-compact +18.9% -10.9% +33.4% +11.2% 🚨 regression
60 duckdb:vortex-file-compressed -9.8% -10.9% +1.2% +12.8% ➖ noise
61 datafusion:vortex-compact -18.5% -10.1% -9.3% +11.2% ➖ noise
61 datafusion:vortex-file-compressed -7.3% -10.1% +3.2% +11.2% ➖ noise
61 duckdb:duckdb -11.9% -10.1% -1.9% +11.2% ➖ noise
61 duckdb:vortex-compact +18.1% -10.1% +31.4% +11.2% 🚨 regression
61 duckdb:vortex-file-compressed -19.2% -10.1% -10.1% +13.6% ➖ noise
62 datafusion:vortex-compact -21.8% -17.6% -5.2% +13.2% ➖ noise
62 datafusion:vortex-file-compressed -17.9% -17.6% -0.4% +15.4% ➖ noise
62 duckdb:duckdb -17.8% -17.6% -0.3% +34.2% ➖ noise
62 duckdb:vortex-compact +29.1% -17.6% +56.6% +21.4% 🚨 regression
62 duckdb:vortex-file-compressed -21.5% -17.6% -4.8% +15.3% ➖ noise
63 datafusion:vortex-compact -10.0% -8.6% -1.6% +11.2% ➖ noise
63 datafusion:vortex-file-compressed -15.1% -8.6% -7.1% +11.2% ➖ noise
63 duckdb:duckdb -15.3% -8.6% -7.3% +11.2% ➖ noise
63 duckdb:vortex-compact +25.2% -8.6% +36.9% +11.2% 🚨 regression
63 duckdb:vortex-file-compressed -4.0% -8.6% +5.0% +12.2% ➖ noise
64 datafusion:vortex-compact -18.3% -10.3% -8.9% +11.2% ➖ noise
64 datafusion:vortex-file-compressed -14.1% -10.3% -4.2% +11.2% ➖ noise
64 duckdb:duckdb -17.2% -10.3% -7.6% +11.2% ➖ noise
64 duckdb:vortex-compact +5.2% -10.3% +17.3% +11.2% 🚨 regression
64 duckdb:vortex-file-compressed -0.3% -10.3% +11.2% +11.2% 🚨 regression
65 datafusion:vortex-compact -24.4% -8.5% -17.4% +11.2% ✅ faster
65 datafusion:vortex-file-compressed -14.7% -8.5% -6.8% +13.7% ➖ noise
65 duckdb:duckdb -9.8% -8.5% -1.4% +12.7% ➖ noise
65 duckdb:vortex-compact +7.2% -8.5% +17.1% +11.2% 🚨 regression
65 duckdb:vortex-file-compressed -19.8% -8.5% -12.4% +13.3% ✅ faster
66 datafusion:vortex-compact -24.2% -9.9% -15.9% +15.7% ✅ faster
66 datafusion:vortex-file-compressed -15.1% -9.9% -5.8% +13.5% ➖ noise
66 duckdb:duckdb -8.5% -9.9% +1.5% +11.2% ➖ noise
66 duckdb:vortex-compact +6.5% -9.9% +18.2% +20.2% ➖ noise
66 duckdb:vortex-file-compressed -16.1% -9.9% -6.9% +11.2% ➖ noise
67 datafusion:vortex-compact -9.9% -11.6% +1.9% +11.2% ➖ noise
67 datafusion:vortex-file-compressed -27.0% -11.6% -17.4% +11.2% ✅ faster
67 duckdb:duckdb -25.0% -11.6% -15.2% +11.2% ✅ faster
67 duckdb:vortex-compact -8.5% -11.6% +3.5% +11.2% ➖ noise
67 duckdb:vortex-file-compressed -26.4% -11.6% -16.7% +11.2% ✅ faster
68 datafusion:vortex-compact -13.8% -9.7% -4.5% +11.2% ➖ noise
68 datafusion:vortex-file-compressed -35.8% -9.7% -28.9% +11.2% ✅ faster
68 duckdb:duckdb -10.1% -9.7% -0.4% +11.2% ➖ noise
68 duckdb:vortex-compact +10.9% -9.7% +22.8% +12.1% 🚨 regression
68 duckdb:vortex-file-compressed -19.2% -9.7% -10.6% +11.2% ✅ faster
69 datafusion:vortex-compact -21.4% -10.5% -12.1% +11.2% ✅ faster
69 datafusion:vortex-file-compressed -12.5% -10.5% -2.2% +11.2% ➖ noise
69 duckdb:duckdb -6.4% -10.5% +4.6% +11.2% ➖ noise
69 duckdb:vortex-compact +21.4% -10.5% +35.6% +11.2% 🚨 regression
69 duckdb:vortex-file-compressed -8.2% -10.5% +2.5% +11.2% ➖ noise
70 datafusion:vortex-compact -12.0% -7.1% -5.3% +11.2% ➖ noise
70 datafusion:vortex-file-compressed -13.6% -7.1% -7.0% +12.5% ➖ noise
70 duckdb:duckdb -2.6% -7.1% +4.8% +14.7% ➖ noise
70 duckdb:vortex-compact +4.0% -7.1% +11.9% +11.7% 🚨 regression
70 duckdb:vortex-file-compressed -13.8% -7.1% -7.2% +12.4% ➖ noise
71 datafusion:vortex-compact -20.2% -7.9% -13.4% +11.2% ✅ faster
71 datafusion:vortex-file-compressed -18.0% -7.9% -10.9% +11.2% ✅ faster
71 duckdb:duckdb -13.3% -7.9% -5.9% +14.4% ➖ noise
71 duckdb:vortex-compact +24.2% -7.9% +34.9% +11.2% 🚨 regression
71 duckdb:vortex-file-compressed -23.4% -7.9% -16.9% +17.8% ✅ faster
72 datafusion:vortex-compact -16.7% -11.6% -5.7% +11.2% ➖ noise
72 datafusion:vortex-file-compressed -15.8% -11.6% -4.7% +11.2% ➖ noise
72 duckdb:duckdb -10.2% -11.6% +1.6% +12.0% ➖ noise
72 duckdb:vortex-compact -6.6% -11.6% +5.7% +11.2% ➖ noise
72 duckdb:vortex-file-compressed -14.2% -11.6% -2.9% +11.2% ➖ noise
73 datafusion:vortex-compact -10.3% -9.9% -0.4% +20.7% ➖ noise
73 datafusion:vortex-file-compressed -5.6% -9.9% +4.8% +19.6% ➖ noise
73 duckdb:duckdb -5.7% -9.9% +4.7% +11.6% ➖ noise
73 duckdb:vortex-compact +42.4% -9.9% +58.1% +11.2% 🚨 regression
73 duckdb:vortex-file-compressed +5.3% -9.9% +16.9% +13.9% 🚨 regression
74 datafusion:vortex-compact -10.6% -11.8% +1.4% +11.2% ➖ noise
74 datafusion:vortex-file-compressed -15.3% -11.8% -3.9% +11.2% ➖ noise
74 duckdb:duckdb -7.3% -11.8% +5.1% +11.2% ➖ noise
74 duckdb:vortex-compact +16.8% -11.8% +32.4% +11.6% 🚨 regression
74 duckdb:vortex-file-compressed +43.9% -11.8% +63.2% +25.2% 🚨 regression
75 datafusion:vortex-compact -10.5% -9.9% -0.7% +11.2% ➖ noise
75 datafusion:vortex-file-compressed -8.8% -9.9% +1.2% +11.2% ➖ noise
75 duckdb:duckdb -6.7% -9.9% +3.5% +11.2% ➖ noise
75 duckdb:vortex-compact +9.6% -9.9% +21.6% +11.2% 🚨 regression
75 duckdb:vortex-file-compressed -3.8% -9.9% +6.7% +11.2% ➖ noise
76 datafusion:vortex-compact -8.8% -13.5% +5.4% +11.2% ➖ noise
76 datafusion:vortex-file-compressed -9.4% -13.5% +4.7% +11.3% ➖ noise
76 duckdb:duckdb -3.3% -13.5% +11.8% +16.6% ➖ noise
76 duckdb:vortex-compact -14.9% -13.5% -1.7% +11.5% ➖ noise
76 duckdb:vortex-file-compressed -23.7% -13.5% -11.8% +13.4% ✅ faster
77 datafusion:vortex-compact -12.6% -9.2% -3.7% +11.2% ➖ noise
77 datafusion:vortex-file-compressed -12.5% -9.2% -3.7% +11.2% ➖ noise
77 duckdb:duckdb +1.4% -9.2% +11.7% +14.1% ➖ noise
77 duckdb:vortex-compact +2.7% -9.2% +13.1% +14.5% ➖ noise
77 duckdb:vortex-file-compressed -21.7% -9.2% -13.8% +12.8% ✅ faster
78 datafusion:vortex-compact -27.1% -13.4% -15.8% +11.2% ✅ faster
78 datafusion:vortex-file-compressed -16.1% -13.4% -3.2% +11.2% ➖ noise
78 duckdb:duckdb -10.8% -13.4% +3.0% +11.2% ➖ noise
78 duckdb:vortex-compact -3.5% -13.4% +11.4% +11.7% ➖ noise
78 duckdb:vortex-file-compressed -19.5% -13.4% -7.1% +11.2% ➖ noise
79 datafusion:vortex-compact -22.8% -8.6% -15.6% +11.2% ✅ faster
79 datafusion:vortex-file-compressed -11.7% -8.6% -3.4% +11.2% ➖ noise
79 duckdb:duckdb -5.4% -8.6% +3.5% +11.2% ➖ noise
79 duckdb:vortex-compact -5.3% -8.6% +3.6% +11.2% ➖ noise
79 duckdb:vortex-file-compressed -19.1% -8.6% -11.5% +12.3% ✅ faster
80 datafusion:vortex-compact -28.1% -10.6% -19.6% +11.2% ✅ faster
80 datafusion:vortex-file-compressed -14.7% -10.6% -4.6% +11.2% ➖ noise
80 duckdb:duckdb -11.7% -10.6% -1.3% +12.0% ➖ noise
80 duckdb:vortex-compact +11.5% -10.6% +24.7% +12.5% 🚨 regression
80 duckdb:vortex-file-compressed -25.3% -10.6% -16.4% +11.2% ✅ faster
81 datafusion:vortex-compact -23.4% -15.3% -9.6% +11.2% ➖ noise
81 datafusion:vortex-file-compressed -10.1% -15.3% +6.2% +12.9% ➖ noise
81 duckdb:duckdb -5.3% -15.3% +11.9% +11.2% 🚨 regression
81 duckdb:vortex-compact -6.5% -15.3% +10.4% +11.2% ➖ noise
81 duckdb:vortex-file-compressed -21.1% -15.3% -6.8% +17.1% ➖ noise
82 datafusion:vortex-compact -27.3% -11.0% -18.3% +11.2% ✅ faster
82 datafusion:vortex-file-compressed -15.9% -11.0% -5.6% +13.6% ➖ noise
82 duckdb:duckdb +3.6% -11.0% +16.4% +16.7% ➖ noise
82 duckdb:vortex-compact -8.6% -11.0% +2.7% +14.2% ➖ noise
82 duckdb:vortex-file-compressed -35.1% -11.0% -27.1% +11.9% ✅ faster
83 datafusion:vortex-compact -27.8% -9.6% -20.2% +11.2% ✅ faster
83 datafusion:vortex-file-compressed -14.7% -9.6% -5.7% +11.2% ➖ noise
83 duckdb:duckdb -3.3% -9.6% +6.9% +12.3% ➖ noise
83 duckdb:vortex-compact -27.8% -9.6% -20.1% +11.2% ✅ faster
83 duckdb:vortex-file-compressed -18.3% -9.6% -9.6% +16.2% ➖ noise
84 datafusion:vortex-compact -30.3% -12.5% -20.4% +12.0% ✅ faster
84 datafusion:vortex-file-compressed -7.4% -12.5% +5.8% +11.2% ➖ noise
84 duckdb:duckdb -5.4% -12.5% +8.0% +11.2% ➖ noise
84 duckdb:vortex-compact +16.9% -12.5% +33.6% +11.2% 🚨 regression
84 duckdb:vortex-file-compressed +7.2% -12.5% +22.4% +11.2% 🚨 regression
85 datafusion:vortex-compact -22.8% -16.8% -7.1% +11.2% ➖ noise
85 datafusion:vortex-file-compressed -11.5% -16.8% +6.4% +11.2% ➖ noise
85 duckdb:duckdb -7.9% -16.8% +10.8% +11.2% ➖ noise
85 duckdb:vortex-compact -7.3% -16.8% +11.4% +11.2% 🚨 regression
85 duckdb:vortex-file-compressed -4.6% -16.8% +14.7% +11.2% 🚨 regression
86 datafusion:vortex-compact -10.0% -18.5% +10.4% +11.8% ➖ noise
86 datafusion:vortex-file-compressed -12.2% -18.5% +7.7% +13.9% ➖ noise
86 duckdb:duckdb -3.2% -18.5% +18.7% +13.4% 🚨 regression
86 duckdb:vortex-compact +24.9% -18.5% +53.2% +18.0% 🚨 regression
86 duckdb:vortex-file-compressed +5.1% -18.5% +28.9% +15.5% 🚨 regression
87 datafusion:vortex-compact -12.1% -15.1% +3.5% +11.2% ➖ noise
87 datafusion:vortex-file-compressed -14.1% -15.1% +1.1% +11.2% ➖ noise
87 duckdb:duckdb -4.5% -15.1% +12.4% +11.2% 🚨 regression
87 duckdb:vortex-compact +6.1% -15.1% +24.9% +20.8% 🚨 regression
87 duckdb:vortex-file-compressed -3.2% -15.1% +14.0% +11.2% 🚨 regression
88 datafusion:vortex-compact -8.7% -8.9% +0.2% +11.2% ➖ noise
88 datafusion:vortex-file-compressed -11.4% -8.9% -2.8% +11.2% ➖ noise
88 duckdb:duckdb +2.7% -8.9% +12.7% +11.2% 🚨 regression
88 duckdb:vortex-compact +1.3% -8.9% +11.1% +11.2% ➖ noise
88 duckdb:vortex-file-compressed -5.0% -8.9% +4.3% +11.2% ➖ noise
89 datafusion:vortex-compact -12.0% -10.7% -1.4% +11.2% ➖ noise
89 datafusion:vortex-file-compressed -15.8% -10.7% -5.7% +11.2% ➖ noise
89 duckdb:duckdb -5.5% -10.7% +5.9% +11.2% ➖ noise
89 duckdb:vortex-compact +34.9% -10.7% +51.1% +11.2% 🚨 regression
89 duckdb:vortex-file-compressed +11.3% -10.7% +24.7% +11.2% 🚨 regression
90 datafusion:vortex-compact -7.0% -10.3% +3.7% +14.3% ➖ noise
90 datafusion:vortex-file-compressed -10.9% -10.3% -0.7% +15.2% ➖ noise
90 duckdb:duckdb -1.9% -10.3% +9.4% +14.9% ➖ noise
90 duckdb:vortex-compact -1.1% -10.3% +10.3% +14.9% ➖ noise
90 duckdb:vortex-file-compressed -0.8% -10.3% +10.6% +16.1% ➖ noise
91 datafusion:vortex-compact -5.5% -12.7% +8.2% +11.2% ➖ noise
91 datafusion:vortex-file-compressed -13.6% -12.7% -1.1% +11.2% ➖ noise
91 duckdb:duckdb -0.7% -12.7% +13.8% +14.9% ➖ noise
91 duckdb:vortex-compact -5.3% -12.7% +8.4% +11.2% ➖ noise
91 duckdb:vortex-file-compressed -6.7% -12.7% +6.8% +13.0% ➖ noise
92 datafusion:vortex-compact -9.3% -12.2% +3.3% +11.2% ➖ noise
92 datafusion:vortex-file-compressed -11.3% -12.2% +1.0% +11.2% ➖ noise
92 duckdb:duckdb -7.6% -12.2% +5.3% +12.9% ➖ noise
92 duckdb:vortex-compact +135.7% -12.2% +168.4% +12.9% 🚨 regression
92 duckdb:vortex-file-compressed +42.6% -12.2% +62.5% +11.2% 🚨 regression
93 datafusion:vortex-compact -27.0% -14.7% -14.4% +11.8% ✅ faster
93 datafusion:vortex-file-compressed -21.2% -14.7% -7.6% +11.2% ➖ noise
93 duckdb:duckdb -7.2% -14.7% +8.8% +11.2% ➖ noise
93 duckdb:vortex-compact -13.7% -14.7% +1.2% +12.4% ➖ noise
93 duckdb:vortex-file-compressed -9.9% -14.7% +5.6% +13.9% ➖ noise
94 datafusion:vortex-compact -28.8% -11.6% -19.4% +11.2% ✅ faster
94 datafusion:vortex-file-compressed -9.7% -11.6% +2.1% +11.9% ➖ noise
94 duckdb:duckdb -8.5% -11.6% +3.6% +11.2% ➖ noise
94 duckdb:vortex-compact +15.4% -11.6% +30.6% +13.4% 🚨 regression
94 duckdb:vortex-file-compressed +7.6% -11.6% +21.7% +11.2% 🚨 regression
95 datafusion:vortex-compact -20.6% -14.6% -6.9% +11.2% ➖ noise
95 datafusion:vortex-file-compressed -11.9% -14.6% +3.2% +11.4% ➖ noise
95 duckdb:duckdb -15.2% -14.6% -0.7% +19.2% ➖ noise
95 duckdb:vortex-compact +10.5% -14.6% +29.4% +15.7% 🚨 regression
95 duckdb:vortex-file-compressed +10.2% -14.6% +29.1% +15.4% 🚨 regression
96 datafusion:vortex-compact -18.3% -11.7% -7.4% +11.2% ➖ noise
96 datafusion:vortex-file-compressed -12.9% -11.7% -1.3% +11.5% ➖ noise
96 duckdb:duckdb -1.6% -11.7% +11.5% +13.6% ➖ noise
96 duckdb:vortex-compact +22.0% -11.7% +38.2% +11.2% 🚨 regression
96 duckdb:vortex-file-compressed +9.2% -11.7% +23.8% +16.7% 🚨 regression
97 datafusion:vortex-compact -27.1% -12.3% -16.8% +13.5% ✅ faster
97 datafusion:vortex-file-compressed -13.2% -12.3% -1.0% +11.2% ➖ noise
97 duckdb:duckdb -11.5% -12.3% +1.0% +13.0% ➖ noise
97 duckdb:vortex-compact -1.6% -12.3% +12.3% +15.4% ➖ noise
97 duckdb:vortex-file-compressed -21.0% -12.3% -9.9% +16.3% ➖ noise
98 datafusion:vortex-compact -31.7% -14.2% -20.4% +11.2% ✅ faster
98 datafusion:vortex-file-compressed -16.8% -14.2% -3.0% +11.2% ➖ noise
98 duckdb:duckdb -3.1% -14.2% +12.9% +13.1% ➖ noise
98 duckdb:vortex-compact +8.8% -14.2% +26.9% +11.2% 🚨 regression
98 duckdb:vortex-file-compressed -26.7% -14.2% -14.6% +12.0% ✅ faster
99 datafusion:vortex-compact -32.5% -6.3% -28.0% +18.7% ✅ faster
99 datafusion:vortex-file-compressed -13.5% -6.3% -7.6% +17.6% ➖ noise
99 duckdb:duckdb -3.9% -6.3% +2.6% +19.9% ➖ noise
99 duckdb:vortex-compact -8.1% -6.3% -1.9% +18.5% ➖ noise
99 duckdb:vortex-file-compressed -20.0% -6.3% -14.6% +19.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.0%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 1.065x ➖
Shifts: Parquet (control) +6.5% · Median polish +1.6%


datafusion / vortex-file-compressed (0.924x ➖, 1↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 52610130 44566271 1.18
fineweb_q01/datafusion:vortex-file-compressed 555041531 502752437 1.10
fineweb_q02/datafusion:vortex-file-compressed 572776388 572762984 1.00
fineweb_q03/datafusion:vortex-file-compressed 🚀 1367559836 2050848490 0.67
fineweb_q04/datafusion:vortex-file-compressed 1365641787 1400347440 0.98
fineweb_q05/datafusion:vortex-file-compressed 1388020966 1373742227 1.01
fineweb_q06/datafusion:vortex-file-compressed 1506961773 1887492092 0.80
fineweb_q07/datafusion:vortex-file-compressed 1360368261 1531469802 0.89
fineweb_q08/datafusion:vortex-file-compressed 527486292 652976520 0.81
datafusion / vortex-compact (0.875x ➖, 1↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 35742773 87807291 0.41
fineweb_q01/datafusion:vortex-compact 554580043 652721098 0.85
fineweb_q02/datafusion:vortex-compact 679269146 561660176 1.21
fineweb_q03/datafusion:vortex-compact 1854879632 1992825621 0.93
fineweb_q04/datafusion:vortex-compact 2248487896 2430496561 0.93
fineweb_q05/datafusion:vortex-compact 1714465405 1903389320 0.90
fineweb_q06/datafusion:vortex-compact 1530709164 1541792070 0.99
fineweb_q07/datafusion:vortex-compact 1298971845 1480788853 0.88
fineweb_q08/datafusion:vortex-compact 431083140 403633586 1.07
datafusion / parquet (1.123x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1941994966 1250895435 1.55
fineweb_q01/datafusion:parquet 2067171663 1894320286 1.09
fineweb_q02/datafusion:parquet 1896826049 2077059185 0.91
fineweb_q03/datafusion:parquet 2285590525 1917504971 1.19
fineweb_q04/datafusion:parquet 1869729284 1936742358 0.97
fineweb_q05/datafusion:parquet 2109609960 1912858316 1.10
fineweb_q06/datafusion:parquet 2333355909 1804191078 1.29
fineweb_q07/datafusion:parquet 2027421264 1854678256 1.09
fineweb_q08/datafusion:parquet 2072689750 2025809279 1.02
duckdb / vortex-file-compressed (1.072x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 97616053 87886477 1.11
fineweb_q01/duckdb:vortex-file-compressed 776439871 665755597 1.17
fineweb_q02/duckdb:vortex-file-compressed 485056574 425932823 1.14
fineweb_q03/duckdb:vortex-file-compressed 1643282372 1553335000 1.06
fineweb_q04/duckdb:vortex-file-compressed 1680940926 1593176736 1.06
fineweb_q05/duckdb:vortex-file-compressed 1646103023 1547993554 1.06
fineweb_q06/duckdb:vortex-file-compressed 1852306065 1771110367 1.05
fineweb_q07/duckdb:vortex-file-compressed 1481205375 1531703209 0.97
fineweb_q08/duckdb:vortex-file-compressed 679943395 646684593 1.05
duckdb / vortex-compact (1.064x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 81652888 78384254 1.04
fineweb_q01/duckdb:vortex-compact 🚨 936738594 559301341 1.67
fineweb_q02/duckdb:vortex-compact 645428628 596135999 1.08
fineweb_q03/duckdb:vortex-compact 1738162183 1840044866 0.94
fineweb_q04/duckdb:vortex-compact 1933936807 1934173815 1.00
fineweb_q05/duckdb:vortex-compact 1623366836 1740851064 0.93
fineweb_q06/duckdb:vortex-compact 1689974135 1610434311 1.05
fineweb_q07/duckdb:vortex-compact 1412182863 1505869559 0.94
fineweb_q08/duckdb:vortex-compact 514835302 481254136 1.07
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1237023974 1215691731 1.02
fineweb_q01/duckdb:parquet 1504938082 1404971087 1.07
fineweb_q02/duckdb:parquet 1480661729 1506035020 0.98
fineweb_q03/duckdb:parquet 3932378213 3958670492 0.99
fineweb_q04/duckdb:parquet 1851041486 1960702986 0.94
fineweb_q05/duckdb:parquet 2178164513 2309907217 0.94
fineweb_q06/duckdb:parquet 4484582371 4409373557 1.02
fineweb_q07/duckdb:parquet 2839279716 2684912202 1.06
fineweb_q08/duckdb:parquet 1266909475 1186463596 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -59.3% +25.7% -67.6% +212.7% ➖ noise
0 datafusion:vortex-file-compressed +18.0% +25.7% -6.1% +200.6% ➖ noise
0 duckdb:vortex-compact +4.2% +25.7% -17.1% +61.3% ➖ noise
0 duckdb:vortex-file-compressed +11.1% +25.7% -11.6% +53.1% ➖ noise
1 datafusion:vortex-compact -15.0% +8.1% -21.4% +77.9% ➖ noise
1 datafusion:vortex-file-compressed +10.4% +8.1% +2.1% +88.9% ➖ noise
1 duckdb:vortex-compact +67.5% +8.1% +54.9% +39.2% 🚨 regression
1 duckdb:vortex-file-compressed +16.6% +8.1% +7.9% +30.0% ➖ noise
2 datafusion:vortex-compact +20.9% -5.2% +27.6% +37.6% ➖ noise
2 datafusion:vortex-file-compressed +0.0% -5.2% +5.5% +43.9% ➖ noise
2 duckdb:vortex-compact +8.3% -5.2% +14.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +13.9% -5.2% +20.2% +30.9% ➖ noise
3 datafusion:vortex-compact -6.9% +8.8% -14.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -33.3% +8.8% -38.7% +67.1% ➖ noise
3 duckdb:vortex-compact -5.5% +8.8% -13.2% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +5.8% +8.8% -2.8% +30.0% ➖ noise
4 datafusion:vortex-compact -7.5% -4.5% -3.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -2.5% -4.5% +2.2% +30.0% ➖ noise
4 duckdb:vortex-compact -0.0% -4.5% +4.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +5.5% -4.5% +10.5% +30.0% ➖ noise
5 datafusion:vortex-compact -9.9% +2.0% -11.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +1.0% +2.0% -0.9% +30.0% ➖ noise
5 duckdb:vortex-compact -6.7% +2.0% -8.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +6.3% +2.0% +4.3% +30.0% ➖ noise
6 datafusion:vortex-compact -0.7% +14.7% -13.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -20.2% +14.7% -30.4% +30.0% ✅ faster
6 duckdb:vortex-compact +4.9% +14.7% -8.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +4.6% +14.7% -8.8% +30.0% ➖ noise
7 datafusion:vortex-compact -12.3% +7.5% -18.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -11.2% +7.5% -17.4% +30.0% ➖ noise
7 duckdb:vortex-compact -6.2% +7.5% -12.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -3.3% +7.5% -10.1% +30.0% ➖ noise
8 datafusion:vortex-compact +6.8% +4.5% +2.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -19.2% +4.5% -22.7% +30.0% ➖ noise
8 duckdb:vortex-compact +7.0% +4.5% +2.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +5.1% +4.5% +0.6% +33.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.901x ➖
Parquet (geomean): 1.059x ➖


unknown / unknown (1.004x ➖, 6↑ 8↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 3047331 2726422 1.12
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1410328 1293547 1.09
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11705756996 11582036688 1.01
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11216344257 11284649648 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8720604 9597302 0.91
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7433725 7999156 0.93
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 1678792 1485583 1.13
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2642905 2405726 1.10
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11313863789 11281254010 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11368178031 11180983607 1.02
random-access/feature-vectors/uniform/vortex-tokio-local-disk 14662248 14878159 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 14643325 14974703 0.98
random-access/lance-tokio-local-disk 778460 733918 1.06
random-access/lance-tokio-local-disk-footer 1431955 1340238 1.07
random-access/nested-lists/correlated/lance-tokio-local-disk 280839 269118 1.04
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 769149 705123 1.09
random-access/nested-lists/correlated/parquet-tokio-local-disk 🚨 151162630 133197659 1.13
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 142257631 133355701 1.07
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 818221 722035 1.13
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 759734 736863 1.03
random-access/nested-lists/uniform/lance-tokio-local-disk 1257958 1170298 1.07
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1785459 1645958 1.08
random-access/nested-lists/uniform/parquet-tokio-local-disk 139063121 133760520 1.04
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 137650185 133861061 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk 2530803 2574511 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2527917 2523234 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk 451495 461327 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 687525 703200 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 30768279 26712286 1.15
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 31036036 26625604 1.17
random-access/nested-structs/correlated/vortex-tokio-local-disk 973187 978159 0.99
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 958900 980045 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk 3068130 3046717 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3322193 3285254 1.01
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 30354989 26447669 1.15
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 30012281 26810339 1.12
random-access/nested-structs/uniform/vortex-tokio-local-disk 2004595 2039583 0.98
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1948791 2018732 0.97
random-access/parquet-tokio-local-disk 185604551 180823993 1.03
random-access/parquet-tokio-local-disk-footer 188391545 184294576 1.02
random-access/taxi/correlated/lance-tokio-local-disk 1011962 959869 1.05
random-access/taxi/correlated/lance-tokio-local-disk-footer 1739972 1636725 1.06
random-access/taxi/correlated/parquet-tokio-local-disk 279632201 270207785 1.03
random-access/taxi/correlated/parquet-tokio-local-disk-footer 284502349 269375309 1.06
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1888946 3075902 0.61
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 2109968 2970291 0.71
random-access/taxi/uniform/lance-tokio-local-disk 9049768 8415928 1.08
random-access/taxi/uniform/lance-tokio-local-disk-footer 9754260 9126608 1.07
random-access/taxi/uniform/parquet-tokio-local-disk 298922752 287190371 1.04
random-access/taxi/uniform/parquet-tokio-local-disk-footer 296015486 287932353 1.03
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 5028303 5787580 0.87
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4868089 5690417 0.86
random-access/vortex-tokio-local-disk 🚀 1412846 1868164 0.76
random-access/vortex-tokio-local-disk-footer 🚀 1417591 1944123 0.73

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.8%
Vortex (geomean): 1.005x ➖
Parquet (geomean): 0.987x ➖
Shifts: Parquet (control) -1.3% · Median polish -0.3%


duckdb / vortex-file-compressed (1.007x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11672324 10993628 1.06
statpopgen_q01/duckdb:vortex-file-compressed 22924320 22155881 1.03
statpopgen_q02/duckdb:vortex-file-compressed 1354847828 1386885394 0.98
statpopgen_q03/duckdb:vortex-file-compressed 3107128102 3109725784 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3114940795 3139165372 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1447991216 1461820891 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2125459742 2140748294 0.99
statpopgen_q07/duckdb:vortex-file-compressed 222581561 220605175 1.01
statpopgen_q08/duckdb:vortex-file-compressed 265735400 259051861 1.03
statpopgen_q09/duckdb:vortex-file-compressed 2894559261 2897596987 1.00
statpopgen_q10/duckdb:vortex-file-compressed 4715299924 4711531270 1.00
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11286939 11040143 1.02
statpopgen_q01/duckdb:vortex-compact 171362570 166012577 1.03
statpopgen_q02/duckdb:vortex-compact 1812895983 1835566624 0.99
statpopgen_q03/duckdb:vortex-compact 3463765103 3488402913 0.99
statpopgen_q04/duckdb:vortex-compact 3487247035 3521477300 0.99
statpopgen_q05/duckdb:vortex-compact 1848587478 1858640453 0.99
statpopgen_q06/duckdb:vortex-compact 2657585188 2695583390 0.99
statpopgen_q07/duckdb:vortex-compact 896240885 885570585 1.01
statpopgen_q08/duckdb:vortex-compact 940989607 916518994 1.03
statpopgen_q09/duckdb:vortex-compact 3308920160 3353909491 0.99
statpopgen_q10/duckdb:vortex-compact 5378323965 5383160233 1.00
duckdb / parquet (0.987x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 329910534 334768223 0.99
statpopgen_q01/duckdb:parquet 415471146 418802444 0.99
statpopgen_q02/duckdb:parquet 1014554376 1024861793 0.99
statpopgen_q03/duckdb:parquet 1511460766 1534369686 0.99
statpopgen_q04/duckdb:parquet 1522066112 1539448079 0.99
statpopgen_q05/duckdb:parquet 1005941094 1040745076 0.97
statpopgen_q06/duckdb:parquet 1483330029 1517080658 0.98
statpopgen_q07/duckdb:parquet 1320919383 1320485259 1.00
statpopgen_q08/duckdb:parquet 1327511577 1330760390 1.00
statpopgen_q09/duckdb:parquet 1378069983 1375316084 1.00
statpopgen_q10/duckdb:parquet 2667700331 2746528904 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +2.2% -1.5% +3.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +6.2% -1.5% +7.7% +10.0% ➖ noise
1 duckdb:vortex-compact +3.2% -0.8% +4.1% +25.4% ➖ noise
1 duckdb:vortex-file-compressed +3.5% -0.8% +4.3% +265.3% ➖ noise
2 duckdb:vortex-compact -1.2% -1.0% -0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.3% -1.0% -1.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.7% -1.5% +0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.1% -1.5% +1.4% +10.0% ➖ noise
4 duckdb:vortex-compact -1.0% -1.1% +0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.8% -1.1% +0.4% +10.0% ➖ noise
5 duckdb:vortex-compact -0.5% -3.3% +2.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.9% -3.3% +2.5% +10.0% ➖ noise
6 duckdb:vortex-compact -1.4% -2.2% +0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.7% -2.2% +1.5% +10.0% ➖ noise
7 duckdb:vortex-compact +1.2% +0.0% +1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.9% +0.0% +0.9% +10.0% ➖ noise
8 duckdb:vortex-compact +2.7% -0.2% +2.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.6% -0.2% +2.8% +10.0% ➖ noise
9 duckdb:vortex-compact -1.3% +0.2% -1.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.1% +0.2% -0.3% +10.0% ➖ noise
10 duckdb:vortex-compact -0.1% -2.9% +2.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.1% -2.9% +3.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.3%


datafusion / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 406602296 398121803 1.02
tpch_q02/datafusion:vortex-file-compressed 114478046 114194898 1.00
tpch_q03/datafusion:vortex-file-compressed 214096556 216217945 0.99
tpch_q04/datafusion:vortex-file-compressed 109320731 109068682 1.00
tpch_q05/datafusion:vortex-file-compressed 387518555 386624988 1.00
tpch_q06/datafusion:vortex-file-compressed 42171533 42800272 0.99
tpch_q07/datafusion:vortex-file-compressed 567750289 565322114 1.00
tpch_q08/datafusion:vortex-file-compressed 378868997 380855030 0.99
tpch_q09/datafusion:vortex-file-compressed 667378287 665884865 1.00
tpch_q10/datafusion:vortex-file-compressed 244558526 243596832 1.00
tpch_q11/datafusion:vortex-file-compressed 86343463 85899883 1.01
tpch_q12/datafusion:vortex-file-compressed 117152546 117576515 1.00
tpch_q13/datafusion:vortex-file-compressed 218712810 217977088 1.00
tpch_q14/datafusion:vortex-file-compressed 56784005 56905135 1.00
tpch_q15/datafusion:vortex-file-compressed 107878181 106869126 1.01
tpch_q16/datafusion:vortex-file-compressed 78152025 77545117 1.01
tpch_q17/datafusion:vortex-file-compressed 648598254 644878633 1.01
tpch_q18/datafusion:vortex-file-compressed 883506804 876940352 1.01
tpch_q19/datafusion:vortex-file-compressed 94235035 93222872 1.01
tpch_q20/datafusion:vortex-file-compressed 170000774 170718217 1.00
tpch_q21/datafusion:vortex-file-compressed 688983413 682348684 1.01
tpch_q22/datafusion:vortex-file-compressed 60580978 60410701 1.00
datafusion / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 435452497 441641550 0.99
tpch_q02/datafusion:vortex-compact 119353835 119072426 1.00
tpch_q03/datafusion:vortex-compact 215759902 217071635 0.99
tpch_q04/datafusion:vortex-compact 118789117 118775670 1.00
tpch_q05/datafusion:vortex-compact 395255285 394353537 1.00
tpch_q06/datafusion:vortex-compact 62958364 63368141 0.99
tpch_q07/datafusion:vortex-compact 585946135 586321350 1.00
tpch_q08/datafusion:vortex-compact 388323444 385128834 1.01
tpch_q09/datafusion:vortex-compact 680227693 683717221 0.99
tpch_q10/datafusion:vortex-compact 272075084 276819169 0.98
tpch_q11/datafusion:vortex-compact 90683754 90303806 1.00
tpch_q12/datafusion:vortex-compact 164803246 165860539 0.99
tpch_q13/datafusion:vortex-compact 271788539 270592624 1.00
tpch_q14/datafusion:vortex-compact 73109505 73911463 0.99
tpch_q15/datafusion:vortex-compact 162484688 164138618 0.99
tpch_q16/datafusion:vortex-compact 82201203 82846280 0.99
tpch_q17/datafusion:vortex-compact 653687523 652849552 1.00
tpch_q18/datafusion:vortex-compact 876854239 880601181 1.00
tpch_q19/datafusion:vortex-compact 135160192 134402798 1.01
tpch_q20/datafusion:vortex-compact 196781506 196714153 1.00
tpch_q21/datafusion:vortex-compact 699711390 694689890 1.01
tpch_q22/datafusion:vortex-compact 71506424 72008614 0.99
datafusion / parquet (1.003x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 417791328 415185537 1.01
tpch_q02/datafusion:parquet 188253805 187304400 1.01
tpch_q03/datafusion:parquet 295723889 295443651 1.00
tpch_q04/datafusion:parquet 136418901 136002677 1.00
tpch_q05/datafusion:parquet 453609081 457267838 0.99
tpch_q06/datafusion:parquet 122182174 118861516 1.03
tpch_q07/datafusion:parquet 632146198 625533022 1.01
tpch_q08/datafusion:parquet 496537259 494892630 1.00
tpch_q09/datafusion:parquet 778432155 772784648 1.01
tpch_q10/datafusion:parquet 510630003 508403241 1.00
tpch_q11/datafusion:parquet 131443264 129129396 1.02
tpch_q12/datafusion:parquet 213626453 212951609 1.00
tpch_q13/datafusion:parquet 339730116 339516331 1.00
tpch_q14/datafusion:parquet 156008144 162038044 0.96
tpch_q15/datafusion:parquet 245285604 244612715 1.00
tpch_q16/datafusion:parquet 140317398 137705041 1.02
tpch_q17/datafusion:parquet 690983819 700676071 0.99
tpch_q18/datafusion:parquet 887917006 875646545 1.01
tpch_q19/datafusion:parquet 269955352 268027558 1.01
tpch_q20/datafusion:parquet 308987350 308714781 1.00
tpch_q21/datafusion:parquet 740650553 739537415 1.00
tpch_q22/datafusion:parquet 217935967 217836663 1.00
datafusion / arrow (1.002x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 589699791 582479178 1.01
tpch_q02/datafusion:arrow 163391220 162151976 1.01
tpch_q03/datafusion:arrow 449583423 446920412 1.01
tpch_q04/datafusion:arrow 339532014 339444083 1.00
tpch_q05/datafusion:arrow 887570893 891857165 1.00
tpch_q06/datafusion:arrow 265578583 266640857 1.00
tpch_q07/datafusion:arrow 1101237392 1090262694 1.01
tpch_q08/datafusion:arrow 1087572844 1092497929 1.00
tpch_q09/datafusion:arrow 1297017612 1300473558 1.00
tpch_q10/datafusion:arrow 583358823 577151098 1.01
tpch_q11/datafusion:arrow 145088336 145308934 1.00
tpch_q12/datafusion:arrow 647641686 640200279 1.01
tpch_q13/datafusion:arrow 505984121 518057587 0.98
tpch_q14/datafusion:arrow 292924021 293253627 1.00
tpch_q15/datafusion:arrow 626138526 626713970 1.00
tpch_q16/datafusion:arrow 104712947 104659459 1.00
tpch_q17/datafusion:arrow 1295154933 1303684406 0.99
tpch_q18/datafusion:arrow 1776147992 1784948125 1.00
tpch_q19/datafusion:arrow 495152635 481108284 1.03
tpch_q20/datafusion:arrow 475247206 471675274 1.01
tpch_q21/datafusion:arrow 2785833694 2761886018 1.01
tpch_q22/datafusion:arrow 138666142 139976168 0.99
duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 175616147 175043255 1.00
tpch_q02/duckdb:vortex-file-compressed 54473482 53233654 1.02
tpch_q03/duckdb:vortex-file-compressed 133377955 132280295 1.01
tpch_q04/duckdb:vortex-file-compressed 161937171 161086498 1.01
tpch_q05/duckdb:vortex-file-compressed 135654117 133346397 1.02
tpch_q06/duckdb:vortex-file-compressed 50993111 48685795 1.05
tpch_q07/duckdb:vortex-file-compressed 156135547 153488954 1.02
tpch_q08/duckdb:vortex-file-compressed 180106167 178888892 1.01
tpch_q09/duckdb:vortex-file-compressed 334624964 336561437 0.99
tpch_q10/duckdb:vortex-file-compressed 163603203 163667548 1.00
tpch_q11/duckdb:vortex-file-compressed 35293832 34494609 1.02
tpch_q12/duckdb:vortex-file-compressed 95573960 98275350 0.97
tpch_q13/duckdb:vortex-file-compressed 235444559 240620740 0.98
tpch_q14/duckdb:vortex-file-compressed 70108086 70295680 1.00
tpch_q15/duckdb:vortex-file-compressed 96633083 96516342 1.00
tpch_q16/duckdb:vortex-file-compressed 82353754 81563833 1.01
tpch_q17/duckdb:vortex-file-compressed 102299704 101642689 1.01
tpch_q18/duckdb:vortex-file-compressed 295731476 296435483 1.00
tpch_q19/duckdb:vortex-file-compressed 92428290 91450486 1.01
tpch_q20/duckdb:vortex-file-compressed 165647185 165671936 1.00
tpch_q21/duckdb:vortex-file-compressed 597713752 589630007 1.01
tpch_q22/duckdb:vortex-file-compressed 77315843 77804487 0.99
duckdb / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 235308081 236088295 1.00
tpch_q02/duckdb:vortex-compact 57337824 59013515 0.97
tpch_q03/duckdb:vortex-compact 139721044 139368988 1.00
tpch_q04/duckdb:vortex-compact 176726461 174498754 1.01
tpch_q05/duckdb:vortex-compact 146956527 146349615 1.00
tpch_q06/duckdb:vortex-compact 81700747 83409113 0.98
tpch_q07/duckdb:vortex-compact 206346436 202503112 1.02
tpch_q08/duckdb:vortex-compact 188778969 187121886 1.01
tpch_q09/duckdb:vortex-compact 362567840 360643924 1.01
tpch_q10/duckdb:vortex-compact 183722322 185521751 0.99
tpch_q11/duckdb:vortex-compact 41765934 41095331 1.02
tpch_q12/duckdb:vortex-compact 201606677 201472668 1.00
tpch_q13/duckdb:vortex-compact 284037510 294842374 0.96
tpch_q14/duckdb:vortex-compact 101742964 103868294 0.98
tpch_q15/duckdb:vortex-compact 118070333 117993460 1.00
tpch_q16/duckdb:vortex-compact 87642633 86132833 1.02
tpch_q17/duckdb:vortex-compact 118831742 115647320 1.03
tpch_q18/duckdb:vortex-compact 294229341 292263063 1.01
tpch_q19/duckdb:vortex-compact 115172673 115458497 1.00
tpch_q20/duckdb:vortex-compact 206567938 204098356 1.01
tpch_q21/duckdb:vortex-compact 621843162 618986797 1.00
tpch_q22/duckdb:vortex-compact 90082623 90574651 0.99
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 252436282 257717833 0.98
tpch_q02/duckdb:parquet 95150238 100463949 0.95
tpch_q03/duckdb:parquet 206099328 205915369 1.00
tpch_q04/duckdb:parquet 133031684 130948439 1.02
tpch_q05/duckdb:parquet 218994951 216781241 1.01
tpch_q06/duckdb:parquet 68056848 66216998 1.03
tpch_q07/duckdb:parquet 176725899 179862886 0.98
tpch_q08/duckdb:parquet 252285922 252653394 1.00
tpch_q09/duckdb:parquet 493727019 493771696 1.00
tpch_q10/duckdb:parquet 609885474 608013530 1.00
tpch_q11/duckdb:parquet 56855316 57470634 0.99
tpch_q12/duckdb:parquet 123353431 121086311 1.02
tpch_q13/duckdb:parquet 446870011 447897600 1.00
tpch_q14/duckdb:parquet 176254748 173369111 1.02
tpch_q15/duckdb:parquet 96009298 95730671 1.00
tpch_q16/duckdb:parquet 158614444 160212118 0.99
tpch_q17/duckdb:parquet 176555876 175136897 1.01
tpch_q18/duckdb:parquet 353483873 351397937 1.01
tpch_q19/duckdb:parquet 283634590 279196458 1.02
tpch_q20/duckdb:parquet 228057076 231559382 0.98
tpch_q21/duckdb:parquet 555376192 557921369 1.00
tpch_q22/duckdb:parquet 288312332 290134633 0.99
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116495559 117390965 0.99
tpch_q02/duckdb:duckdb 44970712 44841490 1.00
tpch_q03/duckdb:duckdb 96539896 97918283 0.99
tpch_q04/duckdb:duckdb 132100972 131861984 1.00
tpch_q05/duckdb:duckdb 110808986 109632567 1.01
tpch_q06/duckdb:duckdb 37267205 37388323 1.00
tpch_q07/duckdb:duckdb 86724976 86539527 1.00
tpch_q08/duckdb:duckdb 110577906 109887011 1.01
tpch_q09/duckdb:duckdb 275587043 278278025 0.99
tpch_q10/duckdb:duckdb 204205629 203052898 1.01
tpch_q11/duckdb:duckdb 15334134 15616324 0.98
tpch_q12/duckdb:duckdb 86159505 84883584 1.02
tpch_q13/duckdb:duckdb 220258279 219206519 1.00
tpch_q14/duckdb:duckdb 70433470 71455239 0.99
tpch_q15/duckdb:duckdb 77615480 77482611 1.00
tpch_q16/duckdb:duckdb 72937978 73346491 0.99
tpch_q17/duckdb:duckdb 84428358 85240668 0.99
tpch_q18/duckdb:duckdb 212555797 211163949 1.01
tpch_q19/duckdb:duckdb 117418897 115977168 1.01
tpch_q20/duckdb:duckdb 111616966 111469185 1.00
tpch_q21/duckdb:duckdb 288852744 296027107 0.98
tpch_q22/duckdb:duckdb 67194306 68097519 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +1.2% -0.7% +2.0% +10.0% ➖ noise
1 datafusion:vortex-compact -1.4% -0.7% -0.7% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +2.1% -0.7% +2.9% +10.0% ➖ noise
1 duckdb:duckdb -0.8% -0.7% -0.0% +10.0% ➖ noise
1 duckdb:vortex-compact -0.3% -0.7% +0.4% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +0.3% -0.7% +1.1% +10.0% ➖ noise
2 datafusion:arrow +0.8% -2.4% +3.3% +10.0% ➖ noise
2 datafusion:vortex-compact +0.2% -2.4% +2.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.2% -2.4% +2.7% +10.0% ➖ noise
2 duckdb:duckdb +0.3% -2.4% +2.8% +10.0% ➖ noise
2 duckdb:vortex-compact -2.8% -2.4% -0.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.3% -2.4% +4.9% +10.0% ➖ noise
3 datafusion:arrow +0.6% +0.1% +0.5% +10.0% ➖ noise
3 datafusion:vortex-compact -0.6% +0.1% -0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.0% +0.1% -1.1% +10.0% ➖ noise
3 duckdb:duckdb -1.4% +0.1% -1.5% +10.0% ➖ noise
3 duckdb:vortex-compact +0.3% +0.1% +0.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.8% +0.1% +0.7% +10.0% ➖ noise
4 datafusion:arrow +0.0% +0.9% -0.9% +10.0% ➖ noise
4 datafusion:vortex-compact +0.0% +0.9% -0.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.2% +0.9% -0.7% +10.0% ➖ noise
4 duckdb:duckdb +0.2% +0.9% -0.8% +10.0% ➖ noise
4 duckdb:vortex-compact +1.3% +0.9% +0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.5% +0.9% -0.4% +10.0% ➖ noise
5 datafusion:arrow -0.5% +0.1% -0.6% +10.0% ➖ noise
5 datafusion:vortex-compact +0.2% +0.1% +0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.2% +0.1% +0.1% +10.0% ➖ noise
5 duckdb:duckdb +1.1% +0.1% +1.0% +10.0% ➖ noise
5 duckdb:vortex-compact +0.4% +0.1% +0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.7% +0.1% +1.6% +10.0% ➖ noise
6 datafusion:arrow -0.4% +2.8% -3.1% +10.0% ➖ noise
6 datafusion:vortex-compact -0.6% +2.8% -3.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.5% +2.8% -4.1% +10.0% ➖ noise
6 duckdb:duckdb -0.3% +2.8% -3.0% +11.0% ➖ noise
6 duckdb:vortex-compact -2.0% +2.8% -4.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.7% +2.8% +1.9% +10.0% ➖ noise
7 datafusion:arrow +1.0% -0.4% +1.4% +10.0% ➖ noise
7 datafusion:vortex-compact -0.1% -0.4% +0.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.4% -0.4% +0.8% +10.0% ➖ noise
7 duckdb:duckdb +0.2% -0.4% +0.6% +10.0% ➖ noise
7 duckdb:vortex-compact +1.9% -0.4% +2.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.7% -0.4% +2.1% +10.0% ➖ noise
8 datafusion:arrow -0.5% +0.1% -0.5% +10.0% ➖ noise
8 datafusion:vortex-compact +0.8% +0.1% +0.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.5% +0.1% -0.6% +10.0% ➖ noise
8 duckdb:duckdb +0.6% +0.1% +0.5% +10.0% ➖ noise
8 duckdb:vortex-compact +0.9% +0.1% +0.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.7% +0.1% +0.6% +10.0% ➖ noise
9 datafusion:arrow -0.3% +0.4% -0.6% +10.0% ➖ noise
9 datafusion:vortex-compact -0.5% +0.4% -0.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.2% +0.4% -0.1% +10.0% ➖ noise
9 duckdb:duckdb -1.0% +0.4% -1.3% +10.0% ➖ noise
9 duckdb:vortex-compact +0.5% +0.4% +0.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.6% +0.4% -0.9% +10.0% ➖ noise
10 datafusion:arrow +1.1% +0.4% +0.7% +10.0% ➖ noise
10 datafusion:vortex-compact -1.7% +0.4% -2.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.4% +0.4% +0.0% +10.0% ➖ noise
10 duckdb:duckdb +0.6% +0.4% +0.2% +10.0% ➖ noise
10 duckdb:vortex-compact -1.0% +0.4% -1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.0% +0.4% -0.4% +10.0% ➖ noise
11 datafusion:arrow -0.2% +0.4% -0.5% +10.0% ➖ noise
11 datafusion:vortex-compact +0.4% +0.4% +0.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.5% +0.4% +0.2% +10.0% ➖ noise
11 duckdb:duckdb -1.8% +0.4% -2.1% +10.2% ➖ noise
11 duckdb:vortex-compact +1.6% +0.4% +1.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.3% +0.4% +2.0% +10.0% ➖ noise
12 datafusion:arrow +1.2% +1.1% +0.1% +26.7% ➖ noise
12 datafusion:vortex-compact -0.6% +1.1% -1.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.4% +1.1% -1.4% +10.0% ➖ noise
12 duckdb:duckdb +1.5% +1.1% +0.4% +10.0% ➖ noise
12 duckdb:vortex-compact +0.1% +1.1% -1.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -2.7% +1.1% -3.8% +10.0% ➖ noise
13 datafusion:arrow -2.3% -0.1% -2.2% +10.0% ➖ noise
13 datafusion:vortex-compact +0.4% -0.1% +0.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.3% -0.1% +0.4% +10.0% ➖ noise
13 duckdb:duckdb +0.5% -0.1% +0.6% +10.0% ➖ noise
13 duckdb:vortex-compact -3.7% -0.1% -3.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.2% -0.1% -2.1% +10.0% ➖ noise
14 datafusion:arrow -0.1% -1.1% +1.0% +10.0% ➖ noise
14 datafusion:vortex-compact -1.1% -1.1% -0.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.2% -1.1% +0.9% +10.0% ➖ noise
14 duckdb:duckdb -1.4% -1.1% -0.4% +10.0% ➖ noise
14 duckdb:vortex-compact -2.0% -1.1% -1.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.3% -1.1% +0.8% +10.0% ➖ noise
15 datafusion:arrow -0.1% +0.3% -0.4% +10.0% ➖ noise
15 datafusion:vortex-compact -1.0% +0.3% -1.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.9% +0.3% +0.7% +10.0% ➖ noise
15 duckdb:duckdb +0.2% +0.3% -0.1% +10.0% ➖ noise
15 duckdb:vortex-compact +0.1% +0.3% -0.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.1% +0.3% -0.2% +10.0% ➖ noise
16 datafusion:arrow +0.1% +0.4% -0.4% +10.0% ➖ noise
16 datafusion:vortex-compact -0.8% +0.4% -1.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.8% +0.4% +0.3% +10.0% ➖ noise
16 duckdb:duckdb -0.6% +0.4% -1.0% +10.0% ➖ noise
16 duckdb:vortex-compact +1.8% +0.4% +1.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.0% +0.4% +0.5% +10.0% ➖ noise
17 datafusion:arrow -0.7% -0.3% -0.4% +10.0% ➖ noise
17 datafusion:vortex-compact +0.1% -0.3% +0.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.6% -0.3% +0.9% +10.0% ➖ noise
17 duckdb:duckdb -1.0% -0.3% -0.7% +10.0% ➖ noise
17 duckdb:vortex-compact +2.8% -0.3% +3.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.6% -0.3% +0.9% +10.0% ➖ noise
18 datafusion:arrow -0.5% +1.0% -1.5% +10.0% ➖ noise
18 datafusion:vortex-compact -0.4% +1.0% -1.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.7% +1.0% -0.2% +10.0% ➖ noise
18 duckdb:duckdb +0.7% +1.0% -0.3% +10.0% ➖ noise
18 duckdb:vortex-compact +0.7% +1.0% -0.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.2% +1.0% -1.2% +10.0% ➖ noise
19 datafusion:arrow +2.9% +1.2% +1.7% +10.0% ➖ noise
19 datafusion:vortex-compact +0.6% +1.2% -0.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.1% +1.2% -0.1% +10.0% ➖ noise
19 duckdb:duckdb +1.2% +1.2% +0.1% +10.0% ➖ noise
19 duckdb:vortex-compact -0.2% +1.2% -1.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.1% +1.2% -0.1% +10.0% ➖ noise
20 datafusion:arrow +0.8% -0.7% +1.5% +10.0% ➖ noise
20 datafusion:vortex-compact +0.0% -0.7% +0.8% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -0.4% -0.7% +0.3% +10.0% ➖ noise
20 duckdb:duckdb +0.1% -0.7% +0.9% +10.0% ➖ noise
20 duckdb:vortex-compact +1.2% -0.7% +1.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.0% -0.7% +0.7% +10.0% ➖ noise
21 datafusion:arrow +0.9% -0.2% +1.0% +10.0% ➖ noise
21 datafusion:vortex-compact +0.7% -0.2% +0.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.0% -0.2% +1.1% +10.0% ➖ noise
21 duckdb:duckdb -2.4% -0.2% -2.3% +10.0% ➖ noise
21 duckdb:vortex-compact +0.5% -0.2% +0.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.4% -0.2% +1.5% +10.0% ➖ noise
22 datafusion:arrow -0.9% -0.3% -0.6% +10.0% ➖ noise
22 datafusion:vortex-compact -0.7% -0.3% -0.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.3% -0.3% +0.6% +10.0% ➖ noise
22 duckdb:duckdb -1.3% -0.3% -1.0% +10.0% ➖ noise
22 duckdb:vortex-compact -0.5% -0.3% -0.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.6% -0.3% -0.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.1%
Vortex (geomean): 1.013x ➖
Parquet (geomean): 1.015x ➖
Shifts: Parquet (control) +1.5% · Median polish +1.6%


datafusion / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1968420 1889203 1.04
clickbench_q01/datafusion:vortex-file-compressed 14851737 13939671 1.07
clickbench_q02/datafusion:vortex-file-compressed 33727545 31264638 1.08
clickbench_q03/datafusion:vortex-file-compressed 41068313 38421356 1.07
clickbench_q04/datafusion:vortex-file-compressed 316546021 310446627 1.02
clickbench_q05/datafusion:vortex-file-compressed 329977014 320204655 1.03
clickbench_q06/datafusion:vortex-file-compressed 1859406 1952097 0.95
clickbench_q07/datafusion:vortex-file-compressed 20108055 18292606 1.10
clickbench_q08/datafusion:vortex-file-compressed 390912871 384078789 1.02
clickbench_q09/datafusion:vortex-file-compressed 590863928 566643951 1.04
clickbench_q10/datafusion:vortex-file-compressed 73452103 71141010 1.03
clickbench_q11/datafusion:vortex-file-compressed 85695485 83595534 1.03
clickbench_q12/datafusion:vortex-file-compressed 281632345 273938782 1.03
clickbench_q13/datafusion:vortex-file-compressed 426766226 416784825 1.02
clickbench_q14/datafusion:vortex-file-compressed 272226367 265927485 1.02
clickbench_q15/datafusion:vortex-file-compressed 372078831 362106765 1.03
clickbench_q16/datafusion:vortex-file-compressed 716780936 703023248 1.02
clickbench_q17/datafusion:vortex-file-compressed 703613168 690992706 1.02
clickbench_q18/datafusion:vortex-file-compressed 1374350041 1425231293 0.96
clickbench_q19/datafusion:vortex-file-compressed 29568427 29457193 1.00
clickbench_q20/datafusion:vortex-file-compressed 356176807 357468484 1.00
clickbench_q21/datafusion:vortex-file-compressed 412537540 410380432 1.01
clickbench_q22/datafusion:vortex-file-compressed 509521966 498112225 1.02
clickbench_q23/datafusion:vortex-file-compressed 706505514 678127265 1.04
clickbench_q24/datafusion:vortex-file-compressed 50173533 51084111 0.98
clickbench_q25/datafusion:vortex-file-compressed 73001803 77179786 0.95
clickbench_q26/datafusion:vortex-file-compressed 48203730 50979572 0.95
clickbench_q27/datafusion:vortex-file-compressed 818431682 805667284 1.02
clickbench_q28/datafusion:vortex-file-compressed 6831357861 6773034054 1.01
clickbench_q29/datafusion:vortex-file-compressed 247597862 240289452 1.03
clickbench_q30/datafusion:vortex-file-compressed 238391753 234920960 1.01
clickbench_q31/datafusion:vortex-file-compressed 280204307 267821296 1.05
clickbench_q32/datafusion:vortex-file-compressed 1258271615 1152075470 1.09
clickbench_q33/datafusion:vortex-file-compressed 1426124861 1386736735 1.03
clickbench_q34/datafusion:vortex-file-compressed 1418535956 1410979228 1.01
clickbench_q35/datafusion:vortex-file-compressed 529554130 512752782 1.03
clickbench_q36/datafusion:vortex-file-compressed 79113600 78469854 1.01
clickbench_q37/datafusion:vortex-file-compressed 39167882 38958439 1.01
clickbench_q38/datafusion:vortex-file-compressed 22551600 23760536 0.95
clickbench_q39/datafusion:vortex-file-compressed 156632189 158633031 0.99
clickbench_q40/datafusion:vortex-file-compressed 🚨 20290763 18076950 1.12
clickbench_q41/datafusion:vortex-file-compressed 17744502 18844724 0.94
clickbench_q42/datafusion:vortex-file-compressed 20058511 19294008 1.04
datafusion / parquet (1.020x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 2000637 1920311 1.04
clickbench_q01/datafusion:parquet 22808615 21971992 1.04
clickbench_q02/datafusion:parquet 55767364 59155606 0.94
clickbench_q03/datafusion:parquet 43768169 45640822 0.96
clickbench_q04/datafusion:parquet 344914719 336899338 1.02
clickbench_q05/datafusion:parquet 384331841 363436517 1.06
clickbench_q06/datafusion:parquet 1776618 1750763 1.01
clickbench_q07/datafusion:parquet 26133409 26908531 0.97
clickbench_q08/datafusion:parquet 425419204 427134131 1.00
clickbench_q09/datafusion:parquet 671852863 651010395 1.03
clickbench_q10/datafusion:parquet 113820226 112623919 1.01
clickbench_q11/datafusion:parquet 142502764 136832979 1.04
clickbench_q12/datafusion:parquet 366510073 363664601 1.01
clickbench_q13/datafusion:parquet 522849821 516715143 1.01
clickbench_q14/datafusion:parquet 375368265 357169990 1.05
clickbench_q15/datafusion:parquet 382428789 374913037 1.02
clickbench_q16/datafusion:parquet 710947567 692817899 1.03
clickbench_q17/datafusion:parquet 709897503 685266393 1.04
clickbench_q18/datafusion:parquet 1418782676 1441675345 0.98
clickbench_q19/datafusion:parquet 37796656 35103556 1.08
clickbench_q20/datafusion:parquet 646159520 635774055 1.02
clickbench_q21/datafusion:parquet 699710820 686502900 1.02
clickbench_q22/datafusion:parquet 1020330053 1002645621 1.02
clickbench_q23/datafusion:parquet 3883958946 3692172146 1.05
clickbench_q24/datafusion:parquet 86232240 88760086 0.97
clickbench_q25/datafusion:parquet 146310383 142519668 1.03
clickbench_q26/datafusion:parquet 92206069 88734976 1.04
clickbench_q27/datafusion:parquet 1093795012 1082950935 1.01
clickbench_q28/datafusion:parquet 6655207358 6626676262 1.00
clickbench_q29/datafusion:parquet 242216409 246049560 0.98
clickbench_q30/datafusion:parquet 380115869 366344778 1.04
clickbench_q31/datafusion:parquet 399372650 399517785 1.00
clickbench_q32/datafusion:parquet 1292564751 1294823745 1.00
clickbench_q33/datafusion:parquet 1590013853 1584652243 1.00
clickbench_q34/datafusion:parquet 1583050520 1541082887 1.03
clickbench_q35/datafusion:parquet 552472827 528575550 1.05
clickbench_q36/datafusion:parquet 🚨 163229894 143507010 1.14
clickbench_q37/datafusion:parquet 64742563 61994008 1.04
clickbench_q38/datafusion:parquet 93417550 96545280 0.97
clickbench_q39/datafusion:parquet 290256174 280206447 1.04
clickbench_q40/datafusion:parquet 37077289 35975269 1.03
clickbench_q41/datafusion:parquet 32596497 30518422 1.07
clickbench_q42/datafusion:parquet 33190154 32467060 1.02
duckdb / vortex-file-compressed (1.007x ➖, 2↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5972960 6281683 0.95
clickbench_q01/duckdb:vortex-file-compressed 15821273 14390149 1.10
clickbench_q02/duckdb:vortex-file-compressed 27380757 26764191 1.02
clickbench_q03/duckdb:vortex-file-compressed 32147894 31639124 1.02
clickbench_q04/duckdb:vortex-file-compressed 188945501 189376520 1.00
clickbench_q05/duckdb:vortex-file-compressed 186432887 185613519 1.00
clickbench_q06/duckdb:vortex-file-compressed 21057952 19628632 1.07
clickbench_q07/duckdb:vortex-file-compressed 15919762 15908726 1.00
clickbench_q08/duckdb:vortex-file-compressed 270615151 267649839 1.01
clickbench_q09/duckdb:vortex-file-compressed 348809544 342988254 1.02
clickbench_q10/duckdb:vortex-file-compressed 73847218 72000647 1.03
clickbench_q11/duckdb:vortex-file-compressed 85828122 83205039 1.03
clickbench_q12/duckdb:vortex-file-compressed 203490623 199982058 1.02
clickbench_q13/duckdb:vortex-file-compressed 409297831 407366127 1.00
clickbench_q14/duckdb:vortex-file-compressed 242900056 236047187 1.03
clickbench_q15/duckdb:vortex-file-compressed 249138035 249363749 1.00
clickbench_q16/duckdb:vortex-file-compressed 748901813 749860903 1.00
clickbench_q17/duckdb:vortex-file-compressed 522406980 552507657 0.95
clickbench_q18/duckdb:vortex-file-compressed 1133679161 1152589328 0.98
clickbench_q19/duckdb:vortex-file-compressed 24350424 23891430 1.02
clickbench_q20/duckdb:vortex-file-compressed 387416658 370953080 1.04
clickbench_q21/duckdb:vortex-file-compressed 430863121 410959219 1.05
clickbench_q22/duckdb:vortex-file-compressed 577553168 620649278 0.93
clickbench_q23/duckdb:vortex-file-compressed 1671883160 1770863835 0.94
clickbench_q24/duckdb:vortex-file-compressed 🚀 42229692 54021760 0.78
clickbench_q25/duckdb:vortex-file-compressed 79681374 78705065 1.01
clickbench_q26/duckdb:vortex-file-compressed 🚀 44148809 51234463 0.86
clickbench_q27/duckdb:vortex-file-compressed 515430896 505344135 1.02
clickbench_q28/duckdb:vortex-file-compressed 3022015287 2998684463 1.01
clickbench_q29/duckdb:vortex-file-compressed 29929113 29323443 1.02
clickbench_q30/duckdb:vortex-file-compressed 197288376 191972008 1.03
clickbench_q31/duckdb:vortex-file-compressed 287138697 286469700 1.00
clickbench_q32/duckdb:vortex-file-compressed 1357297563 1371739860 0.99
clickbench_q33/duckdb:vortex-file-compressed 1559186602 1417923030 1.10
clickbench_q34/duckdb:vortex-file-compressed 1625447879 1495625285 1.09
clickbench_q35/duckdb:vortex-file-compressed 382853252 380459991 1.01
clickbench_q36/duckdb:vortex-file-compressed 33828313 32113202 1.05
clickbench_q37/duckdb:vortex-file-compressed 24918350 23956677 1.04
clickbench_q38/duckdb:vortex-file-compressed 27099251 26016604 1.04
clickbench_q39/duckdb:vortex-file-compressed 46256937 47211165 0.98
clickbench_q40/duckdb:vortex-file-compressed 24982859 24278256 1.03
clickbench_q41/duckdb:vortex-file-compressed 24518095 23261150 1.05
clickbench_q42/duckdb:vortex-file-compressed 25025358 24065076 1.04
duckdb / parquet (1.009x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25513215 26216786 0.97
clickbench_q01/duckdb:parquet 28343720 27994942 1.01
clickbench_q02/duckdb:parquet 49098060 48231345 1.02
clickbench_q03/duckdb:parquet 38054133 38660107 0.98
clickbench_q04/duckdb:parquet 204574212 201507048 1.02
clickbench_q05/duckdb:parquet 264899276 273968539 0.97
clickbench_q06/duckdb:parquet 46257685 45015264 1.03
clickbench_q07/duckdb:parquet 29905108 29167298 1.03
clickbench_q08/duckdb:parquet 266234126 266668957 1.00
clickbench_q09/duckdb:parquet 398906226 396965418 1.00
clickbench_q10/duckdb:parquet 82769566 80964438 1.02
clickbench_q11/duckdb:parquet 99834431 98177207 1.02
clickbench_q12/duckdb:parquet 296895677 296210271 1.00
clickbench_q13/duckdb:parquet 491203459 479315242 1.02
clickbench_q14/duckdb:parquet 330607327 324116975 1.02
clickbench_q15/duckdb:parquet 262584856 257740522 1.02
clickbench_q16/duckdb:parquet 661793514 641377091 1.03
clickbench_q17/duckdb:parquet 544721997 552102914 0.99
clickbench_q18/duckdb:parquet 1104260272 1086791808 1.02
clickbench_q19/duckdb:parquet 25943325 25504539 1.02
clickbench_q20/duckdb:parquet 425138345 421606981 1.01
clickbench_q21/duckdb:parquet 553057442 547558014 1.01
clickbench_q22/duckdb:parquet 945611274 939705560 1.01
clickbench_q23/duckdb:parquet 309120517 317582257 0.97
clickbench_q24/duckdb:parquet 67024300 70013793 0.96
clickbench_q25/duckdb:parquet 157634556 156983654 1.00
clickbench_q26/duckdb:parquet 51199415 49308048 1.04
clickbench_q27/duckdb:parquet 648047866 650239718 1.00
clickbench_q28/duckdb:parquet 4856210143 4812580558 1.01
clickbench_q29/duckdb:parquet 40157874 40245600 1.00
clickbench_q30/duckdb:parquet 303375968 299628315 1.01
clickbench_q31/duckdb:parquet 365500650 361091636 1.01
clickbench_q32/duckdb:parquet 1214803317 1158472475 1.05
clickbench_q33/duckdb:parquet 1333914190 1299195147 1.03
clickbench_q34/duckdb:parquet 1347504876 1329502040 1.01
clickbench_q35/duckdb:parquet 368455061 364283888 1.01
clickbench_q36/duckdb:parquet 47494673 46252952 1.03
clickbench_q37/duckdb:parquet 32770303 32721346 1.00
clickbench_q38/duckdb:parquet 33053540 34215233 0.97
clickbench_q39/duckdb:parquet 81233243 79240653 1.03
clickbench_q40/duckdb:parquet 17880737 19375282 0.92
clickbench_q41/duckdb:parquet 🚨 18788672 17021701 1.10
clickbench_q42/duckdb:parquet 21386838 20117490 1.06
duckdb / duckdb (0.956x ➖, 5↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 17137496 19585998 0.87
clickbench_q01/duckdb:duckdb 🚀 32488964 36454626 0.89
clickbench_q02/duckdb:duckdb 45141486 49434076 0.91
clickbench_q03/duckdb:duckdb 46727217 49750184 0.94
clickbench_q04/duckdb:duckdb 191119121 191002203 1.00
clickbench_q05/duckdb:duckdb 264035049 271448584 0.97
clickbench_q06/duckdb:duckdb 🚀 28824854 39067298 0.74
clickbench_q07/duckdb:duckdb 35037486 38653692 0.91
clickbench_q08/duckdb:duckdb 256361323 248002658 1.03
clickbench_q09/duckdb:duckdb 367946757 367224815 1.00
clickbench_q10/duckdb:duckdb 99123696 100193420 0.99
clickbench_q11/duckdb:duckdb 109093211 109179509 1.00
clickbench_q12/duckdb:duckdb 240338759 235055110 1.02
clickbench_q13/duckdb:duckdb 483481662 492795438 0.98
clickbench_q14/duckdb:duckdb 279345376 276086105 1.01
clickbench_q15/duckdb:duckdb 220326257 219177005 1.01
clickbench_q16/duckdb:duckdb 653064687 644841390 1.01
clickbench_q17/duckdb:duckdb 559674576 569365170 0.98
clickbench_q18/duckdb:duckdb 1242106139 1232717676 1.01
clickbench_q19/duckdb:duckdb 35064827 37969062 0.92
clickbench_q20/duckdb:duckdb 🚀 944312516 1065228718 0.89
clickbench_q21/duckdb:duckdb 972931725 1070219220 0.91
clickbench_q22/duckdb:duckdb 1068433513 1051596012 1.02
clickbench_q23/duckdb:duckdb 259171191 259821083 1.00
clickbench_q24/duckdb:duckdb 60962164 64290290 0.95
clickbench_q25/duckdb:duckdb 139613824 147120418 0.95
clickbench_q26/duckdb:duckdb 60163451 61134168 0.98
clickbench_q27/duckdb:duckdb 🚀 982311528 1204634610 0.82
clickbench_q28/duckdb:duckdb 4673699945 4688286117 1.00
clickbench_q29/duckdb:duckdb 48376042 52737118 0.92
clickbench_q30/duckdb:duckdb 271743342 260992252 1.04
clickbench_q31/duckdb:duckdb 414889912 427992187 0.97
clickbench_q32/duckdb:duckdb 1518500887 1504758043 1.01
clickbench_q33/duckdb:duckdb 2005469070 2123601441 0.94
clickbench_q34/duckdb:duckdb 2227898539 2237635559 1.00
clickbench_q35/duckdb:duckdb 283836291 287899066 0.99
clickbench_q36/duckdb:duckdb 42298392 46249536 0.91
clickbench_q37/duckdb:duckdb 31246279 34328096 0.91
clickbench_q38/duckdb:duckdb 31790134 34855035 0.91
clickbench_q39/duckdb:duckdb 🚨 79218592 68847767 1.15
clickbench_q40/duckdb:duckdb 31596892 34824142 0.91
clickbench_q41/duckdb:duckdb 30469132 33085489 0.92
clickbench_q42/duckdb:duckdb 31793027 35239903 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +4.2% +0.7% +3.5% +771.8% ➖ noise
0 duckdb:duckdb -12.5% +0.7% -13.1% +270.8% ➖ noise
0 duckdb:vortex-file-compressed -4.9% +0.7% -5.6% +381.0% ➖ noise
1 datafusion:vortex-file-compressed +6.5% +2.5% +3.9% +22.7% ➖ noise
1 duckdb:duckdb -10.9% +2.5% -13.1% +60.9% ➖ noise
1 duckdb:vortex-file-compressed +9.9% +2.5% +7.2% +19.0% ➖ noise
2 datafusion:vortex-file-compressed +7.9% -2.0% +10.1% +21.2% ➖ noise
2 duckdb:duckdb -8.7% -2.0% -6.8% +25.4% ➖ noise
2 duckdb:vortex-file-compressed +2.3% -2.0% +4.4% +10.4% ➖ noise
3 datafusion:vortex-file-compressed +6.9% -2.8% +10.0% +157.7% ➖ noise
3 duckdb:duckdb -6.1% -2.8% -3.3% +55.7% ➖ noise
3 duckdb:vortex-file-compressed +1.6% -2.8% +4.6% +81.7% ➖ noise
4 datafusion:vortex-file-compressed +2.0% +1.9% +0.0% +10.0% ➖ noise
4 duckdb:duckdb +0.1% +1.9% -1.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% +1.9% -2.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +3.1% +1.1% +1.9% +10.0% ➖ noise
5 duckdb:duckdb -2.7% +1.1% -3.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.4% +1.1% -0.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.7% +2.1% -6.7% +43.2% ➖ noise
6 duckdb:duckdb -26.2% +2.1% -27.7% +31.2% ✅ faster
6 duckdb:vortex-file-compressed +7.3% +2.1% +5.1% +20.7% ➖ noise
7 datafusion:vortex-file-compressed +9.9% -0.2% +10.2% +10.2% ➖ noise
7 duckdb:duckdb -9.4% -0.2% -9.2% +14.6% ➖ noise
7 duckdb:vortex-file-compressed +0.1% -0.2% +0.3% +11.6% ➖ noise
8 datafusion:vortex-file-compressed +1.8% -0.3% +2.1% +10.0% ➖ noise
8 duckdb:duckdb +3.4% -0.3% +3.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.1% -0.3% +1.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +4.3% +1.8% +2.4% +10.0% ➖ noise
9 duckdb:duckdb +0.2% +1.8% -1.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.7% +1.8% -0.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.2% +1.6% +1.6% +10.0% ➖ noise
10 duckdb:duckdb -1.1% +1.6% -2.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.6% +1.6% +0.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.5% +2.9% -0.4% +10.0% ➖ noise
11 duckdb:duckdb -0.1% +2.9% -2.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.2% +2.9% +0.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +2.8% +0.5% +2.3% +10.0% ➖ noise
12 duckdb:duckdb +2.2% +0.5% +1.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.8% +0.5% +1.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.4% +1.8% +0.6% +10.0% ➖ noise
13 duckdb:duckdb -1.9% +1.8% -3.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.5% +1.8% -1.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.4% +3.5% -1.1% +10.0% ➖ noise
14 duckdb:duckdb +1.2% +3.5% -2.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.9% +3.5% -0.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.8% +1.9% +0.8% +10.0% ➖ noise
15 duckdb:duckdb +0.5% +1.9% -1.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.1% +1.9% -2.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.0% +2.9% -0.9% +10.0% ➖ noise
16 duckdb:duckdb +1.3% +2.9% -1.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.1% +2.9% -2.9% +14.9% ➖ noise
17 datafusion:vortex-file-compressed +1.8% +1.1% +0.7% +10.0% ➖ noise
17 duckdb:duckdb -1.7% +1.1% -2.8% +11.6% ➖ noise
17 duckdb:vortex-file-compressed -5.4% +1.1% -6.5% +18.4% ➖ noise
18 datafusion:vortex-file-compressed -3.6% -0.0% -3.6% +10.0% ➖ noise
18 duckdb:duckdb +0.8% -0.0% +0.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.6% -0.0% -1.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.4% +4.7% -4.1% +27.6% ➖ noise
19 duckdb:duckdb -7.6% +4.7% -11.8% +12.6% ✅ faster
19 duckdb:vortex-file-compressed +1.9% +4.7% -2.6% +23.9% ➖ noise
20 datafusion:vortex-file-compressed -0.4% +1.2% -1.6% +198.6% ➖ noise
20 duckdb:duckdb -11.4% +1.2% -12.4% +28.5% ➖ noise
20 duckdb:vortex-file-compressed +4.4% +1.2% +3.2% +13.0% ➖ noise
21 datafusion:vortex-file-compressed +0.5% +1.5% -0.9% +10.0% ➖ noise
21 duckdb:duckdb -9.1% +1.5% -10.4% +10.0% ✅ faster
21 duckdb:vortex-file-compressed +4.8% +1.5% +3.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +2.3% +1.2% +1.1% +10.6% ➖ noise
22 duckdb:duckdb +1.6% +1.2% +0.4% +16.5% ➖ noise
22 duckdb:vortex-file-compressed -6.9% +1.2% -8.0% +14.5% ➖ noise
23 datafusion:vortex-file-compressed +4.2% +1.2% +3.0% +42.3% ➖ noise
23 duckdb:duckdb -0.3% +1.2% -1.4% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -5.6% +1.2% -6.7% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -1.8% -3.6% +1.8% +21.5% ➖ noise
24 duckdb:duckdb -5.2% -3.6% -1.7% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -21.8% -3.6% -18.9% +25.5% ➖ noise
25 datafusion:vortex-file-compressed -5.4% +1.5% -6.8% +14.9% ➖ noise
25 duckdb:duckdb -5.1% +1.5% -6.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.2% +1.5% -0.3% +14.1% ➖ noise
26 datafusion:vortex-file-compressed -5.4% +3.9% -9.0% +14.4% ➖ noise
26 duckdb:duckdb -1.6% +3.9% -5.3% +13.0% ➖ noise
26 duckdb:vortex-file-compressed -13.8% +3.9% -17.0% +27.1% ➖ noise
27 datafusion:vortex-file-compressed +1.6% +0.3% +1.3% +10.0% ➖ noise
27 duckdb:duckdb -18.5% +0.3% -18.7% +10.0% ✅ faster
27 duckdb:vortex-file-compressed +2.0% +0.3% +1.7% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.9% +0.7% +0.2% +10.0% ➖ noise
28 duckdb:duckdb -0.3% +0.7% -1.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.8% +0.7% +0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +3.0% -0.9% +4.0% +10.0% ➖ noise
29 duckdb:duckdb -8.3% -0.9% -7.4% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +2.1% -0.9% +3.0% +10.1% ➖ noise
30 datafusion:vortex-file-compressed +1.5% +2.5% -1.0% +10.0% ➖ noise
30 duckdb:duckdb +4.1% +2.5% +1.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +2.8% +2.5% +0.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +4.6% +0.6% +4.0% +10.0% ➖ noise
31 duckdb:duckdb -3.1% +0.6% -3.6% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.2% +0.6% -0.4% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +9.2% +2.3% +6.7% +15.7% ➖ noise
32 duckdb:duckdb +0.9% +2.3% -1.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -1.1% +2.3% -3.3% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +2.8% +1.5% +1.3% +10.0% ➖ noise
33 duckdb:duckdb -5.6% +1.5% -7.0% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +10.0% +1.5% +8.3% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.5% +2.0% -1.5% +10.0% ➖ noise
34 duckdb:duckdb -0.4% +2.0% -2.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +8.7% +2.0% +6.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +3.3% +2.8% +0.4% +10.0% ➖ noise
35 duckdb:duckdb -1.4% +2.8% -4.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.6% +2.8% -2.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.8% +8.1% -6.7% +13.6% ➖ noise
36 duckdb:duckdb -8.5% +8.1% -15.4% +15.1% ✅ faster
36 duckdb:vortex-file-compressed +5.3% +8.1% -2.5% +14.1% ➖ noise
37 datafusion:vortex-file-compressed +0.5% +2.3% -1.7% +10.0% ➖ noise
37 duckdb:duckdb -9.0% +2.3% -11.0% +11.6% ✅ faster
37 duckdb:vortex-file-compressed +4.0% +2.3% +1.7% +19.5% ➖ noise
38 datafusion:vortex-file-compressed -5.1% -3.3% -1.8% +11.2% ➖ noise
38 duckdb:duckdb -8.8% -3.3% -5.7% +11.2% ➖ noise
38 duckdb:vortex-file-compressed +4.2% -3.3% +7.7% +12.1% ➖ noise
39 datafusion:vortex-file-compressed -1.3% +3.0% -4.2% +14.0% ➖ noise
39 duckdb:duckdb +15.1% +3.0% +11.7% +16.5% ➖ noise
39 duckdb:vortex-file-compressed -2.0% +3.0% -4.9% +11.6% ➖ noise
40 datafusion:vortex-file-compressed +12.2% -2.5% +15.1% +13.9% 🚨 regression
40 duckdb:duckdb -9.3% -2.5% -7.0% +12.5% ➖ noise
40 duckdb:vortex-file-compressed +2.9% -2.5% +5.5% +12.6% ➖ noise
41 datafusion:vortex-file-compressed -5.8% +8.6% -13.3% +15.5% ➖ noise
41 duckdb:duckdb -7.9% +8.6% -15.2% +10.0% ✅ faster
41 duckdb:vortex-file-compressed +5.4% +8.6% -2.9% +10.3% ➖ noise
42 datafusion:vortex-file-compressed +4.0% +4.2% -0.3% +10.2% ➖ noise
42 duckdb:duckdb -9.8% +4.2% -13.5% +10.0% ✅ faster
42 duckdb:vortex-file-compressed +4.0% +4.2% -0.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.3%
Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.051x ➖
Shifts: Parquet (control) +5.1% · Median polish +2.5%


datafusion / vortex-file-compressed (0.994x ➖, 1↑ 2↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 238198080 222038154 1.07
tpch_q02/datafusion:vortex-file-compressed 🚨 626384623 469736879 1.33
tpch_q03/datafusion:vortex-file-compressed 389894558 383517031 1.02
tpch_q04/datafusion:vortex-file-compressed 214179478 222172264 0.96
tpch_q05/datafusion:vortex-file-compressed 400066019 545000143 0.73
tpch_q06/datafusion:vortex-file-compressed 272729576 380553601 0.72
tpch_q07/datafusion:vortex-file-compressed 🚀 352854467 606910043 0.58
tpch_q08/datafusion:vortex-file-compressed 625445348 683277187 0.92
tpch_q09/datafusion:vortex-file-compressed 542318557 529867791 1.02
tpch_q10/datafusion:vortex-file-compressed 687183761 571952835 1.20
tpch_q11/datafusion:vortex-file-compressed 463282091 403863418 1.15
tpch_q12/datafusion:vortex-file-compressed 441853477 441718116 1.00
tpch_q13/datafusion:vortex-file-compressed 175651233 157346497 1.12
tpch_q14/datafusion:vortex-file-compressed 213198346 262485696 0.81
tpch_q15/datafusion:vortex-file-compressed 349376933 356771124 0.98
tpch_q16/datafusion:vortex-file-compressed 218875610 203298523 1.08
tpch_q17/datafusion:vortex-file-compressed 510599529 427835099 1.19
tpch_q18/datafusion:vortex-file-compressed 449365087 399799954 1.12
tpch_q19/datafusion:vortex-file-compressed 399441177 529284762 0.75
tpch_q20/datafusion:vortex-file-compressed 401063451 392116890 1.02
tpch_q21/datafusion:vortex-file-compressed 🚨 670925527 443395345 1.51
tpch_q22/datafusion:vortex-file-compressed 175848255 166913543 1.05
datafusion / vortex-compact (0.955x ➖, 1↑ 2↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 430115549 248700101 1.73
tpch_q02/datafusion:vortex-compact 🚨 581262261 422772626 1.37
tpch_q03/datafusion:vortex-compact 366331659 416593895 0.88
tpch_q04/datafusion:vortex-compact 292300296 278223379 1.05
tpch_q05/datafusion:vortex-compact 431580235 450283470 0.96
tpch_q06/datafusion:vortex-compact 385325499 389917428 0.99
tpch_q07/datafusion:vortex-compact 462439486 480791263 0.96
tpch_q08/datafusion:vortex-compact 552666379 551206818 1.00
tpch_q09/datafusion:vortex-compact 470198320 406333871 1.16
tpch_q10/datafusion:vortex-compact 559711033 462425299 1.21
tpch_q11/datafusion:vortex-compact 318048859 323096883 0.98
tpch_q12/datafusion:vortex-compact 559873698 596092816 0.94
tpch_q13/datafusion:vortex-compact 183451693 195075920 0.94
tpch_q14/datafusion:vortex-compact 287192831 394658892 0.73
tpch_q15/datafusion:vortex-compact 🚀 493514977 720424764 0.69
tpch_q16/datafusion:vortex-compact 191080256 209731952 0.91
tpch_q17/datafusion:vortex-compact 368549124 420368404 0.88
tpch_q18/datafusion:vortex-compact 296977984 356906528 0.83
tpch_q19/datafusion:vortex-compact 448588456 616622537 0.73
tpch_q20/datafusion:vortex-compact 449266121 552033034 0.81
tpch_q21/datafusion:vortex-compact 547661998 626967966 0.87
tpch_q22/datafusion:vortex-compact 155323506 180183872 0.86
datafusion / parquet (1.063x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 216305402 238875126 0.91
tpch_q02/datafusion:parquet 506406586 411047296 1.23
tpch_q03/datafusion:parquet 🚨 525607100 313273176 1.68
tpch_q04/datafusion:parquet 195798414 188105161 1.04
tpch_q05/datafusion:parquet 557334363 486147440 1.15
tpch_q06/datafusion:parquet 209869436 166864844 1.26
tpch_q07/datafusion:parquet 588789252 581238729 1.01
tpch_q08/datafusion:parquet 708491952 947031810 0.75
tpch_q09/datafusion:parquet 632605889 538022860 1.18
tpch_q10/datafusion:parquet 587257178 519744086 1.13
tpch_q11/datafusion:parquet 377715191 340332767 1.11
tpch_q12/datafusion:parquet 259842377 252984828 1.03
tpch_q13/datafusion:parquet 444929598 433730375 1.03
tpch_q14/datafusion:parquet 187228738 220313667 0.85
tpch_q15/datafusion:parquet 321947914 340599847 0.95
tpch_q16/datafusion:parquet 205627816 183989280 1.12
tpch_q17/datafusion:parquet 405933296 481387202 0.84
tpch_q18/datafusion:parquet 514554482 555526525 0.93
tpch_q19/datafusion:parquet 390508764 370301385 1.05
tpch_q20/datafusion:parquet 441650813 357078777 1.24
tpch_q21/datafusion:parquet 678916546 633010305 1.07
tpch_q22/datafusion:parquet 265065021 224053225 1.18
duckdb / vortex-file-compressed (1.043x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 313980514 277452088 1.13
tpch_q02/duckdb:vortex-file-compressed 1072053089 983328400 1.09
tpch_q03/duckdb:vortex-file-compressed 728312359 658185563 1.11
tpch_q04/duckdb:vortex-file-compressed 421776114 505017449 0.84
tpch_q05/duckdb:vortex-file-compressed 919304377 841449258 1.09
tpch_q06/duckdb:vortex-file-compressed 514369232 406109759 1.27
tpch_q07/duckdb:vortex-file-compressed 895761315 746621979 1.20
tpch_q08/duckdb:vortex-file-compressed 1193860927 1044574717 1.14
tpch_q09/duckdb:vortex-file-compressed 901407444 884159660 1.02
tpch_q10/duckdb:vortex-file-compressed 771418421 760425984 1.01
tpch_q11/duckdb:vortex-file-compressed 539620238 542644199 0.99
tpch_q12/duckdb:vortex-file-compressed 474531174 483624107 0.98
tpch_q13/duckdb:vortex-file-compressed 470603194 521130570 0.90
tpch_q14/duckdb:vortex-file-compressed 531479738 540798141 0.98
tpch_q15/duckdb:vortex-file-compressed 297777025 273872853 1.09
tpch_q16/duckdb:vortex-file-compressed 374654100 366238756 1.02
tpch_q17/duckdb:vortex-file-compressed 793581887 758979783 1.05
tpch_q18/duckdb:vortex-file-compressed 572494705 608345619 0.94
tpch_q19/duckdb:vortex-file-compressed 455154825 475848072 0.96
tpch_q20/duckdb:vortex-file-compressed 892473064 888060206 1.00
tpch_q21/duckdb:vortex-file-compressed 1343956211 1042167530 1.29
tpch_q22/duckdb:vortex-file-compressed 352574331 370430769 0.95
duckdb / vortex-compact (1.079x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 294126949 306385735 0.96
tpch_q02/duckdb:vortex-compact 991223729 939936344 1.05
tpch_q03/duckdb:vortex-compact 664348151 573154932 1.16
tpch_q04/duckdb:vortex-compact 402882341 379924191 1.06
tpch_q05/duckdb:vortex-compact 970953240 940766911 1.03
tpch_q06/duckdb:vortex-compact 453820500 366216509 1.24
tpch_q07/duckdb:vortex-compact 793210071 796013429 1.00
tpch_q08/duckdb:vortex-compact 946522335 977409329 0.97
tpch_q09/duckdb:vortex-compact 1030102981 877993089 1.17
tpch_q10/duckdb:vortex-compact 819888412 704964046 1.16
tpch_q11/duckdb:vortex-compact 523108781 483687956 1.08
tpch_q12/duckdb:vortex-compact 515777620 451590193 1.14
tpch_q13/duckdb:vortex-compact 459925078 486440506 0.95
tpch_q14/duckdb:vortex-compact 593833722 625698538 0.95
tpch_q15/duckdb:vortex-compact 336909011 311052190 1.08
tpch_q16/duckdb:vortex-compact 408897042 359438181 1.14
tpch_q17/duckdb:vortex-compact 613158267 716172129 0.86
tpch_q18/duckdb:vortex-compact 568912632 479950912 1.19
tpch_q19/duckdb:vortex-compact 🚨 618197085 423571664 1.46
tpch_q20/duckdb:vortex-compact 826448631 798777079 1.03
tpch_q21/duckdb:vortex-compact 1233865400 1081980435 1.14
tpch_q22/duckdb:vortex-compact 406070703 382841748 1.06
duckdb / parquet (1.040x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 563075561 404684628 1.39
tpch_q02/duckdb:parquet 1487219043 1224059243 1.21
tpch_q03/duckdb:parquet 1094717854 993691791 1.10
tpch_q04/duckdb:parquet 647224322 648080836 1.00
tpch_q05/duckdb:parquet 1704414678 1713479937 0.99
tpch_q06/duckdb:parquet 500054871 441155417 1.13
tpch_q07/duckdb:parquet 1424885438 1283486265 1.11
tpch_q08/duckdb:parquet 1889879056 1853521253 1.02
tpch_q09/duckdb:parquet 1532133761 1475676912 1.04
tpch_q10/duckdb:parquet 1372760674 1338757033 1.03
tpch_q11/duckdb:parquet 966338262 874593815 1.10
tpch_q12/duckdb:parquet 706922892 917753977 0.77
tpch_q13/duckdb:parquet 892019980 892244449 1.00
tpch_q14/duckdb:parquet 703129943 634974445 1.11
tpch_q15/duckdb:parquet 483153339 555685752 0.87
tpch_q16/duckdb:parquet 623452704 637446452 0.98
tpch_q17/duckdb:parquet 740709139 747529334 0.99
tpch_q18/duckdb:parquet 934887256 900150420 1.04
tpch_q19/duckdb:parquet 875468079 834129777 1.05
tpch_q20/duckdb:parquet 1065637486 1098146543 0.97
tpch_q21/duckdb:parquet 1308844865 1176223361 1.11
tpch_q22/duckdb:parquet 634445960 635727863 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +72.9% +12.2% +54.1% +74.3% ➖ noise
1 datafusion:vortex-file-compressed +7.3% +12.2% -4.4% +83.6% ➖ noise
1 duckdb:vortex-compact -4.0% +12.2% -14.5% +52.3% ➖ noise
1 duckdb:vortex-file-compressed +13.2% +12.2% +0.8% +46.6% ➖ noise
2 datafusion:vortex-compact +37.5% +22.3% +12.4% +35.8% ➖ noise
2 datafusion:vortex-file-compressed +33.3% +22.3% +9.0% +39.0% ➖ noise
2 duckdb:vortex-compact +5.5% +22.3% -13.8% +31.5% ➖ noise
2 duckdb:vortex-file-compressed +9.0% +22.3% -10.9% +31.5% ➖ noise
3 datafusion:vortex-compact -12.1% +36.0% -35.3% +59.3% ➖ noise
3 datafusion:vortex-file-compressed +1.7% +36.0% -25.2% +66.7% ➖ noise
3 duckdb:vortex-compact +15.9% +36.0% -14.7% +32.4% ➖ noise
3 duckdb:vortex-file-compressed +10.7% +36.0% -18.6% +41.6% ➖ noise
4 datafusion:vortex-compact +5.1% +2.0% +3.0% +43.2% ➖ noise
4 datafusion:vortex-file-compressed -3.6% +2.0% -5.4% +41.2% ➖ noise
4 duckdb:vortex-compact +6.0% +2.0% +4.0% +39.7% ➖ noise
4 duckdb:vortex-file-compressed -16.5% +2.0% -18.1% +46.9% ➖ noise
5 datafusion:vortex-compact -4.2% +6.8% -10.2% +31.5% ➖ noise
5 datafusion:vortex-file-compressed -26.6% +6.8% -31.3% +31.5% ✅ faster
5 duckdb:vortex-compact +3.2% +6.8% -3.4% +31.5% ➖ noise
5 duckdb:vortex-file-compressed +9.3% +6.8% +2.3% +31.5% ➖ noise
6 datafusion:vortex-compact -1.2% +19.4% -17.2% +38.6% ➖ noise
6 datafusion:vortex-file-compressed -28.3% +19.4% -40.0% +33.4% ✅ faster
6 duckdb:vortex-compact +23.9% +19.4% +3.8% +31.5% ➖ noise
6 duckdb:vortex-file-compressed +26.7% +19.4% +6.1% +31.5% ➖ noise
7 datafusion:vortex-compact -3.8% +6.0% -9.3% +31.5% ➖ noise
7 datafusion:vortex-file-compressed -41.9% +6.0% -45.2% +31.5% ✅ faster
7 duckdb:vortex-compact -0.4% +6.0% -6.0% +31.5% ➖ noise
7 duckdb:vortex-file-compressed +20.0% +6.0% +13.1% +31.5% ➖ noise
8 datafusion:vortex-compact +0.3% -12.7% +14.8% +31.5% ➖ noise
8 datafusion:vortex-file-compressed -8.5% -12.7% +4.8% +31.5% ➖ noise
8 duckdb:vortex-compact -3.2% -12.7% +10.9% +31.5% ➖ noise
8 duckdb:vortex-file-compressed +14.3% -12.7% +30.9% +31.5% ➖ noise
9 datafusion:vortex-compact +15.7% +10.5% +4.7% +31.5% ➖ noise
9 datafusion:vortex-file-compressed +2.3% +10.5% -7.4% +31.5% ➖ noise
9 duckdb:vortex-compact +17.3% +10.5% +6.2% +31.5% ➖ noise
9 duckdb:vortex-file-compressed +2.0% +10.5% -7.7% +31.5% ➖ noise
10 datafusion:vortex-compact +21.0% +7.6% +12.4% +31.5% ➖ noise
10 datafusion:vortex-file-compressed +20.1% +7.6% +11.6% +35.1% ➖ noise
10 duckdb:vortex-compact +16.3% +7.6% +8.0% +31.5% ➖ noise
10 duckdb:vortex-file-compressed +1.4% +7.6% -5.8% +31.5% ➖ noise
11 datafusion:vortex-compact -1.6% +10.7% -11.1% +31.5% ➖ noise
11 datafusion:vortex-file-compressed +14.7% +10.7% +3.6% +51.1% ➖ noise
11 duckdb:vortex-compact +8.2% +10.7% -2.3% +31.5% ➖ noise
11 duckdb:vortex-file-compressed -0.6% +10.7% -10.2% +31.5% ➖ noise
12 datafusion:vortex-compact -6.1% -11.1% +5.6% +36.3% ➖ noise
12 datafusion:vortex-file-compressed +0.0% -11.1% +12.5% +31.5% ➖ noise
12 duckdb:vortex-compact +14.2% -11.1% +28.4% +31.5% ➖ noise
12 duckdb:vortex-file-compressed -1.9% -11.1% +10.3% +31.5% ➖ noise
13 datafusion:vortex-compact -6.0% +1.3% -7.1% +64.5% ➖ noise
13 datafusion:vortex-file-compressed +11.6% +1.3% +10.2% +47.1% ➖ noise
13 duckdb:vortex-compact -5.5% +1.3% -6.6% +48.9% ➖ noise
13 duckdb:vortex-file-compressed -9.7% +1.3% -10.8% +31.5% ➖ noise
14 datafusion:vortex-compact -27.2% -3.0% -25.0% +31.5% ✅ faster
14 datafusion:vortex-file-compressed -18.8% -3.0% -16.3% +33.0% ➖ noise
14 duckdb:vortex-compact -5.1% -3.0% -2.2% +31.5% ➖ noise
14 duckdb:vortex-file-compressed -1.7% -3.0% +1.3% +31.5% ➖ noise
15 datafusion:vortex-compact -31.5% -9.3% -24.4% +33.5% ➖ noise
15 datafusion:vortex-file-compressed -2.1% -9.3% +8.0% +31.5% ➖ noise
15 duckdb:vortex-compact +8.3% -9.3% +19.5% +42.2% ➖ noise
15 duckdb:vortex-file-compressed +8.7% -9.3% +19.9% +31.5% ➖ noise
16 datafusion:vortex-compact -8.9% +4.6% -12.9% +31.5% ➖ noise
16 datafusion:vortex-file-compressed +7.7% +4.6% +3.0% +31.5% ➖ noise
16 duckdb:vortex-compact +13.8% +4.6% +8.8% +31.5% ➖ noise
16 duckdb:vortex-file-compressed +2.3% +4.6% -2.2% +31.5% ➖ noise
17 datafusion:vortex-compact -12.3% -8.6% -4.1% +35.1% ➖ noise
17 datafusion:vortex-file-compressed +19.3% -8.6% +30.6% +48.3% ➖ noise
17 duckdb:vortex-compact -14.4% -8.6% -6.3% +31.5% ➖ noise
17 duckdb:vortex-file-compressed +4.6% -8.6% +14.4% +35.3% ➖ noise
18 datafusion:vortex-compact -16.8% -1.9% -15.2% +32.7% ➖ noise
18 datafusion:vortex-file-compressed +12.4% -1.9% +14.6% +33.5% ➖ noise
18 duckdb:vortex-compact +18.5% -1.9% +20.9% +31.5% ➖ noise
18 duckdb:vortex-file-compressed -5.9% -1.9% -4.1% +31.5% ➖ noise
19 datafusion:vortex-compact -27.3% +5.2% -30.9% +31.5% ✅ faster
19 datafusion:vortex-file-compressed -24.5% +5.2% -28.3% +31.5% ✅ faster
19 duckdb:vortex-compact +45.9% +5.2% +38.7% +31.5% 🚨 regression
19 duckdb:vortex-file-compressed -4.3% +5.2% -9.1% +31.5% ➖ noise
20 datafusion:vortex-compact -18.6% +9.6% -25.7% +31.5% ✅ faster
20 datafusion:vortex-file-compressed +2.3% +9.6% -6.6% +31.5% ➖ noise
20 duckdb:vortex-compact +3.5% +9.6% -5.6% +31.5% ➖ noise
20 duckdb:vortex-file-compressed +0.5% +9.6% -8.3% +31.5% ➖ noise
21 datafusion:vortex-compact -12.6% +9.2% -20.0% +31.5% ➖ noise
21 datafusion:vortex-file-compressed +51.3% +9.2% +38.5% +33.6% 🚨 regression
21 duckdb:vortex-compact +14.0% +9.2% +4.4% +31.8% ➖ noise
21 duckdb:vortex-file-compressed +29.0% +9.2% +18.0% +31.5% ➖ noise
22 datafusion:vortex-compact -13.8% +8.7% -20.7% +34.8% ➖ noise
22 datafusion:vortex-file-compressed +5.4% +8.7% -3.0% +31.5% ➖ noise
22 duckdb:vortex-compact +6.1% +8.7% -2.4% +34.6% ➖ noise
22 duckdb:vortex-file-compressed -4.8% +8.7% -12.4% +31.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.000x ➖


unknown / unknown (1.000x ➖, 0↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
compress time/Arade 1161821697 1171723909 0.99
compress time/Bimbo 6976329682 7058875539 0.99
compress time/CMSprovider 2940502654 2931874205 1.00
compress time/Euro2016 412301842 416816520 0.99
compress time/Food 383145838 391904667 0.98
compress time/HashTags 798276030 804322748 0.99
compress time/TPC-H l_comment canonical 1321883513 1310695560 1.01
compress time/TPC-H l_comment chunked 1352941738 1303005820 1.04
compress time/taxi 716454328 716777827 1.00
compress time/wide table cols=100 chunks=1 rows=1000 12533579 12992605 0.96
compress time/wide table cols=100 chunks=50 rows=1000 13082222 12634329 1.04
compress time/wide table cols=1000 chunks=1 rows=1000 144226680 135103572 1.07
compress time/wide table cols=1000 chunks=50 rows=1000 139198767 139933475 0.99
compress time/wide table cols=10000 chunks=1 rows=1000 1430207869 1417671732 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1424573426 1408684858 1.01
decompress time/Arade 32658608 31604882 1.03
decompress time/Bimbo 100820544 98521038 1.02
decompress time/CMSprovider 86585897 86378786 1.00
decompress time/Euro2016 21339757 21099887 1.01
decompress time/Food 9276362 10010841 0.93
decompress time/HashTags 83201174 81926635 1.02
decompress time/TPC-H l_comment canonical 41557720 40522509 1.03
decompress time/TPC-H l_comment chunked 41944874 40886262 1.03
decompress time/taxi 21664536 22147154 0.98
decompress time/wide table cols=100 chunks=1 rows=1000 2681300 2812508 0.95
decompress time/wide table cols=100 chunks=50 rows=1000 2730852 2703073 1.01
decompress time/wide table cols=1000 chunks=1 rows=1000 23902384 24475259 0.98
decompress time/wide table cols=1000 chunks=50 rows=1000 24084037 24491336 0.98
decompress time/wide table cols=10000 chunks=1 rows=1000 245325553 246905989 0.99
decompress time/wide table cols=10000 chunks=50 rows=1000 242370242 250237810 0.97
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3004030368 3030019091 0.99
parquet_rs-zstd compress time/Bimbo 17239733286 17061539661 1.01
parquet_rs-zstd compress time/CMSprovider 7711110962 7691092505 1.00
parquet_rs-zstd compress time/Euro2016 1343758803 1347894345 1.00
parquet_rs-zstd compress time/Food 941830402 927954541 1.01
parquet_rs-zstd compress time/HashTags 2453339883 2443589990 1.00
parquet_rs-zstd compress time/TPC-H l_comment canonical 3074683571 3117454469 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3104564710 3094922783 1.00
parquet_rs-zstd compress time/taxi 1505181802 1498253813 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6615344 6633598 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6519602 6671450 0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 86087003 90715619 0.95
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 89429905 85805315 1.04
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 858223919 877614048 0.98
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 862000780 893786163 0.96
parquet_rs-zstd decompress time/Arade 642820953 641593374 1.00
parquet_rs-zstd decompress time/Bimbo 1730811070 1716374052 1.01
parquet_rs-zstd decompress time/CMSprovider 1939533732 1926620572 1.01
parquet_rs-zstd decompress time/Euro2016 386241223 388964304 0.99
parquet_rs-zstd decompress time/Food 220511904 219903205 1.00
parquet_rs-zstd decompress time/HashTags 626537082 635967688 0.99
parquet_rs-zstd decompress time/TPC-H l_comment canonical 561665376 568836312 0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked 561574443 562287868 1.00
parquet_rs-zstd decompress time/taxi 244386189 245271627 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2703666 2735566 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2656115 2715296 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31331841 32939138 0.95
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31853926 32523027 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 366276812 373340892 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 364102922 376285240 0.97
vortex-file-compressed size/Arade 145363828 145363828 1.00
vortex-file-compressed size/Bimbo 468763364 468763364 1.00
vortex-file-compressed size/CMSprovider 417907844 417907844 1.00
vortex-file-compressed size/Euro2016 163394956 163599188 1.00
vortex-file-compressed size/Food 41926968 41926968 1.00
vortex-file-compressed size/HashTags 195647860 195647860 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087392 179087392 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087392 179087392 1.00
vortex-file-compressed size/taxi 52363980 52363980 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 0 0 0.96
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 1 1.06
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 🚨 1 1 1.12
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.03
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio decompress time/Food 0 0 0.92
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 1 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.9%
Vortex (geomean): 1.025x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish +3.1%


datafusion / vortex-file-compressed (1.026x ➖, 1↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 690639264 694733480 0.99
tpch_q02/datafusion:vortex-file-compressed 784302599 778675849 1.01
tpch_q03/datafusion:vortex-file-compressed 🚀 872645702 1476964760 0.59
tpch_q04/datafusion:vortex-file-compressed 597359849 757623309 0.79
tpch_q05/datafusion:vortex-file-compressed 1025788856 1180110997 0.87
tpch_q06/datafusion:vortex-file-compressed 686582487 652820694 1.05
tpch_q07/datafusion:vortex-file-compressed 1342226380 1239903661 1.08
tpch_q08/datafusion:vortex-file-compressed 🚨 2945208206 1621544453 1.82
tpch_q09/datafusion:vortex-file-compressed 1887213396 1598645123 1.18
tpch_q10/datafusion:vortex-file-compressed 1354852463 1076991465 1.26
tpch_q11/datafusion:vortex-file-compressed 657930632 604846530 1.09
tpch_q12/datafusion:vortex-file-compressed 969687850 895187025 1.08
tpch_q13/datafusion:vortex-file-compressed 450261318 426995616 1.05
tpch_q14/datafusion:vortex-file-compressed 597018076 605415117 0.99
tpch_q15/datafusion:vortex-file-compressed 1165994708 1133951587 1.03
tpch_q16/datafusion:vortex-file-compressed 370336511 408711957 0.91
tpch_q17/datafusion:vortex-file-compressed 1179798803 1277036002 0.92
tpch_q18/datafusion:vortex-file-compressed 1308457057 1363859068 0.96
tpch_q19/datafusion:vortex-file-compressed 824012483 836300139 0.99
tpch_q20/datafusion:vortex-file-compressed 1107458800 1025289133 1.08
tpch_q21/datafusion:vortex-file-compressed 1854567450 1671174638 1.11
tpch_q22/datafusion:vortex-file-compressed 559311979 473423312 1.18
datafusion / vortex-compact (0.965x ➖, 2↑ 2↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 706774188 697190985 1.01
tpch_q02/datafusion:vortex-compact 867880959 834477466 1.04
tpch_q03/datafusion:vortex-compact 🚀 780777932 1158101256 0.67
tpch_q04/datafusion:vortex-compact 600040859 695266077 0.86
tpch_q05/datafusion:vortex-compact 922495253 956694283 0.96
tpch_q06/datafusion:vortex-compact 618914964 613150633 1.01
tpch_q07/datafusion:vortex-compact 1084941131 1018992062 1.06
tpch_q08/datafusion:vortex-compact 1112975226 1356483661 0.82
tpch_q09/datafusion:vortex-compact 1323329762 1337576146 0.99
tpch_q10/datafusion:vortex-compact 1074929013 933338628 1.15
tpch_q11/datafusion:vortex-compact 423959330 562093362 0.75
tpch_q12/datafusion:vortex-compact 906975057 1204231088 0.75
tpch_q13/datafusion:vortex-compact 425351505 455974384 0.93
tpch_q14/datafusion:vortex-compact 675824057 735239303 0.92
tpch_q15/datafusion:vortex-compact 1415994382 1469634229 0.96
tpch_q16/datafusion:vortex-compact 🚀 509946995 732911486 0.70
tpch_q17/datafusion:vortex-compact 1268748578 1223045199 1.04
tpch_q18/datafusion:vortex-compact 1196131974 1188219078 1.01
tpch_q19/datafusion:vortex-compact 🚨 1502854673 1151067595 1.31
tpch_q20/datafusion:vortex-compact 1374372302 1101888528 1.25
tpch_q21/datafusion:vortex-compact 1637399975 1670635979 0.98
tpch_q22/datafusion:vortex-compact 🚨 693423885 488638109 1.42
datafusion / parquet (0.910x ➖, 3↑ 1↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 837245408 828880643 1.01
tpch_q02/datafusion:parquet 🚨 1186950603 827291253 1.43
tpch_q03/datafusion:parquet 1315500165 1076621784 1.22
tpch_q04/datafusion:parquet 580823902 709311286 0.82
tpch_q05/datafusion:parquet 🚀 1275803382 2097896205 0.61
tpch_q06/datafusion:parquet 🚀 616079818 917378465 0.67
tpch_q07/datafusion:parquet 1285437726 1725585850 0.74
tpch_q08/datafusion:parquet 1761263916 1870552590 0.94
tpch_q09/datafusion:parquet 1788631600 2047294713 0.87
tpch_q10/datafusion:parquet 🚀 1964459830 3156715826 0.62
tpch_q11/datafusion:parquet 616260570 779493931 0.79
tpch_q12/datafusion:parquet 780103750 683990654 1.14
tpch_q13/datafusion:parquet 765557473 702341840 1.09
tpch_q14/datafusion:parquet 907737472 838549648 1.08
tpch_q15/datafusion:parquet 1362793457 1233799443 1.10
tpch_q16/datafusion:parquet 470052276 415041092 1.13
tpch_q17/datafusion:parquet 1465520838 1376854798 1.06
tpch_q18/datafusion:parquet 1490066684 1782182174 0.84
tpch_q19/datafusion:parquet 1108923732 1292764564 0.86
tpch_q20/datafusion:parquet 1320385578 1661936069 0.79
tpch_q21/datafusion:parquet 1844069088 2253432283 0.82
tpch_q22/datafusion:parquet 986932411 1167118270 0.85
duckdb / vortex-file-compressed (1.048x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 638573638 646903509 0.99
tpch_q02/duckdb:vortex-file-compressed 1226090295 1182261745 1.04
tpch_q03/duckdb:vortex-file-compressed 1098549589 989889197 1.11
tpch_q04/duckdb:vortex-file-compressed 742670542 804824021 0.92
tpch_q05/duckdb:vortex-file-compressed 1158909095 1218190495 0.95
tpch_q06/duckdb:vortex-file-compressed 844208879 812516581 1.04
tpch_q07/duckdb:vortex-file-compressed 1268849492 1117503944 1.14
tpch_q08/duckdb:vortex-file-compressed 1487819713 1471597515 1.01
tpch_q09/duckdb:vortex-file-compressed 1574297858 1408565268 1.12
tpch_q10/duckdb:vortex-file-compressed 1282074939 1142996646 1.12
tpch_q11/duckdb:vortex-file-compressed 665591151 712615815 0.93
tpch_q12/duckdb:vortex-file-compressed 893652563 715028101 1.25
tpch_q13/duckdb:vortex-file-compressed 957715795 953098135 1.00
tpch_q14/duckdb:vortex-file-compressed 833030651 856943458 0.97
tpch_q15/duckdb:vortex-file-compressed 569178328 537234880 1.06
tpch_q16/duckdb:vortex-file-compressed 516370172 488073741 1.06
tpch_q17/duckdb:vortex-file-compressed 1058180518 1004654181 1.05
tpch_q18/duckdb:vortex-file-compressed 940904466 900369347 1.05
tpch_q19/duckdb:vortex-file-compressed 784119681 798816423 0.98
tpch_q20/duckdb:vortex-file-compressed 1287498890 1205690620 1.07
tpch_q21/duckdb:vortex-file-compressed 2094356190 2003474326 1.05
tpch_q22/duckdb:vortex-file-compressed 761960953 623258668 1.22
duckdb / vortex-compact (1.063x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 628425105 616480558 1.02
tpch_q02/duckdb:vortex-compact 1155939833 1042533385 1.11
tpch_q03/duckdb:vortex-compact 862671016 812400370 1.06
tpch_q04/duckdb:vortex-compact 624287859 511274130 1.22
tpch_q05/duckdb:vortex-compact 1096483419 1041456949 1.05
tpch_q06/duckdb:vortex-compact 753679547 786744264 0.96
tpch_q07/duckdb:vortex-compact 1153699028 1013159579 1.14
tpch_q08/duckdb:vortex-compact 1438951401 1316720019 1.09
tpch_q09/duckdb:vortex-compact 1393855472 1341704903 1.04
tpch_q10/duckdb:vortex-compact 1094094317 1012674620 1.08
tpch_q11/duckdb:vortex-compact 702319322 634156820 1.11
tpch_q12/duckdb:vortex-compact 748445978 775050574 0.97
tpch_q13/duckdb:vortex-compact 870400567 893794999 0.97
tpch_q14/duckdb:vortex-compact 927296744 875494448 1.06
tpch_q15/duckdb:vortex-compact 570174164 555056539 1.03
tpch_q16/duckdb:vortex-compact 451450211 433183508 1.04
tpch_q17/duckdb:vortex-compact 941313994 932560784 1.01
tpch_q18/duckdb:vortex-compact 942989770 794831067 1.19
tpch_q19/duckdb:vortex-compact 751612640 767844877 0.98
tpch_q20/duckdb:vortex-compact 1239980701 1166825534 1.06
tpch_q21/duckdb:vortex-compact 1805951267 1722446423 1.05
tpch_q22/duckdb:vortex-compact 770702041 637874709 1.21
duckdb / parquet (1.089x ➖, 0↑ 0↓)
name PR 2f9a5e2 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 989398092 860472089 1.15
tpch_q02/duckdb:parquet 1719710997 1636559436 1.05
tpch_q03/duckdb:parquet 1762929013 1755187079 1.00
tpch_q04/duckdb:parquet 1191686722 1062290377 1.12
tpch_q05/duckdb:parquet 2456176625 2134884259 1.15
tpch_q06/duckdb:parquet 780467807 717193795 1.09
tpch_q07/duckdb:parquet 1977550830 1884825928 1.05
tpch_q08/duckdb:parquet 2888893898 2392130719 1.21
tpch_q09/duckdb:parquet 2672766671 2524677649 1.06
tpch_q10/duckdb:parquet 3088449691 3063830297 1.01
tpch_q11/duckdb:parquet 1097737495 1104838442 0.99
tpch_q12/duckdb:parquet 1243030952 1207285191 1.03
tpch_q13/duckdb:parquet 1364395601 1146144551 1.19
tpch_q14/duckdb:parquet 1263664437 1200471791 1.05
tpch_q15/duckdb:parquet 817986200 907029706 0.90
tpch_q16/duckdb:parquet 1010108711 812537517 1.24
tpch_q17/duckdb:parquet 1575294579 1368832671 1.15
tpch_q18/duckdb:parquet 1532027562 1306996870 1.17
tpch_q19/duckdb:parquet 1611629315 1424535168 1.13
tpch_q20/duckdb:parquet 2036042456 1843833701 1.10
tpch_q21/duckdb:parquet 1902258478 1705882598 1.12
tpch_q22/duckdb:parquet 1133781202 1072583095 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.4% +7.8% -5.9% +49.6% ➖ noise
1 datafusion:vortex-file-compressed -0.6% +7.8% -7.8% +50.7% ➖ noise
1 duckdb:vortex-compact +1.9% +7.8% -5.4% +36.7% ➖ noise
1 duckdb:vortex-file-compressed -1.3% +7.8% -8.4% +34.9% ➖ noise
2 datafusion:vortex-compact +4.0% +22.8% -15.3% +43.4% ➖ noise
2 datafusion:vortex-file-compressed +0.7% +22.8% -18.0% +39.7% ➖ noise
2 duckdb:vortex-compact +10.9% +22.8% -9.7% +34.9% ➖ noise
2 duckdb:vortex-file-compressed +3.7% +22.8% -15.5% +36.2% ➖ noise
3 datafusion:vortex-compact -32.6% +10.8% -39.1% +46.6% ✅ faster
3 datafusion:vortex-file-compressed -40.9% +10.8% -46.7% +97.0% ➖ noise
3 duckdb:vortex-compact +6.2% +10.8% -4.1% +36.1% ➖ noise
3 duckdb:vortex-file-compressed +11.0% +10.8% +0.2% +39.4% ➖ noise
4 datafusion:vortex-compact -13.7% -4.2% -10.0% +34.9% ➖ noise
4 datafusion:vortex-file-compressed -21.2% -4.2% -17.7% +34.9% ➖ noise
4 duckdb:vortex-compact +22.1% -4.2% +27.4% +34.9% ➖ noise
4 duckdb:vortex-file-compressed -7.7% -4.2% -3.7% +34.9% ➖ noise
5 datafusion:vortex-compact -3.6% -16.4% +15.3% +34.9% ➖ noise
5 datafusion:vortex-file-compressed -13.1% -16.4% +3.9% +34.9% ➖ noise
5 duckdb:vortex-compact +5.3% -16.4% +25.9% +34.9% ➖ noise
5 duckdb:vortex-file-compressed -4.9% -16.4% +13.7% +34.9% ➖ noise
6 datafusion:vortex-compact +0.9% -14.5% +18.1% +34.9% ➖ noise
6 datafusion:vortex-file-compressed +5.2% -14.5% +23.0% +34.9% ➖ noise
6 duckdb:vortex-compact -4.2% -14.5% +12.1% +34.9% ➖ noise
6 duckdb:vortex-file-compressed +3.9% -14.5% +21.5% +34.9% ➖ noise
7 datafusion:vortex-compact +6.5% -11.6% +20.4% +34.9% ➖ noise
7 datafusion:vortex-file-compressed +8.3% -11.6% +22.4% +34.9% ➖ noise
7 duckdb:vortex-compact +13.9% -11.6% +28.8% +34.9% ➖ noise
7 duckdb:vortex-file-compressed +13.5% -11.6% +28.4% +34.9% ➖ noise
8 datafusion:vortex-compact -18.0% +6.6% -23.1% +34.9% ➖ noise
8 datafusion:vortex-file-compressed +81.6% +6.6% +70.3% +41.9% 🚨 regression
8 duckdb:vortex-compact +9.3% +6.6% +2.5% +34.9% ➖ noise
8 duckdb:vortex-file-compressed +1.1% +6.6% -5.2% +34.9% ➖ noise
9 datafusion:vortex-compact -1.1% -3.8% +2.9% +34.9% ➖ noise
9 datafusion:vortex-file-compressed +18.1% -3.8% +22.7% +34.9% ➖ noise
9 duckdb:vortex-compact +3.9% -3.8% +8.0% +34.9% ➖ noise
9 duckdb:vortex-file-compressed +11.8% -3.8% +16.2% +34.9% ➖ noise
10 datafusion:vortex-compact +15.2% -20.8% +45.4% +34.9% 🚨 regression
10 datafusion:vortex-file-compressed +25.8% -20.8% +58.8% +34.9% 🚨 regression
10 duckdb:vortex-compact +8.0% -20.8% +36.4% +34.9% 🚨 regression
10 duckdb:vortex-file-compressed +12.2% -20.8% +41.6% +34.9% 🚨 regression
11 datafusion:vortex-compact -24.6% -11.4% -14.9% +34.9% ➖ noise
11 datafusion:vortex-file-compressed +8.8% -11.4% +22.7% +41.0% ➖ noise
11 duckdb:vortex-compact +10.7% -11.4% +25.0% +34.9% ➖ noise
11 duckdb:vortex-file-compressed -6.6% -11.4% +5.4% +34.9% ➖ noise
12 datafusion:vortex-compact -24.7% +8.4% -30.5% +34.9% ✅ faster
12 datafusion:vortex-file-compressed +8.3% +8.4% -0.0% +34.9% ➖ noise
12 duckdb:vortex-compact -3.4% +8.4% -10.9% +34.9% ➖ noise
12 duckdb:vortex-file-compressed +25.0% +8.4% +15.3% +34.9% ➖ noise
13 datafusion:vortex-compact -6.7% +13.9% -18.1% +34.9% ➖ noise
13 datafusion:vortex-file-compressed +5.4% +13.9% -7.4% +34.9% ➖ noise
13 duckdb:vortex-compact -2.6% +13.9% -14.5% +42.9% ➖ noise
13 duckdb:vortex-file-compressed +0.5% +13.9% -11.8% +39.9% ➖ noise
14 datafusion:vortex-compact -8.1% +6.7% -13.9% +34.9% ➖ noise
14 datafusion:vortex-file-compressed -1.4% +6.7% -7.6% +34.9% ➖ noise
14 duckdb:vortex-compact +5.9% +6.7% -0.8% +34.9% ➖ noise
14 duckdb:vortex-file-compressed -2.8% +6.7% -8.9% +34.9% ➖ noise
15 datafusion:vortex-compact -3.6% -0.2% -3.5% +34.9% ➖ noise
15 datafusion:vortex-file-compressed +2.8% -0.2% +3.0% +34.9% ➖ noise
15 duckdb:vortex-compact +2.7% -0.2% +2.9% +34.9% ➖ noise
15 duckdb:vortex-file-compressed +5.9% -0.2% +6.2% +34.9% ➖ noise
16 datafusion:vortex-compact -30.4% +18.7% -41.4% +43.9% ✅ faster
16 datafusion:vortex-file-compressed -9.4% +18.7% -23.6% +34.9% ➖ noise
16 duckdb:vortex-compact +4.2% +18.7% -12.2% +34.9% ➖ noise
16 duckdb:vortex-file-compressed +5.8% +18.7% -10.8% +34.9% ➖ noise
17 datafusion:vortex-compact +3.7% +10.7% -6.3% +34.9% ➖ noise
17 datafusion:vortex-file-compressed -7.6% +10.7% -16.5% +34.9% ➖ noise
17 duckdb:vortex-compact +0.9% +10.7% -8.8% +34.9% ➖ noise
17 duckdb:vortex-file-compressed +5.3% +10.7% -4.8% +34.9% ➖ noise
18 datafusion:vortex-compact +0.7% -1.0% +1.7% +34.9% ➖ noise
18 datafusion:vortex-file-compressed -4.1% -1.0% -3.1% +34.9% ➖ noise
18 duckdb:vortex-compact +18.6% -1.0% +19.8% +34.9% ➖ noise
18 duckdb:vortex-file-compressed +4.5% -1.0% +5.6% +34.9% ➖ noise
19 datafusion:vortex-compact +30.6% -1.5% +32.5% +34.9% ➖ noise
19 datafusion:vortex-file-compressed -1.5% -1.5% +0.0% +34.9% ➖ noise
19 duckdb:vortex-compact -2.1% -1.5% -0.6% +34.9% ➖ noise
19 duckdb:vortex-file-compressed -1.8% -1.5% -0.4% +34.9% ➖ noise
20 datafusion:vortex-compact +24.7% -6.3% +33.2% +35.5% ➖ noise
20 datafusion:vortex-file-compressed +8.0% -6.3% +15.3% +39.3% ➖ noise
20 duckdb:vortex-compact +6.3% -6.3% +13.5% +34.9% ➖ noise
20 duckdb:vortex-file-compressed +6.8% -6.3% +14.0% +34.9% ➖ noise
21 datafusion:vortex-compact -2.0% -4.5% +2.6% +34.9% ➖ noise
21 datafusion:vortex-file-compressed +11.0% -4.5% +16.2% +34.9% ➖ noise
21 duckdb:vortex-compact +4.8% -4.5% +9.8% +34.9% ➖ noise
21 duckdb:vortex-file-compressed +4.5% -4.5% +9.4% +34.9% ➖ noise
22 datafusion:vortex-compact +41.9% -5.5% +50.1% +38.7% 🚨 regression
22 datafusion:vortex-file-compressed +18.1% -5.5% +25.0% +36.1% ➖ noise
22 duckdb:vortex-compact +20.8% -5.5% +27.8% +34.9% ➖ noise
22 duckdb:vortex-file-compressed +22.3% -5.5% +29.3% +34.9% ➖ noise

@connortsui20 connortsui20 deleted the revert-7507-ct/extension-constant branch April 18, 2026 00:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants