Skip to content

add unstable encodings and patches to benchmarks#7426

Merged
joseph-isaacs merged 4 commits intodevelopfrom
ji/add-more-exp
Apr 14, 2026
Merged

add unstable encodings and patches to benchmarks#7426
joseph-isaacs merged 4 commits intodevelopfrom
ji/add-more-exp

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Apr 14, 2026

Summary

Closes: #000

Testing

@joseph-isaacs
fix
4f5dadd 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 799cae2 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done e91b4d2 1 Explore Profiling Data
🟢 Done 4f5dadd 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 0.861x ✅
Parquet (geomean): 0.863x ✅
Shifts: Parquet (control) -13.7% · Median polish -13.2%

datafusion / vortex-file-compressed (0.886x ✅, 4↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 5256275 6648398 0.79
fineweb_q01/datafusion:vortex-file-compressed 26861468 29540652 0.91
fineweb_q02/datafusion:vortex-file-compressed 🚀 28413512 34629868 0.82
fineweb_q03/datafusion:vortex-file-compressed 83926883 87539350 0.96
fineweb_q04/datafusion:vortex-file-compressed 🚀 254812617 289654846 0.88
fineweb_q05/datafusion:vortex-file-compressed 236279407 249689847 0.95
fineweb_q06/datafusion:vortex-file-compressed 72795149 73212421 0.99
fineweb_q07/datafusion:vortex-file-compressed 69495253 76609314 0.91
fineweb_q08/datafusion:vortex-file-compressed 🚀 26615124 33567840 0.79
datafusion / vortex-compact (0.861x ✅, 8↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5171408 5690698 0.91
fineweb_q01/datafusion:vortex-compact 🚀 161954688 184952456 0.88
fineweb_q02/datafusion:vortex-compact 🚀 163698096 187909453 0.87
fineweb_q03/datafusion:vortex-compact 🚀 1447210352 1673701433 0.86
fineweb_q04/datafusion:vortex-compact 🚀 1551185296 1823992862 0.85
fineweb_q05/datafusion:vortex-compact 🚀 1229946988 1451141294 0.85
fineweb_q06/datafusion:vortex-compact 🚀 696133470 814280498 0.85
fineweb_q07/datafusion:vortex-compact 🚀 729809150 866675555 0.84
fineweb_q08/datafusion:vortex-compact 🚀 23404340 27902814 0.84
datafusion / parquet (0.870x ✅, 8↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 6521578 7395731 0.88
fineweb_q01/datafusion:parquet 🚀 279222632 328743364 0.85
fineweb_q02/datafusion:parquet 🚀 278523254 327539544 0.85
fineweb_q03/datafusion:parquet 292193577 321666602 0.91
fineweb_q04/datafusion:parquet 🚀 295609370 334950186 0.88
fineweb_q05/datafusion:parquet 🚀 293799352 332681460 0.88
fineweb_q06/datafusion:parquet 🚀 281404975 340466617 0.83
fineweb_q07/datafusion:parquet 🚀 280515210 320016904 0.88
fineweb_q08/datafusion:parquet 🚀 280351993 319314424 0.88
duckdb / vortex-file-compressed (0.850x ✅, 7↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3251845 4036189 0.81
fineweb_q01/duckdb:vortex-file-compressed 🚀 24494825 29412172 0.83
fineweb_q02/duckdb:vortex-file-compressed 27222013 29719409 0.92
fineweb_q03/duckdb:vortex-file-compressed 🚀 149055455 188489119 0.79
fineweb_q04/duckdb:vortex-file-compressed 🚀 234078454 266328417 0.88
fineweb_q05/duckdb:vortex-file-compressed 222277078 240504494 0.92
fineweb_q06/duckdb:vortex-file-compressed 🚀 62928106 80873321 0.78
fineweb_q07/duckdb:vortex-file-compressed 🚀 71824664 81283847 0.88
fineweb_q08/duckdb:vortex-file-compressed 🚀 23921512 27917903 0.86
duckdb / vortex-compact (0.848x ✅, 7↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 4058659 4972163 0.82
fineweb_q01/duckdb:vortex-compact 104419935 111141180 0.94
fineweb_q02/duckdb:vortex-compact 117044419 129661077 0.90
fineweb_q03/duckdb:vortex-compact 🚀 863498894 1031491078 0.84
fineweb_q04/duckdb:vortex-compact 🚀 913123887 1095860389 0.83
fineweb_q05/duckdb:vortex-compact 🚀 805526881 981945777 0.82
fineweb_q06/duckdb:vortex-compact 🚀 458136780 554643802 0.83
fineweb_q07/duckdb:vortex-compact 🚀 474068501 568593929 0.83
fineweb_q08/duckdb:vortex-compact 🚀 21161897 25554452 0.83
duckdb / parquet (0.855x ✅, 9↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 34962853 41334899 0.85
fineweb_q01/duckdb:parquet 🚀 91716548 107275406 0.85
fineweb_q02/duckdb:parquet 🚀 96077000 112334748 0.86
fineweb_q03/duckdb:parquet 🚀 305035672 355054367 0.86
fineweb_q04/duckdb:parquet 🚀 437447001 497633000 0.88
fineweb_q05/duckdb:parquet 🚀 408624103 467195465 0.87
fineweb_q06/duckdb:parquet 🚀 197393794 229304417 0.86
fineweb_q07/duckdb:parquet 🚀 208549011 240731248 0.87
fineweb_q08/duckdb:parquet 🚀 56171125 70048735 0.80
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -9.1% -13.6% +5.2% +35.9% ➖ noise
0 datafusion:vortex-file-compressed -20.9% -13.6% -8.5% +47.6% ➖ noise
0 duckdb:vortex-compact -18.4% -13.6% -5.5% +33.1% ➖ noise
0 duckdb:vortex-file-compressed -19.4% -13.6% -6.7% +41.1% ➖ noise
1 datafusion:vortex-compact -12.4% -14.8% +2.8% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -9.1% -14.8% +6.7% +20.2% ➖ noise
1 duckdb:vortex-compact -6.0% -14.8% +10.3% +19.3% ➖ noise
1 duckdb:vortex-file-compressed -16.7% -14.8% -2.3% +46.3% ➖ noise
2 datafusion:vortex-compact -12.9% -14.7% +2.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -18.0% -14.7% -3.8% +21.0% ➖ noise
2 duckdb:vortex-compact -9.7% -14.7% +5.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -8.4% -14.7% +7.4% +14.5% ➖ noise
3 datafusion:vortex-compact -13.5% -11.7% -2.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -4.1% -11.7% +8.5% +26.1% ➖ noise
3 duckdb:vortex-compact -16.3% -11.7% -5.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -20.9% -11.7% -10.5% +23.1% ➖ noise
4 datafusion:vortex-compact -15.0% -11.9% -3.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -12.0% -11.9% -0.1% +10.0% ➖ noise
4 duckdb:vortex-compact -16.7% -11.9% -5.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -12.1% -11.9% -0.2% +10.0% ➖ noise
5 datafusion:vortex-compact -15.2% -12.1% -3.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.4% -12.1% +7.7% +10.0% ➖ noise
5 duckdb:vortex-compact -18.0% -12.1% -6.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -7.6% -12.1% +5.2% +10.0% ➖ noise
6 datafusion:vortex-compact -14.5% -15.6% +1.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.6% -15.6% +17.9% +20.8% ➖ noise
6 duckdb:vortex-compact -17.4% -15.6% -2.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -22.2% -15.6% -7.8% +14.4% ➖ noise
7 datafusion:vortex-compact -15.8% -12.9% -3.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -9.3% -12.9% +4.1% +14.9% ➖ noise
7 duckdb:vortex-compact -16.6% -12.9% -4.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -11.6% -12.9% +1.4% +17.2% ➖ noise
8 datafusion:vortex-compact -16.1% -16.1% -0.0% +24.5% ➖ noise
8 datafusion:vortex-file-compressed -20.7% -16.1% -5.5% +46.0% ➖ noise
8 duckdb:vortex-compact -17.2% -16.1% -1.3% +34.1% ➖ noise
8 duckdb:vortex-file-compressed -14.3% -16.1% +2.1% +14.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.007x ➖

datafusion / vortex-file-compressed (1.007x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 124619900 123221483 1.01
polarsignals_q01/datafusion:vortex-file-compressed 362028818 371251975 0.98
polarsignals_q02/datafusion:vortex-file-compressed 22391863 22668979 0.99
polarsignals_q03/datafusion:vortex-file-compressed 374385981 365562330 1.02
polarsignals_q04/datafusion:vortex-file-compressed 11703577 10640591 1.10
polarsignals_q05/datafusion:vortex-file-compressed 15279145 15730463 0.97
polarsignals_q06/datafusion:vortex-file-compressed 18387409 18057749 1.02
polarsignals_q07/datafusion:vortex-file-compressed 13164631 12809357 1.03
polarsignals_q08/datafusion:vortex-file-compressed 454375711 453979181 1.00
polarsignals_q09/datafusion:vortex-file-compressed 10353577 10777406 0.96

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.06 MB 689.06 MB +40 B +0.0%

Totals:

  • vortex-file-compressed: 689.06 MB → 689.06 MB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 0.975x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -1.5%

datafusion / vortex-file-compressed (0.992x ➖, 2↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 30841213 29208881 1.06
tpcds_q02/datafusion:vortex-file-compressed 56744451 55703235 1.02
tpcds_q03/datafusion:vortex-file-compressed 21482538 22064451 0.97
tpcds_q04/datafusion:vortex-file-compressed 317427075 324600311 0.98
tpcds_q05/datafusion:vortex-file-compressed 57694027 55348375 1.04
tpcds_q06/datafusion:vortex-file-compressed 53496153 55452307 0.96
tpcds_q07/datafusion:vortex-file-compressed 53000307 55277567 0.96
tpcds_q08/datafusion:vortex-file-compressed 37555456 40104699 0.94
tpcds_q09/datafusion:vortex-file-compressed 🚨 58603870 51591614 1.14
tpcds_q10/datafusion:vortex-file-compressed 🚀 44059696 49659921 0.89
tpcds_q11/datafusion:vortex-file-compressed 181651319 183549141 0.99
tpcds_q12/datafusion:vortex-file-compressed 24727903 26113246 0.95
tpcds_q13/datafusion:vortex-file-compressed 55491238 57737116 0.96
tpcds_q14/datafusion:vortex-file-compressed 214538885 221026290 0.97
tpcds_q15/datafusion:vortex-file-compressed 36593886 36531427 1.00
tpcds_q16/datafusion:vortex-file-compressed 30483825 31781280 0.96
tpcds_q17/datafusion:vortex-file-compressed 67361364 71224603 0.95
tpcds_q18/datafusion:vortex-file-compressed 81892705 84631604 0.97
tpcds_q19/datafusion:vortex-file-compressed 31563223 33221047 0.95
tpcds_q20/datafusion:vortex-file-compressed 28173324 27881864 1.01
tpcds_q21/datafusion:vortex-file-compressed 147626607 153393298 0.96
tpcds_q22/datafusion:vortex-file-compressed 60749552 63478369 0.96
tpcds_q23/datafusion:vortex-file-compressed 155199296 164152771 0.95
tpcds_q24/datafusion:vortex-file-compressed 115298527 125251046 0.92
tpcds_q25/datafusion:vortex-file-compressed 70837647 70985629 1.00
tpcds_q26/datafusion:vortex-file-compressed 38775141 40721113 0.95
tpcds_q27/datafusion:vortex-file-compressed 126438203 128814991 0.98
tpcds_q28/datafusion:vortex-file-compressed 48322658 46096601 1.05
tpcds_q29/datafusion:vortex-file-compressed 69789028 69457904 1.00
tpcds_q30/datafusion:vortex-file-compressed 32449504 32088064 1.01
tpcds_q31/datafusion:vortex-file-compressed 100425608 97687129 1.03
tpcds_q32/datafusion:vortex-file-compressed 22588011 22828684 0.99
tpcds_q33/datafusion:vortex-file-compressed 39041124 38832991 1.01
tpcds_q34/datafusion:vortex-file-compressed 33011198 34895082 0.95
tpcds_q35/datafusion:vortex-file-compressed 53910382 54790959 0.98
tpcds_q36/datafusion:vortex-file-compressed 80197460 77356252 1.04
tpcds_q37/datafusion:vortex-file-compressed 34920125 34505541 1.01
tpcds_q38/datafusion:vortex-file-compressed 53900308 54032620 1.00
tpcds_q39/datafusion:vortex-file-compressed 145825300 145837147 1.00
tpcds_q40/datafusion:vortex-file-compressed 56734762 56282954 1.01
tpcds_q41/datafusion:vortex-file-compressed 19320395 19670490 0.98
tpcds_q42/datafusion:vortex-file-compressed 19530924 19762334 0.99
tpcds_q43/datafusion:vortex-file-compressed 34449532 33477661 1.03
tpcds_q44/datafusion:vortex-file-compressed 42075688 43864391 0.96
tpcds_q45/datafusion:vortex-file-compressed 36820662 36508963 1.01
tpcds_q46/datafusion:vortex-file-compressed 50396830 47116355 1.07
tpcds_q47/datafusion:vortex-file-compressed 218442655 221077381 0.99
tpcds_q48/datafusion:vortex-file-compressed 45933594 43487643 1.06
tpcds_q49/datafusion:vortex-file-compressed 74067861 73023442 1.01
tpcds_q50/datafusion:vortex-file-compressed 47359142 49870741 0.95
tpcds_q51/datafusion:vortex-file-compressed 95931897 95336028 1.01
tpcds_q52/datafusion:vortex-file-compressed 20608937 18875659 1.09
tpcds_q53/datafusion:vortex-file-compressed 27311994 27314393 1.00
tpcds_q54/datafusion:vortex-file-compressed 44416963 45714665 0.97
tpcds_q55/datafusion:vortex-file-compressed 20100788 20001557 1.00
tpcds_q56/datafusion:vortex-file-compressed 41064039 42635584 0.96
tpcds_q57/datafusion:vortex-file-compressed 132620157 135332164 0.98
tpcds_q58/datafusion:vortex-file-compressed 75132202 74687434 1.01
tpcds_q59/datafusion:vortex-file-compressed 72778922 73679621 0.99
tpcds_q60/datafusion:vortex-file-compressed 39710477 42962428 0.92
tpcds_q61/datafusion:vortex-file-compressed 50600020 52771760 0.96
tpcds_q62/datafusion:vortex-file-compressed 33306856 31962059 1.04
tpcds_q63/datafusion:vortex-file-compressed 26247618 25697856 1.02
tpcds_q64/datafusion:vortex-file-compressed 489011220 484629873 1.01
tpcds_q65/datafusion:vortex-file-compressed 52142201 50807582 1.03
tpcds_q66/datafusion:vortex-file-compressed 96902170 103305650 0.94
tpcds_q67/datafusion:vortex-file-compressed 121277960 131058143 0.93
tpcds_q68/datafusion:vortex-file-compressed 48961381 48140174 1.02
tpcds_q69/datafusion:vortex-file-compressed 43846554 43856693 1.00
tpcds_q70/datafusion:vortex-file-compressed 116529844 118658284 0.98
tpcds_q71/datafusion:vortex-file-compressed 🚀 31229660 34998539 0.89
tpcds_q72/datafusion:vortex-file-compressed 2866509668 2810671766 1.02
tpcds_q73/datafusion:vortex-file-compressed 33452419 34365046 0.97
tpcds_q74/datafusion:vortex-file-compressed 122187453 118979352 1.03
tpcds_q75/datafusion:vortex-file-compressed 124462256 128148929 0.97
tpcds_q76/datafusion:vortex-file-compressed 36616267 35824298 1.02
tpcds_q77/datafusion:vortex-file-compressed 54633185 52617874 1.04
tpcds_q78/datafusion:vortex-file-compressed 133290395 133258520 1.00
tpcds_q79/datafusion:vortex-file-compressed 39833774 39125859 1.02
tpcds_q80/datafusion:vortex-file-compressed 120537386 117613801 1.02
tpcds_q81/datafusion:vortex-file-compressed 38686159 38824400 1.00
tpcds_q82/datafusion:vortex-file-compressed 39250907 37998843 1.03
tpcds_q83/datafusion:vortex-file-compressed 53196574 50081343 1.06
tpcds_q84/datafusion:vortex-file-compressed 17466248 16363358 1.07
tpcds_q85/datafusion:vortex-file-compressed 106617205 104610201 1.02
tpcds_q86/datafusion:vortex-file-compressed 20908047 19586139 1.07
tpcds_q87/datafusion:vortex-file-compressed 55459722 56335845 0.98
tpcds_q88/datafusion:vortex-file-compressed 69934286 77111392 0.91
tpcds_q89/datafusion:vortex-file-compressed 37754002 38260145 0.99
tpcds_q90/datafusion:vortex-file-compressed 18674996 19534471 0.96
tpcds_q91/datafusion:vortex-file-compressed 26243738 27947199 0.94
tpcds_q92/datafusion:vortex-file-compressed 20596970 19967399 1.03
tpcds_q93/datafusion:vortex-file-compressed 35832939 36432694 0.98
tpcds_q94/datafusion:vortex-file-compressed 26718946 27129194 0.98
tpcds_q95/datafusion:vortex-file-compressed 64685482 64438607 1.00
tpcds_q96/datafusion:vortex-file-compressed 15784311 16892949 0.93
tpcds_q97/datafusion:vortex-file-compressed 32338145 31313640 1.03
tpcds_q98/datafusion:vortex-file-compressed 34599831 34667572 1.00
tpcds_q99/datafusion:vortex-file-compressed 47981212 48877089 0.98
datafusion / vortex-compact (0.981x ➖, 2↑ 2↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 36815182 38907425 0.95
tpcds_q02/datafusion:vortex-compact 63264547 63608191 0.99
tpcds_q03/datafusion:vortex-compact 27752011 28647525 0.97
tpcds_q04/datafusion:vortex-compact 348375472 355085795 0.98
tpcds_q05/datafusion:vortex-compact 67717531 72143215 0.94
tpcds_q06/datafusion:vortex-compact 🚀 57662193 65830672 0.88
tpcds_q07/datafusion:vortex-compact 66516095 71911101 0.92
tpcds_q08/datafusion:vortex-compact 47054994 49547674 0.95
tpcds_q09/datafusion:vortex-compact 74879167 73315259 1.02
tpcds_q10/datafusion:vortex-compact 68011398 68066235 1.00
tpcds_q11/datafusion:vortex-compact 196781907 216218025 0.91
tpcds_q12/datafusion:vortex-compact 29500007 32105453 0.92
tpcds_q13/datafusion:vortex-compact 120316168 127876248 0.94
tpcds_q14/datafusion:vortex-compact 268653853 274578248 0.98
tpcds_q15/datafusion:vortex-compact 41340918 44824633 0.92
tpcds_q16/datafusion:vortex-compact 38767681 41450577 0.94
tpcds_q17/datafusion:vortex-compact 95345391 99822266 0.96
tpcds_q18/datafusion:vortex-compact 92674143 95680078 0.97
tpcds_q19/datafusion:vortex-compact 45024808 48628265 0.93
tpcds_q20/datafusion:vortex-compact 31873438 32497597 0.98
tpcds_q21/datafusion:vortex-compact 151551485 153403297 0.99
tpcds_q22/datafusion:vortex-compact 69157496 68269436 1.01
tpcds_q23/datafusion:vortex-compact 191959658 191859716 1.00
tpcds_q24/datafusion:vortex-compact 144409400 152690389 0.95
tpcds_q25/datafusion:vortex-compact 97153381 99470386 0.98
tpcds_q26/datafusion:vortex-compact 47746839 49706980 0.96
tpcds_q27/datafusion:vortex-compact 165099831 166889476 0.99
tpcds_q28/datafusion:vortex-compact 86435670 85315025 1.01
tpcds_q29/datafusion:vortex-compact 96319881 97002551 0.99
tpcds_q30/datafusion:vortex-compact 🚨 38926791 35320942 1.10
tpcds_q31/datafusion:vortex-compact 140074025 136697368 1.02
tpcds_q32/datafusion:vortex-compact 27346908 28911143 0.95
tpcds_q33/datafusion:vortex-compact 55533047 54889845 1.01
tpcds_q34/datafusion:vortex-compact 53327034 53007942 1.01
tpcds_q35/datafusion:vortex-compact 72326338 73898329 0.98
tpcds_q36/datafusion:vortex-compact 104457437 102634272 1.02
tpcds_q37/datafusion:vortex-compact 49152803 51291650 0.96
tpcds_q38/datafusion:vortex-compact 72339688 73650367 0.98
tpcds_q39/datafusion:vortex-compact 159401354 149919440 1.06
tpcds_q40/datafusion:vortex-compact 59904743 59401504 1.01
tpcds_q41/datafusion:vortex-compact 22831094 22025698 1.04
tpcds_q42/datafusion:vortex-compact 26467396 25754098 1.03
tpcds_q43/datafusion:vortex-compact 40424366 40239234 1.00
tpcds_q44/datafusion:vortex-compact 78562982 76644309 1.03
tpcds_q45/datafusion:vortex-compact 40595986 41482400 0.98
tpcds_q46/datafusion:vortex-compact 74471328 78557213 0.95
tpcds_q47/datafusion:vortex-compact 250149932 245682210 1.02
tpcds_q48/datafusion:vortex-compact 🚨 92176548 80692673 1.14
tpcds_q49/datafusion:vortex-compact 96728063 94881373 1.02
tpcds_q50/datafusion:vortex-compact 69578472 70860076 0.98
tpcds_q51/datafusion:vortex-compact 103459098 103382209 1.00
tpcds_q52/datafusion:vortex-compact 24929657 26089531 0.96
tpcds_q53/datafusion:vortex-compact 37443586 37468167 1.00
tpcds_q54/datafusion:vortex-compact 63678092 63570076 1.00
tpcds_q55/datafusion:vortex-compact 26760884 25736383 1.04
tpcds_q56/datafusion:vortex-compact 57501948 57645606 1.00
tpcds_q57/datafusion:vortex-compact 151622870 145320862 1.04
tpcds_q58/datafusion:vortex-compact 83917740 82630721 1.02
tpcds_q59/datafusion:vortex-compact 90910418 87021773 1.04
tpcds_q60/datafusion:vortex-compact 57900965 58339413 0.99
tpcds_q61/datafusion:vortex-compact 77325643 78612512 0.98
tpcds_q62/datafusion:vortex-compact 36808406 36871818 1.00
tpcds_q63/datafusion:vortex-compact 35940571 38520133 0.93
tpcds_q64/datafusion:vortex-compact 561754283 589382465 0.95
tpcds_q65/datafusion:vortex-compact 69785354 71938849 0.97
tpcds_q66/datafusion:vortex-compact 103775478 111515161 0.93
tpcds_q67/datafusion:vortex-compact 130572590 139176474 0.94
tpcds_q68/datafusion:vortex-compact 70413159 77040510 0.91
tpcds_q69/datafusion:vortex-compact 63941708 65141156 0.98
tpcds_q70/datafusion:vortex-compact 132068317 130730337 1.01
tpcds_q71/datafusion:vortex-compact 49283124 51768395 0.95
tpcds_q72/datafusion:vortex-compact 2903078702 3099219711 0.94
tpcds_q73/datafusion:vortex-compact 🚀 53109373 59394469 0.89
tpcds_q74/datafusion:vortex-compact 143685865 154003993 0.93
tpcds_q75/datafusion:vortex-compact 167664200 181898805 0.92
tpcds_q76/datafusion:vortex-compact 53474032 58321804 0.92
tpcds_q77/datafusion:vortex-compact 69454023 70574431 0.98
tpcds_q78/datafusion:vortex-compact 158609705 169854117 0.93
tpcds_q79/datafusion:vortex-compact 62176092 66966439 0.93
tpcds_q80/datafusion:vortex-compact 143177617 141249193 1.01
tpcds_q81/datafusion:vortex-compact 46424043 44363187 1.05
tpcds_q82/datafusion:vortex-compact 51506243 52942358 0.97
tpcds_q83/datafusion:vortex-compact 60841385 61795169 0.98
tpcds_q84/datafusion:vortex-compact 20426270 20024016 1.02
tpcds_q85/datafusion:vortex-compact 130892568 131697445 0.99
tpcds_q86/datafusion:vortex-compact 23797126 23308633 1.02
tpcds_q87/datafusion:vortex-compact 70590171 71863109 0.98
tpcds_q88/datafusion:vortex-compact 139223745 128674711 1.08
tpcds_q89/datafusion:vortex-compact 48529271 46763777 1.04
tpcds_q90/datafusion:vortex-compact 24971481 25367149 0.98
tpcds_q91/datafusion:vortex-compact 43728310 43599981 1.00
tpcds_q92/datafusion:vortex-compact 26476874 27892276 0.95
tpcds_q93/datafusion:vortex-compact 46956526 50108141 0.94
tpcds_q94/datafusion:vortex-compact 31405506 32960784 0.95
tpcds_q95/datafusion:vortex-compact 72478410 72847289 0.99
tpcds_q96/datafusion:vortex-compact 26579776 25176021 1.06
tpcds_q97/datafusion:vortex-compact 43264779 45858153 0.94
tpcds_q98/datafusion:vortex-compact 39900650 42235166 0.94
tpcds_q99/datafusion:vortex-compact 51037950 51362323 0.99
datafusion / parquet (0.990x ➖, 2↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 40430722 37603339 1.08
tpcds_q02/datafusion:parquet 49092345 47320619 1.04
tpcds_q03/datafusion:parquet 15533585 15323845 1.01
tpcds_q04/datafusion:parquet 344581686 329950666 1.04
tpcds_q05/datafusion:parquet 58203992 53315270 1.09
tpcds_q06/datafusion:parquet 67070278 67452040 0.99
tpcds_q07/datafusion:parquet 93723493 92234705 1.02
tpcds_q08/datafusion:parquet 33283243 34056566 0.98
tpcds_q09/datafusion:parquet 60277171 57520264 1.05
tpcds_q10/datafusion:parquet 88892037 88903525 1.00
tpcds_q11/datafusion:parquet 186557363 192736615 0.97
tpcds_q12/datafusion:parquet 24475220 25008995 0.98
tpcds_q13/datafusion:parquet 88322182 94622361 0.93
tpcds_q14/datafusion:parquet 201610499 214144865 0.94
tpcds_q15/datafusion:parquet 27673612 27543472 1.00
tpcds_q16/datafusion:parquet 29971330 30131144 0.99
tpcds_q17/datafusion:parquet 75767903 73796060 1.03
tpcds_q18/datafusion:parquet 141694959 140623033 1.01
tpcds_q19/datafusion:parquet 29894739 29332361 1.02
tpcds_q20/datafusion:parquet 22891370 23515323 0.97
tpcds_q21/datafusion:parquet 24883136 24489128 1.02
tpcds_q22/datafusion:parquet 145228899 144952686 1.00
tpcds_q23/datafusion:parquet 168958438 175101243 0.96
tpcds_q24/datafusion:parquet 112283345 114432743 0.98
tpcds_q25/datafusion:parquet 72750176 77172736 0.94
tpcds_q26/datafusion:parquet 81631721 79114856 1.03
tpcds_q27/datafusion:parquet 174171828 171800005 1.01
tpcds_q28/datafusion:parquet 52168332 53361769 0.98
tpcds_q29/datafusion:parquet 79065048 78237490 1.01
tpcds_q30/datafusion:parquet 47398411 50905990 0.93
tpcds_q31/datafusion:parquet 🚀 78497234 87719581 0.89
tpcds_q32/datafusion:parquet 23625246 25307791 0.93
tpcds_q33/datafusion:parquet 35771856 37657134 0.95
tpcds_q34/datafusion:parquet 28291986 29061257 0.97
tpcds_q35/datafusion:parquet 94863927 91872798 1.03
tpcds_q36/datafusion:parquet 69951960 70350867 0.99
tpcds_q37/datafusion:parquet 24760153 26333548 0.94
tpcds_q38/datafusion:parquet 54836648 52186000 1.05
tpcds_q39/datafusion:parquet 89155285 85802907 1.04
tpcds_q40/datafusion:parquet 29472513 28994772 1.02
tpcds_q41/datafusion:parquet 17323256 17839859 0.97
tpcds_q42/datafusion:parquet 14399325 14850438 0.97
tpcds_q43/datafusion:parquet 19924188 19472554 1.02
tpcds_q44/datafusion:parquet 43976264 43366166 1.01
tpcds_q45/datafusion:parquet 34654353 36110237 0.96
tpcds_q46/datafusion:parquet 40668886 43809191 0.93
tpcds_q47/datafusion:parquet 143072145 146944508 0.97
tpcds_q48/datafusion:parquet 84756727 87734452 0.97
tpcds_q49/datafusion:parquet 68093587 66833315 1.02
tpcds_q50/datafusion:parquet 51843460 50794486 1.02
tpcds_q51/datafusion:parquet 91064129 92829163 0.98
tpcds_q52/datafusion:parquet 14692259 15275017 0.96
tpcds_q53/datafusion:parquet 22969656 24277813 0.95
tpcds_q54/datafusion:parquet 45508853 45272488 1.01
tpcds_q55/datafusion:parquet 14781506 15297558 0.97
tpcds_q56/datafusion:parquet 36797415 38556084 0.95
tpcds_q57/datafusion:parquet 111740406 123180898 0.91
tpcds_q58/datafusion:parquet 59946027 64173779 0.93
tpcds_q59/datafusion:parquet 63731142 62709840 1.02
tpcds_q60/datafusion:parquet 37713304 39160458 0.96
tpcds_q61/datafusion:parquet 54373416 52632408 1.03
tpcds_q62/datafusion:parquet 🚀 25656728 29772625 0.86
tpcds_q63/datafusion:parquet 24068684 22777830 1.06
tpcds_q64/datafusion:parquet 576150325 589718718 0.98
tpcds_q65/datafusion:parquet 45261592 49362838 0.92
tpcds_q66/datafusion:parquet 81884773 79379728 1.03
tpcds_q67/datafusion:parquet 159972513 169923293 0.94
tpcds_q68/datafusion:parquet 43168488 42556609 1.01
tpcds_q69/datafusion:parquet 85575711 84923189 1.01
tpcds_q70/datafusion:parquet 99239407 99568495 1.00
tpcds_q71/datafusion:parquet 27575333 27093177 1.02
tpcds_q72/datafusion:parquet 686527984 700221996 0.98
tpcds_q73/datafusion:parquet 28522229 29670502 0.96
tpcds_q74/datafusion:parquet 109791720 113224308 0.97
tpcds_q75/datafusion:parquet 119650481 122425278 0.98
tpcds_q76/datafusion:parquet 37968649 37851293 1.00
tpcds_q77/datafusion:parquet 53828755 54469940 0.99
tpcds_q78/datafusion:parquet 129024626 128901228 1.00
tpcds_q79/datafusion:parquet 32917275 32566601 1.01
tpcds_q80/datafusion:parquet 98993967 103958028 0.95
tpcds_q81/datafusion:parquet 45843251 45411083 1.01
tpcds_q82/datafusion:parquet 26369792 25061052 1.05
tpcds_q83/datafusion:parquet 52669992 51521805 1.02
tpcds_q84/datafusion:parquet 50554042 50665098 1.00
tpcds_q85/datafusion:parquet 181918688 185343192 0.98
tpcds_q86/datafusion:parquet 18754931 19240313 0.97
tpcds_q87/datafusion:parquet 54241739 58321907 0.93
tpcds_q88/datafusion:parquet 73888015 73749024 1.00
tpcds_q89/datafusion:parquet 27903017 28417272 0.98
tpcds_q90/datafusion:parquet 20146712 19925096 1.01
tpcds_q91/datafusion:parquet 75517173 72825843 1.04
tpcds_q92/datafusion:parquet 24248123 24072242 1.01
tpcds_q93/datafusion:parquet 36517457 37829853 0.97
tpcds_q94/datafusion:parquet 27591685 25289717 1.09
tpcds_q95/datafusion:parquet 73168444 73117701 1.00
tpcds_q96/datafusion:parquet 16223574 16072552 1.01
tpcds_q97/datafusion:parquet 36220972 36851514 0.98
tpcds_q98/datafusion:parquet 27947690 28906113 0.97
tpcds_q99/datafusion:parquet 30133831 30191936 1.00
duckdb / vortex-file-compressed (0.971x ➖, 15↑ 6↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26920402 26210625 1.03
tpcds_q02/duckdb:vortex-file-compressed 85865426 85097061 1.01
tpcds_q03/duckdb:vortex-file-compressed 🚀 24442368 27305672 0.90
tpcds_q04/duckdb:vortex-file-compressed 113697433 103737895 1.10
tpcds_q05/duckdb:vortex-file-compressed 102360218 104011542 0.98
tpcds_q06/duckdb:vortex-file-compressed 36995347 38058376 0.97
tpcds_q07/duckdb:vortex-file-compressed 24216454 24561733 0.99
tpcds_q08/duckdb:vortex-file-compressed 28170244 27760848 1.01
tpcds_q09/duckdb:vortex-file-compressed 🚨 41201157 33998208 1.21
tpcds_q10/duckdb:vortex-file-compressed 🚀 37471487 43903242 0.85
tpcds_q11/duckdb:vortex-file-compressed 66126936 62545347 1.06
tpcds_q12/duckdb:vortex-file-compressed 15716383 14681197 1.07
tpcds_q13/duckdb:vortex-file-compressed 🚀 33455161 43015348 0.78
tpcds_q14/duckdb:vortex-file-compressed 206086600 207806469 0.99
tpcds_q15/duckdb:vortex-file-compressed 44541183 43165193 1.03
tpcds_q16/duckdb:vortex-file-compressed 29743363 31664934 0.94
tpcds_q17/duckdb:vortex-file-compressed 38085737 41473943 0.92
tpcds_q18/duckdb:vortex-file-compressed 47424994 49017925 0.97
tpcds_q19/duckdb:vortex-file-compressed 34700812 35617128 0.97
tpcds_q20/duckdb:vortex-file-compressed 16989406 17085402 0.99
tpcds_q21/duckdb:vortex-file-compressed 19905452 20710174 0.96
tpcds_q22/duckdb:vortex-file-compressed 105970065 110869353 0.96
tpcds_q23/duckdb:vortex-file-compressed 🚀 125092240 155193956 0.81
tpcds_q24/duckdb:vortex-file-compressed 55466698 57511494 0.96
tpcds_q25/duckdb:vortex-file-compressed 39761653 41753376 0.95
tpcds_q26/duckdb:vortex-file-compressed 🚀 40702874 45998144 0.88
tpcds_q27/duckdb:vortex-file-compressed 94073053 91090548 1.03
tpcds_q28/duckdb:vortex-file-compressed 🚨 41231243 36200344 1.14
tpcds_q29/duckdb:vortex-file-compressed 35463502 39042244 0.91
tpcds_q30/duckdb:vortex-file-compressed 29881317 30580551 0.98
tpcds_q31/duckdb:vortex-file-compressed 29433955 30194079 0.97
tpcds_q32/duckdb:vortex-file-compressed 17841402 18346055 0.97
tpcds_q33/duckdb:vortex-file-compressed 66964696 71372592 0.94
tpcds_q34/duckdb:vortex-file-compressed 19764147 21069254 0.94
tpcds_q35/duckdb:vortex-file-compressed 🚀 66899479 78616747 0.85
tpcds_q36/duckdb:vortex-file-compressed 28130799 28774418 0.98
tpcds_q37/duckdb:vortex-file-compressed 23985413 23594359 1.02
tpcds_q38/duckdb:vortex-file-compressed 38831078 40718638 0.95
tpcds_q39/duckdb:vortex-file-compressed 🚀 46053494 51172258 0.90
tpcds_q40/duckdb:vortex-file-compressed 27111011 25825118 1.05
tpcds_q41/duckdb:vortex-file-compressed 14371465 14051527 1.02
tpcds_q42/duckdb:vortex-file-compressed 12460493 13095416 0.95
tpcds_q43/duckdb:vortex-file-compressed 30889514 31589863 0.98
tpcds_q44/duckdb:vortex-file-compressed 🚀 22142602 24627972 0.90
tpcds_q45/duckdb:vortex-file-compressed 28307229 30121094 0.94
tpcds_q46/duckdb:vortex-file-compressed 49425499 50219045 0.98
tpcds_q47/duckdb:vortex-file-compressed 50543353 51283507 0.99
tpcds_q48/duckdb:vortex-file-compressed 🚀 32185397 40203459 0.80
tpcds_q49/duckdb:vortex-file-compressed 🚨 33270044 29854738 1.11
tpcds_q50/duckdb:vortex-file-compressed 36604639 36394695 1.01
tpcds_q51/duckdb:vortex-file-compressed 106459535 104505510 1.02
tpcds_q52/duckdb:vortex-file-compressed 13406876 12862137 1.04
tpcds_q53/duckdb:vortex-file-compressed 17842842 17617873 1.01
tpcds_q54/duckdb:vortex-file-compressed 50810368 46518667 1.09
tpcds_q55/duckdb:vortex-file-compressed 11259273 12120178 0.93
tpcds_q56/duckdb:vortex-file-compressed 66982689 65054052 1.03
tpcds_q57/duckdb:vortex-file-compressed 45238526 46119673 0.98
tpcds_q58/duckdb:vortex-file-compressed 36998155 35620417 1.04
tpcds_q59/duckdb:vortex-file-compressed 82327347 81954171 1.00
tpcds_q60/duckdb:vortex-file-compressed 🚀 65997323 76526019 0.86
tpcds_q61/duckdb:vortex-file-compressed 🚀 36430227 42146988 0.86
tpcds_q62/duckdb:vortex-file-compressed 🚨 21352249 19077451 1.12
tpcds_q63/duckdb:vortex-file-compressed 18197207 19075613 0.95
tpcds_q64/duckdb:vortex-file-compressed 81721838 85353562 0.96
tpcds_q65/duckdb:vortex-file-compressed 24032251 25862903 0.93
tpcds_q66/duckdb:vortex-file-compressed 62105023 58660762 1.06
tpcds_q67/duckdb:vortex-file-compressed 150741036 152326865 0.99
tpcds_q68/duckdb:vortex-file-compressed 42287782 40663218 1.04
tpcds_q69/duckdb:vortex-file-compressed 42874355 44061957 0.97
tpcds_q70/duckdb:vortex-file-compressed 28739241 28550458 1.01
tpcds_q71/duckdb:vortex-file-compressed 21759666 22021259 0.99
tpcds_q72/duckdb:vortex-file-compressed 179484633 179421016 1.00
tpcds_q73/duckdb:vortex-file-compressed 20500567 20901318 0.98
tpcds_q74/duckdb:vortex-file-compressed 🚨 56088090 49544154 1.13
tpcds_q75/duckdb:vortex-file-compressed 61577264 62862881 0.98
tpcds_q76/duckdb:vortex-file-compressed 🚨 70903541 63693154 1.11
tpcds_q77/duckdb:vortex-file-compressed 68224190 65847641 1.04
tpcds_q78/duckdb:vortex-file-compressed 84890878 81335884 1.04
tpcds_q79/duckdb:vortex-file-compressed 37371162 37035388 1.01
tpcds_q80/duckdb:vortex-file-compressed 97887507 100702419 0.97
tpcds_q81/duckdb:vortex-file-compressed 34340735 37507311 0.92
tpcds_q82/duckdb:vortex-file-compressed 23971495 24699601 0.97
tpcds_q83/duckdb:vortex-file-compressed 30533796 30106217 1.01
tpcds_q84/duckdb:vortex-file-compressed 19002428 18790777 1.01
tpcds_q85/duckdb:vortex-file-compressed 50366734 49712784 1.01
tpcds_q86/duckdb:vortex-file-compressed 18466596 19543802 0.94
tpcds_q87/duckdb:vortex-file-compressed 🚀 40565809 49533772 0.82
tpcds_q88/duckdb:vortex-file-compressed 🚀 34423555 44525922 0.77
tpcds_q89/duckdb:vortex-file-compressed 18377090 20203358 0.91
tpcds_q90/duckdb:vortex-file-compressed 13993147 14932006 0.94
tpcds_q91/duckdb:vortex-file-compressed 31021713 30727231 1.01
tpcds_q92/duckdb:vortex-file-compressed 16189611 16386380 0.99
tpcds_q93/duckdb:vortex-file-compressed 32739848 32799806 1.00
tpcds_q94/duckdb:vortex-file-compressed 22372072 24393616 0.92
tpcds_q95/duckdb:vortex-file-compressed 🚀 144585121 166510243 0.87
tpcds_q96/duckdb:vortex-file-compressed 🚀 11476797 17579655 0.65
tpcds_q97/duckdb:vortex-file-compressed 40438712 39991560 1.01
tpcds_q98/duckdb:vortex-file-compressed 19149827 19381936 0.99
tpcds_q99/duckdb:vortex-file-compressed 31978387 31700698 1.01
duckdb / vortex-compact (0.955x ➖, 18↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 34773207 33587112 1.04
tpcds_q02/duckdb:vortex-compact 122927987 125110759 0.98
tpcds_q03/duckdb:vortex-compact 51764483 52750287 0.98
tpcds_q04/duckdb:vortex-compact 127907149 129482190 0.99
tpcds_q05/duckdb:vortex-compact 171678687 179085869 0.96
tpcds_q06/duckdb:vortex-compact 42194961 45246278 0.93
tpcds_q07/duckdb:vortex-compact 37370863 39273569 0.95
tpcds_q08/duckdb:vortex-compact 36983787 36993921 1.00
tpcds_q09/duckdb:vortex-compact 60069869 62764455 0.96
tpcds_q10/duckdb:vortex-compact 🚀 49818015 58295596 0.85
tpcds_q11/duckdb:vortex-compact 79487214 80245473 0.99
tpcds_q12/duckdb:vortex-compact 20053847 20878967 0.96
tpcds_q13/duckdb:vortex-compact 🚀 51793268 70146172 0.74
tpcds_q14/duckdb:vortex-compact 278763042 295585132 0.94
tpcds_q15/duckdb:vortex-compact 48343188 47850177 1.01
tpcds_q16/duckdb:vortex-compact 35923602 34521787 1.04
tpcds_q17/duckdb:vortex-compact 50043181 52111694 0.96
tpcds_q18/duckdb:vortex-compact 59946477 61612805 0.97
tpcds_q19/duckdb:vortex-compact 43106041 43739931 0.99
tpcds_q20/duckdb:vortex-compact 21679500 21649309 1.00
tpcds_q21/duckdb:vortex-compact 28968723 30211275 0.96
tpcds_q22/duckdb:vortex-compact 117902025 119996277 0.98
tpcds_q23/duckdb:vortex-compact 162369164 170714591 0.95
tpcds_q24/duckdb:vortex-compact 73791260 81725137 0.90
tpcds_q25/duckdb:vortex-compact 52672781 56162546 0.94
tpcds_q26/duckdb:vortex-compact 51170090 53971721 0.95
tpcds_q27/duckdb:vortex-compact 137115156 149038753 0.92
tpcds_q28/duckdb:vortex-compact 88379577 86717518 1.02
tpcds_q29/duckdb:vortex-compact 49286641 53581739 0.92
tpcds_q30/duckdb:vortex-compact 36561734 38570260 0.95
tpcds_q31/duckdb:vortex-compact 🚀 33194728 39038890 0.85
tpcds_q32/duckdb:vortex-compact 25033530 25004992 1.00
tpcds_q33/duckdb:vortex-compact 🚀 130754294 145793624 0.90
tpcds_q34/duckdb:vortex-compact 🚀 26998517 32595331 0.83
tpcds_q35/duckdb:vortex-compact 🚀 72609689 84588543 0.86
tpcds_q36/duckdb:vortex-compact 37001164 37190809 0.99
tpcds_q37/duckdb:vortex-compact 34098825 33743737 1.01
tpcds_q38/duckdb:vortex-compact 🚀 42615849 47770821 0.89
tpcds_q39/duckdb:vortex-compact 54753020 54363463 1.01
tpcds_q40/duckdb:vortex-compact 31340959 30618245 1.02
tpcds_q41/duckdb:vortex-compact 17328695 17747785 0.98
tpcds_q42/duckdb:vortex-compact 17336505 16415939 1.06
tpcds_q43/duckdb:vortex-compact 38555686 39463443 0.98
tpcds_q44/duckdb:vortex-compact 🚀 32433232 38032660 0.85
tpcds_q45/duckdb:vortex-compact 34855226 36156768 0.96
tpcds_q46/duckdb:vortex-compact 61650300 65100202 0.95
tpcds_q47/duckdb:vortex-compact 59944533 58344510 1.03
tpcds_q48/duckdb:vortex-compact 🚀 42032495 58052732 0.72
tpcds_q49/duckdb:vortex-compact 45247169 46406780 0.98
tpcds_q50/duckdb:vortex-compact 🚀 49795182 59302110 0.84
tpcds_q51/duckdb:vortex-compact 108622466 107586177 1.01
tpcds_q52/duckdb:vortex-compact 18547047 18863893 0.98
tpcds_q53/duckdb:vortex-compact 25032952 26971360 0.93
tpcds_q54/duckdb:vortex-compact 81835384 81690078 1.00
tpcds_q55/duckdb:vortex-compact 17112185 17666167 0.97
tpcds_q56/duckdb:vortex-compact 136620938 141601068 0.96
tpcds_q57/duckdb:vortex-compact 49434054 48786448 1.01
tpcds_q58/duckdb:vortex-compact 47470162 47110814 1.01
tpcds_q59/duckdb:vortex-compact 104495242 106188725 0.98
tpcds_q60/duckdb:vortex-compact 136525427 150238782 0.91
tpcds_q61/duckdb:vortex-compact 54900535 59478228 0.92
tpcds_q62/duckdb:vortex-compact 21478288 21420771 1.00
tpcds_q63/duckdb:vortex-compact 26395422 25628482 1.03
tpcds_q64/duckdb:vortex-compact 🚀 106294847 118389702 0.90
tpcds_q65/duckdb:vortex-compact 31274538 32164540 0.97
tpcds_q66/duckdb:vortex-compact 93624670 98779917 0.95
tpcds_q67/duckdb:vortex-compact 158976820 160531528 0.99
tpcds_q68/duckdb:vortex-compact 55049234 59397766 0.93
tpcds_q69/duckdb:vortex-compact 🚀 50773087 59509917 0.85
tpcds_q70/duckdb:vortex-compact 37418473 35373098 1.06
tpcds_q71/duckdb:vortex-compact 29426055 28018099 1.05
tpcds_q72/duckdb:vortex-compact 202358323 198541522 1.02
tpcds_q73/duckdb:vortex-compact 🚀 26575033 30950108 0.86
tpcds_q74/duckdb:vortex-compact 58036194 58659653 0.99
tpcds_q75/duckdb:vortex-compact 72913625 72201747 1.01
tpcds_q76/duckdb:vortex-compact 🚀 123761427 143393317 0.86
tpcds_q77/duckdb:vortex-compact 123213307 135721583 0.91
tpcds_q78/duckdb:vortex-compact 90227237 88266915 1.02
tpcds_q79/duckdb:vortex-compact 🚀 58594135 67913921 0.86
tpcds_q80/duckdb:vortex-compact 🚀 159020091 178258152 0.89
tpcds_q81/duckdb:vortex-compact 40005975 42500622 0.94
tpcds_q82/duckdb:vortex-compact 33134802 32085571 1.03
tpcds_q83/duckdb:vortex-compact 46776044 50144075 0.93
tpcds_q84/duckdb:vortex-compact 22813852 24420131 0.93
tpcds_q85/duckdb:vortex-compact 66531927 66704271 1.00
tpcds_q86/duckdb:vortex-compact 🚨 22954229 20168009 1.14
tpcds_q87/duckdb:vortex-compact 🚀 45288323 51268459 0.88
tpcds_q88/duckdb:vortex-compact 39929897 43553823 0.92
tpcds_q89/duckdb:vortex-compact 26447643 26323064 1.00
tpcds_q90/duckdb:vortex-compact 16636910 16738913 0.99
tpcds_q91/duckdb:vortex-compact 48232571 49298034 0.98
tpcds_q92/duckdb:vortex-compact 22331193 21322004 1.05
tpcds_q93/duckdb:vortex-compact 35950480 35623531 1.01
tpcds_q94/duckdb:vortex-compact 27897910 27689426 1.01
tpcds_q95/duckdb:vortex-compact 163618235 166147521 0.98
tpcds_q96/duckdb:vortex-compact 🚀 14014073 19975517 0.70
tpcds_q97/duckdb:vortex-compact 43696043 44724976 0.98
tpcds_q98/duckdb:vortex-compact 25966720 25716109 1.01
tpcds_q99/duckdb:vortex-compact 37187288 33909767 1.10
duckdb / parquet (0.992x ➖, 1↑ 2↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 46040929 47723589 0.96
tpcds_q02/duckdb:parquet 61531691 62315607 0.99
tpcds_q03/duckdb:parquet 12479503 12695835 0.98
tpcds_q04/duckdb:parquet 130890899 130628675 1.00
tpcds_q05/duckdb:parquet 77388367 74772326 1.03
tpcds_q06/duckdb:parquet 29726123 29543391 1.01
tpcds_q07/duckdb:parquet 24260472 23915821 1.01
tpcds_q08/duckdb:parquet 27966643 28338846 0.99
tpcds_q09/duckdb:parquet 39918432 40223272 0.99
tpcds_q10/duckdb:parquet 36684347 36917115 0.99
tpcds_q11/duckdb:parquet 91415345 92676702 0.99
tpcds_q12/duckdb:parquet 15727558 15383667 1.02
tpcds_q13/duckdb:parquet 35695274 36394704 0.98
tpcds_q14/duckdb:parquet 172928606 167246374 1.03
tpcds_q15/duckdb:parquet 31203749 32006973 0.97
tpcds_q16/duckdb:parquet 22763137 22967869 0.99
tpcds_q17/duckdb:parquet 37769902 39035798 0.97
tpcds_q18/duckdb:parquet 49245803 48301971 1.02
tpcds_q19/duckdb:parquet 30071777 29441846 1.02
tpcds_q20/duckdb:parquet 15389884 16041211 0.96
tpcds_q21/duckdb:parquet 🚀 11241365 12927590 0.87
tpcds_q22/duckdb:parquet 68294806 70235908 0.97
tpcds_q23/duckdb:parquet 119672192 118050846 1.01
tpcds_q24/duckdb:parquet 46935661 48122293 0.98
tpcds_q25/duckdb:parquet 33605718 35018904 0.96
tpcds_q26/duckdb:parquet 36045492 38315921 0.94
tpcds_q27/duckdb:parquet 92835299 91466982 1.01
tpcds_q28/duckdb:parquet 37586343 38004678 0.99
tpcds_q29/duckdb:parquet 36902958 36993946 1.00
tpcds_q30/duckdb:parquet 39340166 40563835 0.97
tpcds_q31/duckdb:parquet 22463876 24263038 0.93
tpcds_q32/duckdb:parquet 12248248 11837400 1.03
tpcds_q33/duckdb:parquet 73494511 74595764 0.99
tpcds_q34/duckdb:parquet 21840710 21636854 1.01
tpcds_q35/duckdb:parquet 62286186 63841070 0.98
tpcds_q36/duckdb:parquet 20824084 21778585 0.96
tpcds_q37/duckdb:parquet 14149854 14480076 0.98
tpcds_q38/duckdb:parquet 35039136 35238097 0.99
tpcds_q39/duckdb:parquet 34104643 33846860 1.01
tpcds_q40/duckdb:parquet 19263631 19307142 1.00
tpcds_q41/duckdb:parquet 8167802 7797282 1.05
tpcds_q42/duckdb:parquet 10832618 10711594 1.01
tpcds_q43/duckdb:parquet 16047300 15947629 1.01
tpcds_q44/duckdb:parquet 22764197 22956861 0.99
tpcds_q45/duckdb:parquet 26699086 28695002 0.93
tpcds_q46/duckdb:parquet 47561695 48238144 0.99
tpcds_q47/duckdb:parquet 46514395 49179728 0.95
tpcds_q48/duckdb:parquet 32964600 31483019 1.05
tpcds_q49/duckdb:parquet 24281929 26230996 0.93
tpcds_q50/duckdb:parquet 25474538 25475828 1.00
tpcds_q51/duckdb:parquet 95587734 98315543 0.97
tpcds_q52/duckdb:parquet 11917592 11398322 1.05
tpcds_q53/duckdb:parquet 16630513 16611187 1.00
tpcds_q54/duckdb:parquet 42108318 41991027 1.00
tpcds_q55/duckdb:parquet 11488923 11642612 0.99
tpcds_q56/duckdb:parquet 73884423 68720209 1.08
tpcds_q57/duckdb:parquet 36632225 36987551 0.99
tpcds_q58/duckdb:parquet 21915454 22865167 0.96
tpcds_q59/duckdb:parquet 37232689 35727638 1.04
tpcds_q60/duckdb:parquet 70184271 71644579 0.98
tpcds_q61/duckdb:parquet 32677884 32595697 1.00
tpcds_q62/duckdb:parquet 13055581 12421469 1.05
tpcds_q63/duckdb:parquet 15948870 15649268 1.02
tpcds_q64/duckdb:parquet 75641878 74986940 1.01
tpcds_q65/duckdb:parquet 20893912 21079916 0.99
tpcds_q66/duckdb:parquet 57746178 57532836 1.00
tpcds_q67/duckdb:parquet 141888161 138268249 1.03
tpcds_q68/duckdb:parquet 39228675 38898606 1.01
tpcds_q69/duckdb:parquet 38811095 40068863 0.97
tpcds_q70/duckdb:parquet 20209663 20826876 0.97
tpcds_q71/duckdb:parquet 🚨 20086254 17697102 1.14
tpcds_q72/duckdb:parquet 168179000 169781806 0.99
tpcds_q73/duckdb:parquet 19158970 20215528 0.95
tpcds_q74/duckdb:parquet 53071265 50689970 1.05
tpcds_q75/duckdb:parquet 55438995 54026651 1.03
tpcds_q76/duckdb:parquet 68507136 74766090 0.92
tpcds_q77/duckdb:parquet 65141456 68251229 0.95
tpcds_q78/duckdb:parquet 75378915 82484121 0.91
tpcds_q79/duckdb:parquet 29219918 29628185 0.99
tpcds_q80/duckdb:parquet 88794173 86765343 1.02
tpcds_q81/duckdb:parquet 48245453 49292011 0.98
tpcds_q82/duckdb:parquet 16462864 17238238 0.96
tpcds_q83/duckdb:parquet 17360078 16424182 1.06
tpcds_q84/duckdb:parquet 19652218 19902805 0.99
tpcds_q85/duckdb:parquet 40937076 42734956 0.96
tpcds_q86/duckdb:parquet 12119376 12544615 0.97
tpcds_q87/duckdb:parquet 37082293 37600776 0.99
tpcds_q88/duckdb:parquet 30341023 29959947 1.01
tpcds_q89/duckdb:parquet 17601824 18110365 0.97
tpcds_q90/duckdb:parquet 7621624 8213820 0.93
tpcds_q91/duckdb:parquet 24074511 23796742 1.01
tpcds_q92/duckdb:parquet 12232032 11856639 1.03
tpcds_q93/duckdb:parquet 30239174 32076810 0.94
tpcds_q94/duckdb:parquet 16599798 16979697 0.98
tpcds_q95/duckdb:parquet 🚨 150043874 133742086 1.12
tpcds_q96/duckdb:parquet 9790170 9634556 1.02
tpcds_q97/duckdb:parquet 38108717 37965381 1.00
tpcds_q98/duckdb:parquet 18168749 18974290 0.96
tpcds_q99/duckdb:parquet 20618528 20901403 0.99
duckdb / duckdb (0.978x ➖, 4↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20173536 19789169 1.02
tpcds_q02/duckdb:duckdb 18847160 18180156 1.04
tpcds_q03/duckdb:duckdb 8740345 8530963 1.02
tpcds_q04/duckdb:duckdb 166087678 164939993 1.01
tpcds_q05/duckdb:duckdb 18933749 19639496 0.96
tpcds_q06/duckdb:duckdb 24059972 24110872 1.00
tpcds_q07/duckdb:duckdb 38419511 42360868 0.91
tpcds_q08/duckdb:duckdb 121688350 121153611 1.00
tpcds_q09/duckdb:duckdb 19975043 20032025 1.00
tpcds_q10/duckdb:duckdb 25157177 24412839 1.03
tpcds_q11/duckdb:duckdb 145474582 140514532 1.04
tpcds_q12/duckdb:duckdb 11694040 12189949 0.96
tpcds_q13/duckdb:duckdb 24463758 24751257 0.99
tpcds_q14/duckdb:duckdb 93642566 93853536 1.00
tpcds_q15/duckdb:duckdb 24959737 25587105 0.98
tpcds_q16/duckdb:duckdb 17322688 18287620 0.95
tpcds_q17/duckdb:duckdb 22916188 23023272 1.00
tpcds_q18/duckdb:duckdb 45549761 45583383 1.00
tpcds_q19/duckdb:duckdb 17185923 16622802 1.03
tpcds_q20/duckdb:duckdb 12317926 12566558 0.98
tpcds_q21/duckdb:duckdb 🚀 6870410 7695014 0.89
tpcds_q22/duckdb:duckdb 62940230 69746402 0.90
tpcds_q23/duckdb:duckdb 75607367 80365810 0.94
tpcds_q24/duckdb:duckdb 24588941 25506995 0.96
tpcds_q25/duckdb:duckdb 16406298 17617630 0.93
tpcds_q26/duckdb:duckdb 🚀 25139022 28910258 0.87
tpcds_q27/duckdb:duckdb 41971185 42533754 0.99
tpcds_q28/duckdb:duckdb 21568707 21905919 0.98
tpcds_q29/duckdb:duckdb 21225814 21701407 0.98
tpcds_q30/duckdb:duckdb 30516454 28702493 1.06
tpcds_q31/duckdb:duckdb 21115539 22420720 0.94
tpcds_q32/duckdb:duckdb 7554682 7269854 1.04
tpcds_q33/duckdb:duckdb 12453905 13317336 0.94
tpcds_q34/duckdb:duckdb 15030164 16475883 0.91
tpcds_q35/duckdb:duckdb 35071611 35701062 0.98
tpcds_q36/duckdb:duckdb 73474721 78497567 0.94
tpcds_q37/duckdb:duckdb 7924917 8303970 0.95
tpcds_q38/duckdb:duckdb 30629830 32971754 0.93
tpcds_q39/duckdb:duckdb 26307414 28141015 0.93
tpcds_q40/duckdb:duckdb 14301752 14732291 0.97
tpcds_q41/duckdb:duckdb 🚨 9423916 8556960 1.10
tpcds_q42/duckdb:duckdb 6667031 6794320 0.98
tpcds_q43/duckdb:duckdb 11159082 11696827 0.95
tpcds_q44/duckdb:duckdb 13250467 14103990 0.94
tpcds_q45/duckdb:duckdb 17481822 18123729 0.96
tpcds_q46/duckdb:duckdb 38016025 39535094 0.96
tpcds_q47/duckdb:duckdb 41989542 43472658 0.97
tpcds_q48/duckdb:duckdb 23521351 24106081 0.98
tpcds_q49/duckdb:duckdb 16850776 17491780 0.96
tpcds_q50/duckdb:duckdb 15450675 14622129 1.06
tpcds_q51/duckdb:duckdb 93015720 95017576 0.98
tpcds_q52/duckdb:duckdb 7142539 7552530 0.95
tpcds_q53/duckdb:duckdb 11706502 12147101 0.96
tpcds_q54/duckdb:duckdb 17911122 16926620 1.06
tpcds_q55/duckdb:duckdb 7005943 7474254 0.94
tpcds_q56/duckdb:duckdb 14071626 14329024 0.98
tpcds_q57/duckdb:duckdb 32540307 33533787 0.97
tpcds_q58/duckdb:duckdb 13076427 12300467 1.06
tpcds_q59/duckdb:duckdb 35857103 35316805 1.02
tpcds_q60/duckdb:duckdb 15369148 15327809 1.00
tpcds_q61/duckdb:duckdb 13892544 14655519 0.95
tpcds_q62/duckdb:duckdb 9502480 10022425 0.95
tpcds_q63/duckdb:duckdb 11756696 11528777 1.02
tpcds_q64/duckdb:duckdb 52666397 55185124 0.95
tpcds_q65/duckdb:duckdb 33897877 33811786 1.00
tpcds_q66/duckdb:duckdb 25460844 24931296 1.02
tpcds_q67/duckdb:duckdb 130563461 132634368 0.98
tpcds_q68/duckdb:duckdb 25633864 26278713 0.98
tpcds_q69/duckdb:duckdb 24202770 24540935 0.99
tpcds_q70/duckdb:duckdb 14557037 14826094 0.98
tpcds_q71/duckdb:duckdb 12601283 12489013 1.01
tpcds_q72/duckdb:duckdb 43876871 44103870 0.99
tpcds_q73/duckdb:duckdb 10745118 11418367 0.94
tpcds_q74/duckdb:duckdb 99538794 100868023 0.99
tpcds_q75/duckdb:duckdb 42156344 42858929 0.98
tpcds_q76/duckdb:duckdb 12706019 12758863 1.00
tpcds_q77/duckdb:duckdb 12005243 12027775 1.00
tpcds_q78/duckdb:duckdb 66692271 64726628 1.03
tpcds_q79/duckdb:duckdb 17641223 18605679 0.95
tpcds_q80/duckdb:duckdb 28549913 30215300 0.94
tpcds_q81/duckdb:duckdb 37626096 40725761 0.92
tpcds_q82/duckdb:duckdb 8604932 8914522 0.97
tpcds_q83/duckdb:duckdb 9134332 9409420 0.97
tpcds_q84/duckdb:duckdb 13990862 14067426 0.99
tpcds_q85/duckdb:duckdb 24478311 24457339 1.00
tpcds_q86/duckdb:duckdb 10559183 11577093 0.91
tpcds_q87/duckdb:duckdb 35801869 34722520 1.03
tpcds_q88/duckdb:duckdb 24721001 24408202 1.01
tpcds_q89/duckdb:duckdb 13903159 13531323 1.03
tpcds_q90/duckdb:duckdb 5852324 5616063 1.04
tpcds_q91/duckdb:duckdb 13267906 13364253 0.99
tpcds_q92/duckdb:duckdb 8851016 9125316 0.97
tpcds_q93/duckdb:duckdb 23723190 22943512 1.03
tpcds_q94/duckdb:duckdb 13810124 14563018 0.95
tpcds_q95/duckdb:duckdb 🚀 117768819 137412278 0.86
tpcds_q96/duckdb:duckdb 4929466 4823764 1.02
tpcds_q97/duckdb:duckdb 32055096 32984211 0.97
tpcds_q98/duckdb:duckdb 🚀 13640233 15378194 0.89
tpcds_q99/duckdb:duckdb 16865902 17021612 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.4% +1.8% -7.1% +10.9% ➖ noise
1 datafusion:vortex-file-compressed +5.6% +1.8% +3.7% +12.0% ➖ noise
1 duckdb:duckdb +1.9% +1.8% +0.1% +12.9% ➖ noise
1 duckdb:vortex-compact +3.5% +1.8% +1.7% +11.7% ➖ noise
1 duckdb:vortex-file-compressed +2.7% +1.8% +0.8% +14.6% ➖ noise
2 datafusion:vortex-compact -0.5% +1.2% -1.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.9% +1.2% +0.6% +10.3% ➖ noise
2 duckdb:duckdb +3.7% +1.2% +2.4% +13.4% ➖ noise
2 duckdb:vortex-compact -1.7% +1.2% -2.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.9% +1.2% -0.3% +14.2% ➖ noise
3 datafusion:vortex-compact -3.1% -0.2% -3.0% +11.7% ➖ noise
3 datafusion:vortex-file-compressed -2.6% -0.2% -2.5% +13.2% ➖ noise
3 duckdb:duckdb +2.5% -0.2% +2.6% +13.8% ➖ noise
3 duckdb:vortex-compact -1.9% -0.2% -1.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -10.5% -0.2% -10.3% +10.0% ✅ faster
4 datafusion:vortex-compact -1.9% +2.3% -4.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.2% +2.3% -4.4% +10.0% ➖ noise
4 duckdb:duckdb +0.7% +2.3% -1.6% +10.0% ➖ noise
4 duckdb:vortex-compact -1.2% +2.3% -3.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +9.6% +2.3% +7.1% +10.0% ➖ noise
5 datafusion:vortex-compact -6.1% +6.3% -11.7% +12.2% ✅ faster
5 datafusion:vortex-file-compressed +4.2% +6.3% -1.9% +10.8% ➖ noise
5 duckdb:duckdb -3.6% +6.3% -9.3% +13.5% ➖ noise
5 duckdb:vortex-compact -4.1% +6.3% -9.8% +14.1% ➖ noise
5 duckdb:vortex-file-compressed -1.6% +6.3% -7.4% +11.6% ➖ noise
6 datafusion:vortex-compact -12.4% +0.0% -12.4% +10.0% ✅ faster
6 datafusion:vortex-file-compressed -3.5% +0.0% -3.6% +10.0% ➖ noise
6 duckdb:duckdb -0.2% +0.0% -0.2% +15.4% ➖ noise
6 duckdb:vortex-compact -6.7% +0.0% -6.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.8% +0.0% -2.8% +10.0% ➖ noise
7 datafusion:vortex-compact -7.5% +1.5% -8.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -4.1% +1.5% -5.6% +10.0% ➖ noise
7 duckdb:duckdb -9.3% +1.5% -10.7% +13.0% ➖ noise
7 duckdb:vortex-compact -4.8% +1.5% -6.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.4% +1.5% -2.9% +10.5% ➖ noise
8 datafusion:vortex-compact -5.0% -1.8% -3.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -6.4% -1.8% -4.6% +10.0% ➖ noise
8 duckdb:duckdb +0.4% -1.8% +2.3% +10.0% ➖ noise
8 duckdb:vortex-compact -0.0% -1.8% +1.8% +10.1% ➖ noise
8 duckdb:vortex-file-compressed +1.5% -1.8% +3.3% +10.0% ➖ noise
9 datafusion:vortex-compact +2.1% +2.0% +0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +13.6% +2.0% +11.4% +10.0% 🚨 regression
9 duckdb:duckdb -0.3% +2.0% -2.2% +10.0% ➖ noise
9 duckdb:vortex-compact -4.3% +2.0% -6.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +21.2% +2.0% +18.8% +10.0% 🚨 regression
10 datafusion:vortex-compact -0.1% -0.3% +0.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -11.3% -0.3% -11.0% +10.0% ✅ faster
10 duckdb:duckdb +3.0% -0.3% +3.4% +16.0% ➖ noise
10 duckdb:vortex-compact -14.5% -0.3% -14.3% +10.0% ✅ faster
10 duckdb:vortex-file-compressed -14.6% -0.3% -14.4% +10.8% ✅ faster
11 datafusion:vortex-compact -9.0% -2.3% -6.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.0% -2.3% +1.3% +10.0% ➖ noise
11 duckdb:duckdb +3.5% -2.3% +6.0% +10.0% ➖ noise
11 duckdb:vortex-compact -0.9% -2.3% +1.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +5.7% -2.3% +8.2% +10.0% ➖ noise
12 datafusion:vortex-compact -8.1% +0.0% -8.1% +14.3% ➖ noise
12 datafusion:vortex-file-compressed -5.3% +0.0% -5.3% +10.0% ➖ noise
12 duckdb:duckdb -4.1% +0.0% -4.1% +12.9% ➖ noise
12 duckdb:vortex-compact -4.0% +0.0% -4.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +7.1% +0.0% +7.0% +10.9% ➖ noise
13 datafusion:vortex-compact -5.9% -4.3% -1.7% +10.9% ➖ noise
13 datafusion:vortex-file-compressed -3.9% -4.3% +0.4% +10.0% ➖ noise
13 duckdb:duckdb -1.2% -4.3% +3.3% +10.0% ➖ noise
13 duckdb:vortex-compact -26.2% -4.3% -22.8% +10.0% ✅ faster
13 duckdb:vortex-file-compressed -22.2% -4.3% -18.7% +10.0% ✅ faster
14 datafusion:vortex-compact -2.2% -1.3% -0.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.9% -1.3% -1.6% +10.0% ➖ noise
14 duckdb:duckdb -0.2% -1.3% +1.1% +10.0% ➖ noise
14 duckdb:vortex-compact -5.7% -1.3% -4.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.8% -1.3% +0.5% +10.0% ➖ noise
15 datafusion:vortex-compact -7.8% -1.0% -6.8% +10.4% ➖ noise
15 datafusion:vortex-file-compressed +0.2% -1.0% +1.2% +13.3% ➖ noise
15 duckdb:duckdb -2.5% -1.0% -1.4% +10.8% ➖ noise
15 duckdb:vortex-compact +1.0% -1.0% +2.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.2% -1.0% +4.3% +13.0% ➖ noise
16 datafusion:vortex-compact -6.5% -0.7% -5.8% +10.8% ➖ noise
16 datafusion:vortex-file-compressed -4.1% -0.7% -3.4% +11.0% ➖ noise
16 duckdb:duckdb -5.3% -0.7% -4.6% +19.3% ➖ noise
16 duckdb:vortex-compact +4.1% -0.7% +4.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -6.1% -0.7% -5.4% +12.2% ➖ noise
17 datafusion:vortex-compact -4.5% -0.3% -4.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -5.4% -0.3% -5.1% +10.0% ➖ noise
17 duckdb:duckdb -0.5% -0.3% -0.1% +10.3% ➖ noise
17 duckdb:vortex-compact -4.0% -0.3% -3.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -8.2% -0.3% -7.9% +14.4% ➖ noise
18 datafusion:vortex-compact -3.1% +1.4% -4.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.2% +1.4% -4.5% +10.0% ➖ noise
18 duckdb:duckdb -0.1% +1.4% -1.4% +10.0% ➖ noise
18 duckdb:vortex-compact -2.7% +1.4% -4.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.2% +1.4% -4.5% +11.2% ➖ noise
19 datafusion:vortex-compact -7.4% +2.0% -9.3% +10.0% ✅ faster
19 datafusion:vortex-file-compressed -5.0% +2.0% -6.9% +10.0% ➖ noise
19 duckdb:duckdb +3.4% +2.0% +1.3% +10.0% ➖ noise
19 duckdb:vortex-compact -1.4% +2.0% -3.4% +10.2% ➖ noise
19 duckdb:vortex-file-compressed -2.6% +2.0% -4.5% +12.7% ➖ noise
20 datafusion:vortex-compact -1.9% -3.4% +1.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.0% -3.4% +4.6% +10.1% ➖ noise
20 duckdb:duckdb -2.0% -3.4% +1.4% +12.5% ➖ noise
20 duckdb:vortex-compact +0.1% -3.4% +3.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.6% -3.4% +2.9% +12.1% ➖ noise
21 datafusion:vortex-compact -1.2% -6.0% +5.1% +11.5% ➖ noise
21 datafusion:vortex-file-compressed -3.8% -6.0% +2.4% +11.3% ➖ noise
21 duckdb:duckdb -10.7% -6.0% -5.0% +12.4% ➖ noise
21 duckdb:vortex-compact -4.1% -6.0% +2.0% +14.8% ➖ noise
21 duckdb:vortex-file-compressed -3.9% -6.0% +2.3% +16.7% ➖ noise
22 datafusion:vortex-compact +1.3% -1.3% +2.6% +14.3% ➖ noise
22 datafusion:vortex-file-compressed -4.3% -1.3% -3.0% +11.3% ➖ noise
22 duckdb:duckdb -9.8% -1.3% -8.6% +10.5% ➖ noise
22 duckdb:vortex-compact -1.7% -1.3% -0.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -4.4% -1.3% -3.2% +12.0% ➖ noise
23 datafusion:vortex-compact +0.1% -1.1% +1.2% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -5.5% -1.1% -4.4% +10.0% ➖ noise
23 duckdb:duckdb -5.9% -1.1% -4.9% +13.6% ➖ noise
23 duckdb:vortex-compact -4.9% -1.1% -3.8% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -19.4% -1.1% -18.5% +10.0% ✅ faster
24 datafusion:vortex-compact -5.4% -2.2% -3.3% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -7.9% -2.2% -5.9% +10.0% ➖ noise
24 duckdb:duckdb -3.6% -2.2% -1.5% +10.0% ➖ noise
24 duckdb:vortex-compact -9.7% -2.2% -7.7% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -3.6% -2.2% -1.4% +10.0% ➖ noise
25 datafusion:vortex-compact -2.3% -4.9% +2.7% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -0.2% -4.9% +4.9% +10.0% ➖ noise
25 duckdb:duckdb -6.9% -4.9% -2.1% +10.3% ➖ noise
25 duckdb:vortex-compact -6.2% -4.9% -1.4% +15.3% ➖ noise
25 duckdb:vortex-file-compressed -4.8% -4.9% +0.1% +10.0% ➖ noise
26 datafusion:vortex-compact -3.9% -1.5% -2.5% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -4.8% -1.5% -3.4% +10.0% ➖ noise
26 duckdb:duckdb -13.0% -1.5% -11.7% +13.3% ✅ faster
26 duckdb:vortex-compact -5.2% -1.5% -3.8% +15.0% ➖ noise
26 duckdb:vortex-file-compressed -11.5% -1.5% -10.2% +13.0% ➖ noise
27 datafusion:vortex-compact -1.1% +1.4% -2.5% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -1.8% +1.4% -3.2% +10.0% ➖ noise
27 duckdb:duckdb -1.3% +1.4% -2.7% +16.1% ➖ noise
27 duckdb:vortex-compact -8.0% +1.4% -9.3% +10.0% ✅ faster
27 duckdb:vortex-file-compressed +3.3% +1.4% +1.8% +10.0% ➖ noise
28 datafusion:vortex-compact +1.3% -1.7% +3.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +4.8% -1.7% +6.6% +10.0% ➖ noise
28 duckdb:duckdb -1.5% -1.7% +0.1% +10.0% ➖ noise
28 duckdb:vortex-compact +1.9% -1.7% +3.6% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +13.9% -1.7% +15.8% +10.0% 🚨 regression
29 datafusion:vortex-compact -0.7% +0.4% -1.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.5% +0.4% +0.1% +10.0% ➖ noise
29 duckdb:duckdb -2.2% +0.4% -2.6% +14.7% ➖ noise
29 duckdb:vortex-compact -8.0% +0.4% -8.4% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -9.2% +0.4% -9.5% +12.0% ➖ noise
30 datafusion:vortex-compact +10.2% -5.0% +16.0% +10.0% 🚨 regression
30 datafusion:vortex-file-compressed +1.1% -5.0% +6.4% +10.0% ➖ noise
30 duckdb:duckdb +6.3% -5.0% +11.9% +10.0% 🚨 regression
30 duckdb:vortex-compact -5.2% -5.0% -0.2% +14.5% ➖ noise
30 duckdb:vortex-file-compressed -2.3% -5.0% +2.8% +10.0% ➖ noise
31 datafusion:vortex-compact +2.5% -9.0% +12.6% +10.0% 🚨 regression
31 datafusion:vortex-file-compressed +2.8% -9.0% +12.9% +10.0% 🚨 regression
31 duckdb:duckdb -5.8% -9.0% +3.5% +14.3% ➖ noise
31 duckdb:vortex-compact -15.0% -9.0% -6.6% +10.7% ➖ noise
31 duckdb:vortex-file-compressed -2.5% -9.0% +7.1% +10.0% ➖ noise
32 datafusion:vortex-compact -5.4% -1.7% -3.8% +11.7% ➖ noise
32 datafusion:vortex-file-compressed -1.1% -1.7% +0.7% +10.0% ➖ noise
32 duckdb:duckdb +3.9% -1.7% +5.7% +15.8% ➖ noise
32 duckdb:vortex-compact +0.1% -1.7% +1.9% +12.4% ➖ noise
32 duckdb:vortex-file-compressed -2.8% -1.7% -1.0% +10.0% ➖ noise
33 datafusion:vortex-compact +1.2% -3.3% +4.6% +12.3% ➖ noise
33 datafusion:vortex-file-compressed +0.5% -3.3% +3.9% +10.0% ➖ noise
33 duckdb:duckdb -6.5% -3.3% -3.3% +11.2% ➖ noise
33 duckdb:vortex-compact -10.3% -3.3% -7.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -6.2% -3.3% -3.0% +12.8% ➖ noise
34 datafusion:vortex-compact +0.6% -0.9% +1.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -5.4% -0.9% -4.6% +10.0% ➖ noise
34 duckdb:duckdb -8.8% -0.9% -8.0% +13.6% ➖ noise
34 duckdb:vortex-compact -17.2% -0.9% -16.4% +10.0% ✅ faster
34 duckdb:vortex-file-compressed -6.2% -0.9% -5.4% +13.1% ➖ noise
35 datafusion:vortex-compact -2.1% +0.4% -2.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -1.6% +0.4% -2.0% +10.0% ➖ noise
35 duckdb:duckdb -1.8% +0.4% -2.1% +15.6% ➖ noise
35 duckdb:vortex-compact -14.2% +0.4% -14.5% +10.0% ✅ faster
35 duckdb:vortex-file-compressed -14.9% +0.4% -15.2% +10.0% ✅ faster
36 datafusion:vortex-compact +1.8% -2.5% +4.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +3.7% -2.5% +6.3% +10.0% ➖ noise
36 duckdb:duckdb -6.4% -2.5% -4.0% +10.0% ➖ noise
36 duckdb:vortex-compact -0.5% -2.5% +2.0% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -2.2% -2.5% +0.3% +10.0% ➖ noise
37 datafusion:vortex-compact -4.2% -4.1% -0.0% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +1.2% -4.1% +5.6% +10.0% ➖ noise
37 duckdb:duckdb -4.6% -4.1% -0.4% +16.1% ➖ noise
37 duckdb:vortex-compact +1.1% -4.1% +5.4% +15.0% ➖ noise
37 duckdb:vortex-file-compressed +1.7% -4.1% +6.1% +10.1% ➖ noise
38 datafusion:vortex-compact -1.8% +2.2% -3.9% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -0.2% +2.2% -2.4% +10.0% ➖ noise
38 duckdb:duckdb -7.1% +2.2% -9.1% +10.0% ✅ faster
38 duckdb:vortex-compact -10.8% +2.2% -12.7% +11.0% ✅ faster
38 duckdb:vortex-file-compressed -4.6% +2.2% -6.7% +12.4% ➖ noise
39 datafusion:vortex-compact +6.3% +2.3% +3.9% +10.2% ➖ noise
39 datafusion:vortex-file-compressed -0.0% +2.3% -2.3% +10.8% ➖ noise
39 duckdb:duckdb -6.5% +2.3% -8.6% +12.3% ➖ noise
39 duckdb:vortex-compact +0.7% +2.3% -1.6% +11.2% ➖ noise
39 duckdb:vortex-file-compressed -10.0% +2.3% -12.0% +20.5% ➖ noise
40 datafusion:vortex-compact +0.8% +0.7% +0.1% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +0.8% +0.7% +0.1% +10.0% ➖ noise
40 duckdb:duckdb -2.9% +0.7% -3.6% +10.0% ➖ noise
40 duckdb:vortex-compact +2.4% +0.7% +1.6% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +5.0% +0.7% +4.2% +10.0% ➖ noise
41 datafusion:vortex-compact +3.7% +0.9% +2.8% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -1.8% +0.9% -2.6% +10.0% ➖ noise
41 duckdb:duckdb +10.1% +0.9% +9.2% +10.0% ➖ noise
41 duckdb:vortex-compact -2.4% +0.9% -3.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +2.3% +0.9% +1.4% +10.0% ➖ noise
42 datafusion:vortex-compact +2.8% -1.0% +3.8% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -1.2% -1.0% -0.2% +10.0% ➖ noise
42 duckdb:duckdb -1.9% -1.0% -0.9% +17.0% ➖ noise
42 duckdb:vortex-compact +5.6% -1.0% +6.6% +11.3% ➖ noise
42 duckdb:vortex-file-compressed -4.8% -1.0% -3.9% +14.3% ➖ noise
43 datafusion:vortex-compact +0.5% +1.5% -1.0% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +2.9% +1.5% +1.4% +10.0% ➖ noise
43 duckdb:duckdb -4.6% +1.5% -6.0% +10.0% ➖ noise
43 duckdb:vortex-compact -2.3% +1.5% -3.7% +10.0% ➖ noise
43 duckdb:vortex-file-compressed -2.2% +1.5% -3.6% +10.0% ➖ noise
44 datafusion:vortex-compact +2.5% +0.3% +2.2% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -4.1% +0.3% -4.3% +12.6% ➖ noise
44 duckdb:duckdb -6.1% +0.3% -6.3% +12.3% ➖ noise
44 duckdb:vortex-compact -14.7% +0.3% -15.0% +10.3% ✅ faster
44 duckdb:vortex-file-compressed -10.1% +0.3% -10.3% +13.3% ➖ noise
45 datafusion:vortex-compact -2.1% -5.5% +3.6% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +0.9% -5.5% +6.7% +10.0% ➖ noise
45 duckdb:duckdb -3.5% -5.5% +2.1% +10.3% ➖ noise
45 duckdb:vortex-compact -3.6% -5.5% +2.0% +12.4% ➖ noise
45 duckdb:vortex-file-compressed -6.0% -5.5% -0.5% +12.9% ➖ noise
46 datafusion:vortex-compact -5.2% -4.3% -0.9% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +7.0% -4.3% +11.8% +10.9% 🚨 regression
46 duckdb:duckdb -3.8% -4.3% +0.5% +10.2% ➖ noise
46 duckdb:vortex-compact -5.3% -4.3% -1.0% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -1.6% -4.3% +2.9% +11.2% ➖ noise
47 datafusion:vortex-compact +1.8% -4.0% +6.1% +10.1% ➖ noise
47 datafusion:vortex-file-compressed -1.2% -4.0% +3.0% +10.0% ➖ noise
47 duckdb:duckdb -3.4% -4.0% +0.7% +10.0% ➖ noise
47 duckdb:vortex-compact +2.7% -4.0% +7.1% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -1.4% -4.0% +2.7% +10.0% ➖ noise
48 datafusion:vortex-compact +14.2% +0.6% +13.6% +10.0% 🚨 regression
48 datafusion:vortex-file-compressed +5.6% +0.6% +5.0% +10.0% ➖ noise
48 duckdb:duckdb -2.4% +0.6% -3.0% +19.9% ➖ noise
48 duckdb:vortex-compact -27.6% +0.6% -28.0% +13.5% ✅ faster
48 duckdb:vortex-file-compressed -19.9% +0.6% -20.4% +10.1% ✅ faster
49 datafusion:vortex-compact +1.9% -2.9% +5.0% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +1.4% -2.9% +4.4% +10.0% ➖ noise
49 duckdb:duckdb -3.7% -2.9% -0.8% +11.2% ➖ noise
49 duckdb:vortex-compact -2.5% -2.9% +0.4% +10.5% ➖ noise
49 duckdb:vortex-file-compressed +11.4% -2.9% +14.7% +20.2% ➖ noise
50 datafusion:vortex-compact -1.8% +1.0% -2.8% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -5.0% +1.0% -6.0% +10.0% ➖ noise
50 duckdb:duckdb +5.7% +1.0% +4.6% +10.8% ➖ noise
50 duckdb:vortex-compact -16.0% +1.0% -16.9% +10.0% ✅ faster
50 duckdb:vortex-file-compressed +0.6% +1.0% -0.4% +10.0% ➖ noise
51 datafusion:vortex-compact +0.1% -2.3% +2.5% +10.2% ➖ noise
51 datafusion:vortex-file-compressed +0.6% -2.3% +3.0% +10.0% ➖ noise
51 duckdb:duckdb -2.1% -2.3% +0.2% +17.4% ➖ noise
51 duckdb:vortex-compact +1.0% -2.3% +3.4% +19.3% ➖ noise
51 duckdb:vortex-file-compressed +1.9% -2.3% +4.3% +18.5% ➖ noise
52 datafusion:vortex-compact -4.4% +0.3% -4.7% +10.8% ➖ noise
52 datafusion:vortex-file-compressed +9.2% +0.3% +8.9% +10.1% ➖ noise
52 duckdb:duckdb -5.4% +0.3% -5.7% +19.6% ➖ noise
52 duckdb:vortex-compact -1.7% +0.3% -2.0% +12.4% ➖ noise
52 duckdb:vortex-file-compressed +4.2% +0.3% +3.9% +19.7% ➖ noise
53 datafusion:vortex-compact -0.1% -2.7% +2.7% +10.4% ➖ noise
53 datafusion:vortex-file-compressed -0.0% -2.7% +2.7% +10.5% ➖ noise
53 duckdb:duckdb -3.6% -2.7% -1.0% +15.7% ➖ noise
53 duckdb:vortex-compact -7.2% -2.7% -4.6% +10.4% ➖ noise
53 duckdb:vortex-file-compressed +1.3% -2.7% +4.1% +15.9% ➖ noise
54 datafusion:vortex-compact +0.2% +0.4% -0.2% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -2.8% +0.4% -3.2% +10.0% ➖ noise
54 duckdb:duckdb +5.8% +0.4% +5.4% +12.9% ➖ noise
54 duckdb:vortex-compact +0.2% +0.4% -0.2% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +9.2% +0.4% +8.8% +10.0% ➖ noise
55 datafusion:vortex-compact +4.0% -2.4% +6.5% +11.4% ➖ noise
55 datafusion:vortex-file-compressed +0.5% -2.4% +2.9% +10.1% ➖ noise
55 duckdb:duckdb -6.3% -2.4% -4.0% +15.9% ➖ noise
55 duckdb:vortex-compact -3.1% -2.4% -0.8% +13.8% ➖ noise
55 duckdb:vortex-file-compressed -7.1% -2.4% -4.9% +20.2% ➖ noise
56 datafusion:vortex-compact -0.2% +1.3% -1.5% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -3.7% +1.3% -4.9% +10.0% ➖ noise
56 duckdb:duckdb -1.8% +1.3% -3.1% +11.3% ➖ noise
56 duckdb:vortex-compact -3.5% +1.3% -4.8% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +3.0% +1.3% +1.6% +17.2% ➖ noise
57 datafusion:vortex-compact +4.3% -5.2% +10.1% +10.0% 🚨 regression
57 datafusion:vortex-file-compressed -2.0% -5.2% +3.4% +10.0% ➖ noise
57 duckdb:duckdb -3.0% -5.2% +2.4% +11.2% ➖ noise
57 duckdb:vortex-compact +1.3% -5.2% +6.9% +10.4% ➖ noise
57 duckdb:vortex-file-compressed -1.9% -5.2% +3.5% +15.5% ➖ noise
58 datafusion:vortex-compact +1.6% -5.4% +7.3% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +0.6% -5.4% +6.3% +10.0% ➖ noise
58 duckdb:duckdb +6.3% -5.4% +12.4% +10.9% 🚨 regression
58 duckdb:vortex-compact +0.8% -5.4% +6.5% +15.7% ➖ noise
58 duckdb:vortex-file-compressed +3.9% -5.4% +9.8% +19.8% ➖ noise
59 datafusion:vortex-compact +4.5% +2.9% +1.5% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -1.2% +2.9% -4.0% +10.0% ➖ noise
59 duckdb:duckdb +1.5% +2.9% -1.3% +10.0% ➖ noise
59 duckdb:vortex-compact -1.6% +2.9% -4.4% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +0.5% +2.9% -2.4% +10.0% ➖ noise
60 datafusion:vortex-compact -0.8% -2.9% +2.2% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -7.6% -2.9% -4.8% +12.7% ➖ noise
60 duckdb:duckdb +0.3% -2.9% +3.2% +12.9% ➖ noise
60 duckdb:vortex-compact -9.1% -2.9% -6.4% +11.6% ➖ noise
60 duckdb:vortex-file-compressed -13.8% -2.9% -11.2% +11.4% ✅ faster
61 datafusion:vortex-compact -1.6% +1.8% -3.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -4.1% +1.8% -5.8% +10.0% ➖ noise
61 duckdb:duckdb -5.2% +1.8% -6.9% +12.7% ➖ noise
61 duckdb:vortex-compact -7.7% +1.8% -9.3% +10.0% ✅ faster
61 duckdb:vortex-file-compressed -13.6% +1.8% -15.1% +12.7% ✅ faster
62 datafusion:vortex-compact -0.2% -4.8% +4.9% +12.2% ➖ noise
62 datafusion:vortex-file-compressed +4.2% -4.8% +9.5% +14.0% ➖ noise
62 duckdb:duckdb -5.2% -4.8% -0.4% +13.8% ➖ noise
62 duckdb:vortex-compact +0.3% -4.8% +5.4% +26.6% ➖ noise
62 duckdb:vortex-file-compressed +11.9% -4.8% +17.6% +26.8% ➖ noise
63 datafusion:vortex-compact -6.7% +3.8% -10.1% +10.0% ✅ faster
63 datafusion:vortex-file-compressed +2.1% +3.8% -1.6% +10.4% ➖ noise
63 duckdb:duckdb +2.0% +3.8% -1.7% +10.0% ➖ noise
63 duckdb:vortex-compact +3.0% +3.8% -0.8% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -4.6% +3.8% -8.1% +13.2% ➖ noise
64 datafusion:vortex-compact -4.7% -0.7% -4.0% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +0.9% -0.7% +1.6% +10.0% ➖ noise
64 duckdb:duckdb -4.6% -0.7% -3.9% +11.5% ➖ noise
64 duckdb:vortex-compact -10.2% -0.7% -9.6% +10.0% ✅ faster
64 duckdb:vortex-file-compressed -4.3% -0.7% -3.6% +10.0% ➖ noise
65 datafusion:vortex-compact -3.0% -4.7% +1.8% +10.4% ➖ noise
65 datafusion:vortex-file-compressed +2.6% -4.7% +7.7% +10.2% ➖ noise
65 duckdb:duckdb +0.3% -4.7% +5.2% +14.0% ➖ noise
65 duckdb:vortex-compact -2.8% -4.7% +2.0% +10.5% ➖ noise
65 duckdb:vortex-file-compressed -7.1% -4.7% -2.5% +11.2% ➖ noise
66 datafusion:vortex-compact -6.9% +1.8% -8.5% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -6.2% +1.8% -7.8% +10.4% ➖ noise
66 duckdb:duckdb +2.1% +1.8% +0.4% +10.2% ➖ noise
66 duckdb:vortex-compact -5.2% +1.8% -6.9% +10.1% ➖ noise
66 duckdb:vortex-file-compressed +5.9% +1.8% +4.0% +21.3% ➖ noise
67 datafusion:vortex-compact -6.2% -1.7% -4.5% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -7.5% -1.7% -5.9% +10.0% ➖ noise
67 duckdb:duckdb -1.6% -1.7% +0.2% +10.0% ➖ noise
67 duckdb:vortex-compact -1.0% -1.7% +0.8% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -1.0% -1.7% +0.7% +10.0% ➖ noise
68 datafusion:vortex-compact -8.6% +1.1% -9.6% +10.0% ✅ faster
68 datafusion:vortex-file-compressed +1.7% +1.1% +0.6% +10.0% ➖ noise
68 duckdb:duckdb -2.5% +1.1% -3.6% +10.0% ➖ noise
68 duckdb:vortex-compact -7.3% +1.1% -8.4% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +4.0% +1.1% +2.8% +10.2% ➖ noise
69 datafusion:vortex-compact -1.8% -1.2% -0.6% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -0.0% -1.2% +1.2% +10.0% ➖ noise
69 duckdb:duckdb -1.4% -1.2% -0.2% +10.2% ➖ noise
69 duckdb:vortex-compact -14.7% -1.2% -13.6% +10.2% ✅ faster
69 duckdb:vortex-file-compressed -2.7% -1.2% -1.5% +13.9% ➖ noise
70 datafusion:vortex-compact +1.0% -1.7% +2.7% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -1.8% -1.7% -0.1% +10.0% ➖ noise
70 duckdb:duckdb -1.8% -1.7% -0.2% +12.0% ➖ noise
70 duckdb:vortex-compact +5.8% -1.7% +7.6% +15.0% ➖ noise
70 duckdb:vortex-file-compressed +0.7% -1.7% +2.4% +10.4% ➖ noise
71 datafusion:vortex-compact -4.8% +7.5% -11.4% +10.0% ✅ faster
71 datafusion:vortex-file-compressed -10.8% +7.5% -17.0% +10.0% ✅ faster
71 duckdb:duckdb +0.9% +7.5% -6.1% +16.7% ➖ noise
71 duckdb:vortex-compact +5.0% +7.5% -2.3% +12.5% ➖ noise
71 duckdb:vortex-file-compressed -1.2% +7.5% -8.1% +13.8% ➖ noise
72 datafusion:vortex-compact -6.3% -1.5% -4.9% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +2.0% -1.5% +3.5% +10.0% ➖ noise
72 duckdb:duckdb -0.5% -1.5% +1.0% +11.4% ➖ noise
72 duckdb:vortex-compact +1.9% -1.5% +3.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.0% -1.5% +1.5% +10.0% ➖ noise
73 datafusion:vortex-compact -10.6% -4.6% -6.3% +22.5% ➖ noise
73 datafusion:vortex-file-compressed -2.7% -4.6% +2.0% +25.5% ➖ noise
73 duckdb:duckdb -5.9% -4.6% -1.4% +13.3% ➖ noise
73 duckdb:vortex-compact -14.1% -4.6% -10.0% +10.6% ✅ faster
73 duckdb:vortex-file-compressed -1.9% -4.6% +2.8% +14.6% ➖ noise
74 datafusion:vortex-compact -6.7% +0.8% -7.4% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +2.7% +0.8% +1.9% +10.0% ➖ noise
74 duckdb:duckdb -1.3% +0.8% -2.1% +10.0% ➖ noise
74 duckdb:vortex-compact -1.1% +0.8% -1.8% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +13.2% +0.8% +12.4% +10.0% 🚨 regression
75 datafusion:vortex-compact -7.8% +0.1% -8.0% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -2.9% +0.1% -3.0% +10.0% ➖ noise
75 duckdb:duckdb -1.6% +0.1% -1.8% +10.0% ➖ noise
75 duckdb:vortex-compact +1.0% +0.1% +0.8% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -2.0% +0.1% -2.2% +10.5% ➖ noise
76 datafusion:vortex-compact -8.3% -4.1% -4.4% +11.4% ➖ noise
76 datafusion:vortex-file-compressed +2.2% -4.1% +6.6% +12.3% ➖ noise
76 duckdb:duckdb -0.4% -4.1% +3.9% +28.6% ➖ noise
76 duckdb:vortex-compact -13.7% -4.1% -10.0% +11.2% ➖ noise
76 duckdb:vortex-file-compressed +11.3% -4.1% +16.1% +10.0% 🚨 regression
77 datafusion:vortex-compact -1.6% -2.9% +1.3% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +3.8% -2.9% +6.9% +10.0% ➖ noise
77 duckdb:duckdb -0.2% -2.9% +2.8% +10.8% ➖ noise
77 duckdb:vortex-compact -9.2% -2.9% -6.5% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +3.6% -2.9% +6.7% +10.0% ➖ noise
78 datafusion:vortex-compact -6.6% -4.4% -2.4% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +0.0% -4.4% +4.6% +10.0% ➖ noise
78 duckdb:duckdb +3.0% -4.4% +7.7% +11.0% ➖ noise
78 duckdb:vortex-compact +2.2% -4.4% +6.9% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +4.4% -4.4% +9.1% +14.8% ➖ noise
79 datafusion:vortex-compact -7.2% -0.2% -7.0% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +1.8% -0.2% +2.0% +10.0% ➖ noise
79 duckdb:duckdb -5.2% -0.2% -5.0% +10.0% ➖ noise
79 duckdb:vortex-compact -13.7% -0.2% -13.6% +10.0% ✅ faster
79 duckdb:vortex-file-compressed +0.9% -0.2% +1.1% +13.2% ➖ noise
80 datafusion:vortex-compact +1.4% -1.3% +2.7% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +2.5% -1.3% +3.8% +10.0% ➖ noise
80 duckdb:duckdb -5.5% -1.3% -4.3% +10.0% ➖ noise
80 duckdb:vortex-compact -10.8% -1.3% -9.6% +10.8% ➖ noise
80 duckdb:vortex-file-compressed -2.8% -1.3% -1.5% +10.0% ➖ noise
81 datafusion:vortex-compact +4.6% -0.6% +5.3% +11.4% ➖ noise
81 datafusion:vortex-file-compressed -0.4% -0.6% +0.2% +11.1% ➖ noise
81 duckdb:duckdb -7.6% -0.6% -7.1% +10.4% ➖ noise
81 duckdb:vortex-compact -5.9% -0.6% -5.3% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -8.4% -0.6% -7.9% +14.6% ➖ noise
82 datafusion:vortex-compact -2.7% +0.2% -2.9% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +3.3% +0.2% +3.0% +10.0% ➖ noise
82 duckdb:duckdb -3.5% +0.2% -3.7% +10.0% ➖ noise
82 duckdb:vortex-compact +3.3% +0.2% +3.0% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -2.9% +0.2% -3.2% +14.7% ➖ noise
83 datafusion:vortex-compact -1.5% +3.9% -5.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +6.2% +3.9% +2.2% +10.0% ➖ noise
83 duckdb:duckdb -2.9% +3.9% -6.6% +11.3% ➖ noise
83 duckdb:vortex-compact -6.7% +3.9% -10.3% +10.0% ✅ faster
83 duckdb:vortex-file-compressed +1.4% +3.9% -2.4% +12.2% ➖ noise
84 datafusion:vortex-compact +2.0% -0.7% +2.8% +12.6% ➖ noise
84 datafusion:vortex-file-compressed +6.7% -0.7% +7.5% +10.0% ➖ noise
84 duckdb:duckdb -0.5% -0.7% +0.2% +10.0% ➖ noise
84 duckdb:vortex-compact -6.6% -0.7% -5.9% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +1.1% -0.7% +1.9% +10.0% ➖ noise
85 datafusion:vortex-compact -0.6% -3.0% +2.5% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +1.9% -3.0% +5.1% +10.0% ➖ noise
85 duckdb:duckdb +0.1% -3.0% +3.2% +10.0% ➖ noise
85 duckdb:vortex-compact -0.3% -3.0% +2.9% +10.5% ➖ noise
85 duckdb:vortex-file-compressed +1.3% -3.0% +4.5% +10.0% ➖ noise
86 datafusion:vortex-compact +2.1% -3.0% +5.2% +10.0% ➖ noise
86 datafusion:vortex-file-compressed +6.7% -3.0% +10.0% +12.3% ➖ noise
86 duckdb:duckdb -8.8% -3.0% -6.0% +14.7% ➖ noise
86 duckdb:vortex-compact +13.8% -3.0% +17.3% +16.7% 🚨 regression
86 duckdb:vortex-file-compressed -5.5% -3.0% -2.6% +13.4% ➖ noise
87 datafusion:vortex-compact -1.8% -4.2% +2.6% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -1.6% -4.2% +2.8% +10.0% ➖ noise
87 duckdb:duckdb +3.1% -4.2% +7.7% +10.0% ➖ noise
87 duckdb:vortex-compact -11.7% -4.2% -7.8% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -18.1% -4.2% -14.5% +14.3% ✅ faster
88 datafusion:vortex-compact +8.2% +0.7% +7.4% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -9.3% +0.7% -10.0% +10.0% ✅ faster
88 duckdb:duckdb +1.3% +0.7% +0.5% +10.0% ➖ noise
88 duckdb:vortex-compact -8.3% +0.7% -9.0% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -22.7% +0.7% -23.2% +12.0% ✅ faster
89 datafusion:vortex-compact +3.8% -2.3% +6.2% +10.8% ➖ noise
89 datafusion:vortex-file-compressed -1.3% -2.3% +1.0% +11.0% ➖ noise
89 duckdb:duckdb +2.7% -2.3% +5.2% +12.2% ➖ noise
89 duckdb:vortex-compact +0.5% -2.3% +2.8% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -9.0% -2.3% -6.9% +12.4% ➖ noise
90 datafusion:vortex-compact -1.6% -3.1% +1.6% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -4.4% -3.1% -1.3% +13.5% ➖ noise
90 duckdb:duckdb +4.2% -3.1% +7.6% +11.4% ➖ noise
90 duckdb:vortex-compact -0.6% -3.1% +2.6% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -6.3% -3.1% -3.3% +20.2% ➖ noise
91 datafusion:vortex-compact +0.3% +2.4% -2.1% +10.2% ➖ noise
91 datafusion:vortex-file-compressed -6.1% +2.4% -8.3% +12.3% ➖ noise
91 duckdb:duckdb -0.7% +2.4% -3.1% +13.6% ➖ noise
91 duckdb:vortex-compact -2.2% +2.4% -4.5% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +1.0% +2.4% -1.4% +15.4% ➖ noise
92 datafusion:vortex-compact -5.1% +1.9% -6.9% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +3.2% +1.9% +1.2% +10.0% ➖ noise
92 duckdb:duckdb -3.0% +1.9% -4.9% +14.0% ➖ noise
92 duckdb:vortex-compact +4.7% +1.9% +2.7% +16.8% ➖ noise
92 duckdb:vortex-file-compressed -1.2% +1.9% -3.1% +14.2% ➖ noise
93 datafusion:vortex-compact -6.3% -4.6% -1.8% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.6% -4.6% +3.1% +10.0% ➖ noise
93 duckdb:duckdb +3.4% -4.6% +8.4% +11.3% ➖ noise
93 duckdb:vortex-compact +0.9% -4.6% +5.8% +10.0% ➖ noise
93 duckdb:vortex-file-compressed -0.2% -4.6% +4.6% +12.9% ➖ noise
94 datafusion:vortex-compact -4.7% +3.3% -7.7% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -1.5% +3.3% -4.6% +10.0% ➖ noise
94 duckdb:duckdb -5.2% +3.3% -8.2% +10.0% ➖ noise
94 duckdb:vortex-compact +0.8% +3.3% -2.4% +12.2% ➖ noise
94 duckdb:vortex-file-compressed -8.3% +3.3% -11.2% +10.0% ✅ faster
95 datafusion:vortex-compact -0.5% +6.0% -6.1% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +0.4% +6.0% -5.3% +10.0% ➖ noise
95 duckdb:duckdb -14.3% +6.0% -19.1% +16.3% ✅ faster
95 duckdb:vortex-compact -1.5% +6.0% -7.1% +18.4% ➖ noise
95 duckdb:vortex-file-compressed -13.2% +6.0% -18.0% +12.9% ✅ faster
96 datafusion:vortex-compact +5.6% +1.3% +4.2% +10.3% ➖ noise
96 datafusion:vortex-file-compressed -6.6% +1.3% -7.7% +11.8% ➖ noise
96 duckdb:duckdb +2.2% +1.3% +0.9% +13.7% ➖ noise
96 duckdb:vortex-compact -29.8% +1.3% -30.7% +15.8% ✅ faster
96 duckdb:vortex-file-compressed -34.7% +1.3% -35.5% +15.3% ✅ faster
97 datafusion:vortex-compact -5.7% -0.7% -5.0% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +3.3% -0.7% +4.0% +11.0% ➖ noise
97 duckdb:duckdb -2.8% -0.7% -2.2% +11.7% ➖ noise
97 duckdb:vortex-compact -2.3% -0.7% -1.6% +10.3% ➖ noise
97 duckdb:vortex-file-compressed +1.1% -0.7% +1.8% +10.5% ➖ noise
98 datafusion:vortex-compact -5.5% -3.8% -1.8% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -0.2% -3.8% +3.7% +10.0% ➖ noise
98 duckdb:duckdb -11.3% -3.8% -7.8% +13.8% ➖ noise
98 duckdb:vortex-compact +1.0% -3.8% +4.9% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -1.2% -3.8% +2.7% +10.5% ➖ noise
99 datafusion:vortex-compact -0.6% -0.8% +0.1% +13.9% ➖ noise
99 datafusion:vortex-file-compressed -1.8% -0.8% -1.1% +10.0% ➖ noise
99 duckdb:duckdb -0.9% -0.8% -0.1% +23.8% ➖ noise
99 duckdb:vortex-compact +9.7% -0.8% +10.5% +27.5% ➖ noise
99 duckdb:vortex-file-compressed +0.9% -0.8% +1.7% +22.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.1%
Vortex (geomean): 1.010x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.8%

datafusion / vortex-file-compressed (1.023x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50361137 46994701 1.07
tpch_q02/datafusion:vortex-file-compressed 32554590 31912475 1.02
tpch_q03/datafusion:vortex-file-compressed 27755987 26097492 1.06
tpch_q04/datafusion:vortex-file-compressed 18325155 17570317 1.04
tpch_q05/datafusion:vortex-file-compressed 53342690 53640383 0.99
tpch_q06/datafusion:vortex-file-compressed 9682541 9548398 1.01
tpch_q07/datafusion:vortex-file-compressed 61954917 61609095 1.01
tpch_q08/datafusion:vortex-file-compressed 46200683 43999050 1.05
tpch_q09/datafusion:vortex-file-compressed 55868843 54439145 1.03
tpch_q10/datafusion:vortex-file-compressed 44596690 43088898 1.03
tpch_q11/datafusion:vortex-file-compressed 17593279 17863244 0.98
tpch_q12/datafusion:vortex-file-compressed 22988584 22053569 1.04
tpch_q13/datafusion:vortex-file-compressed 26250619 27477718 0.96
tpch_q14/datafusion:vortex-file-compressed 15787213 15587971 1.01
tpch_q15/datafusion:vortex-file-compressed 24695196 24107680 1.02
tpch_q16/datafusion:vortex-file-compressed 24385714 23800270 1.02
tpch_q17/datafusion:vortex-file-compressed 64161572 63722290 1.01
tpch_q18/datafusion:vortex-file-compressed 78534684 77697592 1.01
tpch_q19/datafusion:vortex-file-compressed 22464563 21475157 1.05
tpch_q20/datafusion:vortex-file-compressed 33535617 32635587 1.03
tpch_q21/datafusion:vortex-file-compressed 74459857 75337374 0.99
tpch_q22/datafusion:vortex-file-compressed 16974827 15909598 1.07
datafusion / vortex-compact (1.012x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59244194 58151529 1.02
tpch_q02/datafusion:vortex-compact 36331498 37243728 0.98
tpch_q03/datafusion:vortex-compact 30972432 32155296 0.96
tpch_q04/datafusion:vortex-compact 22859530 23844282 0.96
tpch_q05/datafusion:vortex-compact 56311024 55552217 1.01
tpch_q06/datafusion:vortex-compact 13399523 13704122 0.98
tpch_q07/datafusion:vortex-compact 70748283 67734117 1.04
tpch_q08/datafusion:vortex-compact 50135137 48678208 1.03
tpch_q09/datafusion:vortex-compact 61467161 60989505 1.01
tpch_q10/datafusion:vortex-compact 52295599 51992356 1.01
tpch_q11/datafusion:vortex-compact 19937639 18781621 1.06
tpch_q12/datafusion:vortex-compact 32003244 31755649 1.01
tpch_q13/datafusion:vortex-compact 35904224 36145922 0.99
tpch_q14/datafusion:vortex-compact 19756216 19378287 1.02
tpch_q15/datafusion:vortex-compact 34261413 32846086 1.04
tpch_q16/datafusion:vortex-compact 30167001 28359864 1.06
tpch_q17/datafusion:vortex-compact 68982747 67092723 1.03
tpch_q18/datafusion:vortex-compact 83914461 83820086 1.00
tpch_q19/datafusion:vortex-compact 31889027 31421657 1.01
tpch_q20/datafusion:vortex-compact 38370377 37510187 1.02
tpch_q21/datafusion:vortex-compact 86476113 85778914 1.01
tpch_q22/datafusion:vortex-compact 16998225 16734884 1.02
datafusion / parquet (0.997x ➖, 2↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 96718418 92870629 1.04
tpch_q02/datafusion:parquet 71287865 69020844 1.03
tpch_q03/datafusion:parquet 80633932 76773222 1.05
tpch_q04/datafusion:parquet 47992551 48071034 1.00
tpch_q05/datafusion:parquet 101933893 101176064 1.01
tpch_q06/datafusion:parquet 45132520 43336589 1.04
tpch_q07/datafusion:parquet 113024043 115704030 0.98
tpch_q08/datafusion:parquet 98803248 97126054 1.02
tpch_q09/datafusion:parquet 132948045 138468891 0.96
tpch_q10/datafusion:parquet 118909616 120010817 0.99
tpch_q11/datafusion:parquet 48143839 47520412 1.01
tpch_q12/datafusion:parquet 🚀 79319946 95970389 0.83
tpch_q13/datafusion:parquet 204872319 202185965 1.01
tpch_q14/datafusion:parquet 🚀 45037351 52461661 0.86
tpch_q15/datafusion:parquet 68598805 66291660 1.03
tpch_q16/datafusion:parquet 50742619 51059832 0.99
tpch_q17/datafusion:parquet 135535820 126064311 1.08
tpch_q18/datafusion:parquet 168692930 167806426 1.01
tpch_q19/datafusion:parquet 85335386 83908096 1.02
tpch_q20/datafusion:parquet 78245859 78639113 0.99
tpch_q21/datafusion:parquet 153494541 148253239 1.04
tpch_q22/datafusion:parquet 35929098 36691269 0.98
datafusion / arrow (1.000x ➖, 1↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 51950366 54130139 0.96
tpch_q02/datafusion:arrow 21609547 21356015 1.01
tpch_q03/datafusion:arrow 32684889 32576325 1.00
tpch_q04/datafusion:arrow 26366735 26672208 0.99
tpch_q05/datafusion:arrow 74349819 79435257 0.94
tpch_q06/datafusion:arrow 19686819 20922722 0.94
tpch_q07/datafusion:arrow 112691661 110909206 1.02
tpch_q08/datafusion:arrow 46735523 43995937 1.06
tpch_q09/datafusion:arrow 70469297 69371991 1.02
tpch_q10/datafusion:arrow 53368773 48901905 1.09
tpch_q11/datafusion:arrow 12029113 11160413 1.08
tpch_q12/datafusion:arrow 54465350 53122644 1.03
tpch_q13/datafusion:arrow 48099477 47254621 1.02
tpch_q14/datafusion:arrow 23335774 22523697 1.04
tpch_q15/datafusion:arrow 45581748 43719073 1.04
tpch_q16/datafusion:arrow 21291415 21105254 1.01
tpch_q17/datafusion:arrow 72326564 67916124 1.06
tpch_q18/datafusion:arrow 139718942 140257434 1.00
tpch_q19/datafusion:arrow 🚀 37579005 44667881 0.84
tpch_q20/datafusion:arrow 36827096 40661110 0.91
tpch_q21/datafusion:arrow 148946251 150173909 0.99
tpch_q22/datafusion:arrow 19425335 19563067 0.99
duckdb / vortex-file-compressed (1.014x ➖, 0↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33652585 32784548 1.03
tpch_q02/duckdb:vortex-file-compressed 26049168 27508969 0.95
tpch_q03/duckdb:vortex-file-compressed 29574901 28903586 1.02
tpch_q04/duckdb:vortex-file-compressed 29948842 29911364 1.00
tpch_q05/duckdb:vortex-file-compressed 32497868 34196324 0.95
tpch_q06/duckdb:vortex-file-compressed 🚨 11766037 10331723 1.14
tpch_q07/duckdb:vortex-file-compressed 37485778 36302164 1.03
tpch_q08/duckdb:vortex-file-compressed 41084438 38601517 1.06
tpch_q09/duckdb:vortex-file-compressed 76651111 77334068 0.99
tpch_q10/duckdb:vortex-file-compressed 36464127 36581901 1.00
tpch_q11/duckdb:vortex-file-compressed 15317432 16467593 0.93
tpch_q12/duckdb:vortex-file-compressed 23186514 21706954 1.07
tpch_q13/duckdb:vortex-file-compressed 37502311 36682354 1.02
tpch_q14/duckdb:vortex-file-compressed 21639187 21530684 1.01
tpch_q15/duckdb:vortex-file-compressed 16110533 15948767 1.01
tpch_q16/duckdb:vortex-file-compressed 29979691 29291611 1.02
tpch_q17/duckdb:vortex-file-compressed 25163523 24532640 1.03
tpch_q18/duckdb:vortex-file-compressed 50406750 47227877 1.07
tpch_q19/duckdb:vortex-file-compressed 31064710 31467421 0.99
tpch_q20/duckdb:vortex-file-compressed 33934420 34352807 0.99
tpch_q21/duckdb:vortex-file-compressed 107142581 101460443 1.06
tpch_q22/duckdb:vortex-file-compressed 17989813 18533305 0.97
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39161673 39997514 0.98
tpch_q02/duckdb:vortex-compact 35993438 38807535 0.93
tpch_q03/duckdb:vortex-compact 32886218 31878286 1.03
tpch_q04/duckdb:vortex-compact 33605325 33908089 0.99
tpch_q05/duckdb:vortex-compact 37412502 36288014 1.03
tpch_q06/duckdb:vortex-compact 13825154 14244260 0.97
tpch_q07/duckdb:vortex-compact 42066345 43358085 0.97
tpch_q08/duckdb:vortex-compact 45281699 45108423 1.00
tpch_q09/duckdb:vortex-compact 89720170 90833547 0.99
tpch_q10/duckdb:vortex-compact 41050236 40759164 1.01
tpch_q11/duckdb:vortex-compact 19606607 20861801 0.94
tpch_q12/duckdb:vortex-compact 35723428 35430433 1.01
tpch_q13/duckdb:vortex-compact 46554831 46503406 1.00
tpch_q14/duckdb:vortex-compact 29574623 29791607 0.99
tpch_q15/duckdb:vortex-compact 18941660 19450261 0.97
tpch_q16/duckdb:vortex-compact 36292789 37468513 0.97
tpch_q17/duckdb:vortex-compact 31595451 30277409 1.04
tpch_q18/duckdb:vortex-compact 49843640 49908480 1.00
tpch_q19/duckdb:vortex-compact 36468055 37010696 0.99
tpch_q20/duckdb:vortex-compact 42373901 42271270 1.00
tpch_q21/duckdb:vortex-compact 111190396 107996137 1.03
tpch_q22/duckdb:vortex-compact 20145911 20544461 0.98
duckdb / parquet (0.999x ➖, 3↑ 2↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 78546197 108744246 0.72
tpch_q02/duckdb:parquet 38881716 39084033 0.99
tpch_q03/duckdb:parquet 69267850 69258630 1.00
tpch_q04/duckdb:parquet 🚀 48182847 54523087 0.88
tpch_q05/duckdb:parquet 66885671 65838007 1.02
tpch_q06/duckdb:parquet 🚨 29027382 20786132 1.40
tpch_q07/duckdb:parquet 67514872 66371292 1.02
tpch_q08/duckdb:parquet 80376031 79524277 1.01
tpch_q09/duckdb:parquet 150310319 152495430 0.99
tpch_q10/duckdb:parquet 127782841 125981512 1.01
tpch_q11/duckdb:parquet 21605732 22623248 0.96
tpch_q12/duckdb:parquet 50855003 55833322 0.91
tpch_q13/duckdb:parquet 262001163 262635628 1.00
tpch_q14/duckdb:parquet 62868688 63093672 1.00
tpch_q15/duckdb:parquet 🚨 34832706 24307193 1.43
tpch_q16/duckdb:parquet 57305416 55541500 1.03
tpch_q17/duckdb:parquet 55361642 53155758 1.04
tpch_q18/duckdb:parquet 117551400 118960081 0.99
tpch_q19/duckdb:parquet 68630354 67829363 1.01
tpch_q20/duckdb:parquet 🚀 62882356 83805574 0.75
tpch_q21/duckdb:parquet 179406226 170119638 1.05
tpch_q22/duckdb:parquet 51681677 51837143 1.00
duckdb / duckdb (1.014x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15870584 15835448 1.00
tpch_q02/duckdb:duckdb 12172172 12315748 0.99
tpch_q03/duckdb:duckdb 19230501 18318576 1.05
tpch_q04/duckdb:duckdb 19571653 18245511 1.07
tpch_q05/duckdb:duckdb 20012208 19566533 1.02
tpch_q06/duckdb:duckdb 5274238 5282493 1.00
tpch_q07/duckdb:duckdb 23822911 22711220 1.05
tpch_q08/duckdb:duckdb 20793235 20612370 1.01
tpch_q09/duckdb:duckdb 54102047 54798125 0.99
tpch_q10/duckdb:duckdb 44451464 42762923 1.04
tpch_q11/duckdb:duckdb 5577920 6065269 0.92
tpch_q12/duckdb:duckdb 14871567 13666407 1.09
tpch_q13/duckdb:duckdb 37488461 38285358 0.98
tpch_q14/duckdb:duckdb 16171575 16069790 1.01
tpch_q15/duckdb:duckdb 11706032 12230577 0.96
tpch_q16/duckdb:duckdb 22898187 22117352 1.04
tpch_q17/duckdb:duckdb 13739844 13326618 1.03
tpch_q18/duckdb:duckdb 39026958 37393635 1.04
tpch_q19/duckdb:duckdb 26424648 25696575 1.03
tpch_q20/duckdb:duckdb 23445506 22416981 1.05
tpch_q21/duckdb:duckdb 55291523 54876465 1.01
tpch_q22/duckdb:duckdb 23583532 24245574 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -4.0% -13.3% +10.7% +24.7% ➖ noise
1 datafusion:vortex-compact +1.9% -13.3% +17.5% +24.6% ➖ noise
1 datafusion:vortex-file-compressed +7.2% -13.3% +23.6% +24.6% ➖ noise
1 duckdb:duckdb +0.2% -13.3% +15.6% +24.6% ➖ noise
1 duckdb:vortex-compact -2.1% -13.3% +12.9% +24.6% ➖ noise
1 duckdb:vortex-file-compressed +2.6% -13.3% +18.4% +24.6% ➖ noise
2 datafusion:arrow +1.2% +1.4% -0.2% +24.6% ➖ noise
2 datafusion:vortex-compact -2.4% +1.4% -3.8% +24.6% ➖ noise
2 datafusion:vortex-file-compressed +2.0% +1.4% +0.6% +24.6% ➖ noise
2 duckdb:duckdb -1.2% +1.4% -2.5% +24.6% ➖ noise
2 duckdb:vortex-compact -7.3% +1.4% -8.5% +24.6% ➖ noise
2 duckdb:vortex-file-compressed -5.3% +1.4% -6.6% +24.6% ➖ noise
3 datafusion:arrow +0.3% +2.5% -2.1% +24.6% ➖ noise
3 datafusion:vortex-compact -3.7% +2.5% -6.0% +24.6% ➖ noise
3 datafusion:vortex-file-compressed +6.4% +2.5% +3.8% +24.6% ➖ noise
3 duckdb:duckdb +5.0% +2.5% +2.4% +24.6% ➖ noise
3 duckdb:vortex-compact +3.2% +2.5% +0.7% +24.6% ➖ noise
3 duckdb:vortex-file-compressed +2.3% +2.5% -0.2% +24.6% ➖ noise
4 datafusion:arrow -1.1% -6.1% +5.2% +24.6% ➖ noise
4 datafusion:vortex-compact -4.1% -6.1% +2.1% +24.6% ➖ noise
4 datafusion:vortex-file-compressed +4.3% -6.1% +11.0% +24.6% ➖ noise
4 duckdb:duckdb +7.3% -6.1% +14.2% +24.6% ➖ noise
4 duckdb:vortex-compact -0.9% -6.1% +5.5% +24.6% ➖ noise
4 duckdb:vortex-file-compressed +0.1% -6.1% +6.6% +24.6% ➖ noise
5 datafusion:arrow -6.4% +1.2% -7.5% +24.6% ➖ noise
5 datafusion:vortex-compact +1.4% +1.2% +0.2% +24.6% ➖ noise
5 datafusion:vortex-file-compressed -0.6% +1.2% -1.7% +24.6% ➖ noise
5 duckdb:duckdb +2.3% +1.2% +1.1% +24.6% ➖ noise
5 duckdb:vortex-compact +3.1% +1.2% +1.9% +24.6% ➖ noise
5 duckdb:vortex-file-compressed -5.0% +1.2% -6.1% +24.6% ➖ noise
6 datafusion:arrow -5.9% +20.6% -22.0% +24.6% ✅ faster
6 datafusion:vortex-compact -2.2% +20.6% -18.9% +24.6% ➖ noise
6 datafusion:vortex-file-compressed +1.4% +20.6% -15.9% +24.6% ➖ noise
6 duckdb:duckdb -0.2% +20.6% -17.2% +27.8% ➖ noise
6 duckdb:vortex-compact -2.9% +20.6% -19.5% +24.6% ➖ noise
6 duckdb:vortex-file-compressed +13.9% +20.6% -5.6% +25.6% ➖ noise
7 datafusion:arrow +1.6% -0.3% +1.9% +24.6% ➖ noise
7 datafusion:vortex-compact +4.4% -0.3% +4.8% +24.6% ➖ noise
7 datafusion:vortex-file-compressed +0.6% -0.3% +0.9% +24.6% ➖ noise
7 duckdb:duckdb +4.9% -0.3% +5.2% +24.6% ➖ noise
7 duckdb:vortex-compact -3.0% -0.3% -2.7% +24.6% ➖ noise
7 duckdb:vortex-file-compressed +3.3% -0.3% +3.6% +24.6% ➖ noise
8 datafusion:arrow +6.2% +1.4% +4.8% +24.6% ➖ noise
8 datafusion:vortex-compact +3.0% +1.4% +1.6% +24.6% ➖ noise
8 datafusion:vortex-file-compressed +5.0% +1.4% +3.6% +24.6% ➖ noise
8 duckdb:duckdb +0.9% +1.4% -0.5% +24.6% ➖ noise
8 duckdb:vortex-compact +0.4% +1.4% -1.0% +24.6% ➖ noise
8 duckdb:vortex-file-compressed +6.4% +1.4% +5.0% +24.6% ➖ noise
9 datafusion:arrow +1.6% -2.7% +4.4% +24.6% ➖ noise
9 datafusion:vortex-compact +0.8% -2.7% +3.6% +24.6% ➖ noise
9 datafusion:vortex-file-compressed +2.6% -2.7% +5.5% +24.6% ➖ noise
9 duckdb:duckdb -1.3% -2.7% +1.5% +24.6% ➖ noise
9 duckdb:vortex-compact -1.2% -2.7% +1.5% +24.6% ➖ noise
9 duckdb:vortex-file-compressed -0.9% -2.7% +1.9% +24.6% ➖ noise
10 datafusion:arrow +9.1% +0.2% +8.9% +24.6% ➖ noise
10 datafusion:vortex-compact +0.6% +0.2% +0.3% +24.6% ➖ noise
10 datafusion:vortex-file-compressed +3.5% +0.2% +3.2% +24.6% ➖ noise
10 duckdb:duckdb +3.9% +0.2% +3.7% +24.6% ➖ noise
10 duckdb:vortex-compact +0.7% +0.2% +0.5% +24.6% ➖ noise
10 duckdb:vortex-file-compressed -0.3% +0.2% -0.6% +24.6% ➖ noise
11 datafusion:arrow +7.8% -1.6% +9.6% +24.6% ➖ noise
11 datafusion:vortex-compact +6.2% -1.6% +7.9% +24.6% ➖ noise
11 datafusion:vortex-file-compressed -1.5% -1.6% +0.1% +24.6% ➖ noise
11 duckdb:duckdb -8.0% -1.6% -6.5% +24.6% ➖ noise
11 duckdb:vortex-compact -6.0% -1.6% -4.5% +24.6% ➖ noise
11 duckdb:vortex-file-compressed -7.0% -1.6% -5.4% +24.6% ➖ noise
12 datafusion:arrow +2.5% -13.2% +18.2% +24.6% ➖ noise
12 datafusion:vortex-compact +0.8% -13.2% +16.2% +24.6% ➖ noise
12 datafusion:vortex-file-compressed +4.2% -13.2% +20.1% +24.6% ➖ noise
12 duckdb:duckdb +8.8% -13.2% +25.4% +24.6% 🚨 regression
12 duckdb:vortex-compact +0.8% -13.2% +16.2% +24.6% ➖ noise
12 duckdb:vortex-file-compressed +6.8% -13.2% +23.1% +24.6% ➖ noise
13 datafusion:arrow +1.8% +0.5% +1.2% +24.6% ➖ noise
13 datafusion:vortex-compact -0.7% +0.5% -1.2% +24.6% ➖ noise
13 datafusion:vortex-file-compressed -4.5% +0.5% -5.0% +24.6% ➖ noise
13 duckdb:duckdb -2.1% +0.5% -2.6% +24.6% ➖ noise
13 duckdb:vortex-compact +0.1% +0.5% -0.4% +24.6% ➖ noise
13 duckdb:vortex-file-compressed +2.2% +0.5% +1.7% +24.6% ➖ noise
14 datafusion:arrow +3.6% -7.5% +12.0% +24.6% ➖ noise
14 datafusion:vortex-compact +2.0% -7.5% +10.2% +24.6% ➖ noise
14 datafusion:vortex-file-compressed +1.3% -7.5% +9.5% +24.6% ➖ noise
14 duckdb:duckdb +0.6% -7.5% +8.8% +24.6% ➖ noise
14 duckdb:vortex-compact -0.7% -7.5% +7.3% +24.6% ➖ noise
14 duckdb:vortex-file-compressed +0.5% -7.5% +8.7% +24.6% ➖ noise
15 datafusion:arrow +4.3% +21.8% -14.4% +24.6% ➖ noise
15 datafusion:vortex-compact +4.3% +21.8% -14.3% +24.6% ➖ noise
15 datafusion:vortex-file-compressed +2.4% +21.8% -15.9% +24.6% ➖ noise
15 duckdb:duckdb -4.3% +21.8% -21.4% +24.6% ✅ faster
15 duckdb:vortex-compact -2.6% +21.8% -20.0% +24.6% ✅ faster
15 duckdb:vortex-file-compressed +1.0% +21.8% -17.0% +24.6% ➖ noise
16 datafusion:arrow +0.9% +1.3% -0.4% +24.6% ➖ noise
16 datafusion:vortex-compact +6.4% +1.3% +5.0% +24.6% ➖ noise
16 datafusion:vortex-file-compressed +2.5% +1.3% +1.2% +24.6% ➖ noise
16 duckdb:duckdb +3.5% +1.3% +2.2% +24.6% ➖ noise
16 duckdb:vortex-compact -3.1% +1.3% -4.3% +24.6% ➖ noise
16 duckdb:vortex-file-compressed +2.3% +1.3% +1.1% +24.6% ➖ noise
17 datafusion:arrow +6.5% +5.8% +0.6% +24.6% ➖ noise
17 datafusion:vortex-compact +2.8% +5.8% -2.8% +24.6% ➖ noise
17 datafusion:vortex-file-compressed +0.7% +5.8% -4.8% +24.6% ➖ noise
17 duckdb:duckdb +3.1% +5.8% -2.6% +24.6% ➖ noise
17 duckdb:vortex-compact +4.4% +5.8% -1.4% +24.6% ➖ noise
17 duckdb:vortex-file-compressed +2.6% +5.8% -3.1% +24.6% ➖ noise
18 datafusion:arrow -0.4% -0.3% -0.1% +24.6% ➖ noise
18 datafusion:vortex-compact +0.1% -0.3% +0.4% +24.6% ➖ noise
18 datafusion:vortex-file-compressed +1.1% -0.3% +1.4% +24.6% ➖ noise
18 duckdb:duckdb +4.4% -0.3% +4.7% +24.6% ➖ noise
18 duckdb:vortex-compact -0.1% -0.3% +0.2% +24.6% ➖ noise
18 duckdb:vortex-file-compressed +6.7% -0.3% +7.1% +24.6% ➖ noise
19 datafusion:arrow -15.9% +1.4% -17.1% +24.6% ➖ noise
19 datafusion:vortex-compact +1.5% +1.4% +0.0% +24.6% ➖ noise
19 datafusion:vortex-file-compressed +4.6% +1.4% +3.1% +24.6% ➖ noise
19 duckdb:duckdb +2.8% +1.4% +1.4% +24.6% ➖ noise
19 duckdb:vortex-compact -1.5% +1.4% -2.9% +24.6% ➖ noise
19 duckdb:vortex-file-compressed -1.3% +1.4% -2.7% +24.6% ➖ noise
20 datafusion:arrow -9.4% -13.6% +4.8% +24.6% ➖ noise
20 datafusion:vortex-compact +2.3% -13.6% +18.4% +24.6% ➖ noise
20 datafusion:vortex-file-compressed +2.8% -13.6% +18.9% +24.6% ➖ noise
20 duckdb:duckdb +4.6% -13.6% +21.0% +24.6% ➖ noise
20 duckdb:vortex-compact +0.2% -13.6% +16.0% +24.6% ➖ noise
20 duckdb:vortex-file-compressed -1.2% -13.6% +14.3% +24.6% ➖ noise
21 datafusion:arrow -0.8% +4.5% -5.1% +24.6% ➖ noise
21 datafusion:vortex-compact +0.8% +4.5% -3.5% +24.6% ➖ noise
21 datafusion:vortex-file-compressed -1.2% +4.5% -5.4% +24.6% ➖ noise
21 duckdb:duckdb +0.8% +4.5% -3.6% +24.6% ➖ noise
21 duckdb:vortex-compact +3.0% +4.5% -1.5% +24.6% ➖ noise
21 duckdb:vortex-file-compressed +5.6% +4.5% +1.1% +24.6% ➖ noise
22 datafusion:arrow -0.7% -1.2% +0.5% +24.6% ➖ noise
22 datafusion:vortex-compact +1.6% -1.2% +2.8% +24.6% ➖ noise
22 datafusion:vortex-file-compressed +6.7% -1.2% +8.0% +24.6% ➖ noise
22 duckdb:duckdb -2.7% -1.2% -1.6% +24.6% ➖ noise
22 duckdb:vortex-compact -1.9% -1.2% -0.8% +24.6% ➖ noise
22 duckdb:vortex-file-compressed -2.9% -1.2% -1.8% +24.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.8%
Vortex (geomean): 0.990x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +0.3%

datafusion / vortex-file-compressed (1.060x ➖, 0↑ 2↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 221451824 264146501 0.84
tpch_q02/datafusion:vortex-file-compressed 501878339 488556110 1.03
tpch_q03/datafusion:vortex-file-compressed 495552976 401380020 1.23
tpch_q04/datafusion:vortex-file-compressed 269609449 235040025 1.15
tpch_q05/datafusion:vortex-file-compressed 432736845 458798481 0.94
tpch_q06/datafusion:vortex-file-compressed 278433515 343486504 0.81
tpch_q07/datafusion:vortex-file-compressed 403642678 483176509 0.84
tpch_q08/datafusion:vortex-file-compressed 🚨 991831376 757859311 1.31
tpch_q09/datafusion:vortex-file-compressed 535751116 453482303 1.18
tpch_q10/datafusion:vortex-file-compressed 493510587 542098709 0.91
tpch_q11/datafusion:vortex-file-compressed 424353129 375162372 1.13
tpch_q12/datafusion:vortex-file-compressed 🚨 667818881 406032617 1.64
tpch_q13/datafusion:vortex-file-compressed 218173728 216106841 1.01
tpch_q14/datafusion:vortex-file-compressed 195037362 174413600 1.12
tpch_q15/datafusion:vortex-file-compressed 333291162 306284733 1.09
tpch_q16/datafusion:vortex-file-compressed 214268461 197854590 1.08
tpch_q17/datafusion:vortex-file-compressed 358443574 385157407 0.93
tpch_q18/datafusion:vortex-file-compressed 359780283 347487185 1.04
tpch_q19/datafusion:vortex-file-compressed 386059526 333492178 1.16
tpch_q20/datafusion:vortex-file-compressed 376714470 340826198 1.11
tpch_q21/datafusion:vortex-file-compressed 537081029 496847508 1.08
tpch_q22/datafusion:vortex-file-compressed 147462067 148689625 0.99
datafusion / vortex-compact (1.015x ➖, 1↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 237459888 256953658 0.92
tpch_q02/datafusion:vortex-compact 412109116 430096373 0.96
tpch_q03/datafusion:vortex-compact 373346595 361970938 1.03
tpch_q04/datafusion:vortex-compact 181433475 200297470 0.91
tpch_q05/datafusion:vortex-compact 393707401 376652988 1.05
tpch_q06/datafusion:vortex-compact 283985195 314598651 0.90
tpch_q07/datafusion:vortex-compact 371238064 391563924 0.95
tpch_q08/datafusion:vortex-compact 641773939 532486234 1.21
tpch_q09/datafusion:vortex-compact 453851106 371204904 1.22
tpch_q10/datafusion:vortex-compact 🚨 646175848 446733218 1.45
tpch_q11/datafusion:vortex-compact 265098618 269710656 0.98
tpch_q12/datafusion:vortex-compact 441023652 404088340 1.09
tpch_q13/datafusion:vortex-compact 206320350 172620091 1.20
tpch_q14/datafusion:vortex-compact 280023525 236508375 1.18
tpch_q15/datafusion:vortex-compact 493459137 475002111 1.04
tpch_q16/datafusion:vortex-compact 193471414 216898977 0.89
tpch_q17/datafusion:vortex-compact 🚀 337243725 531599578 0.63
tpch_q18/datafusion:vortex-compact 324605914 406145648 0.80
tpch_q19/datafusion:vortex-compact 575032677 540800474 1.06
tpch_q20/datafusion:vortex-compact 463214795 457558570 1.01
tpch_q21/datafusion:vortex-compact 591991345 579845218 1.02
tpch_q22/datafusion:vortex-compact 167398801 148168502 1.13
datafusion / parquet (1.085x ➖, 0↑ 2↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 195356561 219230937 0.89
tpch_q02/datafusion:parquet 410119762 411443520 1.00
tpch_q03/datafusion:parquet 294659527 301030807 0.98
tpch_q04/datafusion:parquet 155802962 137038016 1.14
tpch_q05/datafusion:parquet 517680419 487243988 1.06
tpch_q06/datafusion:parquet 🚨 189035554 135114460 1.40
tpch_q07/datafusion:parquet 538516128 477744468 1.13
tpch_q08/datafusion:parquet 626317104 587902095 1.07
tpch_q09/datafusion:parquet 479742232 530697418 0.90
tpch_q10/datafusion:parquet 618405647 518273198 1.19
tpch_q11/datafusion:parquet 389489368 327545462 1.19
tpch_q12/datafusion:parquet 250030625 236982142 1.06
tpch_q13/datafusion:parquet 527651160 439681735 1.20
tpch_q14/datafusion:parquet 176776930 176759001 1.00
tpch_q15/datafusion:parquet 281410095 305637920 0.92
tpch_q16/datafusion:parquet 195151805 167990655 1.16
tpch_q17/datafusion:parquet 394389482 350804996 1.12
tpch_q18/datafusion:parquet 532307895 462998833 1.15
tpch_q19/datafusion:parquet 394466688 437541333 0.90
tpch_q20/datafusion:parquet 381465037 413987413 0.92
tpch_q21/datafusion:parquet 596305683 530232628 1.12
tpch_q22/datafusion:parquet 🚨 218891244 135243171 1.62
duckdb / vortex-file-compressed (0.918x ➖, 1↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 259007439 268181551 0.97
tpch_q02/duckdb:vortex-file-compressed 1036634232 1073888336 0.97
tpch_q03/duckdb:vortex-file-compressed 855583697 733624057 1.17
tpch_q04/duckdb:vortex-file-compressed 403463284 402657293 1.00
tpch_q05/duckdb:vortex-file-compressed 913220660 931129113 0.98
tpch_q06/duckdb:vortex-file-compressed 363240858 459605198 0.79
tpch_q07/duckdb:vortex-file-compressed 754308807 806753208 0.93
tpch_q08/duckdb:vortex-file-compressed 936029002 977653501 0.96
tpch_q09/duckdb:vortex-file-compressed 1022594829 1122362700 0.91
tpch_q10/duckdb:vortex-file-compressed 688796536 797521506 0.86
tpch_q11/duckdb:vortex-file-compressed 522852282 579897875 0.90
tpch_q12/duckdb:vortex-file-compressed 458242148 549119431 0.83
tpch_q13/duckdb:vortex-file-compressed 470441873 517469614 0.91
tpch_q14/duckdb:vortex-file-compressed 503270282 588180903 0.86
tpch_q15/duckdb:vortex-file-compressed 305603814 321556205 0.95
tpch_q16/duckdb:vortex-file-compressed 373361429 424011942 0.88
tpch_q17/duckdb:vortex-file-compressed 749582181 703345788 1.07
tpch_q18/duckdb:vortex-file-compressed 532386345 631882697 0.84
tpch_q19/duckdb:vortex-file-compressed 497462229 477635731 1.04
tpch_q20/duckdb:vortex-file-compressed 🚀 769373452 1150381508 0.67
tpch_q21/duckdb:vortex-file-compressed 1071076588 1175609920 0.91
tpch_q22/duckdb:vortex-file-compressed 371285371 400734685 0.93
duckdb / vortex-compact (0.971x ➖, 0↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 287504181 265320830 1.08
tpch_q02/duckdb:vortex-compact 931569186 987289527 0.94
tpch_q03/duckdb:vortex-compact 649526505 622553642 1.04
tpch_q04/duckdb:vortex-compact 350466271 348205069 1.01
tpch_q05/duckdb:vortex-compact 801484824 890730095 0.90
tpch_q06/duckdb:vortex-compact 417573898 481310949 0.87
tpch_q07/duckdb:vortex-compact 740667809 796472827 0.93
tpch_q08/duckdb:vortex-compact 882371825 922515195 0.96
tpch_q09/duckdb:vortex-compact 923100629 927780911 0.99
tpch_q10/duckdb:vortex-compact 690039921 790131946 0.87
tpch_q11/duckdb:vortex-compact 551077135 517156992 1.07
tpch_q12/duckdb:vortex-compact 491463677 494422439 0.99
tpch_q13/duckdb:vortex-compact 477074762 464284123 1.03
tpch_q14/duckdb:vortex-compact 525254357 473042401 1.11
tpch_q15/duckdb:vortex-compact 302451977 379879114 0.80
tpch_q16/duckdb:vortex-compact 399641297 422050569 0.95
tpch_q17/duckdb:vortex-compact 688166333 767709529 0.90
tpch_q18/duckdb:vortex-compact 455161006 483554358 0.94
tpch_q19/duckdb:vortex-compact 🚨 634130804 478910238 1.32
tpch_q20/duckdb:vortex-compact 784990501 915054315 0.86
tpch_q21/duckdb:vortex-compact 1290450401 1095612466 1.18
tpch_q22/duckdb:vortex-compact 359921281 459251496 0.78
duckdb / parquet (0.975x ➖, 1↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 509733220 767864123 0.66
tpch_q02/duckdb:parquet 1484627259 1354321714 1.10
tpch_q03/duckdb:parquet 982192322 1057931639 0.93
tpch_q04/duckdb:parquet 783498667 667625194 1.17
tpch_q05/duckdb:parquet 1745806663 1556105194 1.12
tpch_q06/duckdb:parquet 514849204 419273926 1.23
tpch_q07/duckdb:parquet 1375206336 1273369278 1.08
tpch_q08/duckdb:parquet 1680713473 1696396037 0.99
tpch_q09/duckdb:parquet 1615174865 1467141553 1.10
tpch_q10/duckdb:parquet 1322403964 1471978259 0.90
tpch_q11/duckdb:parquet 951854339 976927159 0.97
tpch_q12/duckdb:parquet 601376368 669146894 0.90
tpch_q13/duckdb:parquet 951017635 920693848 1.03
tpch_q14/duckdb:parquet 711795125 707619659 1.01
tpch_q15/duckdb:parquet 611105124 648270027 0.94
tpch_q16/duckdb:parquet 598691066 626864477 0.96
tpch_q17/duckdb:parquet 724393035 762827414 0.95
tpch_q18/duckdb:parquet 871617242 979016296 0.89
tpch_q19/duckdb:parquet 863961062 981032185 0.88
tpch_q20/duckdb:parquet 1275622050 1483173819 0.86
tpch_q21/duckdb:parquet 1181646319 1324148896 0.89
tpch_q22/duckdb:parquet 581857020 548265088 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.6% -23.1% +20.2% +159.3% ➖ noise
1 datafusion:vortex-file-compressed -16.2% -23.1% +9.0% +155.6% ➖ noise
1 duckdb:vortex-compact +8.4% -23.1% +40.9% +60.7% ➖ noise
1 duckdb:vortex-file-compressed -3.4% -23.1% +25.6% +84.1% ➖ noise
2 datafusion:vortex-compact -4.2% +4.5% -8.3% +64.9% ➖ noise
2 datafusion:vortex-file-compressed +2.7% +4.5% -1.7% +47.0% ➖ noise
2 duckdb:vortex-compact -5.6% +4.5% -9.7% +35.8% ➖ noise
2 duckdb:vortex-file-compressed -3.5% +4.5% -7.7% +35.8% ➖ noise
3 datafusion:vortex-compact +3.1% -4.7% +8.2% +91.3% ➖ noise
3 datafusion:vortex-file-compressed +23.5% -4.7% +29.5% +106.2% ➖ noise
3 duckdb:vortex-compact +4.3% -4.7% +9.4% +47.6% ➖ noise
3 duckdb:vortex-file-compressed +16.6% -4.7% +22.3% +46.2% ➖ noise
4 datafusion:vortex-compact -9.4% +15.5% -21.6% +51.8% ➖ noise
4 datafusion:vortex-file-compressed +14.7% +15.5% -0.7% +37.3% ➖ noise
4 duckdb:vortex-compact +0.6% +15.5% -12.9% +51.5% ➖ noise
4 duckdb:vortex-file-compressed +0.2% +15.5% -13.3% +45.2% ➖ noise
5 datafusion:vortex-compact +4.5% +9.2% -4.3% +35.8% ➖ noise
5 datafusion:vortex-file-compressed -5.7% +9.2% -13.6% +35.8% ➖ noise
5 duckdb:vortex-compact -10.0% +9.2% -17.6% +35.8% ➖ noise
5 duckdb:vortex-file-compressed -1.9% +9.2% -10.2% +35.8% ➖ noise
6 datafusion:vortex-compact -9.7% +31.1% -31.1% +35.8% ✅ faster
6 datafusion:vortex-file-compressed -18.9% +31.1% -38.2% +35.8% ✅ faster
6 duckdb:vortex-compact -13.2% +31.1% -33.8% +35.8% ✅ faster
6 duckdb:vortex-file-compressed -21.0% +31.1% -39.7% +35.8% ✅ faster
7 datafusion:vortex-compact -5.2% +10.3% -14.1% +35.8% ➖ noise
7 datafusion:vortex-file-compressed -16.5% +10.3% -24.3% +35.8% ➖ noise
7 duckdb:vortex-compact -7.0% +10.3% -15.7% +35.8% ➖ noise
7 duckdb:vortex-file-compressed -6.5% +10.3% -15.3% +35.8% ➖ noise
8 datafusion:vortex-compact +20.5% +2.7% +17.3% +35.8% ➖ noise
8 datafusion:vortex-file-compressed +30.9% +2.7% +27.4% +50.2% ➖ noise
8 duckdb:vortex-compact -4.4% +2.7% -6.9% +35.8% ➖ noise
8 duckdb:vortex-file-compressed -4.3% +2.7% -6.8% +35.8% ➖ noise
9 datafusion:vortex-compact +22.3% -0.2% +22.6% +39.9% ➖ noise
9 datafusion:vortex-file-compressed +18.1% -0.2% +18.4% +40.2% ➖ noise
9 duckdb:vortex-compact -0.5% -0.2% -0.3% +35.8% ➖ noise
9 duckdb:vortex-file-compressed -8.9% -0.2% -8.7% +35.8% ➖ noise
10 datafusion:vortex-compact +44.6% +3.5% +39.7% +35.8% 🚨 regression
10 datafusion:vortex-file-compressed -9.0% +3.5% -12.1% +50.9% ➖ noise
10 duckdb:vortex-compact -12.7% +3.5% -15.6% +35.8% ➖ noise
10 duckdb:vortex-file-compressed -13.6% +3.5% -16.6% +35.8% ➖ noise
11 datafusion:vortex-compact -1.7% +7.6% -8.7% +35.8% ➖ noise
11 datafusion:vortex-file-compressed +13.1% +7.6% +5.1% +74.9% ➖ noise
11 duckdb:vortex-compact +6.6% +7.6% -1.0% +35.8% ➖ noise
11 duckdb:vortex-file-compressed -9.8% +7.6% -16.2% +43.5% ➖ noise
12 datafusion:vortex-compact +9.1% -2.6% +12.1% +50.4% ➖ noise
12 datafusion:vortex-file-compressed +64.5% -2.6% +68.9% +84.9% ➖ noise
12 duckdb:vortex-compact -0.6% -2.6% +2.1% +47.7% ➖ noise
12 duckdb:vortex-file-compressed -16.5% -2.6% -14.3% +41.9% ➖ noise
13 datafusion:vortex-compact +19.5% +11.3% +7.4% +86.9% ➖ noise
13 datafusion:vortex-file-compressed +1.0% +11.3% -9.3% +61.3% ➖ noise
13 duckdb:vortex-compact +2.8% +11.3% -7.7% +64.5% ➖ noise
13 duckdb:vortex-file-compressed -9.1% +11.3% -18.3% +57.7% ➖ noise
14 datafusion:vortex-compact +18.4% +0.3% +18.0% +54.2% ➖ noise
14 datafusion:vortex-file-compressed +11.8% +0.3% +11.5% +47.9% ➖ noise
14 duckdb:vortex-compact +11.0% +0.3% +10.7% +35.8% ➖ noise
14 duckdb:vortex-file-compressed -14.4% +0.3% -14.7% +35.8% ➖ noise
15 datafusion:vortex-compact +3.9% -6.8% +11.5% +41.9% ➖ noise
15 datafusion:vortex-file-compressed +8.8% -6.8% +16.8% +79.1% ➖ noise
15 duckdb:vortex-compact -20.4% -6.8% -14.5% +35.8% ➖ noise
15 duckdb:vortex-file-compressed -5.0% -6.8% +2.0% +35.8% ➖ noise
16 datafusion:vortex-compact -10.8% +5.3% -15.3% +49.9% ➖ noise
16 datafusion:vortex-file-compressed +8.3% +5.3% +2.8% +35.8% ➖ noise
16 duckdb:vortex-compact -5.3% +5.3% -10.1% +35.8% ➖ noise
16 duckdb:vortex-file-compressed -11.9% +5.3% -16.4% +35.8% ➖ noise
17 datafusion:vortex-compact -36.6% +3.3% -38.6% +35.8% ✅ faster
17 datafusion:vortex-file-compressed -6.9% +3.3% -9.9% +51.1% ➖ noise
17 duckdb:vortex-compact -10.4% +3.3% -13.2% +35.8% ➖ noise
17 duckdb:vortex-file-compressed +6.6% +3.3% +3.1% +35.8% ➖ noise
18 datafusion:vortex-compact -20.1% +1.2% -21.0% +44.5% ➖ noise
18 datafusion:vortex-file-compressed +3.5% +1.2% +2.3% +35.8% ➖ noise
18 duckdb:vortex-compact -5.9% +1.2% -7.0% +35.8% ➖ noise
18 duckdb:vortex-file-compressed -15.7% +1.2% -16.7% +35.8% ➖ noise
19 datafusion:vortex-compact +6.3% -10.9% +19.3% +52.4% ➖ noise
19 datafusion:vortex-file-compressed +15.8% -10.9% +29.9% +35.8% ➖ noise
19 duckdb:vortex-compact +32.4% -10.9% +48.6% +40.3% 🚨 regression
19 duckdb:vortex-file-compressed +4.2% -10.9% +16.9% +43.7% ➖ noise
20 datafusion:vortex-compact +1.2% -11.0% +13.7% +35.8% ➖ noise
20 datafusion:vortex-file-compressed +10.5% -11.0% +24.2% +35.8% ➖ noise
20 duckdb:vortex-compact -14.2% -11.0% -3.6% +35.8% ➖ noise
20 duckdb:vortex-file-compressed -33.1% -11.0% -24.9% +35.8% ➖ noise
21 datafusion:vortex-compact +2.1% +0.2% +1.9% +35.8% ➖ noise
21 datafusion:vortex-file-compressed +8.1% +0.2% +7.9% +35.8% ➖ noise
21 duckdb:vortex-compact +17.8% +0.2% +17.6% +55.6% ➖ noise
21 duckdb:vortex-file-compressed -8.9% +0.2% -9.1% +35.8% ➖ noise
22 datafusion:vortex-compact +13.0% +31.1% -13.8% +35.8% ➖ noise
22 datafusion:vortex-file-compressed -0.8% +31.1% -24.3% +35.8% ➖ noise
22 duckdb:vortex-compact -21.6% +31.1% -40.2% +77.3% ➖ noise
22 duckdb:vortex-file-compressed -7.3% +31.1% -29.3% +35.8% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.6%
Vortex (geomean): 1.003x ➖
Parquet (geomean): 1.062x ➖
Shifts: Parquet (control) +6.2% · Median polish -2.1%

datafusion / vortex-file-compressed (0.980x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 27276056 30535111 0.89
fineweb_q01/datafusion:vortex-file-compressed 601430361 745453943 0.81
fineweb_q02/datafusion:vortex-file-compressed 613358560 570939640 1.07
fineweb_q03/datafusion:vortex-file-compressed 1402512602 1351320108 1.04
fineweb_q04/datafusion:vortex-file-compressed 1361617891 1353311597 1.01
fineweb_q05/datafusion:vortex-file-compressed 1336018581 1331889783 1.00
fineweb_q06/datafusion:vortex-file-compressed 1464196610 1467623110 1.00
fineweb_q07/datafusion:vortex-file-compressed 1349230177 1333208624 1.01
fineweb_q08/datafusion:vortex-file-compressed 549484862 537512663 1.02
datafusion / vortex-compact (1.128x ➖, 0↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 63170533 32021499 1.97
fineweb_q01/datafusion:vortex-compact 804132688 698889165 1.15
fineweb_q02/datafusion:vortex-compact 845188853 717731568 1.18
fineweb_q03/datafusion:vortex-compact 1813752326 1838936544 0.99
fineweb_q04/datafusion:vortex-compact 2224736012 2183622626 1.02
fineweb_q05/datafusion:vortex-compact 1736292356 1682488283 1.03
fineweb_q06/datafusion:vortex-compact 1664026349 1372699745 1.21
fineweb_q07/datafusion:vortex-compact 1323448209 1310256389 1.01
fineweb_q08/datafusion:vortex-compact 411691233 473586045 0.87
datafusion / parquet (1.177x ➖, 0↑ 3↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1244321411 1149277374 1.08
fineweb_q01/datafusion:parquet 1904697184 1725095694 1.10
fineweb_q02/datafusion:parquet 1743974163 1902112991 0.92
fineweb_q03/datafusion:parquet 1843668245 1786494382 1.03
fineweb_q04/datafusion:parquet 1786541962 1804942646 0.99
fineweb_q05/datafusion:parquet 🚨 3360004452 1821313077 1.84
fineweb_q06/datafusion:parquet 🚨 3078733265 1954270339 1.58
fineweb_q07/datafusion:parquet 1892400747 1890963721 1.00
fineweb_q08/datafusion:parquet 🚨 2478988239 1868826980 1.33
duckdb / vortex-file-compressed (0.959x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 86519096 88283897 0.98
fineweb_q01/duckdb:vortex-file-compressed 574693154 764397856 0.75
fineweb_q02/duckdb:vortex-file-compressed 455406727 443949890 1.03
fineweb_q03/duckdb:vortex-file-compressed 1460849354 1531414189 0.95
fineweb_q04/duckdb:vortex-file-compressed 1479268128 1506507424 0.98
fineweb_q05/duckdb:vortex-file-compressed 1488315801 1445022942 1.03
fineweb_q06/duckdb:vortex-file-compressed 1628166797 1727675708 0.94
fineweb_q07/duckdb:vortex-file-compressed 1487651841 1476301531 1.01
fineweb_q08/duckdb:vortex-file-compressed 622976266 628352541 0.99
duckdb / vortex-compact (0.954x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 80331458 89526269 0.90
fineweb_q01/duckdb:vortex-compact 563599775 624590615 0.90
fineweb_q02/duckdb:vortex-compact 526534491 559792494 0.94
fineweb_q03/duckdb:vortex-compact 1658275415 1693895654 0.98
fineweb_q04/duckdb:vortex-compact 1604115656 1717251476 0.93
fineweb_q05/duckdb:vortex-compact 1471751601 1506499883 0.98
fineweb_q06/duckdb:vortex-compact 1414092281 1413067390 1.00
fineweb_q07/duckdb:vortex-compact 1260597841 1397936282 0.90
fineweb_q08/duckdb:vortex-compact 530179207 499548249 1.06
duckdb / parquet (0.958x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1033719433 1244590537 0.83
fineweb_q01/duckdb:parquet 1626122787 1643988334 0.99
fineweb_q02/duckdb:parquet 1643714207 1702662714 0.97
fineweb_q03/duckdb:parquet 4117404837 4122994064 1.00
fineweb_q04/duckdb:parquet 1840002781 1896903511 0.97
fineweb_q05/duckdb:parquet 2735293143 2925652940 0.93
fineweb_q06/duckdb:parquet 3513123220 3505639425 1.00
fineweb_q07/duckdb:parquet 3996645781 4568604336 0.87
fineweb_q08/duckdb:parquet 1289440673 1191380574 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +97.3% -5.2% +108.0% +182.2% ➖ noise
0 datafusion:vortex-file-compressed -10.7% -5.2% -5.8% +168.5% ➖ noise
0 duckdb:vortex-compact -10.3% -5.2% -5.4% +64.8% ➖ noise
0 duckdb:vortex-file-compressed -2.0% -5.2% +3.3% +70.4% ➖ noise
1 datafusion:vortex-compact +15.1% +4.5% +10.1% +64.2% ➖ noise
1 datafusion:vortex-file-compressed -19.3% +4.5% -22.8% +76.2% ➖ noise
1 duckdb:vortex-compact -9.8% +4.5% -13.7% +59.1% ➖ noise
1 duckdb:vortex-file-compressed -24.8% +4.5% -28.1% +40.6% ➖ noise
2 datafusion:vortex-compact +17.8% -5.9% +25.2% +48.7% ➖ noise
2 datafusion:vortex-file-compressed +7.4% -5.9% +14.2% +40.6% ➖ noise
2 duckdb:vortex-compact -5.9% -5.9% -0.0% +73.7% ➖ noise
2 duckdb:vortex-file-compressed +2.6% -5.9% +9.0% +40.6% ➖ noise
3 datafusion:vortex-compact -1.4% +1.5% -2.8% +40.6% ➖ noise
3 datafusion:vortex-file-compressed +3.8% +1.5% +2.2% +40.6% ➖ noise
3 duckdb:vortex-compact -2.1% +1.5% -3.6% +40.6% ➖ noise
3 duckdb:vortex-file-compressed -4.6% +1.5% -6.0% +40.6% ➖ noise
4 datafusion:vortex-compact +1.9% -2.0% +4.0% +40.6% ➖ noise
4 datafusion:vortex-file-compressed +0.6% -2.0% +2.7% +40.6% ➖ noise
4 duckdb:vortex-compact -6.6% -2.0% -4.7% +40.6% ➖ noise
4 duckdb:vortex-file-compressed -1.8% -2.0% +0.2% +40.6% ➖ noise
5 datafusion:vortex-compact +3.2% +31.3% -21.4% +40.6% ➖ noise
5 datafusion:vortex-file-compressed +0.3% +31.3% -23.6% +40.6% ➖ noise
5 duckdb:vortex-compact -2.3% +31.3% -25.6% +40.6% ➖ noise
5 duckdb:vortex-file-compressed +3.0% +31.3% -21.6% +40.6% ➖ noise
6 datafusion:vortex-compact +21.2% +25.6% -3.5% +40.6% ➖ noise
6 datafusion:vortex-file-compressed -0.2% +25.6% -20.6% +40.6% ➖ noise
6 duckdb:vortex-compact +0.1% +25.6% -20.4% +40.6% ➖ noise
6 duckdb:vortex-file-compressed -5.8% +25.6% -25.0% +40.6% ➖ noise
7 datafusion:vortex-compact +1.0% -6.4% +8.0% +40.6% ➖ noise
7 datafusion:vortex-file-compressed +1.2% -6.4% +8.2% +40.6% ➖ noise
7 duckdb:vortex-compact -9.8% -6.4% -3.6% +40.6% ➖ noise
7 duckdb:vortex-file-compressed +0.8% -6.4% +7.7% +40.6% ➖ noise
8 datafusion:vortex-compact -13.1% +19.8% -27.4% +40.6% ➖ noise
8 datafusion:vortex-file-compressed +2.2% +19.8% -14.7% +40.6% ➖ noise
8 duckdb:vortex-compact +6.1% +19.8% -11.4% +40.6% ➖ noise
8 duckdb:vortex-file-compressed -0.9% +19.8% -17.3% +40.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 1.013x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.5%

datafusion / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 410636911 413268750 0.99
tpch_q02/datafusion:vortex-file-compressed 115076182 111371996 1.03
tpch_q03/datafusion:vortex-file-compressed 210652187 201788938 1.04
tpch_q04/datafusion:vortex-file-compressed 105949915 98018394 1.08
tpch_q05/datafusion:vortex-file-compressed 379695879 377704182 1.01
tpch_q06/datafusion:vortex-file-compressed 40191208 39848470 1.01
tpch_q07/datafusion:vortex-file-compressed 555731087 554251362 1.00
tpch_q08/datafusion:vortex-file-compressed 376738971 368318469 1.02
tpch_q09/datafusion:vortex-file-compressed 654584432 669015287 0.98
tpch_q10/datafusion:vortex-file-compressed 244789158 235516009 1.04
tpch_q11/datafusion:vortex-file-compressed 85030739 83049809 1.02
tpch_q12/datafusion:vortex-file-compressed 112930518 104003829 1.09
tpch_q13/datafusion:vortex-file-compressed 215826563 219349744 0.98
tpch_q14/datafusion:vortex-file-compressed 56906310 60690224 0.94
tpch_q15/datafusion:vortex-file-compressed 105149934 105931035 0.99
tpch_q16/datafusion:vortex-file-compressed 78238396 75042336 1.04
tpch_q17/datafusion:vortex-file-compressed 628898297 647730646 0.97
tpch_q18/datafusion:vortex-file-compressed 866286564 866050440 1.00
tpch_q19/datafusion:vortex-file-compressed 90372246 87353875 1.03
tpch_q20/datafusion:vortex-file-compressed 168127081 169250845 0.99
tpch_q21/datafusion:vortex-file-compressed 676033366 649709979 1.04
tpch_q22/datafusion:vortex-file-compressed 60486462 60222321 1.00
datafusion / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 430453043 430644811 1.00
tpch_q02/datafusion:vortex-compact 117053847 118217879 0.99
tpch_q03/datafusion:vortex-compact 213981217 214312707 1.00
tpch_q04/datafusion:vortex-compact 116535461 117427202 0.99
tpch_q05/datafusion:vortex-compact 386366587 385210353 1.00
tpch_q06/datafusion:vortex-compact 62589428 61025371 1.03
tpch_q07/datafusion:vortex-compact 575654542 582206474 0.99
tpch_q08/datafusion:vortex-compact 381123016 379253852 1.00
tpch_q09/datafusion:vortex-compact 669690097 681459273 0.98
tpch_q10/datafusion:vortex-compact 264384429 265468808 1.00
tpch_q11/datafusion:vortex-compact 88643695 88194019 1.01
tpch_q12/datafusion:vortex-compact 163401459 161646984 1.01
tpch_q13/datafusion:vortex-compact 261971408 267273335 0.98
tpch_q14/datafusion:vortex-compact 73230369 72220572 1.01
tpch_q15/datafusion:vortex-compact 161661020 161233597 1.00
tpch_q16/datafusion:vortex-compact 80597003 80762139 1.00
tpch_q17/datafusion:vortex-compact 640684388 643347861 1.00
tpch_q18/datafusion:vortex-compact 867507251 869915884 1.00
tpch_q19/datafusion:vortex-compact 128562936 126973770 1.01
tpch_q20/datafusion:vortex-compact 192911835 195440511 0.99
tpch_q21/datafusion:vortex-compact 686080755 691111838 0.99
tpch_q22/datafusion:vortex-compact 69831192 69956833 1.00
datafusion / parquet (0.994x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 416627388 442838485 0.94
tpch_q02/datafusion:parquet 181780497 185786405 0.98
tpch_q03/datafusion:parquet 291949532 294533423 0.99
tpch_q04/datafusion:parquet 136160457 135801037 1.00
tpch_q05/datafusion:parquet 447662664 444897918 1.01
tpch_q06/datafusion:parquet 118577228 119280463 0.99
tpch_q07/datafusion:parquet 630887179 623373163 1.01
tpch_q08/datafusion:parquet 494320599 493738072 1.00
tpch_q09/datafusion:parquet 762956739 776143938 0.98
tpch_q10/datafusion:parquet 491152384 502369313 0.98
tpch_q11/datafusion:parquet 129111822 131141325 0.98
tpch_q12/datafusion:parquet 210587396 212760418 0.99
tpch_q13/datafusion:parquet 332190700 338859872 0.98
tpch_q14/datafusion:parquet 158829327 156328918 1.02
tpch_q15/datafusion:parquet 243366018 247472242 0.98
tpch_q16/datafusion:parquet 146886097 136969873 1.07
tpch_q17/datafusion:parquet 676933370 695354677 0.97
tpch_q18/datafusion:parquet 872121940 886115456 0.98
tpch_q19/datafusion:parquet 281568776 272399517 1.03
tpch_q20/datafusion:parquet 305459264 307295220 0.99
tpch_q21/datafusion:parquet 729592713 729419936 1.00
tpch_q22/datafusion:parquet 212173379 216873143 0.98
datafusion / arrow (0.989x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 574157254 575282101 1.00
tpch_q02/datafusion:arrow 158566793 159118865 1.00
tpch_q03/datafusion:arrow 435214323 435303118 1.00
tpch_q04/datafusion:arrow 333493038 332257824 1.00
tpch_q05/datafusion:arrow 867305122 887336694 0.98
tpch_q06/datafusion:arrow 257010110 267541418 0.96
tpch_q07/datafusion:arrow 1076732609 1085531578 0.99
tpch_q08/datafusion:arrow 1066966622 1051036567 1.02
tpch_q09/datafusion:arrow 1276324129 1264764809 1.01
tpch_q10/datafusion:arrow 570007350 572093975 1.00
tpch_q11/datafusion:arrow 143014486 150450586 0.95
tpch_q12/datafusion:arrow 633951054 639515109 0.99
tpch_q13/datafusion:arrow 510704556 506634406 1.01
tpch_q14/datafusion:arrow 286812924 289518898 0.99
tpch_q15/datafusion:arrow 617647405 619619467 1.00
tpch_q16/datafusion:arrow 104274549 104137902 1.00
tpch_q17/datafusion:arrow 1274927022 1277604621 1.00
tpch_q18/datafusion:arrow 1756560185 1819714443 0.97
tpch_q19/datafusion:arrow 477755225 488520799 0.98
tpch_q20/datafusion:arrow 458216789 469410846 0.98
tpch_q21/datafusion:arrow 2751498403 2803941690 0.98
tpch_q22/datafusion:arrow 138767576 143406014 0.97
duckdb / vortex-file-compressed (1.030x ➖, 0↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 175222012 179196770 0.98
tpch_q02/duckdb:vortex-file-compressed 53310028 53143647 1.00
tpch_q03/duckdb:vortex-file-compressed 132604777 125098582 1.06
tpch_q04/duckdb:vortex-file-compressed 🚨 158529919 143939881 1.10
tpch_q05/duckdb:vortex-file-compressed 131955876 130435928 1.01
tpch_q06/duckdb:vortex-file-compressed 46719638 46803571 1.00
tpch_q07/duckdb:vortex-file-compressed 151623879 145170027 1.04
tpch_q08/duckdb:vortex-file-compressed 178197996 173915756 1.02
tpch_q09/duckdb:vortex-file-compressed 337384521 330637274 1.02
tpch_q10/duckdb:vortex-file-compressed 164500471 152243366 1.08
tpch_q11/duckdb:vortex-file-compressed 35505130 34475532 1.03
tpch_q12/duckdb:vortex-file-compressed 96045708 88247604 1.09
tpch_q13/duckdb:vortex-file-compressed 245281444 244031248 1.01
tpch_q14/duckdb:vortex-file-compressed 69688589 67659149 1.03
tpch_q15/duckdb:vortex-file-compressed 96904884 97155701 1.00
tpch_q16/duckdb:vortex-file-compressed 79548355 78431651 1.01
tpch_q17/duckdb:vortex-file-compressed 102168111 102264747 1.00
tpch_q18/duckdb:vortex-file-compressed 308443752 281011862 1.10
tpch_q19/duckdb:vortex-file-compressed 90276624 88858804 1.02
tpch_q20/duckdb:vortex-file-compressed 162080873 162195826 1.00
tpch_q21/duckdb:vortex-file-compressed 597302673 544155536 1.10
tpch_q22/duckdb:vortex-file-compressed 75525823 76800238 0.98
duckdb / vortex-compact (1.010x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229107881 227794272 1.01
tpch_q02/duckdb:vortex-compact 58201288 57016552 1.02
tpch_q03/duckdb:vortex-compact 138717409 136040534 1.02
tpch_q04/duckdb:vortex-compact 173913169 169826044 1.02
tpch_q05/duckdb:vortex-compact 145870200 145707700 1.00
tpch_q06/duckdb:vortex-compact 81785214 83173413 0.98
tpch_q07/duckdb:vortex-compact 199835976 198377694 1.01
tpch_q08/duckdb:vortex-compact 187636566 186003330 1.01
tpch_q09/duckdb:vortex-compact 361707455 361826689 1.00
tpch_q10/duckdb:vortex-compact 182510926 186799283 0.98
tpch_q11/duckdb:vortex-compact 40464338 40866724 0.99
tpch_q12/duckdb:vortex-compact 198952689 199557027 1.00
tpch_q13/duckdb:vortex-compact 295195687 290656358 1.02
tpch_q14/duckdb:vortex-compact 102045666 100389028 1.02
tpch_q15/duckdb:vortex-compact 117074050 117492629 1.00
tpch_q16/duckdb:vortex-compact 87076108 84038052 1.04
tpch_q17/duckdb:vortex-compact 115738570 114216038 1.01
tpch_q18/duckdb:vortex-compact 305283464 285828731 1.07
tpch_q19/duckdb:vortex-compact 113913645 110913148 1.03
tpch_q20/duckdb:vortex-compact 204537779 203006339 1.01
tpch_q21/duckdb:vortex-compact 624647264 625730590 1.00
tpch_q22/duckdb:vortex-compact 88816020 88510026 1.00
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 259755649 258321944 1.01
tpch_q02/duckdb:parquet 104709150 102528067 1.02
tpch_q03/duckdb:parquet 210554308 214469811 0.98
tpch_q04/duckdb:parquet 136384453 134704980 1.01
tpch_q05/duckdb:parquet 217944000 219307826 0.99
tpch_q06/duckdb:parquet 64395147 67829017 0.95
tpch_q07/duckdb:parquet 177477586 181339298 0.98
tpch_q08/duckdb:parquet 246940161 250531230 0.99
tpch_q09/duckdb:parquet 457337505 458555484 1.00
tpch_q10/duckdb:parquet 603885586 598408071 1.01
tpch_q11/duckdb:parquet 42508163 42998179 0.99
tpch_q12/duckdb:parquet 127646365 125412743 1.02
tpch_q13/duckdb:parquet 448913465 426409420 1.05
tpch_q14/duckdb:parquet 173087490 168384167 1.03
tpch_q15/duckdb:parquet 99037165 96889797 1.02
tpch_q16/duckdb:parquet 162547731 156333948 1.04
tpch_q17/duckdb:parquet 177294194 182088391 0.97
tpch_q18/duckdb:parquet 348619492 346134602 1.01
tpch_q19/duckdb:parquet 281871839 277190914 1.02
tpch_q20/duckdb:parquet 229521864 227570379 1.01
tpch_q21/duckdb:parquet 577869463 567926752 1.02
tpch_q22/duckdb:parquet 293474259 290688460 1.01
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 115976686 116819161 0.99
tpch_q02/duckdb:duckdb 45042295 48392005 0.93
tpch_q03/duckdb:duckdb 96475867 97125146 0.99
tpch_q04/duckdb:duckdb 129351179 131313306 0.99
tpch_q05/duckdb:duckdb 107573639 111363832 0.97
tpch_q06/duckdb:duckdb 39812654 39851790 1.00
tpch_q07/duckdb:duckdb 86230267 85922684 1.00
tpch_q08/duckdb:duckdb 111339616 109623837 1.02
tpch_q09/duckdb:duckdb 276880367 275932242 1.00
tpch_q10/duckdb:duckdb 199776141 201654734 0.99
tpch_q11/duckdb:duckdb 16214513 15141507 1.07
tpch_q12/duckdb:duckdb 83493833 84667953 0.99
tpch_q13/duckdb:duckdb 250340758 252072951 0.99
tpch_q14/duckdb:duckdb 69794438 70442648 0.99
tpch_q15/duckdb:duckdb 79356119 78801724 1.01
tpch_q16/duckdb:duckdb 72426060 72001431 1.01
tpch_q17/duckdb:duckdb 83864515 83997689 1.00
tpch_q18/duckdb:duckdb 212818524 212358094 1.00
tpch_q19/duckdb:duckdb 114750922 115606105 0.99
tpch_q20/duckdb:duckdb 111208996 110786426 1.00
tpch_q21/duckdb:duckdb 308661173 306696691 1.01
tpch_q22/duckdb:duckdb 71290077 66912500 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.2% -2.7% +2.6% +10.0% ➖ noise
1 datafusion:vortex-compact -0.0% -2.7% +2.8% +10.5% ➖ noise
1 datafusion:vortex-file-compressed -0.6% -2.7% +2.2% +12.7% ➖ noise
1 duckdb:duckdb -0.7% -2.7% +2.1% +10.0% ➖ noise
1 duckdb:vortex-compact +0.6% -2.7% +3.4% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -2.2% -2.7% +0.5% +10.0% ➖ noise
2 datafusion:arrow -0.3% -0.0% -0.3% +10.0% ➖ noise
2 datafusion:vortex-compact -1.0% -0.0% -0.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +3.3% -0.0% +3.4% +10.1% ➖ noise
2 duckdb:duckdb -6.9% -0.0% -6.9% +13.7% ➖ noise
2 duckdb:vortex-compact +2.1% -0.0% +2.1% +10.4% ➖ noise
2 duckdb:vortex-file-compressed +0.3% -0.0% +0.4% +10.7% ➖ noise
3 datafusion:arrow -0.0% -1.4% +1.4% +10.0% ➖ noise
3 datafusion:vortex-compact -0.2% -1.4% +1.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +4.4% -1.4% +5.8% +10.0% ➖ noise
3 duckdb:duckdb -0.7% -1.4% +0.7% +10.0% ➖ noise
3 duckdb:vortex-compact +2.0% -1.4% +3.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +6.0% -1.4% +7.5% +10.0% ➖ noise
4 datafusion:arrow +0.4% +0.8% -0.4% +10.0% ➖ noise
4 datafusion:vortex-compact -0.8% +0.8% -1.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +8.1% +0.8% +7.3% +10.0% ➖ noise
4 duckdb:duckdb -1.5% +0.8% -2.2% +10.0% ➖ noise
4 duckdb:vortex-compact +2.4% +0.8% +1.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +10.1% +0.8% +9.3% +10.0% ➖ noise
5 datafusion:arrow -2.3% -0.0% -2.3% +10.0% ➖ noise
5 datafusion:vortex-compact +0.3% -0.0% +0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.5% -0.0% +0.5% +10.0% ➖ noise
5 duckdb:duckdb -3.4% -0.0% -3.4% +10.0% ➖ noise
5 duckdb:vortex-compact +0.1% -0.0% +0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.2% -0.0% +1.2% +10.0% ➖ noise
6 datafusion:arrow -3.9% -2.9% -1.1% +10.0% ➖ noise
6 datafusion:vortex-compact +2.6% -2.9% +5.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.9% -2.9% +3.8% +10.0% ➖ noise
6 duckdb:duckdb -0.1% -2.9% +2.8% +14.8% ➖ noise
6 duckdb:vortex-compact -1.7% -2.9% +1.2% +10.3% ➖ noise
6 duckdb:vortex-file-compressed -0.2% -2.9% +2.8% +13.4% ➖ noise
7 datafusion:arrow -0.8% -0.5% -0.3% +10.0% ➖ noise
7 datafusion:vortex-compact -1.1% -0.5% -0.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.3% -0.5% +0.7% +10.0% ➖ noise
7 duckdb:duckdb +0.4% -0.5% +0.8% +11.1% ➖ noise
7 duckdb:vortex-compact +0.7% -0.5% +1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.4% -0.5% +4.9% +10.0% ➖ noise
8 datafusion:arrow +1.5% -0.7% +2.2% +10.0% ➖ noise
8 datafusion:vortex-compact +0.5% -0.7% +1.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.3% -0.7% +3.0% +10.0% ➖ noise
8 duckdb:duckdb +1.6% -0.7% +2.2% +10.0% ➖ noise
8 duckdb:vortex-compact +0.9% -0.7% +1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.5% -0.7% +3.1% +10.0% ➖ noise
9 datafusion:arrow +0.9% -1.0% +1.9% +10.0% ➖ noise
9 datafusion:vortex-compact -1.7% -1.0% -0.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.2% -1.0% -1.2% +10.0% ➖ noise
9 duckdb:duckdb +0.3% -1.0% +1.3% +10.0% ➖ noise
9 duckdb:vortex-compact -0.0% -1.0% +1.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.0% -1.0% +3.1% +10.0% ➖ noise
10 datafusion:arrow -0.4% -0.7% +0.3% +10.0% ➖ noise
10 datafusion:vortex-compact -0.4% -0.7% +0.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.9% -0.7% +4.6% +10.0% ➖ noise
10 duckdb:duckdb -0.9% -0.7% -0.3% +10.0% ➖ noise
10 duckdb:vortex-compact -2.3% -0.7% -1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +8.1% -0.7% +8.8% +10.0% ➖ noise
11 datafusion:arrow -4.9% -1.3% -3.6% +10.0% ➖ noise
11 datafusion:vortex-compact +0.5% -1.3% +1.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.4% -1.3% +3.8% +10.0% ➖ noise
11 duckdb:duckdb +7.1% -1.3% +8.5% +16.5% ➖ noise
11 duckdb:vortex-compact -1.0% -1.3% +0.4% +12.9% ➖ noise
11 duckdb:vortex-file-compressed +3.0% -1.3% +4.4% +12.9% ➖ noise
12 datafusion:arrow -0.9% +0.4% -1.2% +47.8% ➖ noise
12 datafusion:vortex-compact +1.1% +0.4% +0.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +8.6% +0.4% +8.2% +10.0% ➖ noise
12 duckdb:duckdb -1.4% +0.4% -1.8% +10.0% ➖ noise
12 duckdb:vortex-compact -0.3% +0.4% -0.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +8.8% +0.4% +8.4% +10.0% ➖ noise
13 datafusion:arrow +0.8% +1.6% -0.8% +10.3% ➖ noise
13 datafusion:vortex-compact -2.0% +1.6% -3.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.6% +1.6% -3.1% +10.0% ➖ noise
13 duckdb:duckdb -0.7% +1.6% -2.2% +10.0% ➖ noise
13 duckdb:vortex-compact +1.6% +1.6% -0.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.5% +1.6% -1.1% +10.0% ➖ noise
14 datafusion:arrow -0.9% +2.2% -3.1% +10.0% ➖ noise
14 datafusion:vortex-compact +1.4% +2.2% -0.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -6.2% +2.2% -8.2% +10.7% ➖ noise
14 duckdb:duckdb -0.9% +2.2% -3.0% +10.0% ➖ noise
14 duckdb:vortex-compact +1.7% +2.2% -0.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +3.0% +2.2% +0.8% +10.0% ➖ noise
15 datafusion:arrow -0.3% +0.3% -0.6% +10.0% ➖ noise
15 datafusion:vortex-compact +0.3% +0.3% +0.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.7% +0.3% -1.0% +10.0% ➖ noise
15 duckdb:duckdb +0.7% +0.3% +0.4% +10.0% ➖ noise
15 duckdb:vortex-compact -0.4% +0.3% -0.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.3% +0.3% -0.5% +10.0% ➖ noise
16 datafusion:arrow +0.1% +5.6% -5.2% +10.0% ➖ noise
16 datafusion:vortex-compact -0.2% +5.6% -5.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +4.3% +5.6% -1.3% +10.0% ➖ noise
16 duckdb:duckdb +0.6% +5.6% -4.7% +10.0% ➖ noise
16 duckdb:vortex-compact +3.6% +5.6% -1.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.4% +5.6% -3.9% +10.6% ➖ noise
17 datafusion:arrow -0.2% -2.6% +2.5% +10.0% ➖ noise
17 datafusion:vortex-compact -0.4% -2.6% +2.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -2.9% -2.6% -0.3% +10.0% ➖ noise
17 duckdb:duckdb -0.2% -2.6% +2.5% +10.0% ➖ noise
17 duckdb:vortex-compact +1.3% -2.6% +4.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.1% -2.6% +2.6% +10.0% ➖ noise
18 datafusion:arrow -3.5% -0.4% -3.0% +13.0% ➖ noise
18 datafusion:vortex-compact -0.3% -0.4% +0.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.0% -0.4% +0.5% +10.0% ➖ noise
18 duckdb:duckdb +0.2% -0.4% +0.7% +10.0% ➖ noise
18 duckdb:vortex-compact +6.8% -0.4% +7.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +9.8% -0.4% +10.2% +10.0% 🚨 regression
19 datafusion:arrow -2.2% +2.5% -4.6% +10.0% ➖ noise
19 datafusion:vortex-compact +1.3% +2.5% -1.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +3.5% +2.5% +0.9% +14.0% ➖ noise
19 duckdb:duckdb -0.7% +2.5% -3.2% +10.0% ➖ noise
19 duckdb:vortex-compact +2.7% +2.5% +0.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.6% +2.5% -0.9% +10.0% ➖ noise
20 datafusion:arrow -2.4% +0.1% -2.5% +10.0% ➖ noise
20 datafusion:vortex-compact -1.3% +0.1% -1.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -0.7% +0.1% -0.8% +10.0% ➖ noise
20 duckdb:duckdb +0.4% +0.1% +0.3% +10.0% ➖ noise
20 duckdb:vortex-compact +0.8% +0.1% +0.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.1% +0.1% -0.2% +10.0% ➖ noise
21 datafusion:arrow -1.9% +0.9% -2.7% +10.0% ➖ noise
21 datafusion:vortex-compact -0.7% +0.9% -1.6% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +4.1% +0.9% +3.1% +10.0% ➖ noise
21 duckdb:duckdb +0.6% +0.9% -0.2% +10.0% ➖ noise
21 duckdb:vortex-compact -0.2% +0.9% -1.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +9.8% +0.9% +8.8% +10.0% ➖ noise
22 datafusion:arrow -3.2% -0.6% -2.6% +10.0% ➖ noise
22 datafusion:vortex-compact -0.2% -0.6% +0.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.4% -0.6% +1.1% +10.0% ➖ noise
22 duckdb:duckdb +6.5% -0.6% +7.2% +10.0% ➖ noise
22 duckdb:vortex-compact +0.3% -0.6% +1.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -1.7% -0.6% -1.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.1%
Vortex (geomean): 0.912x ➖
Parquet (geomean): 0.961x ➖
Shifts: Parquet (control) -3.9% · Median polish -8.9%

datafusion / vortex-file-compressed (0.897x ➖, 2↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 905770020 726021243 1.25
tpch_q02/datafusion:vortex-file-compressed 🚀 649976325 1023360109 0.64
tpch_q03/datafusion:vortex-file-compressed 802966649 880434896 0.91
tpch_q04/datafusion:vortex-file-compressed 585914349 712024425 0.82
tpch_q05/datafusion:vortex-file-compressed 1024420829 1053693353 0.97
tpch_q06/datafusion:vortex-file-compressed 667101086 629030881 1.06
tpch_q07/datafusion:vortex-file-compressed 1027136861 1228153846 0.84
tpch_q08/datafusion:vortex-file-compressed 1104588006 1327681653 0.83
tpch_q09/datafusion:vortex-file-compressed 1239645914 1696155832 0.73
tpch_q10/datafusion:vortex-file-compressed 🚀 968052573 1429723366 0.68
tpch_q11/datafusion:vortex-file-compressed 489972674 626640170 0.78
tpch_q12/datafusion:vortex-file-compressed 897366198 1098933113 0.82
tpch_q13/datafusion:vortex-file-compressed 463798026 473827762 0.98
tpch_q14/datafusion:vortex-file-compressed 745258215 641660988 1.16
tpch_q15/datafusion:vortex-file-compressed 1188935114 1107307752 1.07
tpch_q16/datafusion:vortex-file-compressed 324845691 419046010 0.78
tpch_q17/datafusion:vortex-file-compressed 1280014604 1321162737 0.97
tpch_q18/datafusion:vortex-file-compressed 1548752694 1298457748 1.19
tpch_q19/datafusion:vortex-file-compressed 956949936 972844408 0.98
tpch_q20/datafusion:vortex-file-compressed 1013564004 1205972348 0.84
tpch_q21/datafusion:vortex-file-compressed 1758935759 1939881448 0.91
tpch_q22/datafusion:vortex-file-compressed 435049866 519698582 0.84
datafusion / vortex-compact (0.997x ➖, 2↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 686886801 697153412 0.99
tpch_q02/datafusion:vortex-compact 663971996 725244609 0.92
tpch_q03/datafusion:vortex-compact 🚀 731329515 1101777198 0.66
tpch_q04/datafusion:vortex-compact 566723478 584090890 0.97
tpch_q05/datafusion:vortex-compact 885808926 1094769453 0.81
tpch_q06/datafusion:vortex-compact 628081130 673736746 0.93
tpch_q07/datafusion:vortex-compact 1077545121 1039786588 1.04
tpch_q08/datafusion:vortex-compact 1119255901 1128179076 0.99
tpch_q09/datafusion:vortex-compact 1402649293 1354666253 1.04
tpch_q10/datafusion:vortex-compact 🚀 962002582 1394627319 0.69
tpch_q11/datafusion:vortex-compact 532917633 477008449 1.12
tpch_q12/datafusion:vortex-compact 878676821 980554940 0.90
tpch_q13/datafusion:vortex-compact 390553675 485890959 0.80
tpch_q14/datafusion:vortex-compact 722888995 623168274 1.16
tpch_q15/datafusion:vortex-compact 1200353017 1039487011 1.15
tpch_q16/datafusion:vortex-compact 355925116 320980152 1.11
tpch_q17/datafusion:vortex-compact 1388571124 1198587022 1.16
tpch_q18/datafusion:vortex-compact 1096622978 1290368535 0.85
tpch_q19/datafusion:vortex-compact 🚨 2682648882 1157175428 2.32
tpch_q20/datafusion:vortex-compact 1377452068 1139700283 1.21
tpch_q21/datafusion:vortex-compact 1533104033 1666043302 0.92
tpch_q22/datafusion:vortex-compact 370877230 390596917 0.95
datafusion / parquet (1.003x ➖, 0↑ 3↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 826189213 818122765 1.01
tpch_q02/datafusion:parquet 🚨 1121972800 853927508 1.31
tpch_q03/datafusion:parquet 🚨 1227683609 942860874 1.30
tpch_q04/datafusion:parquet 560782925 507559094 1.10
tpch_q05/datafusion:parquet 1293409048 1137461792 1.14
tpch_q06/datafusion:parquet 565704936 527002310 1.07
tpch_q07/datafusion:parquet 1326869786 1256433576 1.06
tpch_q08/datafusion:parquet 1553597788 1576137595 0.99
tpch_q09/datafusion:parquet 1676658971 1795035251 0.93
tpch_q10/datafusion:parquet 2042030082 2108434224 0.97
tpch_q11/datafusion:parquet 530997691 664725113 0.80
tpch_q12/datafusion:parquet 653256134 680242749 0.96
tpch_q13/datafusion:parquet 661449669 806823479 0.82
tpch_q14/datafusion:parquet 830556864 816993720 1.02
tpch_q15/datafusion:parquet 1218763653 1189359876 1.02
tpch_q16/datafusion:parquet 373519918 372931715 1.00
tpch_q17/datafusion:parquet 1325606148 1363294611 0.97
tpch_q18/datafusion:parquet 1459735098 1482008402 0.98
tpch_q19/datafusion:parquet 1057163271 903732862 1.17
tpch_q20/datafusion:parquet 🚨 1562897941 1183432876 1.32
tpch_q21/datafusion:parquet 1719584303 2455405251 0.70
tpch_q22/datafusion:parquet 1179210990 1643151083 0.72
duckdb / vortex-file-compressed (0.900x ➖, 1↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 615330137 645065393 0.95
tpch_q02/duckdb:vortex-file-compressed 1310497055 1295247147 1.01
tpch_q03/duckdb:vortex-file-compressed 1169958207 984450881 1.19
tpch_q04/duckdb:vortex-file-compressed 607357004 650944096 0.93
tpch_q05/duckdb:vortex-file-compressed 1144758001 1229150221 0.93
tpch_q06/duckdb:vortex-file-compressed 801636144 861419686 0.93
tpch_q07/duckdb:vortex-file-compressed 1210974773 1232994817 0.98
tpch_q08/duckdb:vortex-file-compressed 1388404970 1791545802 0.77
tpch_q09/duckdb:vortex-file-compressed 1344021240 1551206163 0.87
tpch_q10/duckdb:vortex-file-compressed 1245205322 1207673614 1.03
tpch_q11/duckdb:vortex-file-compressed 652991279 807410874 0.81
tpch_q12/duckdb:vortex-file-compressed 652222420 777246894 0.84
tpch_q13/duckdb:vortex-file-compressed 981782508 923394446 1.06
tpch_q14/duckdb:vortex-file-compressed 862891858 881426095 0.98
tpch_q15/duckdb:vortex-file-compressed 522254703 597909054 0.87
tpch_q16/duckdb:vortex-file-compressed 432733708 540764370 0.80
tpch_q17/duckdb:vortex-file-compressed 941650726 1073267412 0.88
tpch_q18/duckdb:vortex-file-compressed 🚀 852629836 1236367337 0.69
tpch_q19/duckdb:vortex-file-compressed 751047979 825839230 0.91
tpch_q20/duckdb:vortex-file-compressed 1199448717 1679802753 0.71
tpch_q21/duckdb:vortex-file-compressed 2104970754 2053786534 1.02
tpch_q22/duckdb:vortex-file-compressed 638261037 812071111 0.79
duckdb / vortex-compact (0.858x ➖, 1↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 589795161 604034030 0.98
tpch_q02/duckdb:vortex-compact 1144820160 1308197585 0.88
tpch_q03/duckdb:vortex-compact 808339215 877071904 0.92
tpch_q04/duckdb:vortex-compact 450972628 550640725 0.82
tpch_q05/duckdb:vortex-compact 1024936055 1060241770 0.97
tpch_q06/duckdb:vortex-compact 681826156 810994729 0.84
tpch_q07/duckdb:vortex-compact 1001483406 1102128440 0.91
tpch_q08/duckdb:vortex-compact 1448630872 1396821423 1.04
tpch_q09/duckdb:vortex-compact 1528940755 1649369389 0.93
tpch_q10/duckdb:vortex-compact 989218090 1260856480 0.78
tpch_q11/duckdb:vortex-compact 681468760 840437210 0.81
tpch_q12/duckdb:vortex-compact 🚀 689054467 1546101192 0.45
tpch_q13/duckdb:vortex-compact 854206519 1102381853 0.77
tpch_q14/duckdb:vortex-compact 804954157 897308403 0.90
tpch_q15/duckdb:vortex-compact 518063733 584750931 0.89
tpch_q16/duckdb:vortex-compact 455043369 530334904 0.86
tpch_q17/duckdb:vortex-compact 902912380 970528934 0.93
tpch_q18/duckdb:vortex-compact 762991702 729979628 1.05
tpch_q19/duckdb:vortex-compact 780826852 930216119 0.84
tpch_q20/duckdb:vortex-compact 1127620046 1192773217 0.95
tpch_q21/duckdb:vortex-compact 1600834272 2048494963 0.78
tpch_q22/duckdb:vortex-compact 649918813 778542169 0.83
duckdb / parquet (0.920x ➖, 2↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1102537603 1165291482 0.95
tpch_q02/duckdb:parquet 1793169671 1756662319 1.02
tpch_q03/duckdb:parquet 1779227089 1843283392 0.97
tpch_q04/duckdb:parquet 1233203531 1223354990 1.01
tpch_q05/duckdb:parquet 2321060251 2369888923 0.98
tpch_q06/duckdb:parquet 776949235 823668379 0.94
tpch_q07/duckdb:parquet 1772674002 1830478612 0.97
tpch_q08/duckdb:parquet 2340048291 2908164576 0.80
tpch_q09/duckdb:parquet 2206532044 2579504997 0.86
tpch_q10/duckdb:parquet 4271386085 3855778081 1.11
tpch_q11/duckdb:parquet 1138327861 1088249844 1.05
tpch_q12/duckdb:parquet 1020862546 1233758491 0.83
tpch_q13/duckdb:parquet 1373473134 1241161346 1.11
tpch_q14/duckdb:parquet 🚀 1209084029 1742621236 0.69
tpch_q15/duckdb:parquet 🚀 784875458 1143954143 0.69
tpch_q16/duckdb:parquet 802841464 881856886 0.91
tpch_q17/duckdb:parquet 1324187773 1403711270 0.94
tpch_q18/duckdb:parquet 1409846681 1642740198 0.86
tpch_q19/duckdb:parquet 1904469338 1983382233 0.96
tpch_q20/duckdb:parquet 1775650036 2129048073 0.83
tpch_q21/duckdb:parquet 1783448082 1997452468 0.89
tpch_q22/duckdb:parquet 1198229924 1145363562 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.5% -2.3% +0.8% +121.3% ➖ noise
1 datafusion:vortex-file-compressed +24.8% -2.3% +27.6% +87.6% ➖ noise
1 duckdb:vortex-compact -2.4% -2.3% -0.1% +55.0% ➖ noise
1 duckdb:vortex-file-compressed -4.6% -2.3% -2.4% +55.5% ➖ noise
2 datafusion:vortex-compact -8.4% +15.8% -20.9% +75.0% ➖ noise
2 datafusion:vortex-file-compressed -36.5% +15.8% -45.2% +80.4% ✅ faster
2 duckdb:vortex-compact -12.5% +15.8% -24.4% +53.3% ➖ noise
2 duckdb:vortex-file-compressed +1.2% +15.8% -12.6% +51.2% ➖ noise
3 datafusion:vortex-compact -33.6% +12.1% -40.8% +78.8% ➖ noise
3 datafusion:vortex-file-compressed -8.8% +12.1% -18.6% +109.1% ➖ noise
3 duckdb:vortex-compact -7.8% +12.1% -17.8% +76.3% ➖ noise
3 duckdb:vortex-file-compressed +18.8% +12.1% +6.0% +87.2% ➖ noise
4 datafusion:vortex-compact -3.0% +5.5% -8.1% +48.9% ➖ noise
4 datafusion:vortex-file-compressed -17.7% +5.5% -22.0% +40.3% ➖ noise
4 duckdb:vortex-compact -18.1% +5.5% -22.4% +93.5% ➖ noise
4 duckdb:vortex-file-compressed -6.7% +5.5% -11.6% +45.3% ➖ noise
5 datafusion:vortex-compact -19.1% +5.5% -23.3% +30.0% ✅ faster
5 datafusion:vortex-file-compressed -2.8% +5.5% -7.9% +34.7% ➖ noise
5 duckdb:vortex-compact -3.3% +5.5% -8.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -6.9% +5.5% -11.7% +30.0% ➖ noise
6 datafusion:vortex-compact -6.8% +0.6% -7.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +6.1% +0.6% +5.4% +30.0% ➖ noise
6 duckdb:vortex-compact -15.9% +0.6% -16.4% +32.3% ➖ noise
6 duckdb:vortex-file-compressed -6.9% +0.6% -7.5% +30.0% ➖ noise
7 datafusion:vortex-compact +3.6% +1.1% +2.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -16.4% +1.1% -17.3% +30.0% ➖ noise
7 duckdb:vortex-compact -9.1% +1.1% -10.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -1.8% +1.1% -2.9% +30.0% ➖ noise
8 datafusion:vortex-compact -0.8% -10.9% +11.4% +31.7% ➖ noise
8 datafusion:vortex-file-compressed -16.8% -10.9% -6.6% +30.0% ➖ noise
8 duckdb:vortex-compact +3.7% -10.9% +16.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -22.5% -10.9% -13.0% +30.0% ➖ noise
9 datafusion:vortex-compact +3.5% -10.6% +15.8% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -26.9% -10.6% -18.2% +30.0% ➖ noise
9 duckdb:vortex-compact -7.3% -10.6% +3.7% +37.8% ➖ noise
9 duckdb:vortex-file-compressed -13.4% -10.6% -3.1% +30.0% ➖ noise
10 datafusion:vortex-compact -31.0% +3.6% -33.4% +42.7% ✅ faster
10 datafusion:vortex-file-compressed -32.3% +3.6% -34.6% +44.0% ✅ faster
10 duckdb:vortex-compact -21.5% +3.6% -24.3% +66.0% ➖ noise
10 duckdb:vortex-file-compressed +3.1% +3.6% -0.5% +42.6% ➖ noise
11 datafusion:vortex-compact +11.7% -8.6% +22.2% +58.1% ➖ noise
11 datafusion:vortex-file-compressed -21.8% -8.6% -14.5% +35.2% ➖ noise
11 duckdb:vortex-compact -18.9% -8.6% -11.3% +33.8% ➖ noise
11 duckdb:vortex-file-compressed -19.1% -8.6% -11.5% +38.7% ➖ noise
12 datafusion:vortex-compact -10.4% -10.9% +0.5% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -18.3% -10.9% -8.4% +30.0% ➖ noise
12 duckdb:vortex-compact -55.4% -10.9% -50.0% +83.5% ✅ faster
12 duckdb:vortex-file-compressed -16.1% -10.9% -5.9% +43.3% ➖ noise
13 datafusion:vortex-compact -19.6% -4.8% -15.6% +54.4% ➖ noise
13 datafusion:vortex-file-compressed -2.1% -4.8% +2.8% +64.2% ➖ noise
13 duckdb:vortex-compact -22.5% -4.8% -18.6% +81.1% ➖ noise
13 duckdb:vortex-file-compressed +6.3% -4.8% +11.6% +124.3% ➖ noise
14 datafusion:vortex-compact +16.0% -16.0% +38.1% +31.8% 🚨 regression
14 datafusion:vortex-file-compressed +16.1% -16.0% +38.3% +30.0% 🚨 regression
14 duckdb:vortex-compact -10.3% -16.0% +6.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -2.1% -16.0% +16.6% +30.0% ➖ noise
15 datafusion:vortex-compact +15.5% -16.2% +37.7% +30.0% 🚨 regression
15 datafusion:vortex-file-compressed +7.4% -16.2% +28.1% +30.0% ➖ noise
15 duckdb:vortex-compact -11.4% -16.2% +5.7% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -12.7% -16.2% +4.2% +30.0% ➖ noise
16 datafusion:vortex-compact +10.9% -4.5% +16.1% +54.8% ➖ noise
16 datafusion:vortex-file-compressed -22.5% -4.5% -18.8% +33.3% ➖ noise
16 duckdb:vortex-compact -14.2% -4.5% -10.1% +32.0% ➖ noise
16 duckdb:vortex-file-compressed -20.0% -4.5% -16.2% +34.3% ➖ noise
17 datafusion:vortex-compact +15.9% -4.2% +21.0% +36.8% ➖ noise
17 datafusion:vortex-file-compressed -3.1% -4.2% +1.2% +39.7% ➖ noise
17 duckdb:vortex-compact -7.0% -4.2% -2.9% +35.2% ➖ noise
17 duckdb:vortex-file-compressed -12.3% -4.2% -8.4% +35.9% ➖ noise
18 datafusion:vortex-compact -15.0% -8.1% -7.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +19.3% -8.1% +29.7% +30.0% ➖ noise
18 duckdb:vortex-compact +4.5% -8.1% +13.7% +36.0% ➖ noise
18 duckdb:vortex-file-compressed -31.0% -8.1% -25.0% +30.0% ✅ faster
19 datafusion:vortex-compact +131.8% +6.0% +118.7% +64.7% 🚨 regression
19 datafusion:vortex-file-compressed -1.6% +6.0% -7.2% +45.2% ➖ noise
19 duckdb:vortex-compact -16.1% +6.0% -20.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -9.1% +6.0% -14.2% +30.0% ➖ noise
20 datafusion:vortex-compact +20.9% +4.9% +15.2% +33.9% ➖ noise
20 datafusion:vortex-file-compressed -16.0% +4.9% -19.9% +38.6% ➖ noise
20 duckdb:vortex-compact -5.5% +4.9% -9.9% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -28.6% +4.9% -32.0% +30.0% ✅ faster
21 datafusion:vortex-compact -8.0% -20.9% +16.4% +35.8% ➖ noise
21 datafusion:vortex-file-compressed -9.3% -20.9% +14.7% +30.0% ➖ noise
21 duckdb:vortex-compact -21.9% -20.9% -1.2% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +2.5% -20.9% +29.6% +30.0% ➖ noise
22 datafusion:vortex-compact -5.0% -13.4% +9.6% +41.5% ➖ noise
22 datafusion:vortex-file-compressed -16.3% -13.4% -3.4% +85.2% ➖ noise
22 duckdb:vortex-compact -16.5% -13.4% -3.7% +37.5% ➖ noise
22 duckdb:vortex-file-compressed -21.4% -13.4% -9.3% +43.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -1.2%

datafusion / vortex-file-compressed (1.015x ➖, 0↑ 2↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1855237 1909642 0.97
clickbench_q01/datafusion:vortex-file-compressed 13941006 13910739 1.00
clickbench_q02/datafusion:vortex-file-compressed 34933013 35576793 0.98
clickbench_q03/datafusion:vortex-file-compressed 38264222 38330831 1.00
clickbench_q04/datafusion:vortex-file-compressed 304715986 307814768 0.99
clickbench_q05/datafusion:vortex-file-compressed 313089120 319752561 0.98
clickbench_q06/datafusion:vortex-file-compressed 1870766 1949029 0.96
clickbench_q07/datafusion:vortex-file-compressed 18666101 17452521 1.07
clickbench_q08/datafusion:vortex-file-compressed 384131771 384762129 1.00
clickbench_q09/datafusion:vortex-file-compressed 551905882 575483855 0.96
clickbench_q10/datafusion:vortex-file-compressed 72949039 73652147 0.99
clickbench_q11/datafusion:vortex-file-compressed 83160784 83111317 1.00
clickbench_q12/datafusion:vortex-file-compressed 278683317 273565764 1.02
clickbench_q13/datafusion:vortex-file-compressed 407349780 412744036 0.99
clickbench_q14/datafusion:vortex-file-compressed 265430659 257452463 1.03
clickbench_q15/datafusion:vortex-file-compressed 351332976 365551984 0.96
clickbench_q16/datafusion:vortex-file-compressed 689038190 696958081 0.99
clickbench_q17/datafusion:vortex-file-compressed 676992073 685725015 0.99
clickbench_q18/datafusion:vortex-file-compressed 1405264704 1330325671 1.06
clickbench_q19/datafusion:vortex-file-compressed 🚨 26017757 23194472 1.12
clickbench_q20/datafusion:vortex-file-compressed 358556949 353689086 1.01
clickbench_q21/datafusion:vortex-file-compressed 404509548 402411402 1.01
clickbench_q22/datafusion:vortex-file-compressed 498303734 481647160 1.03
clickbench_q23/datafusion:vortex-file-compressed 696440707 686995192 1.01
clickbench_q24/datafusion:vortex-file-compressed 55324715 51001608 1.08
clickbench_q25/datafusion:vortex-file-compressed 🚨 79127689 66225840 1.19
clickbench_q26/datafusion:vortex-file-compressed 52089997 48392708 1.08
clickbench_q27/datafusion:vortex-file-compressed 822147945 790295177 1.04
clickbench_q28/datafusion:vortex-file-compressed 6676690941 6823250421 0.98
clickbench_q29/datafusion:vortex-file-compressed 243069925 233583006 1.04
clickbench_q30/datafusion:vortex-file-compressed 240050099 228337067 1.05
clickbench_q31/datafusion:vortex-file-compressed 271092806 265828712 1.02
clickbench_q32/datafusion:vortex-file-compressed 1297572238 1212123953 1.07
clickbench_q33/datafusion:vortex-file-compressed 1414623503 1415409550 1.00
clickbench_q34/datafusion:vortex-file-compressed 1405034206 1380794835 1.02
clickbench_q35/datafusion:vortex-file-compressed 514383632 515258484 1.00
clickbench_q36/datafusion:vortex-file-compressed 79404753 84795086 0.94
clickbench_q37/datafusion:vortex-file-compressed 39499523 39876882 0.99
clickbench_q38/datafusion:vortex-file-compressed 22501696 22329889 1.01
clickbench_q39/datafusion:vortex-file-compressed 144104121 144615308 1.00
clickbench_q40/datafusion:vortex-file-compressed 18228811 19085911 0.96
clickbench_q41/datafusion:vortex-file-compressed 17267073 16196475 1.07
clickbench_q42/datafusion:vortex-file-compressed 18660734 18026882 1.04
datafusion / parquet (0.982x ➖, 1↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1978773 1806768 1.10
clickbench_q01/datafusion:parquet 21398885 20279197 1.06
clickbench_q02/datafusion:parquet 55202056 56181714 0.98
clickbench_q03/datafusion:parquet 44297353 45605012 0.97
clickbench_q04/datafusion:parquet 324721735 346508985 0.94
clickbench_q05/datafusion:parquet 361383795 369713383 0.98
clickbench_q06/datafusion:parquet 1740682 1781956 0.98
clickbench_q07/datafusion:parquet 26397822 25904804 1.02
clickbench_q08/datafusion:parquet 399729962 430355199 0.93
clickbench_q09/datafusion:parquet 635549912 655382517 0.97
clickbench_q10/datafusion:parquet 108750056 110950061 0.98
clickbench_q11/datafusion:parquet 133825219 139538556 0.96
clickbench_q12/datafusion:parquet 360217450 369817470 0.97
clickbench_q13/datafusion:parquet 533838546 500637925 1.07
clickbench_q14/datafusion:parquet 350556941 365127173 0.96
clickbench_q15/datafusion:parquet 376806176 380569176 0.99
clickbench_q16/datafusion:parquet 680730791 698431845 0.97
clickbench_q17/datafusion:parquet 675729956 685304619 0.99
clickbench_q18/datafusion:parquet 1431775936 1481982570 0.97
clickbench_q19/datafusion:parquet 33842267 32087381 1.05
clickbench_q20/datafusion:parquet 621516884 624074177 1.00
clickbench_q21/datafusion:parquet 679980846 684507877 0.99
clickbench_q22/datafusion:parquet 978140170 1010064369 0.97
clickbench_q23/datafusion:parquet 3641450424 3750318401 0.97
clickbench_q24/datafusion:parquet 89995886 94480751 0.95
clickbench_q25/datafusion:parquet 136881711 147438796 0.93
clickbench_q26/datafusion:parquet 86575746 87290228 0.99
clickbench_q27/datafusion:parquet 1055421808 1073136802 0.98
clickbench_q28/datafusion:parquet 6477946578 6676112905 0.97
clickbench_q29/datafusion:parquet 237760605 248278781 0.96
clickbench_q30/datafusion:parquet 358999051 369639051 0.97
clickbench_q31/datafusion:parquet 388246648 395877830 0.98
clickbench_q32/datafusion:parquet 🚨 1314987959 1182345866 1.11
clickbench_q33/datafusion:parquet 1516564054 1544939959 0.98
clickbench_q34/datafusion:parquet 1524678341 1539300239 0.99
clickbench_q35/datafusion:parquet 523774421 541723405 0.97
clickbench_q36/datafusion:parquet 144199561 157831659 0.91
clickbench_q37/datafusion:parquet 60443010 62390303 0.97
clickbench_q38/datafusion:parquet 90229816 92219189 0.98
clickbench_q39/datafusion:parquet 267166189 282988323 0.94
clickbench_q40/datafusion:parquet 34175650 32800188 1.04
clickbench_q41/datafusion:parquet 🚀 29650690 33484362 0.89
clickbench_q42/datafusion:parquet 31340280 31616234 0.99
duckdb / vortex-file-compressed (0.985x ➖, 4↑ 2↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6354164 6003622 1.06
clickbench_q01/duckdb:vortex-file-compressed 14109645 14084760 1.00
clickbench_q02/duckdb:vortex-file-compressed 25534590 25619653 1.00
clickbench_q03/duckdb:vortex-file-compressed 31727333 30442596 1.04
clickbench_q04/duckdb:vortex-file-compressed 190763748 182670060 1.04
clickbench_q05/duckdb:vortex-file-compressed 196699327 203257547 0.97
clickbench_q06/duckdb:vortex-file-compressed 18030803 18140887 0.99
clickbench_q07/duckdb:vortex-file-compressed 15751184 15097681 1.04
clickbench_q08/duckdb:vortex-file-compressed 265680936 269617988 0.99
clickbench_q09/duckdb:vortex-file-compressed 353504933 352155341 1.00
clickbench_q10/duckdb:vortex-file-compressed 70298105 71593413 0.98
clickbench_q11/duckdb:vortex-file-compressed 81265240 81322169 1.00
clickbench_q12/duckdb:vortex-file-compressed 220915616 221489022 1.00
clickbench_q13/duckdb:vortex-file-compressed 438085752 440509659 0.99
clickbench_q14/duckdb:vortex-file-compressed 258022605 244856716 1.05
clickbench_q15/duckdb:vortex-file-compressed 227913533 223031314 1.02
clickbench_q16/duckdb:vortex-file-compressed 🚀 652197237 753043030 0.87
clickbench_q17/duckdb:vortex-file-compressed 🚀 560032408 624524765 0.90
clickbench_q18/duckdb:vortex-file-compressed 1229710421 1243468543 0.99
clickbench_q19/duckdb:vortex-file-compressed 🚨 23896391 20312146 1.18
clickbench_q20/duckdb:vortex-file-compressed 391265880 395536009 0.99
clickbench_q21/duckdb:vortex-file-compressed 404929492 414339440 0.98
clickbench_q22/duckdb:vortex-file-compressed 663888003 700278569 0.95
clickbench_q23/duckdb:vortex-file-compressed 🚀 914375100 1225785212 0.75
clickbench_q24/duckdb:vortex-file-compressed 46425405 46939036 0.99
clickbench_q25/duckdb:vortex-file-compressed 🚨 85450192 74459915 1.15
clickbench_q26/duckdb:vortex-file-compressed 47131403 51789346 0.91
clickbench_q27/duckdb:vortex-file-compressed 508461223 502692596 1.01
clickbench_q28/duckdb:vortex-file-compressed 2997585500 2992733742 1.00
clickbench_q29/duckdb:vortex-file-compressed 28525510 28872046 0.99
clickbench_q30/duckdb:vortex-file-compressed 196866072 180407540 1.09
clickbench_q31/duckdb:vortex-file-compressed 268501197 262959822 1.02
clickbench_q32/duckdb:vortex-file-compressed 1325230409 1361195507 0.97
clickbench_q33/duckdb:vortex-file-compressed 1626226748 1633800648 1.00
clickbench_q34/duckdb:vortex-file-compressed 1669712328 1624417179 1.03
clickbench_q35/duckdb:vortex-file-compressed 372566141 371685685 1.00
clickbench_q36/duckdb:vortex-file-compressed 🚀 30063014 33719976 0.89
clickbench_q37/duckdb:vortex-file-compressed 22650757 24369264 0.93
clickbench_q38/duckdb:vortex-file-compressed 23729974 25813857 0.92
clickbench_q39/duckdb:vortex-file-compressed 44673147 45087041 0.99
clickbench_q40/duckdb:vortex-file-compressed 23001012 23398689 0.98
clickbench_q41/duckdb:vortex-file-compressed 21714070 23415766 0.93
clickbench_q42/duckdb:vortex-file-compressed 23602248 26178388 0.90
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 216407679 226056259 0.96
clickbench_q01/duckdb:parquet 50200173 49903863 1.01
clickbench_q02/duckdb:parquet 65462949 66838931 0.98
clickbench_q03/duckdb:parquet 63283852 64657459 0.98
clickbench_q04/duckdb:parquet 206662868 202539641 1.02
clickbench_q05/duckdb:parquet 286137589 279152461 1.03
clickbench_q06/duckdb:parquet 60709704 60063130 1.01
clickbench_q07/duckdb:parquet 52777640 51653297 1.02
clickbench_q08/duckdb:parquet 266722572 270563388 0.99
clickbench_q09/duckdb:parquet 396375741 396892143 1.00
clickbench_q10/duckdb:parquet 97503088 96167807 1.01
clickbench_q11/duckdb:parquet 108441460 107687492 1.01
clickbench_q12/duckdb:parquet 297853161 296227716 1.01
clickbench_q13/duckdb:parquet 509545625 516616007 0.99
clickbench_q14/duckdb:parquet 328240081 331370656 0.99
clickbench_q15/duckdb:parquet 240667946 242680771 0.99
clickbench_q16/duckdb:parquet 611479731 618569339 0.99
clickbench_q17/duckdb:parquet 507687742 521153647 0.97
clickbench_q18/duckdb:parquet 1047010897 1063777712 0.98
clickbench_q19/duckdb:parquet 50064478 48446545 1.03
clickbench_q20/duckdb:parquet 434369707 436943611 0.99
clickbench_q21/duckdb:parquet 550300355 556964025 0.99
clickbench_q22/duckdb:parquet 933314670 930283123 1.00
clickbench_q23/duckdb:parquet 317888883 319667346 0.99
clickbench_q24/duckdb:parquet 76279477 78299645 0.97
clickbench_q25/duckdb:parquet 141782965 140618028 1.01
clickbench_q26/duckdb:parquet 52805913 52661341 1.00
clickbench_q27/duckdb:parquet 648808059 649133956 1.00
clickbench_q28/duckdb:parquet 4833129665 4865182953 0.99
clickbench_q29/duckdb:parquet 61429465 62162504 0.99
clickbench_q30/duckdb:parquet 306003486 304455052 1.01
clickbench_q31/duckdb:parquet 350640066 349687604 1.00
clickbench_q32/duckdb:parquet 1187040288 1145756713 1.04
clickbench_q33/duckdb:parquet 1239086788 1298341645 0.95
clickbench_q34/duckdb:parquet 1258592818 1335216945 0.94
clickbench_q35/duckdb:parquet 351837508 354965814 0.99
clickbench_q36/duckdb:parquet 63843516 65069369 0.98
clickbench_q37/duckdb:parquet 54378908 54310130 1.00
clickbench_q38/duckdb:parquet 58901584 58755306 1.00
clickbench_q39/duckdb:parquet 98769967 100538133 0.98
clickbench_q40/duckdb:parquet 55428995 55204260 1.00
clickbench_q41/duckdb:parquet 57684616 60367000 0.96
clickbench_q42/duckdb:parquet 50118713 49637794 1.01
duckdb / duckdb (0.971x ➖, 0↑ 1↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18389307 18859140 0.98
clickbench_q01/duckdb:duckdb 32926365 35162862 0.94
clickbench_q02/duckdb:duckdb 46712110 47463248 0.98
clickbench_q03/duckdb:duckdb 47509331 49143233 0.97
clickbench_q04/duckdb:duckdb 214097695 225452704 0.95
clickbench_q05/duckdb:duckdb 313060433 333744360 0.94
clickbench_q06/duckdb:duckdb 36471969 37690759 0.97
clickbench_q07/duckdb:duckdb 36310905 37355502 0.97
clickbench_q08/duckdb:duckdb 313637354 314749214 1.00
clickbench_q09/duckdb:duckdb 446302718 490952220 0.91
clickbench_q10/duckdb:duckdb 97563041 98568550 0.99
clickbench_q11/duckdb:duckdb 106871308 107492203 0.99
clickbench_q12/duckdb:duckdb 289370156 319978113 0.90
clickbench_q13/duckdb:duckdb 523615725 579469682 0.90
clickbench_q14/duckdb:duckdb 347854922 369302704 0.94
clickbench_q15/duckdb:duckdb 257082012 259831852 0.99
clickbench_q16/duckdb:duckdb 675070074 698327725 0.97
clickbench_q17/duckdb:duckdb 577330626 580151024 1.00
clickbench_q18/duckdb:duckdb 1247086494 1272947669 0.98
clickbench_q19/duckdb:duckdb 35613533 37051263 0.96
clickbench_q20/duckdb:duckdb 912569518 945643159 0.97
clickbench_q21/duckdb:duckdb 1015527027 1000442089 1.02
clickbench_q22/duckdb:duckdb 1107309889 1096161624 1.01
clickbench_q23/duckdb:duckdb 249012460 259377846 0.96
clickbench_q24/duckdb:duckdb 62008987 62794877 0.99
clickbench_q25/duckdb:duckdb 125667278 126453517 0.99
clickbench_q26/duckdb:duckdb 55559192 56320428 0.99
clickbench_q27/duckdb:duckdb 1028404036 1062880180 0.97
clickbench_q28/duckdb:duckdb 4610085975 4616235952 1.00
clickbench_q29/duckdb:duckdb 48848948 51163592 0.95
clickbench_q30/duckdb:duckdb 280759160 293518850 0.96
clickbench_q31/duckdb:duckdb 424904957 417954185 1.02
clickbench_q32/duckdb:duckdb 1451482844 1497017175 0.97
clickbench_q33/duckdb:duckdb 1904639327 1963720521 0.97
clickbench_q34/duckdb:duckdb 2007480737 2136536588 0.94
clickbench_q35/duckdb:duckdb 266611959 265451190 1.00
clickbench_q36/duckdb:duckdb 41517123 43556803 0.95
clickbench_q37/duckdb:duckdb 31783342 33627713 0.95
clickbench_q38/duckdb:duckdb 31424342 32774469 0.96
clickbench_q39/duckdb:duckdb 🚨 80472680 68934863 1.17
clickbench_q40/duckdb:duckdb 31906751 34063629 0.94
clickbench_q41/duckdb:duckdb 31210429 31924934 0.98
clickbench_q42/duckdb:duckdb 32083019 33757375 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -2.8% +2.4% -5.1% +597.0% ➖ noise
0 duckdb:duckdb -2.5% +2.4% -4.8% +257.3% ➖ noise
0 duckdb:vortex-file-compressed +5.8% +2.4% +3.4% +298.1% ➖ noise
1 datafusion:vortex-file-compressed +0.2% +3.0% -2.7% +47.7% ➖ noise
1 duckdb:duckdb -6.4% +3.0% -9.1% +44.9% ➖ noise
1 duckdb:vortex-file-compressed +0.2% +3.0% -2.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.8% -1.9% +0.1% +17.2% ➖ noise
2 duckdb:duckdb -1.6% -1.9% +0.3% +17.5% ➖ noise
2 duckdb:vortex-file-compressed -0.3% -1.9% +1.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.2% -2.5% +2.4% +158.4% ➖ noise
3 duckdb:duckdb -3.3% -2.5% -0.8% +35.0% ➖ noise
3 duckdb:vortex-file-compressed +4.2% -2.5% +6.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.0% -2.2% +1.2% +10.0% ➖ noise
4 duckdb:duckdb -5.0% -2.2% -2.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.4% -2.2% +6.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.1% +0.1% -2.2% +10.0% ➖ noise
5 duckdb:duckdb -6.2% +0.1% -6.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.2% +0.1% -3.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.0% -0.6% -3.4% +41.6% ➖ noise
6 duckdb:duckdb -3.2% -0.6% -2.6% +30.2% ➖ noise
6 duckdb:vortex-file-compressed -0.6% -0.6% +0.0% +19.7% ➖ noise
7 datafusion:vortex-file-compressed +7.0% +2.0% +4.8% +12.7% ➖ noise
7 duckdb:duckdb -2.8% +2.0% -4.7% +10.5% ➖ noise
7 duckdb:vortex-file-compressed +4.3% +2.0% +2.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.2% -4.3% +4.3% +10.0% ➖ noise
8 duckdb:duckdb -0.4% -4.3% +4.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.5% -4.3% +3.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -4.1% -1.6% -2.5% +10.0% ➖ noise
9 duckdb:duckdb -9.1% -1.6% -7.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.4% -1.6% +2.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.0% -0.3% -0.6% +10.4% ➖ noise
10 duckdb:duckdb -1.0% -0.3% -0.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.8% -0.3% -1.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.1% -1.7% +1.8% +10.0% ➖ noise
11 duckdb:duckdb -0.6% -1.7% +1.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.1% -1.7% +1.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.9% -1.0% +2.9% +10.0% ➖ noise
12 duckdb:duckdb -9.6% -1.0% -8.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.3% -1.0% +0.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.3% +2.6% -3.8% +10.0% ➖ noise
13 duckdb:duckdb -9.6% +2.6% -11.9% +10.0% ✅ faster
13 duckdb:vortex-file-compressed -0.6% +2.6% -3.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +3.1% -2.5% +5.7% +10.0% ➖ noise
14 duckdb:duckdb -5.8% -2.5% -3.4% +10.6% ➖ noise
14 duckdb:vortex-file-compressed +5.4% -2.5% +8.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -3.9% -0.9% -3.0% +10.0% ➖ noise
15 duckdb:duckdb -1.1% -0.9% -0.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +2.2% -0.9% +3.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -1.1% -1.8% +0.7% +10.0% ➖ noise
16 duckdb:duckdb -3.3% -1.8% -1.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -13.4% -1.8% -11.8% +18.9% ➖ noise
17 datafusion:vortex-file-compressed -1.3% -2.0% +0.7% +10.0% ➖ noise
17 duckdb:duckdb -0.5% -2.0% +1.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -10.3% -2.0% -8.5% +12.6% ➖ noise
18 datafusion:vortex-file-compressed +5.6% -2.5% +8.3% +10.0% ➖ noise
18 duckdb:duckdb -2.0% -2.5% +0.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.1% -2.5% +1.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +12.2% +4.4% +7.4% +11.6% ➖ noise
19 duckdb:duckdb -3.9% +4.4% -7.9% +12.0% ➖ noise
19 duckdb:vortex-file-compressed +17.6% +4.4% +12.7% +28.5% ➖ noise
20 datafusion:vortex-file-compressed +1.4% -0.5% +1.9% +198.1% ➖ noise
20 duckdb:duckdb -3.5% -0.5% -3.0% +23.4% ➖ noise
20 duckdb:vortex-file-compressed -1.1% -0.5% -0.6% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.5% -0.9% +1.5% +10.0% ➖ noise
21 duckdb:duckdb +1.5% -0.9% +2.5% +14.1% ➖ noise
21 duckdb:vortex-file-compressed -2.3% -0.9% -1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +3.5% -1.4% +5.0% +11.2% ➖ noise
22 duckdb:duckdb +1.0% -1.4% +2.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -5.2% -1.4% -3.8% +22.0% ➖ noise
23 datafusion:vortex-file-compressed +1.4% -1.7% +3.2% +45.4% ➖ noise
23 duckdb:duckdb -4.0% -1.7% -2.3% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -25.4% -1.7% -24.1% +38.3% ➖ noise
24 datafusion:vortex-file-compressed +8.5% -3.7% +12.6% +51.2% ➖ noise
24 duckdb:duckdb -1.3% -3.7% +2.5% +11.1% ➖ noise
24 duckdb:vortex-file-compressed -1.1% -3.7% +2.7% +38.9% ➖ noise
25 datafusion:vortex-file-compressed +19.5% -3.2% +23.5% +12.5% 🚨 regression
25 duckdb:duckdb -0.6% -3.2% +2.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +14.8% -3.2% +18.6% +15.1% 🚨 regression
26 datafusion:vortex-file-compressed +7.6% -0.3% +7.9% +14.8% ➖ noise
26 duckdb:duckdb -1.4% -0.3% -1.1% +12.4% ➖ noise
26 duckdb:vortex-file-compressed -9.0% -0.3% -8.7% +18.7% ➖ noise
27 datafusion:vortex-file-compressed +4.0% -0.9% +4.9% +10.0% ➖ noise
27 duckdb:duckdb -3.2% -0.9% -2.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +1.1% -0.9% +2.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -2.1% -1.8% -0.3% +10.0% ➖ noise
28 duckdb:duckdb -0.1% -1.8% +1.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.2% -1.8% +2.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +4.1% -2.7% +7.0% +10.0% ➖ noise
29 duckdb:duckdb -4.5% -2.7% -1.9% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -1.2% -2.7% +1.6% +12.9% ➖ noise
30 datafusion:vortex-file-compressed +5.1% -1.2% +6.4% +10.0% ➖ noise
30 duckdb:duckdb -4.3% -1.2% -3.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +9.1% -1.2% +10.4% +10.0% 🚨 regression
31 datafusion:vortex-file-compressed +2.0% -0.8% +2.8% +10.0% ➖ noise
31 duckdb:duckdb +1.7% -0.8% +2.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +2.1% -0.8% +3.0% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +7.0% +7.3% -0.3% +11.7% ➖ noise
32 duckdb:duckdb -3.0% +7.3% -9.7% +10.0% ✅ faster
32 duckdb:vortex-file-compressed -2.6% +7.3% -9.3% +10.0% ✅ faster
33 datafusion:vortex-file-compressed -0.1% -3.2% +3.3% +14.0% ➖ noise
33 duckdb:duckdb -3.0% -3.2% +0.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -0.5% -3.2% +2.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.8% -3.4% +5.3% +10.0% ➖ noise
34 duckdb:duckdb -6.0% -3.4% -2.8% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +2.8% -3.4% +6.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.2% -2.1% +2.0% +10.0% ➖ noise
35 duckdb:duckdb +0.4% -2.1% +2.6% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.2% -2.1% +2.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -6.4% -5.3% -1.1% +10.0% ➖ noise
36 duckdb:duckdb -4.7% -5.3% +0.7% +10.8% ➖ noise
36 duckdb:vortex-file-compressed -10.8% -5.3% -5.8% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -0.9% -1.5% +0.6% +10.0% ➖ noise
37 duckdb:duckdb -5.5% -1.5% -4.0% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -7.1% -1.5% -5.6% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +0.8% -1.0% +1.7% +10.0% ➖ noise
38 duckdb:duckdb -4.1% -1.0% -3.2% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -8.1% -1.0% -7.2% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -0.4% -3.7% +3.5% +15.5% ➖ noise
39 duckdb:duckdb +16.7% -3.7% +21.2% +20.8% 🚨 regression
39 duckdb:vortex-file-compressed -0.9% -3.7% +2.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -4.5% +2.3% -6.6% +14.9% ➖ noise
40 duckdb:duckdb -6.3% +2.3% -8.4% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -1.7% +2.3% -3.9% +12.5% ➖ noise
41 datafusion:vortex-file-compressed +6.6% -8.0% +15.9% +11.7% 🚨 regression
41 duckdb:duckdb -2.2% -8.0% +6.3% +10.4% ➖ noise
41 duckdb:vortex-file-compressed -7.3% -8.0% +0.8% +13.6% ➖ noise
42 datafusion:vortex-file-compressed +3.5% +0.0% +3.5% +10.0% ➖ noise
42 duckdb:duckdb -5.0% +0.0% -5.0% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -9.8% +0.0% -9.9% +10.0% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.9%
Vortex (geomean): 1.048x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.3%

duckdb / vortex-file-compressed (1.134x ❌, 0↑ 3↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10803368 10795902 1.00
statpopgen_q01/duckdb:vortex-file-compressed 🚨 48383805 26317179 1.84
statpopgen_q02/duckdb:vortex-file-compressed 1300097112 1304645697 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3024855784 3067061662 0.99
statpopgen_q04/duckdb:vortex-file-compressed 3117387051 3084027496 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1388421932 1408845643 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2049061939 2053030819 1.00
statpopgen_q07/duckdb:vortex-file-compressed 🚨 328449860 223929835 1.47
statpopgen_q08/duckdb:vortex-file-compressed 🚨 347872760 235869406 1.47
statpopgen_q09/duckdb:vortex-file-compressed 2876517644 2820704075 1.02
statpopgen_q10/duckdb:vortex-file-compressed 4645349065 4609571715 1.01
duckdb / vortex-compact (0.969x ➖, 1↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10662447 10662846 1.00
statpopgen_q01/duckdb:vortex-compact 🚀 124190877 168805331 0.74
statpopgen_q02/duckdb:vortex-compact 1805969588 1813985290 1.00
statpopgen_q03/duckdb:vortex-compact 3464601301 3457996308 1.00
statpopgen_q04/duckdb:vortex-compact 3495641530 3570062184 0.98
statpopgen_q05/duckdb:vortex-compact 1802060402 1833056827 0.98
statpopgen_q06/duckdb:vortex-compact 2659817140 2625198743 1.01
statpopgen_q07/duckdb:vortex-compact 928084096 928251121 1.00
statpopgen_q08/duckdb:vortex-compact 959855351 961275965 1.00
statpopgen_q09/duckdb:vortex-compact 3298492208 3314714224 1.00
statpopgen_q10/duckdb:vortex-compact 5346266075 5378873052 0.99
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 306198097 310791574 0.99
statpopgen_q01/duckdb:parquet 396655313 388556331 1.02
statpopgen_q02/duckdb:parquet 980154204 994804385 0.99
statpopgen_q03/duckdb:parquet 1488441929 1504480485 0.99
statpopgen_q04/duckdb:parquet 1497397708 1501524065 1.00
statpopgen_q05/duckdb:parquet 991260651 988785264 1.00
statpopgen_q06/duckdb:parquet 1470030044 1479363408 0.99
statpopgen_q07/duckdb:parquet 1873716648 1840762511 1.02
statpopgen_q08/duckdb:parquet 1868284187 1864477070 1.00
statpopgen_q09/duckdb:parquet 1359339586 1336128692 1.02
statpopgen_q10/duckdb:parquet 2609290997 2648878977 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.0% -1.5% +1.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +0.1% -1.5% +1.6% +10.0% ➖ noise
1 duckdb:vortex-compact -26.4% +2.1% -27.9% +53.9% ➖ noise
1 duckdb:vortex-file-compressed +83.8% +2.1% +80.1% +199.5% ➖ noise
2 duckdb:vortex-compact -0.4% -1.5% +1.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.3% -1.5% +1.1% +10.0% ➖ noise
3 duckdb:vortex-compact +0.2% -1.1% +1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.4% -1.1% -0.3% +10.0% ➖ noise
4 duckdb:vortex-compact -2.1% -0.3% -1.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% -0.3% +1.4% +10.0% ➖ noise
5 duckdb:vortex-compact -1.7% +0.3% -1.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.4% +0.3% -1.7% +10.0% ➖ noise
6 duckdb:vortex-compact +1.3% -0.6% +2.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.2% -0.6% +0.4% +10.0% ➖ noise
7 duckdb:vortex-compact -0.0% +1.8% -1.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +46.7% +1.8% +44.1% +19.6% 🚨 regression
8 duckdb:vortex-compact -0.1% +0.2% -0.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +47.5% +0.2% +47.2% +10.0% 🚨 regression
9 duckdb:vortex-compact -0.5% +1.7% -2.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.0% +1.7% +0.2% +10.0% ➖ noise
10 duckdb:vortex-compact -0.6% -1.5% +0.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.8% -1.5% +2.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: Random Access

Vortex (geomean): 0.915x ➖
Parquet (geomean): 1.037x ➖

unknown / unknown (0.988x ➖, 7↑ 5↓)
name PR 799cae2 (ns) base 3e6834e (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 2836828 2366586 1.20
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1258490 1259202 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11781137039 11523538354 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11289222362 11199571162 1.01
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8096078 8519994 0.95
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7467157 7307890 1.02
random-access/feature-vectors/uniform/lance-tokio-local-disk 1455271 1439507 1.01
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2343969 2323586 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11281167569 11283972530 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11193685953 11265831474 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13955871 13453243 1.04
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 14287690 13454485 1.06
random-access/lance-tokio-local-disk 747862 733023 1.02
random-access/lance-tokio-local-disk-footer 1334538 1339018 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 272710 267770 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 684517 694936 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk 141696940 137082180 1.03
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 140903390 134366434 1.05
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 726460 817236 0.89
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 872724 818732 1.07
random-access/nested-lists/uniform/lance-tokio-local-disk 1168785 1162568 1.01
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1626326 1634839 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk 141593753 132916715 1.07
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 142930485 135608887 1.05
random-access/nested-lists/uniform/vortex-tokio-local-disk 2408345 2590777 0.93
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2531497 2700441 0.94
random-access/nested-structs/correlated/lance-tokio-local-disk 433588 429065 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 639151 642135 1.00
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 28992069 25746308 1.13
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 29210191 25093359 1.16
random-access/nested-structs/correlated/vortex-tokio-local-disk 836788 885077 0.95
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 933498 908287 1.03
random-access/nested-structs/uniform/lance-tokio-local-disk 2821217 2803728 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3057261 3112350 0.98
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 29052750 25033901 1.16
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 29287672 25271511 1.16
random-access/nested-structs/uniform/vortex-tokio-local-disk 1913106 1827853 1.05
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1929711 1864820 1.03
random-access/parquet-tokio-local-disk 184241845 190329981 0.97
random-access/parquet-tokio-local-disk-footer 183419336 188326027 0.97
random-access/taxi/correlated/lance-tokio-local-disk 969248 952103 1.02
random-access/taxi/correlated/lance-tokio-local-disk-footer 1632428 1619681 1.01
random-access/taxi/correlated/parquet-tokio-local-disk 271462002 275304368 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 273511254 277330693 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1760913 2544401 0.69
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1908263 2573763 0.74
random-access/taxi/uniform/lance-tokio-local-disk 8557551 8350776 1.02
random-access/taxi/uniform/lance-tokio-local-disk-footer 9244031 8979272 1.03
random-access/taxi/uniform/parquet-tokio-local-disk 287026442 296220214 0.97
random-access/taxi/uniform/parquet-tokio-local-disk-footer 286160154 292391365 0.98
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4778707 5403492 0.88
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4642561 5298259 0.88
random-access/vortex-tokio-local-disk 🚀 1289466 1797191 0.72
random-access/vortex-tokio-local-disk-footer 🚀 1299399 1717187 0.76

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

Benchmarks: Compression

Vortex (geomean): 1.002x ➖
Parquet (geomean): 1.019x ➖

unknown / unknown (1.025x ➖, 2↑ 11↓)
name PR 799cae2 (ns) base 5330d32 (ns) ratio (PR/base)
compress time/Arade 1203494179 1232617133 0.98
compress time/Bimbo 7311567489 6943945765 1.05
compress time/CMSprovider 3045002922 2889113758 1.05
compress time/Euro2016 451367182 424606709 1.06
compress time/Food 390061075 364722877 1.07
compress time/HashTags 818446283 799467907 1.02
compress time/TPC-H l_comment canonical 1372253545 1263557448 1.09
compress time/TPC-H l_comment chunked 1372004126 1274738046 1.08
compress time/taxi 758362050 704728105 1.08
compress time/wide table cols=100 chunks=1 rows=1000 14173273 13179153 1.08
compress time/wide table cols=100 chunks=50 rows=1000 14441829 13942540 1.04
compress time/wide table cols=1000 chunks=1 rows=1000 144879534 147712698 0.98
compress time/wide table cols=1000 chunks=50 rows=1000 145007065 141627347 1.02
compress time/wide table cols=10000 chunks=1 rows=1000 1460429674 1446668905 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1472134486 1431088271 1.03
decompress time/Arade 35606215 34927122 1.02
decompress time/Bimbo 108980501 102155263 1.07
decompress time/CMSprovider 94896167 86789143 1.09
decompress time/Euro2016 21937861 21215067 1.03
decompress time/Food 10565247 9692384 1.09
decompress time/HashTags 83629353 78225838 1.07
decompress time/TPC-H l_comment canonical 🚨 44764596 40664877 1.10
decompress time/TPC-H l_comment chunked 42929917 41112554 1.04
decompress time/taxi 22883688 22898696 1.00
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3004797 2502418 1.20
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2870112 2564524 1.12
decompress time/wide table cols=1000 chunks=1 rows=1000 24125359 24328321 0.99
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 24914591 21966522 1.13
decompress time/wide table cols=10000 chunks=1 rows=1000 248042491 229656290 1.08
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 258784536 235068343 1.10
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3159307137 3341338333 0.95
parquet_rs-zstd compress time/Bimbo 17956446131 17324613411 1.04
parquet_rs-zstd compress time/CMSprovider 8459913408 7746794100 1.09
parquet_rs-zstd compress time/Euro2016 1420647841 1336172910 1.06
parquet_rs-zstd compress time/Food 964682601 930563630 1.04
parquet_rs-zstd compress time/HashTags 🚨 2744741950 2456720975 1.12
parquet_rs-zstd compress time/TPC-H l_comment canonical 3259008212 3063096860 1.06
parquet_rs-zstd compress time/TPC-H l_comment chunked 3273963825 3054614227 1.07
parquet_rs-zstd compress time/taxi 1576818787 1507999066 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 8253341 6874579 1.20
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 8085513 6715085 1.20
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 91503945 87787450 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 90566677 86458494 1.05
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 915387835 891924014 1.03
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 917599746 904622363 1.01
parquet_rs-zstd decompress time/Arade 660292942 709989237 0.93
parquet_rs-zstd decompress time/Bimbo 1752678684 1745488309 1.00
parquet_rs-zstd decompress time/CMSprovider 2073259824 1943988883 1.07
parquet_rs-zstd decompress time/Euro2016 400292635 384390593 1.04
parquet_rs-zstd decompress time/Food 229874295 221036656 1.04
parquet_rs-zstd decompress time/HashTags 🚨 711426824 624138499 1.14
parquet_rs-zstd decompress time/TPC-H l_comment canonical 581361646 564352886 1.03
parquet_rs-zstd decompress time/TPC-H l_comment chunked 571642427 560267301 1.02
parquet_rs-zstd decompress time/taxi 250087910 248142088 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3166665 2741989 1.15
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3036166 2689464 1.13
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34015584 33107566 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33587389 32139761 1.05
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 381205335 378113917 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 379955671 363443464 1.05
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163757340 163395292 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.03
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio compress time/Food 0 0 1.03
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.92
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 1.03
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.90
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 2 0.86
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.10
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.06
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio decompress time/Food 0 0 1.05
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.94
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.07
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@robert3005
Copy link
Copy Markdown
Contributor

robert3005 commented Apr 14, 2026

You also need to enable the compile flag

@joseph-isaacs
fix
7d50166 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
Merge branch 'develop' into ji/add-more-exp
e91b4d2
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

File Sizes: TPC-H SF=1 on NVME

File Size Changes (18 files changed, -0.2% overall, 16↑ 2↓)
File Scale Format Base HEAD Change %
region_0.vortex 1.0 vortex-compact 4.24 KB 4.27 KB +32 B +0.7%
region_0.vortex 1.0 vortex-file-compressed 4.50 KB 4.53 KB +32 B +0.7%
nation_0.vortex 1.0 vortex-compact 6.02 KB 6.06 KB +40 B +0.6%
nation_0.vortex 1.0 vortex-file-compressed 8.10 KB 8.14 KB +40 B +0.5%
partsupp_0.vortex 1.0 vortex-file-compressed 35.79 MB 35.90 MB +105.59 KB +0.3%
supplier_0.vortex 1.0 vortex-compact 491.78 KB 491.81 KB +32 B +0.0%
supplier_0.vortex 1.0 vortex-file-compressed 700.14 KB 700.17 KB +32 B +0.0%
part_0.vortex 1.0 vortex-compact 3.62 MB 3.62 MB +40 B +0.0%
part_0.vortex 1.0 vortex-file-compressed 5.42 MB 5.42 MB +40 B +0.0%
customer_0.vortex 1.0 vortex-compact 7.42 MB 7.42 MB +40 B +0.0%
customer_0.vortex 1.0 vortex-file-compressed 10.48 MB 10.48 MB +40 B +0.0%
partsupp_0.vortex 1.0 vortex-compact 25.21 MB 25.21 MB +32 B +0.0%
orders_0.vortex 1.0 vortex-compact 31.68 MB 31.68 MB +40 B +0.0%
orders_0.vortex 1.0 vortex-file-compressed 43.36 MB 43.36 MB +40 B +0.0%
lineitem_0.vortex 1.0 vortex-compact 62.86 MB 62.86 MB +40 B +0.0%
lineitem_1.vortex 1.0 vortex-compact 62.89 MB 62.89 MB +40 B +0.0%
lineitem_0.vortex 1.0 vortex-file-compressed 85.61 MB 85.24 MB 382.71 KB -0.4%
lineitem_1.vortex 1.0 vortex-file-compressed 85.20 MB 84.72 MB 498.13 KB -0.6%

Totals:

  • vortex-compact: 194.43 MB → 194.43 MB (+0.0%)
  • vortex-file-compressed: 266.83 MB → 266.07 MB (-0.3%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

File Sizes: FineWeb NVMe

File Size Changes (2 files changed, -0.0% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB +40 B +0.0%
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB 248 B -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (+0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (48 files changed, -0.9% overall, 46↑ 2↓)
File Scale Format Base HEAD Change %
date_dim.vortex 1.0 vortex-file-compressed 1001.17 KB 1.01 MB +28.60 KB +2.9%
income_band.vortex 1.0 vortex-compact 4.09 KB 4.12 KB +32 B +0.8%
income_band.vortex 1.0 vortex-file-compressed 4.26 KB 4.29 KB +32 B +0.7%
reason.vortex 1.0 vortex-compact 4.35 KB 4.38 KB +32 B +0.7%
reason.vortex 1.0 vortex-file-compressed 5.38 KB 5.41 KB +32 B +0.6%
household_demographics.vortex 1.0 vortex-compact 7.12 KB 7.16 KB +40 B +0.5%
ship_mode.vortex 1.0 vortex-compact 7.38 KB 7.42 KB +40 B +0.5%
ship_mode.vortex 1.0 vortex-file-compressed 8.75 KB 8.79 KB +40 B +0.4%
household_demographics.vortex 1.0 vortex-file-compressed 13.34 KB 13.38 KB +40 B +0.3%
warehouse.vortex 1.0 vortex-compact 13.82 KB 13.86 KB +32 B +0.2%
web_page.vortex 1.0 vortex-compact 17.50 KB 17.54 KB +40 B +0.2%
catalog_sales.vortex 1.0 vortex-file-compressed 69.26 MB 69.41 MB +156.15 KB +0.2%
warehouse.vortex 1.0 vortex-file-compressed 14.70 KB 14.73 KB +32 B +0.2%
web_page.vortex 1.0 vortex-file-compressed 20.56 KB 20.60 KB +40 B +0.2%
store.vortex 1.0 vortex-compact 28.27 KB 28.31 KB +40 B +0.1%
web_site.vortex 1.0 vortex-compact 28.97 KB 29.01 KB +40 B +0.1%
store.vortex 1.0 vortex-file-compressed 30.80 KB 30.84 KB +40 B +0.1%
call_center.vortex 1.0 vortex-compact 30.83 KB 30.87 KB +40 B +0.1%
call_center.vortex 1.0 vortex-file-compressed 33.68 KB 33.71 KB +40 B +0.1%
promotion.vortex 1.0 vortex-compact 34.82 KB 34.86 KB +40 B +0.1%
web_site.vortex 1.0 vortex-file-compressed 35.43 KB 35.46 KB +40 B +0.1%
promotion.vortex 1.0 vortex-file-compressed 42.46 KB 42.50 KB +40 B +0.1%
time_dim.vortex 1.0 vortex-compact 85.23 KB 85.27 KB +40 B +0.0%
date_dim.vortex 1.0 vortex-compact 130.77 KB 130.81 KB +40 B +0.0%
catalog_page.vortex 1.0 vortex-compact 353.97 KB 354.01 KB +40 B +0.0%
customer_address.vortex 1.0 vortex-compact 546.22 KB 546.26 KB +40 B +0.0%
catalog_page.vortex 1.0 vortex-file-compressed 601.49 KB 601.53 KB +40 B +0.0%
customer_demographics.vortex 1.0 vortex-compact 623.86 KB 623.89 KB +40 B +0.0%
time_dim.vortex 1.0 vortex-file-compressed 673.22 KB 673.26 KB +40 B +0.0%
item.vortex 1.0 vortex-compact 974.95 KB 974.99 KB +40 B +0.0%
customer_address.vortex 1.0 vortex-file-compressed 992.00 KB 992.04 KB +40 B +0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.47 MB 1.47 MB +40 B +0.0%
item.vortex 1.0 vortex-file-compressed 1.72 MB 1.72 MB +40 B +0.0%
web_returns.vortex 1.0 vortex-compact 2.97 MB 2.97 MB +40 B +0.0%
customer.vortex 1.0 vortex-compact 3.27 MB 3.27 MB +40 B +0.0%
web_returns.vortex 1.0 vortex-file-compressed 3.46 MB 3.46 MB +40 B +0.0%
customer.vortex 1.0 vortex-file-compressed 4.49 MB 4.49 MB +40 B +0.0%
catalog_returns.vortex 1.0 vortex-compact 5.98 MB 5.98 MB +40 B +0.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.28 MB 7.28 MB +40 B +0.0%
store_returns.vortex 1.0 vortex-compact 9.28 MB 9.28 MB +40 B +0.0%
store_returns.vortex 1.0 vortex-file-compressed 11.10 MB 11.10 MB +40 B +0.0%
inventory.vortex 1.0 vortex-compact 15.95 MB 15.95 MB +32 B +0.0%
web_sales.vortex 1.0 vortex-compact 29.26 MB 29.26 MB +40 B +0.0%
web_sales.vortex 1.0 vortex-file-compressed 33.58 MB 33.58 MB +40 B +0.0%
inventory.vortex 1.0 vortex-file-compressed 36.56 MB 36.56 MB +32 B +0.0%
catalog_sales.vortex 1.0 vortex-compact 59.15 MB 59.15 MB +40 B +0.0%
store_sales.vortex 1.0 vortex-compact 78.28 MB 77.67 MB 618.04 KB -0.8%
store_sales.vortex 1.0 vortex-file-compressed 100.57 MB 96.78 MB 3.79 MB -3.8%

Totals:

  • vortex-compact: 207.23 MB → 206.62 MB (-0.3%)
  • vortex-file-compressed: 273.15 MB → 269.55 MB (-1.3%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

File Sizes: TPC-H SF=10 on NVME

File Size Changes (48 files changed, -0.2% overall, 35↑ 13↓)
File Scale Format Base HEAD Change %
region_0.vortex 10.0 vortex-compact 4.24 KB 4.27 KB +32 B +0.7%
region_0.vortex 10.0 vortex-file-compressed 4.50 KB 4.53 KB +32 B +0.7%
nation_0.vortex 10.0 vortex-compact 6.02 KB 6.06 KB +40 B +0.6%
nation_0.vortex 10.0 vortex-file-compressed 8.10 KB 8.14 KB +40 B +0.5%
partsupp_0.vortex 10.0 vortex-file-compressed 179.78 MB 180.30 MB +527.84 KB +0.3%
partsupp_1.vortex 10.0 vortex-file-compressed 179.96 MB 180.47 MB +527.62 KB +0.3%
supplier_0.vortex 10.0 vortex-compact 4.72 MB 4.72 MB +32 B +0.0%
supplier_0.vortex 10.0 vortex-file-compressed 6.67 MB 6.67 MB +32 B +0.0%
part_0.vortex 10.0 vortex-compact 18.06 MB 18.06 MB +40 B +0.0%
part_1.vortex 10.0 vortex-compact 18.06 MB 18.06 MB +40 B +0.0%
part_1.vortex 10.0 vortex-file-compressed 26.92 MB 26.92 MB +40 B +0.0%
part_0.vortex 10.0 vortex-file-compressed 26.95 MB 26.95 MB +40 B +0.0%
customer_0.vortex 10.0 vortex-compact 74.01 MB 74.01 MB +40 B +0.0%
lineitem_9.vortex 10.0 vortex-compact 100.26 MB 100.26 MB +40 B +0.0%
lineitem_11.vortex 10.0 vortex-compact 100.32 MB 100.32 MB +40 B +0.0%
lineitem_4.vortex 10.0 vortex-compact 100.35 MB 100.35 MB +40 B +0.0%
lineitem_7.vortex 10.0 vortex-compact 100.38 MB 100.38 MB +40 B +0.0%
lineitem_2.vortex 10.0 vortex-compact 100.38 MB 100.38 MB +40 B +0.0%
lineitem_8.vortex 10.0 vortex-compact 100.39 MB 100.39 MB +40 B +0.0%
lineitem_0.vortex 10.0 vortex-compact 100.39 MB 100.39 MB +40 B +0.0%
lineitem_3.vortex 10.0 vortex-compact 100.41 MB 100.41 MB +40 B +0.0%
lineitem_10.vortex 10.0 vortex-compact 100.42 MB 100.42 MB +40 B +0.0%
lineitem_12.vortex 10.0 vortex-compact 100.42 MB 100.42 MB +40 B +0.0%
lineitem_1.vortex 10.0 vortex-compact 100.44 MB 100.44 MB +40 B +0.0%
lineitem_6.vortex 10.0 vortex-compact 100.48 MB 100.48 MB +40 B +0.0%
lineitem_5.vortex 10.0 vortex-compact 100.49 MB 100.49 MB +40 B +0.0%
customer_0.vortex 10.0 vortex-file-compressed 104.54 MB 104.54 MB +40 B +0.0%
orders_1.vortex 10.0 vortex-compact 114.53 MB 114.53 MB +40 B +0.0%
orders_2.vortex 10.0 vortex-compact 114.55 MB 114.55 MB +40 B +0.0%
orders_0.vortex 10.0 vortex-compact 114.56 MB 114.56 MB +40 B +0.0%
partsupp_1.vortex 10.0 vortex-compact 126.64 MB 126.64 MB +32 B +0.0%
partsupp_0.vortex 10.0 vortex-compact 126.66 MB 126.66 MB +32 B +0.0%
orders_0.vortex 10.0 vortex-file-compressed 163.53 MB 163.53 MB +40 B +0.0%
orders_2.vortex 10.0 vortex-file-compressed 163.59 MB 163.59 MB +40 B +0.0%
orders_1.vortex 10.0 vortex-file-compressed 163.75 MB 163.75 MB +40 B +0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 135.05 MB 134.56 MB 494.30 KB -0.4%
lineitem_9.vortex 10.0 vortex-file-compressed 134.88 MB 134.36 MB 537.21 KB -0.4%
lineitem_0.vortex 10.0 vortex-file-compressed 134.94 MB 134.36 MB 593.30 KB -0.4%
lineitem_2.vortex 10.0 vortex-file-compressed 134.69 MB 134.09 MB 614.54 KB -0.4%
lineitem_4.vortex 10.0 vortex-file-compressed 134.74 MB 134.13 MB 623.26 KB -0.5%
lineitem_12.vortex 10.0 vortex-file-compressed 134.84 MB 134.22 MB 627.85 KB -0.5%
lineitem_10.vortex 10.0 vortex-file-compressed 134.83 MB 134.21 MB 629.73 KB -0.5%
lineitem_1.vortex 10.0 vortex-file-compressed 134.63 MB 133.98 MB 664.27 KB -0.5%
lineitem_8.vortex 10.0 vortex-file-compressed 134.46 MB 133.78 MB 696.51 KB -0.5%
lineitem_7.vortex 10.0 vortex-file-compressed 134.42 MB 133.73 MB 702.73 KB -0.5%
lineitem_3.vortex 10.0 vortex-file-compressed 134.25 MB 133.48 MB 788.96 KB -0.6%
lineitem_5.vortex 10.0 vortex-file-compressed 134.37 MB 133.59 MB 797.52 KB -0.6%
lineitem_6.vortex 10.0 vortex-file-compressed 133.87 MB 132.98 MB 911.21 KB -0.7%

Totals:

  • vortex-compact: 1.97 GB → 1.97 GB (+0.0%)
  • vortex-file-compressed: 2.70 GB → 2.69 GB (-0.3%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

File Sizes: Clickbench on NVME

File Size Changes (201 files changed, -0.9% overall, 91↑ 110↓)
File Scale Format Base HEAD Change %
hits_27.vortex 1.0 vortex-file-compressed 172.05 MB 173.50 MB +1.45 MB +0.8%
hits_28.vortex 1.0 vortex-file-compressed 165.69 MB 166.34 MB +669.33 KB +0.4%
hits_65.vortex 1.0 vortex-file-compressed 235.15 MB 236.04 MB +917.23 KB +0.4%
hits_36.vortex 1.0 vortex-compact 48.68 MB 48.75 MB +70.55 KB +0.1%
hits_46.vortex 1.0 vortex-compact 41.61 MB 41.67 MB +59.54 KB +0.1%
hits_65.vortex 1.0 vortex-compact 129.46 MB 129.63 MB +171.70 KB +0.1%
hits_40.vortex 1.0 vortex-compact 75.59 MB 75.65 MB +67.33 KB +0.1%
hits_95.vortex 1.0 vortex-compact 57.43 MB 57.47 MB +46.33 KB +0.1%
hits_52.vortex 1.0 vortex-compact 63.41 MB 63.44 MB +36.42 KB +0.1%
hits_26.vortex 1.0 vortex-compact 70.61 MB 70.65 MB +37.84 KB +0.1%
hits_19.vortex 1.0 vortex-compact 44.54 MB 44.56 MB +23.77 KB +0.1%
hits_67.vortex 1.0 vortex-compact 113.69 MB 113.75 MB +56.62 KB +0.0%
hits_86.vortex 1.0 vortex-compact 47.99 MB 48.01 MB +20.31 KB +0.0%
hits_98.vortex 1.0 vortex-compact 72.43 MB 72.46 MB +30.32 KB +0.0%
hits_45.vortex 1.0 vortex-compact 75.67 MB 75.70 MB +30.35 KB +0.0%
hits_32.vortex 1.0 vortex-compact 43.87 MB 43.89 MB +17.48 KB +0.0%
hits_37.vortex 1.0 vortex-compact 53.60 MB 53.61 MB +19.74 KB +0.0%
hits_66.vortex 1.0 vortex-compact 53.24 MB 53.26 MB +19.02 KB +0.0%
hits_55.vortex 1.0 vortex-compact 93.42 MB 93.45 MB +32.56 KB +0.0%
hits_28.vortex 1.0 vortex-compact 70.02 MB 70.05 MB +23.91 KB +0.0%
hits_4.vortex 1.0 vortex-compact 71.53 MB 71.55 MB +19.20 KB +0.0%
hits_27.vortex 1.0 vortex-compact 69.66 MB 69.68 MB +18.46 KB +0.0%
hits_15.vortex 1.0 vortex-compact 47.87 MB 47.88 MB +12.26 KB +0.0%
hits_69.vortex 1.0 vortex-compact 80.74 MB 80.76 MB +15.82 KB +0.0%
hits_97.vortex 1.0 vortex-compact 68.90 MB 68.91 MB +11.56 KB +0.0%
hits_16.vortex 1.0 vortex-compact 48.09 MB 48.10 MB +7.91 KB +0.0%
hits_24.vortex 1.0 vortex-compact 43.39 MB 43.39 MB +6.36 KB +0.0%
hits_23.vortex 1.0 vortex-compact 43.94 MB 43.94 MB +5.42 KB +0.0%
hits_73.vortex 1.0 vortex-compact 69.77 MB 69.77 MB +8.21 KB +0.0%
hits_14.vortex 1.0 vortex-compact 73.51 MB 73.52 MB +8.51 KB +0.0%
hits_22.vortex 1.0 vortex-compact 44.47 MB 44.48 MB +4.77 KB +0.0%
hits_50.vortex 1.0 vortex-compact 112.74 MB 112.75 MB +11.03 KB +0.0%
hits_89.vortex 1.0 vortex-compact 112.44 MB 112.45 MB +8.34 KB +0.0%
hits_25.vortex 1.0 vortex-compact 72.86 MB 72.87 MB +4.16 KB +0.0%
hits_84.vortex 1.0 vortex-compact 72.85 MB 72.85 MB +3.99 KB +0.0%
hits_53.vortex 1.0 vortex-compact 58.85 MB 58.85 MB +2.52 KB +0.0%
hits_0.vortex 1.0 vortex-compact 58.39 MB 58.39 MB +1.88 KB +0.0%
hits_39.vortex 1.0 vortex-compact 49.56 MB 49.56 MB +1.16 KB +0.0%
hits_56.vortex 1.0 vortex-compact 77.69 MB 77.69 MB +1.61 KB +0.0%
hits_96.vortex 1.0 vortex-compact 90.83 MB 90.83 MB +1.35 KB +0.0%
hits_3.vortex 1.0 vortex-compact 93.91 MB 93.91 MB +1.39 KB +0.0%
hits_59.vortex 1.0 vortex-compact 65.96 MB 65.96 MB +888 B +0.0%
hits_17.vortex 1.0 vortex-compact 58.08 MB 58.08 MB +384 B +0.0%
hits_93.vortex 1.0 vortex-compact 58.65 MB 58.65 MB +208 B +0.0%
hits_71.vortex 1.0 vortex-compact 69.03 MB 69.03 MB +192 B +0.0%
hits_48.vortex 1.0 vortex-compact 17.12 MB 17.12 MB +40 B +0.0%
hits_82.vortex 1.0 vortex-compact 66.59 MB 66.59 MB +152 B +0.0%
hits_47.vortex 1.0 vortex-compact 18.06 MB 18.06 MB +40 B +0.0%
hits_33.vortex 1.0 vortex-compact 35.72 MB 35.72 MB +40 B +0.0%
hits_29.vortex 1.0 vortex-compact 36.38 MB 36.38 MB +40 B +0.0%
hits_20.vortex 1.0 vortex-compact 37.88 MB 37.88 MB +40 B +0.0%
hits_63.vortex 1.0 vortex-compact 45.88 MB 45.88 MB +40 B +0.0%
hits_49.vortex 1.0 vortex-compact 50.27 MB 50.27 MB +40 B +0.0%
hits_21.vortex 1.0 vortex-compact 51.31 MB 51.31 MB +40 B +0.0%
hits_72.vortex 1.0 vortex-compact 51.54 MB 51.54 MB +40 B +0.0%
hits_83.vortex 1.0 vortex-compact 52.30 MB 52.30 MB +40 B +0.0%
hits_85.vortex 1.0 vortex-compact 52.51 MB 52.51 MB +40 B +0.0%
hits_31.vortex 1.0 vortex-compact 55.28 MB 55.28 MB +40 B +0.0%
hits_61.vortex 1.0 vortex-compact 57.40 MB 57.40 MB +40 B +0.0%
hits_34.vortex 1.0 vortex-compact 58.01 MB 58.01 MB +40 B +0.0%
hits_58.vortex 1.0 vortex-compact 60.19 MB 60.19 MB +40 B +0.0%
hits_91.vortex 1.0 vortex-compact 60.68 MB 60.68 MB +40 B +0.0%
hits_70.vortex 1.0 vortex-compact 61.06 MB 61.06 MB +40 B +0.0%
hits_8.vortex 1.0 vortex-compact 62.67 MB 62.67 MB +40 B +0.0%
hits_5.vortex 1.0 vortex-compact 62.68 MB 62.68 MB +40 B +0.0%
hits_38.vortex 1.0 vortex-compact 62.85 MB 62.85 MB +40 B +0.0%
hits_6.vortex 1.0 vortex-compact 62.94 MB 62.94 MB +40 B +0.0%
hits_7.vortex 1.0 vortex-compact 63.58 MB 63.58 MB +40 B +0.0%
hits_60.vortex 1.0 vortex-compact 64.06 MB 64.06 MB +40 B +0.0%
hits_81.vortex 1.0 vortex-compact 65.21 MB 65.21 MB +40 B +0.0%
hits_9.vortex 1.0 vortex-compact 65.45 MB 65.45 MB +40 B +0.0%
hits_13.vortex 1.0 vortex-compact 67.72 MB 67.72 MB +40 B +0.0%
hits_12.vortex 1.0 vortex-compact 69.04 MB 69.04 MB +40 B +0.0%
hits_74.vortex 1.0 vortex-compact 71.37 MB 71.37 MB +40 B +0.0%
hits_88.vortex 1.0 vortex-compact 73.07 MB 73.07 MB +40 B +0.0%
hits_76.vortex 1.0 vortex-compact 76.12 MB 76.12 MB +40 B +0.0%
hits_99.vortex 1.0 vortex-compact 77.04 MB 77.04 MB +40 B +0.0%
hits_90.vortex 1.0 vortex-compact 81.59 MB 81.59 MB +40 B +0.0%
hits_79.vortex 1.0 vortex-compact 85.36 MB 85.36 MB +40 B +0.0%
hits_1.vortex 1.0 vortex-compact 90.07 MB 90.07 MB +40 B +0.0%
hits_94.vortex 1.0 vortex-compact 90.36 MB 90.36 MB +40 B +0.0%
hits_92.vortex 1.0 vortex-compact 94.00 MB 94.00 MB +40 B +0.0%
hits_78.vortex 1.0 vortex-compact 97.53 MB 97.53 MB +40 B +0.0%
hits_77.vortex 1.0 vortex-compact 117.87 MB 117.87 MB +40 B +0.0%
hits_87.vortex 1.0 vortex-compact 118.73 MB 118.73 MB +40 B +0.0%
hits_2.vortex 1.0 vortex-compact 129.05 MB 129.05 MB +40 B +0.0%
hits_44.vortex 1.0 vortex-compact 132.13 MB 132.13 MB +40 B +0.0%
hits_42.vortex 1.0 vortex-compact 163.89 MB 163.89 MB +40 B +0.0%
hits_41.vortex 1.0 vortex-compact 165.44 MB 165.44 MB +40 B +0.0%
hits_51.vortex 1.0 vortex-compact 167.28 MB 167.28 MB +40 B +0.0%
hits_43.vortex 1.0 vortex-compact 168.57 MB 168.57 MB +40 B +0.0%
hits_54.vortex 1.0 vortex-compact 117.25 MB 117.25 MB 40 B -0.0%
hits_62.vortex 1.0 vortex-compact 74.04 MB 74.04 MB 64 B -0.0%
hits_35.vortex 1.0 vortex-compact 74.79 MB 74.79 MB 176 B -0.0%
hits_68.vortex 1.0 vortex-compact 75.68 MB 75.68 MB 208 B -0.0%
hits_18.vortex 1.0 vortex-compact 64.03 MB 64.03 MB 264 B -0.0%
hits_11.vortex 1.0 vortex-compact 54.10 MB 54.10 MB 1.13 KB -0.0%
hits_57.vortex 1.0 vortex-compact 83.30 MB 83.30 MB 2.26 KB -0.0%
hits_10.vortex 1.0 vortex-compact 48.67 MB 48.67 MB 2.52 KB -0.0%
hits_80.vortex 1.0 vortex-compact 67.81 MB 67.81 MB 3.72 KB -0.0%
hits_75.vortex 1.0 vortex-compact 43.42 MB 43.41 MB 2.61 KB -0.0%
hits_64.vortex 1.0 vortex-compact 53.69 MB 53.69 MB 9.26 KB -0.0%
hits_30.vortex 1.0 vortex-compact 58.49 MB 58.46 MB 26.02 KB -0.0%
hits_41.vortex 1.0 vortex-file-compressed 298.02 MB 297.76 MB 271.38 KB -0.1%
hits_42.vortex 1.0 vortex-file-compressed 296.37 MB 296.11 MB 275.30 KB -0.1%
hits_43.vortex 1.0 vortex-file-compressed 303.30 MB 303.02 MB 281.98 KB -0.1%
hits_54.vortex 1.0 vortex-file-compressed 361.00 MB 360.62 MB 384.31 KB -0.1%
hits_51.vortex 1.0 vortex-file-compressed 427.32 MB 426.74 MB 591.23 KB -0.1%
hits_0.vortex 1.0 vortex-file-compressed 111.62 MB 111.46 MB 157.09 KB -0.1%
hits_5.vortex 1.0 vortex-file-compressed 121.88 MB 121.66 MB 228.79 KB -0.2%
hits_8.vortex 1.0 vortex-file-compressed 122.16 MB 121.89 MB 274.57 KB -0.2%
hits_6.vortex 1.0 vortex-file-compressed 122.26 MB 121.89 MB 378.73 KB -0.3%
hits_7.vortex 1.0 vortex-file-compressed 123.14 MB 122.77 MB 385.59 KB -0.3%
hits_89.vortex 1.0 vortex-file-compressed 265.84 MB 264.74 MB 1.11 MB -0.4%
hits_78.vortex 1.0 vortex-file-compressed 238.48 MB 237.45 MB 1.03 MB -0.4%
hits_45.vortex 1.0 vortex-file-compressed 144.18 MB 143.54 MB 653.23 KB -0.4%
hits_26.vortex 1.0 vortex-file-compressed 143.26 MB 142.56 MB 714.42 KB -0.5%
hits_44.vortex 1.0 vortex-file-compressed 242.91 MB 241.45 MB 1.46 MB -0.6%
hits_24.vortex 1.0 vortex-file-compressed 78.47 MB 77.97 MB 510.55 KB -0.6%
hits_67.vortex 1.0 vortex-file-compressed 266.21 MB 264.44 MB 1.77 MB -0.7%
hits_13.vortex 1.0 vortex-file-compressed 122.45 MB 121.63 MB 841.27 KB -0.7%
hits_77.vortex 1.0 vortex-file-compressed 218.66 MB 217.10 MB 1.56 MB -0.7%
hits_50.vortex 1.0 vortex-file-compressed 255.67 MB 253.80 MB 1.87 MB -0.7%
hits_58.vortex 1.0 vortex-file-compressed 113.89 MB 113.02 MB 894.95 KB -0.8%
hits_55.vortex 1.0 vortex-file-compressed 252.49 MB 250.46 MB 2.03 MB -0.8%
hits_40.vortex 1.0 vortex-file-compressed 142.75 MB 141.59 MB 1.17 MB -0.8%
hits_87.vortex 1.0 vortex-file-compressed 221.49 MB 219.62 MB 1.87 MB -0.8%
hits_22.vortex 1.0 vortex-file-compressed 79.63 MB 78.94 MB 703.12 KB -0.9%
hits_2.vortex 1.0 vortex-file-compressed 241.83 MB 239.70 MB 2.13 MB -0.9%
hits_14.vortex 1.0 vortex-file-compressed 135.09 MB 133.90 MB 1.20 MB -0.9%
hits_23.vortex 1.0 vortex-file-compressed 79.10 MB 78.38 MB 737.73 KB -0.9%
hits_79.vortex 1.0 vortex-file-compressed 204.69 MB 202.78 MB 1.92 MB -0.9%
hits_36.vortex 1.0 vortex-file-compressed 80.25 MB 79.48 MB 780.16 KB -0.9%
hits_90.vortex 1.0 vortex-file-compressed 204.73 MB 202.76 MB 1.97 MB -1.0%
hits_75.vortex 1.0 vortex-file-compressed 74.14 MB 73.40 MB 763.02 KB -1.0%
hits_53.vortex 1.0 vortex-file-compressed 97.83 MB 96.77 MB 1.06 MB -1.1%
hits_4.vortex 1.0 vortex-file-compressed 139.29 MB 137.68 MB 1.61 MB -1.2%
hits_88.vortex 1.0 vortex-file-compressed 137.52 MB 135.89 MB 1.63 MB -1.2%
hits_86.vortex 1.0 vortex-file-compressed 81.62 MB 80.62 MB 1019.46 KB -1.2%
hits_56.vortex 1.0 vortex-file-compressed 164.78 MB 162.66 MB 2.12 MB -1.3%
hits_1.vortex 1.0 vortex-file-compressed 182.58 MB 180.21 MB 2.36 MB -1.3%
hits_9.vortex 1.0 vortex-file-compressed 124.86 MB 123.24 MB 1.62 MB -1.3%
hits_16.vortex 1.0 vortex-file-compressed 87.52 MB 86.38 MB 1.14 MB -1.3%
hits_98.vortex 1.0 vortex-file-compressed 151.46 MB 149.39 MB 2.07 MB -1.4%
hits_74.vortex 1.0 vortex-file-compressed 152.64 MB 150.52 MB 2.12 MB -1.4%
hits_69.vortex 1.0 vortex-file-compressed 148.02 MB 145.96 MB 2.06 MB -1.4%
hits_81.vortex 1.0 vortex-file-compressed 127.49 MB 125.70 MB 1.79 MB -1.4%
hits_3.vortex 1.0 vortex-file-compressed 194.58 MB 191.80 MB 2.78 MB -1.4%
hits_12.vortex 1.0 vortex-file-compressed 125.89 MB 124.07 MB 1.82 MB -1.4%
hits_76.vortex 1.0 vortex-file-compressed 140.27 MB 138.22 MB 2.04 MB -1.5%
hits_73.vortex 1.0 vortex-file-compressed 132.51 MB 130.48 MB 2.02 MB -1.5%
hits_68.vortex 1.0 vortex-file-compressed 173.90 MB 171.22 MB 2.68 MB -1.5%
hits_84.vortex 1.0 vortex-file-compressed 145.78 MB 143.42 MB 2.36 MB -1.6%
hits_82.vortex 1.0 vortex-file-compressed 123.06 MB 121.02 MB 2.04 MB -1.7%
hits_57.vortex 1.0 vortex-file-compressed 159.52 MB 156.87 MB 2.65 MB -1.7%
hits_25.vortex 1.0 vortex-file-compressed 137.95 MB 135.54 MB 2.41 MB -1.7%
hits_64.vortex 1.0 vortex-file-compressed 95.91 MB 94.21 MB 1.70 MB -1.8%
hits_52.vortex 1.0 vortex-file-compressed 121.42 MB 119.21 MB 2.20 MB -1.8%
hits_94.vortex 1.0 vortex-file-compressed 187.20 MB 183.76 MB 3.44 MB -1.8%
hits_31.vortex 1.0 vortex-file-compressed 105.21 MB 103.21 MB 2.00 MB -1.9%
hits_63.vortex 1.0 vortex-file-compressed 81.30 MB 79.72 MB 1.58 MB -1.9%
hits_47.vortex 1.0 vortex-file-compressed 42.31 MB 41.47 MB 853.73 KB -2.0%
hits_39.vortex 1.0 vortex-file-compressed 94.60 MB 92.67 MB 1.93 MB -2.0%
hits_70.vortex 1.0 vortex-file-compressed 116.50 MB 114.08 MB 2.41 MB -2.1%
hits_92.vortex 1.0 vortex-file-compressed 199.44 MB 195.24 MB 4.21 MB -2.1%
hits_10.vortex 1.0 vortex-file-compressed 82.86 MB 81.05 MB 1.80 MB -2.2%
hits_99.vortex 1.0 vortex-file-compressed 161.22 MB 157.59 MB 3.63 MB -2.3%
hits_32.vortex 1.0 vortex-file-compressed 77.96 MB 76.12 MB 1.84 MB -2.4%
hits_49.vortex 1.0 vortex-file-compressed 89.79 MB 87.66 MB 2.12 MB -2.4%
hits_20.vortex 1.0 vortex-file-compressed 68.19 MB 66.58 MB 1.62 MB -2.4%
hits_80.vortex 1.0 vortex-file-compressed 125.82 MB 122.75 MB 3.08 MB -2.4%
hits_62.vortex 1.0 vortex-file-compressed 150.79 MB 147.10 MB 3.69 MB -2.4%
hits_35.vortex 1.0 vortex-file-compressed 141.04 MB 137.56 MB 3.48 MB -2.5%
hits_59.vortex 1.0 vortex-file-compressed 123.56 MB 120.49 MB 3.07 MB -2.5%
hits_71.vortex 1.0 vortex-file-compressed 128.32 MB 125.12 MB 3.20 MB -2.5%
hits_46.vortex 1.0 vortex-file-compressed 81.30 MB 79.26 MB 2.05 MB -2.5%
hits_61.vortex 1.0 vortex-file-compressed 115.67 MB 112.74 MB 2.93 MB -2.5%
hits_96.vortex 1.0 vortex-file-compressed 184.16 MB 179.48 MB 4.68 MB -2.5%
hits_21.vortex 1.0 vortex-file-compressed 102.37 MB 99.70 MB 2.67 MB -2.6%
hits_30.vortex 1.0 vortex-file-compressed 105.66 MB 102.83 MB 2.83 MB -2.7%
hits_38.vortex 1.0 vortex-file-compressed 120.34 MB 117.06 MB 3.28 MB -2.7%
hits_66.vortex 1.0 vortex-file-compressed 106.93 MB 104.02 MB 2.91 MB -2.7%
hits_15.vortex 1.0 vortex-file-compressed 98.12 MB 95.39 MB 2.73 MB -2.8%
hits_97.vortex 1.0 vortex-file-compressed 133.35 MB 129.62 MB 3.73 MB -2.8%
hits_33.vortex 1.0 vortex-file-compressed 63.75 MB 61.95 MB 1.80 MB -2.8%
hits_34.vortex 1.0 vortex-file-compressed 113.61 MB 110.35 MB 3.25 MB -2.9%
hits_85.vortex 1.0 vortex-file-compressed 108.40 MB 105.07 MB 3.33 MB -3.1%
hits_95.vortex 1.0 vortex-file-compressed 116.83 MB 113.14 MB 3.69 MB -3.2%
hits_37.vortex 1.0 vortex-file-compressed 99.49 MB 96.35 MB 3.15 MB -3.2%
hits_18.vortex 1.0 vortex-file-compressed 129.31 MB 125.20 MB 4.11 MB -3.2%
hits_11.vortex 1.0 vortex-file-compressed 98.26 MB 95.07 MB 3.19 MB -3.3%
hits_48.vortex 1.0 vortex-file-compressed 29.05 MB 28.11 MB 967.74 KB -3.3%
hits_29.vortex 1.0 vortex-file-compressed 66.92 MB 64.72 MB 2.21 MB -3.3%
hits_83.vortex 1.0 vortex-file-compressed 106.24 MB 102.67 MB 3.57 MB -3.4%
hits_19.vortex 1.0 vortex-file-compressed 83.96 MB 81.13 MB 2.84 MB -3.4%
hits_91.vortex 1.0 vortex-file-compressed 119.47 MB 115.26 MB 4.22 MB -3.5%
hits_60.vortex 1.0 vortex-file-compressed 124.99 MB 120.45 MB 4.54 MB -3.6%
hits_17.vortex 1.0 vortex-file-compressed 106.60 MB 102.70 MB 3.90 MB -3.7%
hits_93.vortex 1.0 vortex-file-compressed 110.81 MB 106.43 MB 4.38 MB -4.0%
hits_72.vortex 1.0 vortex-file-compressed 98.78 MB 94.88 MB 3.91 MB -4.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 7.03 GB (+0.0%)
  • vortex-file-compressed: 14.08 GB → 13.88 GB (-1.4%)

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026 •
edited
Loading

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, -1.2% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 955.21 MB 955.21 MB 120 B -0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.81 GB 1.78 GB 33.16 MB -1.8%

Totals:

  • vortex-compact: 955.47 MB → 955.47 MB (-0.0%)
  • vortex-file-compressed: 1.81 GB → 1.78 GB (-1.8%)

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@joseph-isaacs joseph-isaacs added the changelog/chore A trivial change label Apr 14, 2026
@joseph-isaacs joseph-isaacs marked this pull request as ready for review April 14, 2026 16:55
@joseph-isaacs joseph-isaacs enabled auto-merge (squash) April 14, 2026 16:55
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@joseph-isaacs joseph-isaacs merged commit 5330d32 into develop Apr 14, 2026
123 of 159 checks passed
@joseph-isaacs joseph-isaacs deleted the ji/add-more-exp branch April 14, 2026 17:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes

Assignees

No one assigned

Labels

changelog/chore A trivial change

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@joseph-isaacs @robert3005