WIP: JSON/Variant experiments#8156
Conversation
Merging this PR will not alter performance
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Simulation | bitwise_not_vortex_buffer_mut[128] |
246.1 ns | 275.3 ns | -10.6% |
| ⚡ | Simulation | take_map[(0.1, 1.0)] |
1.9 ms | 1.7 ms | +14.26% |
| ⚡ | Simulation | take_map[(0.1, 0.5)] |
1,092.6 µs | 982.1 µs | +11.25% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing adamg/json-to-variant (c06df54) with develop (5aa3f3d)
078ea95 to
ebbb563
Compare
Polar Signals Profiling ResultsLatest Run
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 0.907x ➖ How to read Verdict and Engines
datafusion / vortex-file-compressed (0.907x ➖, 5↑ 0↓)
File Size Changes (1 files changed, -0.5% overall, 0↑ 1↓)
Totals:
|
Benchmarks: FineWeb NVMeVerdict: No clear signal (environment too noisy confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.992x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.101x ❌, 1↑ 4↓)
datafusion / parquet (1.013x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.025x ➖, 0↑ 1↓)
duckdb / vortex-compact (1.009x ➖, 0↑ 0↓)
duckdb / parquet (1.211x ❌, 0↑ 5↓)
No file size changes detected. Full attributed analysis
|
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.993x ➖, 0↑ 0↓)
datafusion / parquet (0.995x ➖, 1↑ 0↓)
datafusion / arrow (1.007x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.002x ➖, 0↑ 0↓)
duckdb / parquet (1.024x ➖, 0↑ 2↓)
duckdb / duckdb (0.997x ➖, 0↑ 0↓)
No file size changes detected. Full attributed analysis
|
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.985x ➖, 2↑ 0↓)
datafusion / vortex-compact (0.987x ➖, 3↑ 2↓)
datafusion / parquet (0.995x ➖, 2↑ 2↓)
duckdb / vortex-file-compressed (0.998x ➖, 1↑ 0↓)
duckdb / vortex-compact (1.001x ➖, 2↑ 5↓)
duckdb / parquet (0.999x ➖, 0↑ 3↓)
duckdb / duckdb (1.026x ➖, 0↑ 5↓)
No file size changes detected. Full attributed analysis
|
Benchmarks: FineWeb S3Verdict: No clear signal (environment too noisy confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.829x ➖, 3↑ 1↓)
datafusion / vortex-compact (1.078x ➖, 1↑ 2↓)
datafusion / parquet (1.127x ➖, 0↑ 2↓)
duckdb / vortex-file-compressed (1.008x ➖, 0↑ 1↓)
duckdb / vortex-compact (1.160x ➖, 0↑ 1↓)
duckdb / parquet (1.057x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) How to read Verdict and Engines
duckdb / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.984x ➖, 0↑ 0↓)
duckdb / parquet (0.984x ➖, 0↑ 0↓)
No file size changes detected. Full attributed analysis
|
Benchmarks: Random AccessVortex (geomean): 1.001x ➖ How to read Verdict and Engines
unknown / unknown (1.038x ➖, 0↑ 1↓)
|
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (1.035x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.044x ➖, 0↑ 0↓)
datafusion / parquet (0.993x ➖, 0↑ 0↓)
datafusion / arrow (0.996x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.030x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
duckdb / parquet (1.021x ➖, 0↑ 0↓)
duckdb / duckdb (1.002x ➖, 0↑ 0↓)
No file size changes detected. Full attributed analysis
|
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.956x ➖, 8↑ 1↓)
datafusion / parquet (0.968x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.980x ➖, 4↑ 1↓)
duckdb / parquet (0.972x ➖, 2↑ 1↓)
duckdb / duckdb (0.980x ➖, 0↑ 0↓)
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
Full attributed analysis
|
Benchmarks: Appian on NVMEVerdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (1.017x ➖, 0↑ 0↓)
datafusion / parquet (1.024x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
duckdb / parquet (1.004x ➖, 0↑ 0↓)
duckdb / duckdb (1.005x ➖, 0↑ 0↓)
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
Full attributed analysis
|
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.970x ➖, 2↑ 3↓)
datafusion / vortex-compact (0.948x ➖, 1↑ 2↓)
datafusion / parquet (0.847x ➖, 5↑ 0↓)
duckdb / vortex-file-compressed (0.952x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.982x ➖, 0↑ 0↓)
duckdb / parquet (0.900x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: CompressionVortex (geomean): 0.997x ➖ How to read Verdict and Engines
unknown / unknown (0.998x ➖, 2↑ 0↓)
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.917x ➖, 0↑ 0↓)
datafusion / parquet (0.877x ➖, 2↑ 1↓)
duckdb / vortex-file-compressed (0.970x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.984x ➖, 0↑ 0↓)
duckdb / parquet (0.923x ➖, 0↑ 0↓)
Full attributed analysis
|
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
70c91be to
1bf8321
Compare
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Summary
Closes: #000
Testing