Skip to content

feat(compressor): measure inputs and blocks by the bytes their rows reference - #10445

Merged
joseph-isaacs merged 13 commits into
developfrom
ji/exact-size-compressor-baseline
Oct 12, 2026
Merged

joseph-isaacs merged 13 commits into
developfrom
ji/exact-size-compressor-baseline

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Second of three stacked PRs, on top of vortex-data/vortex#10439. Uses the exact uncompressed size where nbytes() overstated view arrays that share a decompressed Parquet page.

Changes

  • CascadingCompressor measures the input, and each leaf a scheme competes against, by the bytes its rows reference. A dictionary of distinct strings no longer looks like a 20x win against a 2 MiB shared page. Sampling scores slices the same way.
  • The repartition writer coalesces blocks by the exact size, so 27 KiB string blocks reach the 1 MiB block_size_minimum instead of each being emitted alone. The Python dataset test's fragment count drops from 26 to 16 as the string column's blocks now line up with the numeric columns'.
  • The compressing layout caches the exact size on each chunk before compression so the compressor reads it instead of recomputing it. The statistic is serialized with the others, so a written file grows by a few bytes per leaf; the stock ticker file size test moves by 24 bytes.
  • A dtype the aggregate cannot measure, such as variant, is sized by the bytes it holds.

🤖 Generated with Claude Code

https://claude.ai/code/session_015LWq6yREM1uAD9mbD2ZAst


Generated by Claude Code


Generated by Claude Code

Claude added 5 commits October 9, 2026 11:37
…ure blocks exactly

Arrow's Parquet reader points each batch's string views into the whole
decompressed page, and VarBinView::slice keeps every buffer, so the
nbytes() of an 8,192-row block of TPC-H l_comment was about 1 MiB for
27 KiB of strings. The repartition writer measured blocks with nbytes(),
so every block already exceeded the 1 MiB minimum and never coalesced.

Rather than trimming buffers on import, which costs a pass over every
imported view array, keep the import zero-copy and let callers that
size blocks ask for a precise measurement:

- `UncompressedSizeInBytes` takes `UncompressedSizeOpts { precision }`.
  `Inexact` (the default) keeps today's behaviour and counts every
  held buffer. `Exact` counts only the bytes the valid rows reference:
  a VarBinView walks its views, a ListView rebuilds to its referenced
  elements, nested types forward the precision to their children, and
  fixed-width types are the same either way.
- The `Stat::UncompressedSizeInBytes` slot is the exact size. Only the
  exact aggregate reads and writes it as `Precision::Exact`; an inexact
  measurement is cached as `Precision::Inexact`, an upper bound that
  inexact queries reuse and exact queries ignore. `compute_stat`, and so
  file statistics, now measure exactly.
- The repartition coalescer measures each block exactly, so view blocks
  sharing a large buffer coalesce up to `block_size_minimum`.

Adds a regression test streaming ten 8,192-row view blocks that share a
2 MiB buffer and asserting they coalesce three to a block.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015LWq6yREM1uAD9mbD2ZAst
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
…tes from uncompressed output

The writer caches the exact uncompressed size on every chunk before
compression. The compressor now reads that size, computing it without
recording anything where it is absent, as the baseline a scheme has to
beat, for the full array and for the sampled slices whose views still
point at the full array's buffers. Dead bytes in a view array's buffers
no longer make a dictionary of distinct strings look like a 20x win.

Compaction moves from before scheme selection to after it. A scheme
that changes the encoding rebuilds the data it keeps, so its dead bytes
are gone for free. An array that keeps its canonical encoding, because
no scheme matched, won, or beat the exact size, is compacted when it
holds more than its rows reference: buffers used end to end are kept,
contiguous ranges are sliced without copying, and the rest rewritten.
The previous up-front compaction skipped arrays holding at most 128
bytes per row or with over half their bytes referenced, which let an
Arrow page shared by 8,192-row blocks pass through whole.

`uncompressed_size_in_bytes_uncached` measures columnar arrays without
caching a statistic on them or their children, since an uncompressed
leaf is serialized with its statistics and a size the compressor
measured for itself would grow the file.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015LWq6yREM1uAD9mbD2ZAst
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
…fragments

The uncompressed size aggregate does not apply to variant arrays, so
the coalescer, the compressing layout and the compressor fell over on
the first variant chunk. Each now checks the dtype first and sizes an
unsupported array by the bytes it holds, as before.

The Python dataset test counted 26 fragments, which were the row splits
left by string blocks that never coalesced. Measured exactly, the string
column's blocks line up with the numeric columns' and the file has 16.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015LWq6yREM1uAD9mbD2ZAst
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
…ange

The compressor baseline and the layout coalescing move to their own
changes stacked on this one, and the longest comments are shortened.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015LWq6yREM1uAD9mbD2ZAst
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
…eference

A scheme now competes against the exact uncompressed size of the array,
not the buffers it holds, so a view array sharing a decompressed Parquet
page no longer makes every scheme look like a win. The repartition
writer coalesces blocks by the same measure, so such blocks still reach
the block size minimum, and the compressing layout caches the exact size
on each chunk for the compressor to read.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015LWq6yREM1uAD9mbD2ZAst
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@codspeed

ghost commented Oct 12, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 39.37%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ 9 benchmarks spent significant time in system calls

System calls cannot be consistently instrumented, so they are not included in the measure, which understates the real cost. Please switch to the Walltime instrument to accurately measure system calls.

Measurement and system calls

⚡ 7 improved benchmarks
✅ 2206 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ WallTime threshold_neon[80] 7.7 µs 4.5 µs +68.87%
⚡ WallTime threshold_neon[64] 6.9 µs 4.2 µs +65.81%
⚡ WallTime threshold_neon[8] 4.6 µs 2.8 µs +64.62%
⚡ WallTime filter_neon[64] 4.6 µs 3 µs +56.11%
⚡ WallTime bitpack_blocked_compress_avx2 7.6 µs 6.7 µs +13.4%
⚡ WallTime filter_neon[80] 3.6 µs 3.2 µs +12.46%
⚡ WallTime threshold_avx512[8] 2.1 µs 1.9 µs +11.29%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/exact-size-compressor-baseline (7d66806) with develop (84e0d73)

Open in CodSpeed

Joe Isaacs and others added 6 commits October 12, 2026 12:22
…e flag

The exact size of a list view's elements is found by scanning offsets
and sizes: lists that tile one contiguous run are measured as a slice
of it, fixed-width elements are sized by count, and only overlapping or
gapped lists of variable-width elements are rebuilt. The accumulator
already caches an exact result through the stat slot, so the cache flag
and the uncached variant go. Precision is documented as approximate
versus actual bytes used.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015LWq6yREM1uAD9mbD2ZAst
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 729502c
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 2d03521
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: b840fc0
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 09ef167

Signed-off-by: Claude <noreply@anthropic.com>
The uncached variant is gone: the writer caches the exact size on each
chunk anyway, so the compressor reads and records through the one path.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015LWq6yREM1uAD9mbD2ZAst
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 3402fe7

Signed-off-by: Claude <noreply@anthropic.com>
…en file

The writer now records the exact uncompressed size on each chunk before
compression, and the array statistics serializer writes it with the
other statistics, so the stock ticker file grows by 24 bytes. The
compact strategy writes no such statistics and is unchanged.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015LWq6yREM1uAD9mbD2ZAst
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Base automatically changed from ji/bold-gates-h5cp86 to develop October 12, 2026 12:42
…ressor-baseline

Signed-off-by: Claude <noreply@anthropic.com>
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 12, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 12, 2026
@github-actions

ghost commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9c23a32 random-access-bench 1 Explore Profiling Data
🟢 Done 9c23a32 compress-bench 1 Explore Profiling Data
🟢 Done 9c23a32 string-bench 1 Explore Profiling Data
🟢 Done 9c23a32 statpopgen 1 Explore Profiling Data
🟢 Done 9c23a32 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 9c23a32 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 9c23a32 tpch-s3-10 1 Explore Profiling Data
🟢 Done 9c23a32 clickbench-nvme 1 Explore Profiling Data
🟢 Done 9c23a32 tpcds-nvme 1 Explore Profiling Data
🟢 Done 9c23a32 appian-nvme 1 Explore Profiling Data
🟢 Done 9c23a32 fineweb-s3 1 Explore Profiling Data
🟢 Done 9c23a32 polarsignals 1 Explore Profiling Data
🟢 Done 9c23a32 tpch-s3 1 Explore Profiling Data
🟢 Done 9c23a32 tpch-nvme 1 Explore Profiling Data
🟢 Done 9c23a32 fineweb 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 9c23a32b vs base 787fac76
Vortex (geomean): hot 1.002x ➖ · cold 1.023x ➖


datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57627496 / 57278784 / +0.6% 103624326 / 103206602 / +0.4% 0.56 / 0.55 / +0.2%
polarsignals_q01/datafusion:vortex-file-compressed 63758800 / 64381592 / -1.0% 126639353 / 129101463 / -1.9% 0.50 / 0.50 / +1.0%
polarsignals_q02/datafusion:vortex-file-compressed 71646746 / 73812098 / -2.9% 113075226 / 114150660 / -0.9% 0.63 / 0.65 / -2.0%
polarsignals_q03/datafusion:vortex-file-compressed 80996126 / 81214682 / -0.3% 140959036 / 144825812 / -2.7% 0.57 / 0.56 / +2.5%
polarsignals_q04/datafusion:vortex-file-compressed 9755179 / 9785760 / -0.3% 49684146 / 47024004 / +5.7% 0.20 / 0.21 / -5.6%
polarsignals_q05/datafusion:vortex-file-compressed 24883170 / 25154978 / -1.1% 67228060 / 62711365 / +7.2% 0.37 / 0.40 / -7.7%
polarsignals_q06/datafusion:vortex-file-compressed 23437214 / 21728869 / +7.9% 64841920 / 60419364 / +7.3% 0.36 / 0.36 / +0.5%
polarsignals_q07/datafusion:vortex-file-compressed 39411218 / 40436267 / -2.5% 80238276 / 78520598 / +2.2% 0.49 / 0.51 / -4.6%
polarsignals_q08/datafusion:vortex-file-compressed 98383802 / 97668660 / +0.7% 162076466 / 163633200 / -1.0% 0.61 / 0.60 / +1.7%
polarsignals_q09/datafusion:vortex-file-compressed 10122038 / 9974246 / +1.5% 50778704 / 47304703 / +7.3% 0.20 / 0.21 / -5.5%

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.90 MB 685.92 MB +22.52 KB +0.0%

Totals:

  • vortex-file-compressed: 685.90 MB → 685.92 MB (+0.0%)

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 9c23a32b vs base 787fac76
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-3.2%, low confidence) · DuckDB No clear signal (+2.0%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 1.023x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.974x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6960000 / 6837281 / +1.8% 21420698 / 18944096 / +13.1% 🔴 0.32 / 0.36 / -10.0%
fineweb_q01/datafusion:vortex-file-compressed 11874808 / 12136421 / -2.2% 49593816 / 46400987 / +6.9% 0.24 / 0.26 / -8.5%
fineweb_q02/datafusion:vortex-file-compressed 13072094 / 13730232 / -4.8% 55472595 / 48822738 / +13.6% 🔴 0.24 / 0.28 / -16.2%
fineweb_q03/datafusion:vortex-file-compressed 22209442 / 22868456 / -2.9% 116926137 / 111495983 / +4.9% 0.19 / 0.21 / -7.4%
fineweb_q04/datafusion:vortex-file-compressed 82031094 / 81479358 / +0.7% 174984989 / 164057680 / +6.7% 0.47 / 0.50 / -5.6%
fineweb_q05/datafusion:vortex-file-compressed 68685308 / 68912120 / -0.3% 153739208 / 148212808 / +3.7% 0.45 / 0.46 / -3.9%
fineweb_q06/datafusion:vortex-file-compressed 21153911 / 20996059 / +0.8% 118127773 / 125128394 / -5.6% 0.18 / 0.17 / +6.7%
fineweb_q07/datafusion:vortex-file-compressed 19963071 / 19832220 / +0.7% 116234113 / 104945551 / +10.8% 🔴 0.17 / 0.19 / -9.1%
fineweb_q08/datafusion:vortex-file-compressed 8578698 / 10187098 / -15.8% 🟢 71248395 / 43671740 / +63.1% 🔴 0.12 / 0.23 / -48.4%
datafusion / vortex-compact / ns (0.972x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 7198266 / 7118490 / +1.1% 20799982 / 19614906 / +6.0% 0.35 / 0.36 / -4.6%
fineweb_q01/datafusion:vortex-compact 43887919 / 60055076 / -26.9% 🟢 81260151 / 77135807 / +5.3% 0.54 / 0.78 / -30.6%
fineweb_q02/datafusion:vortex-compact 44322504 / 43660831 / +1.5% 82350046 / 78033422 / +5.5% 0.54 / 0.56 / -3.8%
fineweb_q03/datafusion:vortex-compact 168182715 / 181435084 / -7.3% 226474609 / 224881483 / +0.7% 0.74 / 0.81 / -8.0%
fineweb_q04/datafusion:vortex-compact 182608558 / 175834515 / +3.9% 251764981 / 247715780 / +1.6% 0.73 / 0.71 / +2.2%
fineweb_q05/datafusion:vortex-compact 169268318 / 152908386 / +10.7% 🔴 234421882 / 239770692 / -2.2% 0.72 / 0.64 / +13.2%
fineweb_q06/datafusion:vortex-compact 87254862 / 87388990 / -0.2% 168841007 / 165566281 / +2.0% 0.52 / 0.53 / -2.1%
fineweb_q07/datafusion:vortex-compact 89307820 / 87330856 / +2.3% 160665058 / 161168677 / -0.3% 0.56 / 0.54 / +2.6%
fineweb_q08/datafusion:vortex-compact 8589148 / 9053864 / -5.1% 53438378 / 48656063 / +9.8% 0.16 / 0.19 / -13.6%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9505970 / 9507382 / -0.0% 35924008 / 31974279 / +12.4% 🔴 0.26 / 0.30 / -11.0%
fineweb_q01/datafusion:parquet 75407846 / 74274646 / +1.5% 160160995 / 162333506 / -1.3% 0.47 / 0.46 / +2.9%
fineweb_q02/datafusion:parquet 75290708 / 74239503 / +1.4% 161741896 / 156571968 / +3.3% 0.47 / 0.47 / -1.8%
fineweb_q03/datafusion:parquet 72816667 / 74469177 / -2.2% 164578152 / 156461403 / +5.2% 0.44 / 0.48 / -7.0%
fineweb_q04/datafusion:parquet 84420381 / 83199947 / +1.5% 159867742 / 159442970 / +0.3% 0.53 / 0.52 / +1.2%
fineweb_q05/datafusion:parquet 81281468 / 81700770 / -0.5% 159480260 / 157587350 / +1.2% 0.51 / 0.52 / -1.7%
fineweb_q06/datafusion:parquet 77348533 / 75797761 / +2.0% 164909827 / 166396951 / -0.9% 0.47 / 0.46 / +3.0%
fineweb_q07/datafusion:parquet 75224500 / 73298340 / +2.6% 163059549 / 162376662 / +0.4% 0.46 / 0.45 / +2.2%
fineweb_q08/datafusion:parquet 73953219 / 75041724 / -1.5% 159237996 / 159474278 / -0.1% 0.46 / 0.47 / -1.3%
duckdb / vortex-file-compressed / ns (1.009x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1985280 / 1841777 / +7.8% 5023701 / 5239765 / -4.1% 0.40 / 0.35 / +12.4%
fineweb_q01/duckdb:vortex-file-compressed 19995772 / 18505284 / +8.1% 55108518 / 58921146 / -6.5% 0.36 / 0.31 / +15.5%
fineweb_q02/duckdb:vortex-file-compressed 21922384 / 22894098 / -4.2% 55640592 / 57062986 / -2.5% 0.39 / 0.40 / -1.8%
fineweb_q03/duckdb:vortex-file-compressed 29964461 / 31483432 / -4.8% 106754058 / 150253376 / -29.0% 🟢 0.28 / 0.21 / +34.0%
fineweb_q04/duckdb:vortex-file-compressed 95052677 / 78854408 / +20.5% 🔴 228717379 / 121874846 / +87.7% 🔴 0.42 / 0.65 / -35.8%
fineweb_q05/duckdb:vortex-file-compressed 67532966 / 77772102 / -13.2% 🟢 105852494 / 189858170 / -44.2% 🟢 0.64 / 0.41 / +55.7%
fineweb_q06/duckdb:vortex-file-compressed 53706686 / 36857434 / +45.7% 🔴 138696853 / 128414484 / +8.0% 0.39 / 0.29 / +34.9%
fineweb_q07/duckdb:vortex-file-compressed 26798886 / 30371880 / -11.8% 🟢 106506019 / 114533354 / -7.0% 0.25 / 0.27 / -5.1%
fineweb_q08/duckdb:vortex-file-compressed 5936345 / 7832768 / -24.2% 🟢 15960177 / 17543559 / -9.0% 0.37 / 0.45 / -16.7%
duckdb / vortex-compact / ns (1.011x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2571474 / 2095885 / +22.7% 🔴 7472599 / 5457816 / +36.9% 🔴 0.34 / 0.38 / -10.4%
fineweb_q01/duckdb:vortex-compact 53372796 / 51281602 / +4.1% 91702090 / 99577134 / -7.9% 0.58 / 0.51 / +13.0%
fineweb_q02/duckdb:vortex-compact 46482534 / 46838340 / -0.8% 70073862 / 70027195 / +0.1% 0.66 / 0.67 / -0.8%
fineweb_q03/duckdb:vortex-compact 208648675 / 183831624 / +13.5% 🔴 312595403 / 246661841 / +26.7% 🔴 0.67 / 0.75 / -10.4%
fineweb_q04/duckdb:vortex-compact 191470200 / 211568773 / -9.5% 243959523 / 337157217 / -27.6% 🟢 0.78 / 0.63 / +25.1%
fineweb_q05/duckdb:vortex-compact 178744072 / 183570615 / -2.6% 236688986 / 221956070 / +6.6% 0.76 / 0.83 / -8.7%
fineweb_q06/duckdb:vortex-compact 105298960 / 108624433 / -3.1% 185643605 / 179471208 / +3.4% 0.57 / 0.61 / -6.3%
fineweb_q07/duckdb:vortex-compact 101771772 / 103340370 / -1.5% 166091385 / 165516238 / +0.3% 0.61 / 0.62 / -1.9%
fineweb_q08/duckdb:vortex-compact 6888389 / 7568649 / -9.0% 12338768 / 14811935 / -16.7% 🟢 0.56 / 0.51 / +9.3%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21291702 / 22240651 / -4.3% 24858215 / 26907477 / -7.6% 0.86 / 0.83 / +3.6%
fineweb_q01/duckdb:parquet 44663703 / 44678429 / -0.0% 55072420 / 54933522 / +0.3% 0.81 / 0.81 / -0.3%
fineweb_q02/duckdb:parquet 43933964 / 43963028 / -0.1% 53499470 / 53164660 / +0.6% 0.82 / 0.83 / -0.7%
fineweb_q03/duckdb:parquet 94334305 / 95312264 / -1.0% 186868641 / 185283789 / +0.9% 0.50 / 0.51 / -1.9%
fineweb_q04/duckdb:parquet 152690587 / 153430226 / -0.5% 205133687 / 198908040 / +3.1% 0.74 / 0.77 / -3.5%
fineweb_q05/duckdb:parquet 145341913 / 143430842 / +1.3% 203483205 / 195153594 / +4.3% 0.71 / 0.73 / -2.8%
fineweb_q06/duckdb:parquet 72921770 / 71629367 / +1.8% 128431065 / 134060642 / -4.2% 0.57 / 0.53 / +6.3%
fineweb_q07/duckdb:parquet 72504340 / 72918687 / -0.6% 157602624 / 153223746 / +2.9% 0.46 / 0.48 / -3.3%
fineweb_q08/duckdb:parquet 23882224 / 25230611 / -5.3% 23941241 / 27788348 / -13.8% 🟢 1.00 / 0.91 / +9.9%

File Size Changes (2 files changed, +0.0% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +10.10 KB +0.0%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB 240 B -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (-0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.0%)

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 9c23a32b vs base 787fac76
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+1.8%, low confidence)
Vortex (geomean): hot 1.015x ➖ · cold 0.999x ➖
Parquet (geomean): hot 1.004x ➖ · cold 0.991x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16395763 / 16289354 / +0.7% 45858593 / 47941574 / -4.3% 0.36 / 0.34 / +5.2%
tpch_q02/datafusion:vortex-file-compressed 17347193 / 17237215 / +0.6% 37593121 / 38091894 / -1.3% 0.46 / 0.45 / +2.0%
tpch_q03/datafusion:vortex-file-compressed 19529160 / 19288930 / +1.2% 45488730 / 48143385 / -5.5% 0.43 / 0.40 / +7.2%
tpch_q04/datafusion:vortex-file-compressed 10062602 / 10180737 / -1.2% 33880108 / 32747916 / +3.5% 0.30 / 0.31 / -4.5%
tpch_q05/datafusion:vortex-file-compressed 36751170 / 36524341 / +0.6% 67473783 / 65141937 / +3.6% 0.54 / 0.56 / -2.9%
tpch_q06/datafusion:vortex-file-compressed 6412984 / 6645270 / -3.5% 29139397 / 30398200 / -4.1% 0.22 / 0.22 / +0.7%
tpch_q07/datafusion:vortex-file-compressed 52232798 / 51648017 / +1.1% 83337773 / 82822993 / +0.6% 0.63 / 0.62 / +0.5%
tpch_q08/datafusion:vortex-file-compressed 51873729 / 51855644 / +0.0% 81527698 / 83545789 / -2.4% 0.64 / 0.62 / +2.5%
tpch_q09/datafusion:vortex-file-compressed 52177042 / 49399237 / +5.6% 79084864 / 77549475 / +2.0% 0.66 / 0.64 / +3.6%
tpch_q10/datafusion:vortex-file-compressed 17163794 / 17320145 / -0.9% 50850901 / 50700844 / +0.3% 0.34 / 0.34 / -1.2%
tpch_q11/datafusion:vortex-file-compressed 15206322 / 15091518 / +0.8% 34527550 / 34325312 / +0.6% 0.44 / 0.44 / +0.2%
tpch_q12/datafusion:vortex-file-compressed 22796219 / 23330633 / -2.3% 45215560 / 48571899 / -6.9% 0.50 / 0.48 / +5.0%
tpch_q13/datafusion:vortex-file-compressed 19688298 / 20247679 / -2.8% 42103521 / 41119207 / +2.4% 0.47 / 0.49 / -5.0%
tpch_q14/datafusion:vortex-file-compressed 15028648 / 14995145 / +0.2% 39423928 / 40490047 / -2.6% 0.38 / 0.37 / +2.9%
tpch_q15/datafusion:vortex-file-compressed 18757358 / 18653310 / +0.6% 45108755 / 43998694 / +2.5% 0.42 / 0.42 / -1.9%
tpch_q16/datafusion:vortex-file-compressed 18757002 / 18550371 / +1.1% 39608682 / 38064485 / +4.1% 0.47 / 0.49 / -2.8%
tpch_q17/datafusion:vortex-file-compressed 28460597 / 27625705 / +3.0% 56703389 / 57888031 / -2.0% 0.50 / 0.48 / +5.2%
tpch_q18/datafusion:vortex-file-compressed 36499933 / 36605500 / -0.3% 58054390 / 56433022 / +2.9% 0.63 / 0.65 / -3.1%
tpch_q19/datafusion:vortex-file-compressed 14752902 / 14399137 / +2.5% 38053129 / 39101439 / -2.7% 0.39 / 0.37 / +5.3%
tpch_q20/datafusion:vortex-file-compressed 20947448 / 21021328 / -0.4% 44735449 / 44720298 / +0.0% 0.47 / 0.47 / -0.4%
tpch_q21/datafusion:vortex-file-compressed 38990881 / 39160097 / -0.4% 68027598 / 63554066 / +7.0% 0.57 / 0.62 / -7.0%
tpch_q22/datafusion:vortex-file-compressed 11928012 / 11343448 / +5.2% 32098165 / 32141646 / -0.1% 0.37 / 0.35 / +5.3%
datafusion / vortex-compact / ns (1.010x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 18141562 / 18244890 / -0.6% 45884001 / 43001561 / +6.7% 0.40 / 0.42 / -6.8%
tpch_q02/datafusion:vortex-compact 19963496 / 19670450 / +1.5% 38948787 / 37945627 / +2.6% 0.51 / 0.52 / -1.1%
tpch_q03/datafusion:vortex-compact 19861468 / 19932242 / -0.4% 47130730 / 45763771 / +3.0% 0.42 / 0.44 / -3.2%
tpch_q04/datafusion:vortex-compact 10746539 / 10959506 / -1.9% 34146936 / 31840538 / +7.2% 0.31 / 0.34 / -8.6%
tpch_q05/datafusion:vortex-compact 38126698 / 37531930 / +1.6% 66191542 / 66539880 / -0.5% 0.58 / 0.56 / +2.1%
tpch_q06/datafusion:vortex-compact 7322633 / 7216156 / +1.5% 28430713 / 29478984 / -3.6% 0.26 / 0.24 / +5.2%
tpch_q07/datafusion:vortex-compact 52390927 / 52545000 / -0.3% 80947358 / 82192034 / -1.5% 0.65 / 0.64 / +1.2%
tpch_q08/datafusion:vortex-compact 52994441 / 52849048 / +0.3% 82401681 / 77725746 / +6.0% 0.64 / 0.68 / -5.4%
tpch_q09/datafusion:vortex-compact 50547436 / 49596382 / +1.9% 79161637 / 78331825 / +1.1% 0.64 / 0.63 / +0.8%
tpch_q10/datafusion:vortex-compact 20263833 / 18969202 / +6.8% 50651751 / 50354003 / +0.6% 0.40 / 0.38 / +6.2%
tpch_q11/datafusion:vortex-compact 16154618 / 15962475 / +1.2% 36416307 / 34491406 / +5.6% 0.44 / 0.46 / -4.1%
tpch_q12/datafusion:vortex-compact 24181893 / 24356297 / -0.7% 47047167 / 49114220 / -4.2% 0.51 / 0.50 / +3.6%
tpch_q13/datafusion:vortex-compact 20363189 / 20572232 / -1.0% 43954755 / 41308863 / +6.4% 0.46 / 0.50 / -7.0%
tpch_q14/datafusion:vortex-compact 16369176 / 16516286 / -0.9% 41547473 / 42319247 / -1.8% 0.39 / 0.39 / +1.0%
tpch_q15/datafusion:vortex-compact 20156506 / 19956841 / +1.0% 44914454 / 44559952 / +0.8% 0.45 / 0.45 / +0.2%
tpch_q16/datafusion:vortex-compact 18987922 / 18892089 / +0.5% 40288932 / 39207919 / +2.8% 0.47 / 0.48 / -2.2%
tpch_q17/datafusion:vortex-compact 28922450 / 29981487 / -3.5% 58881536 / 57357140 / +2.7% 0.49 / 0.52 / -6.0%
tpch_q18/datafusion:vortex-compact 37220034 / 36892008 / +0.9% 59737232 / 56892831 / +5.0% 0.62 / 0.65 / -3.9%
tpch_q19/datafusion:vortex-compact 17356784 / 17552248 / -1.1% 43089053 / 44272045 / -2.7% 0.40 / 0.40 / +1.6%
tpch_q20/datafusion:vortex-compact 22109648 / 22335716 / -1.0% 45703384 / 46865801 / -2.5% 0.48 / 0.48 / +1.5%
tpch_q21/datafusion:vortex-compact 40429595 / 41005415 / -1.4% 67514458 / 67608840 / -0.1% 0.60 / 0.61 / -1.3%
tpch_q22/datafusion:vortex-compact 13853212 / 11694346 / +18.5% 🔴 33484879 / 31264217 / +7.1% 0.41 / 0.37 / +10.6%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72272403 / 72136831 / +0.2% 90094948 / 90145650 / -0.1% 0.80 / 0.80 / +0.2%
tpch_q02/datafusion:parquet 57767139 / 57712067 / +0.1% 76481790 / 78625943 / -2.7% 0.76 / 0.73 / +2.9%
tpch_q03/datafusion:parquet 84166037 / 83736073 / +0.5% 106447006 / 109422174 / -2.7% 0.79 / 0.77 / +3.3%
tpch_q04/datafusion:parquet 46687940 / 47061230 / -0.8% 67014490 / 69520643 / -3.6% 0.70 / 0.68 / +2.9%
tpch_q05/datafusion:parquet 99452396 / 99526788 / -0.1% 128438501 / 129495027 / -0.8% 0.77 / 0.77 / +0.7%
tpch_q06/datafusion:parquet 31966375 / 31902327 / +0.2% 50301831 / 53093971 / -5.3% 0.64 / 0.60 / +5.8%
tpch_q07/datafusion:parquet 105101495 / 104609605 / +0.5% 137059983 / 134708566 / +1.7% 0.77 / 0.78 / -1.3%
tpch_q08/datafusion:parquet 113501405 / 112943305 / +0.5% 142283974 / 140916558 / +1.0% 0.80 / 0.80 / -0.5%
tpch_q09/datafusion:parquet 130859859 / 130138481 / +0.6% 161450352 / 162171441 / -0.4% 0.81 / 0.80 / +1.0%
tpch_q10/datafusion:parquet 104405176 / 104180721 / +0.2% 131147829 / 139202662 / -5.8% 0.80 / 0.75 / +6.4%
tpch_q11/datafusion:parquet 41545443 / 42104951 / -1.3% 64632041 / 64971182 / -0.5% 0.64 / 0.65 / -0.8%
tpch_q12/datafusion:parquet 69210439 / 69317745 / -0.2% 90901882 / 92062810 / -1.3% 0.76 / 0.75 / +1.1%
tpch_q13/datafusion:parquet 187474433 / 186942650 / +0.3% 208845739 / 210546201 / -0.8% 0.90 / 0.89 / +1.1%
tpch_q14/datafusion:parquet 47932295 / 48431657 / -1.0% 74004071 / 76097692 / -2.8% 0.65 / 0.64 / +1.8%
tpch_q15/datafusion:parquet 55567239 / 54284603 / +2.4% 74266592 / 80321377 / -7.5% 0.75 / 0.68 / +10.7%
tpch_q16/datafusion:parquet 41410417 / 41026017 / +0.9% 59681902 / 62903135 / -5.1% 0.69 / 0.65 / +6.4%
tpch_q17/datafusion:parquet 129547069 / 128450270 / +0.9% 153762139 / 153589405 / +0.1% 0.84 / 0.84 / +0.7%
tpch_q18/datafusion:parquet 129950532 / 130549906 / -0.5% 150284957 / 153748277 / -2.3% 0.86 / 0.85 / +1.8%
tpch_q19/datafusion:parquet 59843613 / 59192123 / +1.1% 86384779 / 88530768 / -2.4% 0.69 / 0.67 / +3.6%
tpch_q20/datafusion:parquet 68124957 / 68311000 / -0.3% 90821574 / 92734625 / -2.1% 0.75 / 0.74 / +1.8%
tpch_q21/datafusion:parquet 108775275 / 108444565 / +0.3% 130411626 / 131916706 / -1.1% 0.83 / 0.82 / +1.5%
tpch_q22/datafusion:parquet 47447209 / 47165661 / +0.6% 67472131 / 66666088 / +1.2% 0.70 / 0.71 / -0.6%
duckdb / vortex-file-compressed / ns (1.013x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11287286 / 11663585 / -3.2% 22189264 / 21706509 / +2.2% 0.51 / 0.54 / -5.3%
tpch_q02/duckdb:vortex-file-compressed 17331387 / 17440679 / -0.6% 27792533 / 26512925 / +4.8% 0.62 / 0.66 / -5.2%
tpch_q03/duckdb:vortex-file-compressed 18174828 / 17930486 / +1.4% 35585778 / 34536097 / +3.0% 0.51 / 0.52 / -1.6%
tpch_q04/duckdb:vortex-file-compressed 17500598 / 17419673 / +0.5% 30116512 / 31750565 / -5.1% 0.58 / 0.55 / +5.9%
tpch_q05/duckdb:vortex-file-compressed 22119231 / 21541595 / +2.7% 34949674 / 36430330 / -4.1% 0.63 / 0.59 / +7.0%
tpch_q06/duckdb:vortex-file-compressed 5299090 / 5519372 / -4.0% 14948741 / 17711816 / -15.6% 🟢 0.35 / 0.31 / +13.8%
tpch_q07/duckdb:vortex-file-compressed 20604249 / 20660039 / -0.3% 36094892 / 39275349 / -8.1% 0.57 / 0.53 / +8.5%
tpch_q08/duckdb:vortex-file-compressed 23102187 / 23656752 / -2.3% 36237722 / 40306890 / -10.1% 🟢 0.64 / 0.59 / +8.6%
tpch_q09/duckdb:vortex-file-compressed 29323599 / 30302656 / -3.2% 49322693 / 46805120 / +5.4% 0.59 / 0.65 / -8.2%
tpch_q10/duckdb:vortex-file-compressed 29723985 / 27958854 / +6.3% 42802338 / 45526414 / -6.0% 0.69 / 0.61 / +13.1%
tpch_q11/duckdb:vortex-file-compressed 8866952 / 8865896 / +0.0% 15108978 / 18050860 / -16.3% 🟢 0.59 / 0.49 / +19.5%
tpch_q12/duckdb:vortex-file-compressed 16492613 / 17503885 / -5.8% 31446210 / 31317739 / +0.4% 0.52 / 0.56 / -6.2%
tpch_q13/duckdb:vortex-file-compressed 23101988 / 21695289 / +6.5% 39193068 / 41907104 / -6.5% 0.59 / 0.52 / +13.9%
tpch_q14/duckdb:vortex-file-compressed 13119246 / 13688405 / -4.2% 24601778 / 25566546 / -3.8% 0.53 / 0.54 / -0.4%
tpch_q15/duckdb:vortex-file-compressed 9802495 / 8878326 / +10.4% 🔴 19083874 / 20185690 / -5.5% 0.51 / 0.44 / +16.8%
tpch_q16/duckdb:vortex-file-compressed 18613399 / 18229675 / +2.1% 23712886 / 23659257 / +0.2% 0.78 / 0.77 / +1.9%
tpch_q17/duckdb:vortex-file-compressed 15040827 / 14741390 / +2.0% 31687895 / 31903896 / -0.7% 0.47 / 0.46 / +2.7%
tpch_q18/duckdb:vortex-file-compressed 25615907 / 24381924 / +5.1% 32628379 / 36412893 / -10.4% 🟢 0.79 / 0.67 / +17.2%
tpch_q19/duckdb:vortex-file-compressed 24133628 / 23248111 / +3.8% 35062258 / 36049871 / -2.7% 0.69 / 0.64 / +6.7%
tpch_q20/duckdb:vortex-file-compressed 16940113 / 16883166 / +0.3% 36321036 / 35525687 / +2.2% 0.47 / 0.48 / -1.9%
tpch_q21/duckdb:vortex-file-compressed 66503273 / 68696865 / -3.2% 85938639 / 85099424 / +1.0% 0.77 / 0.81 / -4.1%
tpch_q22/duckdb:vortex-file-compressed 14297419 / 12174137 / +17.4% 🔴 21730271 / 20389303 / +6.6% 0.66 / 0.60 / +10.2%
duckdb / vortex-compact / ns (1.032x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 12670963 / 12460540 / +1.7% 23669182 / 24076216 / -1.7% 0.54 / 0.52 / +3.4%
tpch_q02/duckdb:vortex-compact 20162402 / 19737608 / +2.2% 29674467 / 29135770 / +1.8% 0.68 / 0.68 / +0.3%
tpch_q03/duckdb:vortex-compact 18433431 / 18246404 / +1.0% 35500548 / 33443919 / +6.1% 0.52 / 0.55 / -4.8%
tpch_q04/duckdb:vortex-compact 17699356 / 17108038 / +3.5% 32423167 / 30114328 / +7.7% 0.55 / 0.57 / -3.9%
tpch_q05/duckdb:vortex-compact 22791560 / 22655829 / +0.6% 35982471 / 36232771 / -0.7% 0.63 / 0.63 / +1.3%
tpch_q06/duckdb:vortex-compact 5978840 / 6232389 / -4.1% 14221347 / 14813966 / -4.0% 0.42 / 0.42 / -0.1%
tpch_q07/duckdb:vortex-compact 21404464 / 21493423 / -0.4% 35052030 / 38611592 / -9.2% 0.61 / 0.56 / +9.7%
tpch_q08/duckdb:vortex-compact 24943105 / 25232620 / -1.1% 40326616 / 40073293 / +0.6% 0.62 / 0.63 / -1.8%
tpch_q09/duckdb:vortex-compact 29446506 / 30434284 / -3.2% 45949478 / 47656807 / -3.6% 0.64 / 0.64 / +0.3%
tpch_q10/duckdb:vortex-compact 32440629 / 29006497 / +11.8% 🔴 46847152 / 44198433 / +6.0% 0.69 / 0.66 / +5.5%
tpch_q11/duckdb:vortex-compact 10003949 / 9907335 / +1.0% 16786881 / 16183303 / +3.7% 0.60 / 0.61 / -2.7%
tpch_q12/duckdb:vortex-compact 17917075 / 16995943 / +5.4% 28492834 / 29369518 / -3.0% 0.63 / 0.58 / +8.7%
tpch_q13/duckdb:vortex-compact 22815143 / 22031869 / +3.6% 39916547 / 41064637 / -2.8% 0.57 / 0.54 / +6.5%
tpch_q14/duckdb:vortex-compact 14402815 / 14328020 / +0.5% 26717522 / 27912631 / -4.3% 0.54 / 0.51 / +5.0%
tpch_q15/duckdb:vortex-compact 9982674 / 9955571 / +0.3% 24712597 / 21630232 / +14.3% 🔴 0.40 / 0.46 / -12.2%
tpch_q16/duckdb:vortex-compact 20777996 / 19788347 / +5.0% 30971930 / 24661994 / +25.6% 🔴 0.67 / 0.80 / -16.4%
tpch_q17/duckdb:vortex-compact 16965252 / 16340789 / +3.8% 33562964 / 33247011 / +1.0% 0.51 / 0.49 / +2.8%
tpch_q18/duckdb:vortex-compact 24943143 / 24804470 / +0.6% 35345882 / 35155772 / +0.5% 0.71 / 0.71 / +0.0%
tpch_q19/duckdb:vortex-compact 24732753 / 23369265 / +5.8% 36551510 / 34559968 / +5.8% 0.68 / 0.68 / +0.1%
tpch_q20/duckdb:vortex-compact 19551820 / 19268952 / +1.5% 33465091 / 36162401 / -7.5% 0.58 / 0.53 / +9.6%
tpch_q21/duckdb:vortex-compact 67670029 / 67087901 / +0.9% 82554649 / 89493499 / -7.8% 0.82 / 0.75 / +9.3%
tpch_q22/duckdb:vortex-compact 17724338 / 13133030 / +35.0% 🔴 24586034 / 21861171 / +12.5% 🔴 0.72 / 0.60 / +20.0%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 63143208 / 63265511 / -0.2% 69325396 / 70156572 / -1.2% 0.91 / 0.90 / +1.0%
tpch_q02/duckdb:parquet 37884657 / 37461657 / +1.1% 46466291 / 45320393 / +2.5% 0.82 / 0.83 / -1.4%
tpch_q03/duckdb:parquet 68053549 / 67677261 / +0.6% 78964223 / 78663749 / +0.4% 0.86 / 0.86 / +0.2%
tpch_q04/duckdb:parquet 46846428 / 46438809 / +0.9% 56261069 / 56002322 / +0.5% 0.83 / 0.83 / +0.4%
tpch_q05/duckdb:parquet 66217925 / 65991279 / +0.3% 77695507 / 77467656 / +0.3% 0.85 / 0.85 / +0.0%
tpch_q06/duckdb:parquet 21991402 / 21815220 / +0.8% 27279875 / 27156230 / +0.5% 0.81 / 0.80 / +0.4%
tpch_q07/duckdb:parquet 65600471 / 65190563 / +0.6% 75865901 / 75362192 / +0.7% 0.86 / 0.87 / -0.0%
tpch_q08/duckdb:parquet 80501128 / 79949108 / +0.7% 92271420 / 92582444 / -0.3% 0.87 / 0.86 / +1.0%
tpch_q09/duckdb:parquet 120003040 / 119513285 / +0.4% 135360339 / 132764830 / +2.0% 0.89 / 0.90 / -1.5%
tpch_q10/duckdb:parquet 119794173 / 119148507 / +0.5% 131338975 / 131657658 / -0.2% 0.91 / 0.90 / +0.8%
tpch_q11/duckdb:parquet 21561628 / 21298229 / +1.2% 26452049 / 24842918 / +6.5% 0.82 / 0.86 / -4.9%
tpch_q12/duckdb:parquet 44577337 / 44473821 / +0.2% 52159051 / 52398494 / -0.5% 0.85 / 0.85 / +0.7%
tpch_q13/duckdb:parquet 244398263 / 241945475 / +1.0% 253548717 / 251660614 / +0.8% 0.96 / 0.96 / +0.3%
tpch_q14/duckdb:parquet 47515369 / 47319208 / +0.4% 55794953 / 56159396 / -0.6% 0.85 / 0.84 / +1.1%
tpch_q15/duckdb:parquet 26611423 / 26717926 / -0.4% 33081922 / 33640064 / -1.7% 0.80 / 0.79 / +1.3%
tpch_q16/duckdb:parquet 51514385 / 51040487 / +0.9% 59847768 / 63124874 / -5.2% 0.86 / 0.81 / +6.5%
tpch_q17/duckdb:parquet 49187449 / 48937525 / +0.5% 59057669 / 59429601 / -0.6% 0.83 / 0.82 / +1.1%
tpch_q18/duckdb:parquet 96440913 / 97130251 / -0.7% 105098359 / 106652543 / -1.5% 0.92 / 0.91 / +0.8%
tpch_q19/duckdb:parquet 65152121 / 65158575 / -0.0% 75572117 / 74937486 / +0.8% 0.86 / 0.87 / -0.8%
tpch_q20/duckdb:parquet 62071796 / 61596575 / +0.8% 73400221 / 73562280 / -0.2% 0.85 / 0.84 / +1.0%
tpch_q21/duckdb:parquet 143228934 / 141558003 / +1.2% 154689351 / 153381139 / +0.9% 0.93 / 0.92 / +0.3%
tpch_q22/duckdb:parquet 51622799 / 51883300 / -0.5% 58689538 / 58992535 / -0.5% 0.88 / 0.88 / +0.0%

File Size Changes (14 files changed, -0.4% overall, 3↑ 11↓)
File Scale Format Base HEAD Change %
nation.vortex 1.0 vortex-file-compressed 10.68 KB 10.71 KB +32 B +0.3%
customer.vortex 1.0 vortex-compact 7.41 MB 7.42 MB +10.43 KB +0.1%
partsupp.vortex 1.0 vortex-file-compressed 24.95 MB 24.95 MB +448 B +0.0%
partsupp.vortex 1.0 vortex-compact 20.30 MB 20.30 MB 1.47 KB -0.0%
orders.vortex 1.0 vortex-compact 31.73 MB 31.70 MB 23.56 KB -0.1%
lineitem.vortex 1.0 vortex-compact 126.03 MB 125.89 MB 139.48 KB -0.1%
supplier.vortex 1.0 vortex-compact 495.79 KB 494.59 KB 1.20 KB -0.2%
part.vortex 1.0 vortex-file-compressed 5.40 MB 5.38 MB 14.74 KB -0.3%
orders.vortex 1.0 vortex-file-compressed 42.78 MB 42.51 MB 281.50 KB -0.6%
lineitem.vortex 1.0 vortex-file-compressed 171.53 MB 170.41 MB 1.11 MB -0.6%
customer.vortex 1.0 vortex-file-compressed 9.17 MB 9.10 MB 80.79 KB -0.9%
part.vortex 1.0 vortex-compact 3.55 MB 3.51 MB 37.55 KB -1.0%
supplier.vortex 1.0 vortex-file-compressed 625.03 KB 607.73 KB 17.30 KB -2.8%
region.vortex 1.0 vortex-file-compressed 6.62 KB 6.25 KB 384 B -5.7%

Totals:

  • vortex-compact: 189.77 MB → 189.58 MB (-0.1%)
  • vortex-file-compressed: 254.72 MB → 253.22 MB (-0.6%)

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 9c23a32b vs base 787fac76
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.975x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.957x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 174060248 / 188170692 / -7.5% 615272516 / 557617680 / +10.3% 🔴 0.28 / 0.34 / -16.2%
clickbench-sorted_q24/datafusion:vortex-file-compressed 11470028 / 10656072 / +7.6% 48579770 / 51897698 / -6.4% 0.24 / 0.21 / +15.0%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11692746 / 11409014 / +2.5% 49585177 / 53426365 / -7.2% 0.24 / 0.21 / +10.4%
clickbench-sorted_q36/datafusion:vortex-file-compressed 24203720 / 23743684 / +1.9% 65724899 / 70051253 / -6.2% 0.37 / 0.34 / +8.6%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18837776 / 18129126 / +3.9% 57854118 / 65325351 / -11.4% 🟢 0.33 / 0.28 / +17.3%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17950196 / 17708228 / +1.4% 58611732 / 62327060 / -6.0% 0.31 / 0.28 / +7.8%
clickbench-sorted_q39/datafusion:vortex-file-compressed 41374693 / 39934496 / +3.6% 89648150 / 95654339 / -6.3% 0.46 / 0.42 / +10.5%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12370140 / 11942146 / +3.6% 42920676 / 46902437 / -8.5% 0.29 / 0.25 / +13.2%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11823414 / 12141966 / -2.6% 45023932 / 45032704 / -0.0% 0.26 / 0.27 / -2.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10079442 / 9851914 / +2.3% 35758554 / 38726138 / -7.7% 0.28 / 0.25 / +10.8%
datafusion / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 189660906 / 182215604 / +4.1% 422309602 / 437438704 / -3.5% 0.45 / 0.42 / +7.8%
clickbench-sorted_q24/datafusion:vortex-compact 19254180 / 19479966 / -1.2% 49321656 / 50454030 / -2.2% 0.39 / 0.39 / +1.1%
clickbench-sorted_q26/datafusion:vortex-compact 18351009 / 19397752 / -5.4% 49061695 / 46524949 / +5.5% 0.37 / 0.42 / -10.3%
clickbench-sorted_q36/datafusion:vortex-compact 25832258 / 25357217 / +1.9% 70385706 / 71614018 / -1.7% 0.37 / 0.35 / +3.7%
clickbench-sorted_q37/datafusion:vortex-compact 21807548 / 21982758 / -0.8% 68619286 / 66934063 / +2.5% 0.32 / 0.33 / -3.2%
clickbench-sorted_q38/datafusion:vortex-compact 22071345 / 22097104 / -0.1% 62508176 / 67711983 / -7.7% 0.35 / 0.33 / +8.2%
clickbench-sorted_q39/datafusion:vortex-compact 41776858 / 42916116 / -2.7% 86380248 / 86811958 / -0.5% 0.48 / 0.49 / -2.2%
clickbench-sorted_q40/datafusion:vortex-compact 14894244 / 14859628 / +0.2% 44738319 / 46678053 / -4.2% 0.33 / 0.32 / +4.6%
clickbench-sorted_q41/datafusion:vortex-compact 14563592 / 14298104 / +1.9% 45458613 / 43577796 / +4.3% 0.32 / 0.33 / -2.4%
clickbench-sorted_q42/datafusion:vortex-compact 10718873 / 10620907 / +0.9% 36087527 / 37105580 / -2.7% 0.30 / 0.29 / +3.8%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 762939378 / 762468576 / +0.1% 968836912 / 983779291 / -1.5% 0.79 / 0.78 / +1.6%
clickbench-sorted_q24/datafusion:parquet 9340310 / 9357178 / -0.2% 72767829 / 74115505 / -1.8% 0.13 / 0.13 / +1.7%
clickbench-sorted_q26/datafusion:parquet 9605308 / 9348300 / +2.7% 73811768 / 72781594 / +1.4% 0.13 / 0.13 / +1.3%
clickbench-sorted_q36/datafusion:parquet 94373552 / 94112720 / +0.3% 170353175 / 172514949 / -1.3% 0.55 / 0.55 / +1.5%
clickbench-sorted_q37/datafusion:parquet 64854748 / 64422844 / +0.7% 133905575 / 133269307 / +0.5% 0.48 / 0.48 / +0.2%
clickbench-sorted_q38/datafusion:parquet 88096252 / 87586137 / +0.6% 158125489 / 165420529 / -4.4% 0.56 / 0.53 / +5.2%
clickbench-sorted_q39/datafusion:parquet 160187646 / 160096554 / +0.1% 232975492 / 240584086 / -3.2% 0.69 / 0.67 / +3.3%
clickbench-sorted_q40/datafusion:parquet 44847379 / 44764168 / +0.2% 112904742 / 117348756 / -3.8% 0.40 / 0.38 / +4.1%
clickbench-sorted_q41/datafusion:parquet 42342942 / 42216790 / +0.3% 109308095 / 111368015 / -1.8% 0.39 / 0.38 / +2.2%
clickbench-sorted_q42/datafusion:parquet 26334656 / 26427552 / -0.4% 89982873 / 88246833 / +2.0% 0.29 / 0.30 / -2.3%
duckdb / vortex-file-compressed / ns (1.002x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 57927779 / 56563446 / +2.4% 80834280 / 80578400 / +0.3% 0.72 / 0.70 / +2.1%
clickbench-sorted_q24/duckdb:vortex-file-compressed 21626570 / 21566074 / +0.3% 35135179 / 38105129 / -7.8% 0.62 / 0.57 / +8.8%
clickbench-sorted_q26/duckdb:vortex-file-compressed 14183346 / 16972634 / -16.4% 🟢 26417296 / 32170940 / -17.9% 🟢 0.54 / 0.53 / +1.8%
clickbench-sorted_q36/duckdb:vortex-file-compressed 31387018 / 29052722 / +8.0% 65798897 / 62621801 / +5.1% 0.48 / 0.46 / +2.8%
clickbench-sorted_q37/duckdb:vortex-file-compressed 23295495 / 24188736 / -3.7% 54290653 / 53226134 / +2.0% 0.43 / 0.45 / -5.6%
clickbench-sorted_q38/duckdb:vortex-file-compressed 25437132 / 25873906 / -1.7% 55586988 / 62805881 / -11.5% 🟢 0.46 / 0.41 / +11.1%
clickbench-sorted_q39/duckdb:vortex-file-compressed 47167621 / 47818097 / -1.4% 98152284 / 102153151 / -3.9% 0.48 / 0.47 / +2.7%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15364535 / 15116804 / +1.6% 36808251 / 39509552 / -6.8% 0.42 / 0.38 / +9.1%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15481257 / 15178934 / +2.0% 38710232 / 37540076 / +3.1% 0.40 / 0.40 / -1.1%
clickbench-sorted_q42/duckdb:vortex-file-compressed 14456109 / 12753215 / +13.4% 🔴 31226859 / 30438600 / +2.6% 0.46 / 0.42 / +10.5%
duckdb / vortex-compact / ns (0.984x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 66397674 / 59667384 / +11.3% 🔴 95830839 / 83125542 / +15.3% 🔴 0.69 / 0.72 / -3.5%
clickbench-sorted_q24/duckdb:vortex-compact 21256522 / 23908536 / -11.1% 🟢 32779851 / 32339275 / +1.4% 0.65 / 0.74 / -12.3%
clickbench-sorted_q26/duckdb:vortex-compact 15578273 / 16224852 / -4.0% 29769937 / 33204031 / -10.3% 🟢 0.52 / 0.49 / +7.1%
clickbench-sorted_q36/duckdb:vortex-compact 33820290 / 33457516 / +1.1% 68667596 / 71023232 / -3.3% 0.49 / 0.47 / +4.6%
clickbench-sorted_q37/duckdb:vortex-compact 29794862 / 29275709 / +1.8% 59229156 / 65689356 / -9.8% 0.50 / 0.45 / +12.9%
clickbench-sorted_q38/duckdb:vortex-compact 28699220 / 29822631 / -3.8% 65427525 / 64204701 / +1.9% 0.44 / 0.46 / -5.6%
clickbench-sorted_q39/duckdb:vortex-compact 58134745 / 58518349 / -0.7% 94551973 / 98343538 / -3.9% 0.61 / 0.60 / +3.3%
clickbench-sorted_q40/duckdb:vortex-compact 18967656 / 17489555 / +8.5% 41400996 / 41068402 / +0.8% 0.46 / 0.43 / +7.6%
clickbench-sorted_q41/duckdb:vortex-compact 17113130 / 16800126 / +1.9% 39717802 / 39146629 / +1.5% 0.43 / 0.43 / +0.4%
clickbench-sorted_q42/duckdb:vortex-compact 13522385 / 16447676 / -17.8% 🟢 33731232 / 30708505 / +9.8% 0.40 / 0.54 / -25.2%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 131963304 / 126445108 / +4.4% 134572758 / 167185435 / -19.5% 🟢 0.98 / 0.76 / +29.7%
clickbench-sorted_q24/duckdb:parquet 17603640 / 18465018 / -4.7% 31119919 / 29148487 / +6.8% 0.57 / 0.63 / -10.7%
clickbench-sorted_q26/duckdb:parquet 12525704 / 12350036 / +1.4% 22283871 / 20975725 / +6.2% 0.56 / 0.59 / -4.5%
clickbench-sorted_q36/duckdb:parquet 43817090 / 42994982 / +1.9% 60037630 / 67317974 / -10.8% 🟢 0.73 / 0.64 / +14.3%
clickbench-sorted_q37/duckdb:parquet 30541946 / 32189352 / -5.1% 45737301 / 51120913 / -10.5% 🟢 0.67 / 0.63 / +6.1%
clickbench-sorted_q38/duckdb:parquet 41487207 / 42033316 / -1.3% 56230321 / 62158092 / -9.5% 0.74 / 0.68 / +9.1%
clickbench-sorted_q39/duckdb:parquet 73514858 / 73338843 / +0.2% 85146695 / 89932339 / -5.3% 0.86 / 0.82 / +5.9%
clickbench-sorted_q40/duckdb:parquet 17499014 / 17438632 / +0.3% 36776066 / 40540799 / -9.3% 0.48 / 0.43 / +10.6%
clickbench-sorted_q41/duckdb:parquet 16866963 / 16554531 / +1.9% 35980768 / 40039538 / -10.1% 🟢 0.47 / 0.41 / +13.4%
clickbench-sorted_q42/duckdb:parquet 10960654 / 11482896 / -4.5% 22234817 / 23777424 / -6.5% 0.49 / 0.48 / +2.1%

File Size Changes (200 files changed, -0.0% overall, 99↑ 101↓)
File Scale Format Base HEAD Change %
hits_098.vortex 1.0 vortex-compact 102.54 MB 103.99 MB +1.45 MB +1.4%
hits_076.vortex 1.0 vortex-file-compressed 159.99 MB 161.87 MB +1.88 MB +1.2%
hits_086.vortex 1.0 vortex-file-compressed 191.72 MB 193.70 MB +1.98 MB +1.0%
hits_061.vortex 1.0 vortex-compact 123.65 MB 124.77 MB +1.13 MB +0.9%
hits_027.vortex 1.0 vortex-compact 138.01 MB 139.16 MB +1.15 MB +0.8%
hits_044.vortex 1.0 vortex-file-compressed 199.69 MB 201.13 MB +1.44 MB +0.7%
hits_006.vortex 1.0 vortex-compact 95.94 MB 96.60 MB +679.16 KB +0.7%
hits_074.vortex 1.0 vortex-file-compressed 198.89 MB 200.21 MB +1.32 MB +0.7%
hits_078.vortex 1.0 vortex-compact 97.01 MB 97.56 MB +567.78 KB +0.6%
hits_070.vortex 1.0 vortex-compact 152.34 MB 153.08 MB +751.36 KB +0.5%
hits_080.vortex 1.0 vortex-compact 96.55 MB 97.00 MB +462.45 KB +0.5%
hits_081.vortex 1.0 vortex-compact 152.52 MB 153.18 MB +672.95 KB +0.4%
hits_007.vortex 1.0 vortex-file-compressed 200.26 MB 201.03 MB +789.95 KB +0.4%
hits_062.vortex 1.0 vortex-file-compressed 171.27 MB 171.87 MB +611.98 KB +0.3%
hits_088.vortex 1.0 vortex-file-compressed 172.80 MB 173.38 MB +601.82 KB +0.3%
hits_052.vortex 1.0 vortex-compact 97.47 MB 97.75 MB +293.10 KB +0.3%
hits_080.vortex 1.0 vortex-file-compressed 126.83 MB 127.16 MB +339.24 KB +0.3%
hits_007.vortex 1.0 vortex-compact 153.37 MB 153.76 MB +394.77 KB +0.3%
hits_098.vortex 1.0 vortex-file-compressed 137.78 MB 138.12 MB +348.09 KB +0.2%
hits_040.vortex 1.0 vortex-compact 110.34 MB 110.58 MB +243.23 KB +0.2%
hits_003.vortex 1.0 vortex-compact 104.68 MB 104.90 MB +227.58 KB +0.2%
hits_077.vortex 1.0 vortex-compact 133.96 MB 134.23 MB +281.19 KB +0.2%
hits_053.vortex 1.0 vortex-file-compressed 189.55 MB 189.94 MB +394.59 KB +0.2%
hits_089.vortex 1.0 vortex-compact 97.49 MB 97.69 MB +199.32 KB +0.2%
hits_028.vortex 1.0 vortex-compact 115.54 MB 115.77 MB +231.99 KB +0.2%
hits_058.vortex 1.0 vortex-file-compressed 154.43 MB 154.73 MB +308.66 KB +0.2%
hits_045.vortex 1.0 vortex-file-compressed 139.80 MB 140.07 MB +278.60 KB +0.2%
hits_087.vortex 1.0 vortex-file-compressed 161.62 MB 161.93 MB +321.52 KB +0.2%
hits_090.vortex 1.0 vortex-file-compressed 192.30 MB 192.67 MB +381.11 KB +0.2%
hits_051.vortex 1.0 vortex-compact 133.61 MB 133.85 MB +246.43 KB +0.2%
hits_096.vortex 1.0 vortex-file-compressed 200.29 MB 200.64 MB +360.68 KB +0.2%
hits_099.vortex 1.0 vortex-compact 132.84 MB 133.07 MB +237.97 KB +0.2%
hits_002.vortex 1.0 vortex-compact 123.88 MB 124.09 MB +220.64 KB +0.2%
hits_072.vortex 1.0 vortex-compact 75.55 MB 75.67 MB +130.94 KB +0.2%
hits_009.vortex 1.0 vortex-file-compressed 101.01 MB 101.18 MB +171.92 KB +0.2%
hits_010.vortex 1.0 vortex-file-compressed 168.82 MB 169.10 MB +282.18 KB +0.2%
hits_036.vortex 1.0 vortex-compact 133.11 MB 133.33 MB +220.86 KB +0.2%
hits_065.vortex 1.0 vortex-file-compressed 161.91 MB 162.15 MB +249.22 KB +0.2%
hits_097.vortex 1.0 vortex-file-compressed 192.65 MB 192.92 MB +274.19 KB +0.1%
hits_062.vortex 1.0 vortex-compact 132.40 MB 132.58 MB +180.62 KB +0.1%
hits_014.vortex 1.0 vortex-compact 133.48 MB 133.65 MB +174.44 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.69 MB 172.90 MB +215.27 KB +0.1%
hits_039.vortex 1.0 vortex-compact 124.17 MB 124.32 MB +146.80 KB +0.1%
hits_011.vortex 1.0 vortex-compact 152.19 MB 152.36 MB +179.22 KB +0.1%
hits_050.vortex 1.0 vortex-file-compressed 161.57 MB 161.75 MB +183.98 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 129.96 MB 130.10 MB +147.11 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.09 MB 167.27 MB +186.16 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 200.69 MB 200.88 MB +194.21 KB +0.1%
hits_059.vortex 1.0 vortex-compact 152.01 MB 152.15 MB +141.75 KB +0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.84 MB 161.98 MB +145.70 KB +0.1%
hits_057.vortex 1.0 vortex-compact 111.65 MB 111.74 MB +98.35 KB +0.1%
hits_023.vortex 1.0 vortex-compact 142.43 MB 142.56 MB +125.28 KB +0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.82 MB 142.94 MB +120.03 KB +0.1%
hits_065.vortex 1.0 vortex-compact 124.26 MB 124.36 MB +101.35 KB +0.1%
hits_064.vortex 1.0 vortex-file-compressed 190.45 MB 190.60 MB +153.99 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.83 MB 130.93 MB +104.98 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 200.23 MB 200.38 MB +154.40 KB +0.1%
hits_083.vortex 1.0 vortex-compact 110.06 MB 110.14 MB +83.71 KB +0.1%
hits_024.vortex 1.0 vortex-file-compressed 161.05 MB 161.16 MB +121.13 KB +0.1%
hits_013.vortex 1.0 vortex-compact 125.71 MB 125.80 MB +93.50 KB +0.1%
hits_024.vortex 1.0 vortex-compact 124.92 MB 125.00 MB +89.74 KB +0.1%
hits_037.vortex 1.0 vortex-file-compressed 178.06 MB 178.17 MB +114.01 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.64 MB 153.73 MB +94.36 KB +0.1%
hits_067.vortex 1.0 vortex-file-compressed 130.89 MB 130.97 MB +79.72 KB +0.1%
hits_017.vortex 1.0 vortex-compact 111.84 MB 111.90 MB +65.01 KB +0.1%
hits_038.vortex 1.0 vortex-file-compressed 189.56 MB 189.66 MB +101.14 KB +0.1%
hits_092.vortex 1.0 vortex-compact 152.83 MB 152.91 MB +80.70 KB +0.1%
hits_045.vortex 1.0 vortex-compact 105.69 MB 105.74 MB +49.88 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.03 MB 135.10 MB +63.40 KB +0.0%
hits_005.vortex 1.0 vortex-compact 116.02 MB 116.07 MB +51.58 KB +0.0%
hits_010.vortex 1.0 vortex-compact 122.52 MB 122.58 MB +52.84 KB +0.0%
hits_058.vortex 1.0 vortex-compact 110.36 MB 110.40 MB +46.02 KB +0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.75 MB 153.81 MB +60.98 KB +0.0%
hits_043.vortex 1.0 vortex-compact 94.38 MB 94.41 MB +34.84 KB +0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.40 MB 130.44 MB +47.77 KB +0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.62 MB 130.67 MB +44.80 KB +0.0%
hits_044.vortex 1.0 vortex-compact 153.22 MB 153.27 MB +52.23 KB +0.0%
hits_019.vortex 1.0 vortex-compact 106.14 MB 106.18 MB +33.32 KB +0.0%
hits_042.vortex 1.0 vortex-file-compressed 202.17 MB 202.23 MB +63.07 KB +0.0%
hits_008.vortex 1.0 vortex-compact 105.71 MB 105.74 MB +31.95 KB +0.0%
hits_031.vortex 1.0 vortex-compact 111.25 MB 111.28 MB +33.42 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.97 MB 154.02 MB +44.04 KB +0.0%
hits_054.vortex 1.0 vortex-compact 111.90 MB 111.92 MB +27.55 KB +0.0%
hits_094.vortex 1.0 vortex-compact 110.84 MB 110.86 MB +25.84 KB +0.0%
hits_001.vortex 1.0 vortex-file-compressed 188.77 MB 188.81 MB +43.86 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.43 MB 161.46 MB +37.06 KB +0.0%
hits_022.vortex 1.0 vortex-compact 152.46 MB 152.49 MB +34.91 KB +0.0%
hits_082.vortex 1.0 vortex-compact 105.75 MB 105.77 MB +24.09 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.92 MB 171.95 MB +29.45 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.75 MB 181.78 MB +30.05 KB +0.0%
hits_069.vortex 1.0 vortex-compact 99.78 MB 99.79 MB +15.39 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.09 MB 189.12 MB +27.82 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.61 MB 126.63 MB +16.42 KB +0.0%
hits_079.vortex 1.0 vortex-file-compressed 180.55 MB 180.57 MB +21.98 KB +0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.28 MB 130.30 MB +13.23 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.50 MB 136.52 MB +13.28 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.00 MB 134.01 MB +12.71 KB +0.0%
hits_064.vortex 1.0 vortex-compact 138.88 MB 138.89 MB +11.07 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.94 MB 75.95 MB +2.48 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 201.06 MB 201.06 MB 1.05 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.21 MB 75.21 MB 600 B -0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.23 MB 147.23 MB 3.19 KB -0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.47 MB 190.46 MB 6.80 KB -0.0%
hits_012.vortex 1.0 vortex-compact 138.77 MB 138.77 MB 5.03 KB -0.0%
hits_046.vortex 1.0 vortex-file-compressed 100.70 MB 100.70 MB 4.09 KB -0.0%
hits_015.vortex 1.0 vortex-compact 97.17 MB 97.17 MB 4.10 KB -0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.42 MB 160.41 MB 7.63 KB -0.0%
hits_046.vortex 1.0 vortex-compact 75.00 MB 75.00 MB 3.98 KB -0.0%
hits_030.vortex 1.0 vortex-compact 97.92 MB 97.92 MB 5.72 KB -0.0%
hits_055.vortex 1.0 vortex-file-compressed 200.74 MB 200.73 MB 12.41 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.13 MB 131.12 MB 8.57 KB -0.0%
hits_019.vortex 1.0 vortex-file-compressed 140.12 MB 140.11 MB 9.76 KB -0.0%
hits_042.vortex 1.0 vortex-compact 136.73 MB 136.72 MB 10.18 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.90 MB 194.88 MB 21.78 KB -0.0%
hits_070.vortex 1.0 vortex-file-compressed 201.01 MB 200.98 MB 25.48 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.65 MB 130.63 MB 17.14 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.68 MB 161.66 MB 22.29 KB -0.0%
hits_029.vortex 1.0 vortex-file-compressed 200.93 MB 200.90 MB 28.73 KB -0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.44 MB 172.41 MB 25.52 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.12 MB 191.09 MB 30.80 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.40 MB 147.37 MB 28.11 KB -0.0%
hits_047.vortex 1.0 vortex-compact 110.04 MB 110.02 MB 22.09 KB -0.0%
hits_094.vortex 1.0 vortex-file-compressed 158.24 MB 158.20 MB 35.90 KB -0.0%
hits_049.vortex 1.0 vortex-compact 140.32 MB 140.29 MB 34.63 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 200.60 MB 200.55 MB 50.25 KB -0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.32 MB 147.28 MB 43.98 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.70 MB 126.66 MB 43.07 KB -0.0%
hits_027.vortex 1.0 vortex-file-compressed 191.67 MB 191.60 MB 67.52 KB -0.0%
hits_085.vortex 1.0 vortex-file-compressed 200.78 MB 200.71 MB 71.17 KB -0.0%
hits_092.vortex 1.0 vortex-file-compressed 200.86 MB 200.79 MB 75.38 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.93 MB 101.89 MB 39.06 KB -0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.87 MB 130.82 MB 50.54 KB -0.0%
hits_071.vortex 1.0 vortex-compact 105.66 MB 105.62 MB 44.60 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.39 MB 159.32 MB 72.15 KB -0.0%
hits_063.vortex 1.0 vortex-compact 97.71 MB 97.66 MB 44.77 KB -0.0%
hits_079.vortex 1.0 vortex-compact 128.09 MB 128.03 MB 63.22 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.62 MB 130.55 MB 66.90 KB -0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.42 MB 139.35 MB 73.09 KB -0.1%
hits_091.vortex 1.0 vortex-compact 112.14 MB 112.08 MB 60.74 KB -0.1%
hits_093.vortex 1.0 vortex-compact 98.48 MB 98.43 MB 57.31 KB -0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.33 MB 130.25 MB 80.37 KB -0.1%
hits_056.vortex 1.0 vortex-compact 100.93 MB 100.86 MB 65.98 KB -0.1%
hits_020.vortex 1.0 vortex-file-compressed 159.95 MB 159.84 MB 108.34 KB -0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.37 MB 156.26 MB 114.08 KB -0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.30 MB 139.20 MB 112.16 KB -0.1%
hits_050.vortex 1.0 vortex-compact 125.19 MB 125.08 MB 109.81 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.64 MB 161.48 MB 158.15 KB -0.1%
hits_085.vortex 1.0 vortex-compact 152.79 MB 152.64 MB 151.52 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.80 MB 153.64 MB 156.23 KB -0.1%
hits_025.vortex 1.0 vortex-compact 133.68 MB 133.54 MB 143.54 KB -0.1%
hits_073.vortex 1.0 vortex-file-compressed 173.26 MB 173.08 MB 189.73 KB -0.1%
hits_001.vortex 1.0 vortex-compact 137.93 MB 137.78 MB 154.44 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.92 MB 130.76 MB 163.41 KB -0.1%
hits_033.vortex 1.0 vortex-compact 153.28 MB 153.08 MB 204.13 KB -0.1%
hits_029.vortex 1.0 vortex-compact 153.18 MB 152.98 MB 206.32 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 173.18 MB 172.95 MB 236.83 KB -0.1%
hits_016.vortex 1.0 vortex-file-compressed 180.06 MB 179.82 MB 246.62 KB -0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.31 MB 152.09 MB 217.23 KB -0.1%
hits_088.vortex 1.0 vortex-compact 133.86 MB 133.65 MB 213.40 KB -0.2%
hits_076.vortex 1.0 vortex-compact 125.06 MB 124.87 MB 204.28 KB -0.2%
hits_086.vortex 1.0 vortex-compact 140.71 MB 140.48 MB 235.41 KB -0.2%
hits_051.vortex 1.0 vortex-file-compressed 173.24 MB 172.94 MB 307.59 KB -0.2%
hits_055.vortex 1.0 vortex-compact 153.28 MB 153.00 MB 281.70 KB -0.2%
hits_066.vortex 1.0 vortex-compact 117.48 MB 117.27 MB 219.67 KB -0.2%
hits_018.vortex 1.0 vortex-compact 153.24 MB 152.95 MB 299.32 KB -0.2%
hits_099.vortex 1.0 vortex-file-compressed 172.16 MB 171.83 MB 337.23 KB -0.2%
hits_035.vortex 1.0 vortex-file-compressed 102.30 MB 102.10 MB 209.59 KB -0.2%
hits_032.vortex 1.0 vortex-file-compressed 154.30 MB 153.99 MB 318.89 KB -0.2%
hits_068.vortex 1.0 vortex-compact 112.30 MB 112.07 MB 232.31 KB -0.2%
hits_057.vortex 1.0 vortex-file-compressed 160.15 MB 159.82 MB 338.64 KB -0.2%
hits_071.vortex 1.0 vortex-file-compressed 139.98 MB 139.60 MB 397.58 KB -0.3%
hits_020.vortex 1.0 vortex-compact 112.09 MB 111.78 MB 319.56 KB -0.3%
hits_060.vortex 1.0 vortex-file-compressed 194.83 MB 194.26 MB 584.25 KB -0.3%
hits_095.vortex 1.0 vortex-compact 110.53 MB 110.15 MB 390.86 KB -0.3%
hits_074.vortex 1.0 vortex-compact 152.13 MB 151.59 MB 545.88 KB -0.4%
hits_000.vortex 1.0 vortex-compact 99.36 MB 99.00 MB 374.50 KB -0.4%
hits_096.vortex 1.0 vortex-compact 152.49 MB 151.91 MB 596.03 KB -0.4%
hits_059.vortex 1.0 vortex-file-compressed 200.07 MB 199.23 MB 861.65 KB -0.4%
hits_084.vortex 1.0 vortex-compact 110.66 MB 110.19 MB 490.71 KB -0.4%
hits_040.vortex 1.0 vortex-file-compressed 144.89 MB 144.22 MB 684.29 KB -0.5%
hits_037.vortex 1.0 vortex-compact 132.39 MB 131.77 MB 627.91 KB -0.5%
hits_032.vortex 1.0 vortex-compact 110.48 MB 109.91 MB 578.59 KB -0.5%
hits_041.vortex 1.0 vortex-compact 98.44 MB 97.93 MB 518.64 KB -0.5%
hits_022.vortex 1.0 vortex-file-compressed 200.13 MB 199.02 MB 1.11 MB -0.6%
hits_066.vortex 1.0 vortex-file-compressed 163.87 MB 162.91 MB 983.41 KB -0.6%
hits_060.vortex 1.0 vortex-compact 141.03 MB 140.17 MB 873.98 KB -0.6%
hits_033.vortex 1.0 vortex-file-compressed 201.01 MB 199.78 MB 1.24 MB -0.6%
hits_053.vortex 1.0 vortex-compact 138.40 MB 137.52 MB 898.02 KB -0.6%
hits_090.vortex 1.0 vortex-compact 140.98 MB 140.07 MB 927.37 KB -0.6%
hits_048.vortex 1.0 vortex-compact 152.87 MB 151.87 MB 1018.02 KB -0.7%
hits_034.vortex 1.0 vortex-compact 133.30 MB 132.42 MB 894.30 KB -0.7%
hits_075.vortex 1.0 vortex-compact 138.91 MB 137.92 MB 1014.48 KB -0.7%
hits_038.vortex 1.0 vortex-compact 139.13 MB 138.13 MB 1.00 MB -0.7%
hits_021.vortex 1.0 vortex-compact 110.97 MB 110.14 MB 841.75 KB -0.7%
hits_016.vortex 1.0 vortex-compact 127.70 MB 126.69 MB 1.01 MB -0.8%
hits_097.vortex 1.0 vortex-compact 141.38 MB 140.15 MB 1.22 MB -0.9%
hits_004.vortex 1.0 vortex-compact 98.37 MB 97.50 MB 890.70 KB -0.9%
hits_087.vortex 1.0 vortex-compact 125.24 MB 124.12 MB 1.12 MB -0.9%
hits_067.vortex 1.0 vortex-compact 98.99 MB 98.10 MB 919.26 KB -0.9%
hits_026.vortex 1.0 vortex-compact 98.86 MB 97.27 MB 1.59 MB -1.6%

Totals:

  • vortex-compact: 11.91 GB → 11.90 GB (-0.1%)
  • vortex-file-compressed: 15.96 GB → 15.97 GB (+0.0%)

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 9c23a32b vs base 787fac76
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +14.9%
Engines: DataFusion No clear signal (+24.4%, environment too noisy confidence) · DuckDB No clear signal (+6.0%, environment too noisy confidence)
Vortex (geomean): hot 1.020x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.888x ➖ · cold 0.907x ➖
Shifts: Parquet (control) -11.2% · Median polish -5.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 55239940 / 53217542 / +3.8% 137100781 / 150769991 / -9.1% 0.40 / 0.35 / +14.1%
fineweb_q01/datafusion:vortex-file-compressed 678674213 / 555383384 / +22.2% 912432662 / 761533209 / +19.8% 0.74 / 0.73 / +2.0%
fineweb_q02/datafusion:vortex-file-compressed 440988948 / 616545812 / -28.5% 689433671 / 702409308 / -1.8% 0.64 / 0.88 / -27.1%
fineweb_q03/datafusion:vortex-file-compressed 498204342 / 523720244 / -4.9% 1005632690 / 924397564 / +8.8% 0.50 / 0.57 / -12.6%
fineweb_q04/datafusion:vortex-file-compressed 422461996 / 429190558 / -1.6% 436696451 / 499966319 / -12.7% 0.97 / 0.86 / +12.7%
fineweb_q05/datafusion:vortex-file-compressed 459828126 / 450988842 / +2.0% 438001519 / 440315368 / -0.5% 1.05 / 1.02 / +2.5%
fineweb_q06/datafusion:vortex-file-compressed 1022120658 / 852507052 / +19.9% 882618932 / 891492747 / -1.0% 1.16 / 0.96 / +21.1%
fineweb_q07/datafusion:vortex-file-compressed 705110160 / 554713722 / +27.1% 585119075 / 515489008 / +13.5% 1.21 / 1.08 / +12.0%
fineweb_q08/datafusion:vortex-file-compressed 205965541 / 246335452 / -16.4% 191613808 / 257807686 / -25.7% 1.07 / 0.96 / +12.5%
datafusion / vortex-compact / ns (1.082x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 46930246 / 61822506 / -24.1% 170310773 / 135837152 / +25.4% 0.28 / 0.46 / -39.5%
fineweb_q01/datafusion:vortex-compact 490985358 / 384445964 / +27.7% 895259329 / 751543239 / +19.1% 0.55 / 0.51 / +7.2%
fineweb_q02/datafusion:vortex-compact 773587186 / 466039082 / +66.0% 🔴 746478052 / 542443768 / +37.6% 🔴 1.04 / 0.86 / +20.6%
fineweb_q03/datafusion:vortex-compact 802161100 / 612761495 / +30.9% 🔴 891830349 / 995621651 / -10.4% 0.90 / 0.62 / +46.1%
fineweb_q04/datafusion:vortex-compact 482034748 / 686271192 / -29.8% 646957537 / 815141960 / -20.6% 0.75 / 0.84 / -11.5%
fineweb_q05/datafusion:vortex-compact 464788506 / 456623966 / +1.8% 584296978 / 559242303 / +4.5% 0.80 / 0.82 / -2.6%
fineweb_q06/datafusion:vortex-compact 671222197 / 685547082 / -2.1% 696757221 / 685995171 / +1.6% 0.96 / 1.00 / -3.6%
fineweb_q07/datafusion:vortex-compact 833409257 / 566794080 / +47.0% 🔴 543888364 / 428019394 / +27.1% 1.53 / 1.32 / +15.7%
fineweb_q08/datafusion:vortex-compact 183216522 / 196269388 / -6.7% 243281987 / 245045220 / -0.7% 0.75 / 0.80 / -6.0%
datafusion / parquet / ns (0.841x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 538958333 / 506887507 / +6.3% 803550171 / 1057768368 / -24.0% 0.67 / 0.48 / +40.0%
fineweb_q01/datafusion:parquet 725943895 / 1312132176 / -44.7% 🟢 893859336 / 1017864496 / -12.2% 0.81 / 1.29 / -37.0%
fineweb_q02/datafusion:parquet 924426344 / 802707164 / +15.2% 907601779 / 1025883379 / -11.5% 1.02 / 0.78 / +30.2%
fineweb_q03/datafusion:parquet 772359790 / 878490269 / -12.1% 853290950 / 809517313 / +5.4% 0.91 / 1.09 / -16.6%
fineweb_q04/datafusion:parquet 884302481 / 798825054 / +10.7% 722334094 / 726595916 / -0.6% 1.22 / 1.10 / +11.4%
fineweb_q05/datafusion:parquet 749624042 / 1076933167 / -30.4% 🟢 754274493 / 1337458516 / -43.6% 🟢 0.99 / 0.81 / +23.4%
fineweb_q06/datafusion:parquet 813357586 / 1267834285 / -35.8% 🟢 794530699 / 997767315 / -20.4% 1.02 / 1.27 / -19.4%
fineweb_q07/datafusion:parquet 970140429 / 895615490 / +8.3% 1118365342 / 864903209 / +29.3% 0.87 / 1.04 / -16.2%
fineweb_q08/datafusion:parquet 820901566 / 1250695760 / -34.4% 🟢 952276375 / 1272959869 / -25.2% 0.86 / 0.98 / -12.3%
duckdb / vortex-file-compressed / ns (1.081x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 49724846 / 62476010 / -20.4% 53246492 / 53772744 / -1.0% 0.93 / 1.16 / -19.6%
fineweb_q01/duckdb:vortex-file-compressed 760822996 / 406328711 / +87.2% 🔴 601274888 / 486738702 / +23.5% 1.27 / 0.83 / +51.6%
fineweb_q02/duckdb:vortex-file-compressed 633055794 / 752460114 / -15.9% 624446552 / 699622723 / -10.7% 1.01 / 1.08 / -5.7%
fineweb_q03/duckdb:vortex-file-compressed 959002708 / 983350734 / -2.5% 1204393364 / 1139183232 / +5.7% 0.80 / 0.86 / -7.8%
fineweb_q04/duckdb:vortex-file-compressed 987634387 / 1032617942 / -4.4% 932258954 / 1132813915 / -17.7% 1.06 / 0.91 / +16.2%
fineweb_q05/duckdb:vortex-file-compressed 845418298 / 914360102 / -7.5% 920037942 / 987360038 / -6.8% 0.92 / 0.93 / -0.8%
fineweb_q06/duckdb:vortex-file-compressed 1248969324 / 1309795592 / -4.6% 1252274369 / 1237001472 / +1.2% 1.00 / 1.06 / -5.8%
fineweb_q07/duckdb:vortex-file-compressed 1087591788 / 977689223 / +11.2% 1033374262 / 1032237721 / +0.1% 1.05 / 0.95 / +11.1%
fineweb_q08/duckdb:vortex-file-compressed 807919396 / 459310943 / +75.9% 🔴 921005424 / 733241765 / +25.6% 0.88 / 0.63 / +40.0%
duckdb / vortex-compact / ns (0.914x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 70145428 / 65847999 / +6.5% 70256245 / 66970380 / +4.9% 1.00 / 0.98 / +1.5%
fineweb_q01/duckdb:vortex-compact 413792678 / 531893524 / -22.2% 705804421 / 614197208 / +14.9% 0.59 / 0.87 / -32.3%
fineweb_q02/duckdb:vortex-compact 627637057 / 617816740 / +1.6% 593266397 / 908970291 / -34.7% 🟢 1.06 / 0.68 / +55.6%
fineweb_q03/duckdb:vortex-compact 1176421930 / 1148521014 / +2.4% 1233557996 / 1338121564 / -7.8% 0.95 / 0.86 / +11.1%
fineweb_q04/duckdb:vortex-compact 1055380930 / 1134202622 / -6.9% 1193400945 / 1093098554 / +9.2% 0.88 / 1.04 / -14.8%
fineweb_q05/duckdb:vortex-compact 882716174 / 935366982 / -5.6% 987833341 / 1084590413 / -8.9% 0.89 / 0.86 / +3.6%
fineweb_q06/duckdb:vortex-compact 1114205171 / 1278034878 / -12.8% 1164234552 / 1147436297 / +1.5% 0.96 / 1.11 / -14.1%
fineweb_q07/duckdb:vortex-compact 1029391496 / 1140867344 / -9.8% 996865326 / 984740420 / +1.2% 1.03 / 1.16 / -10.9%
fineweb_q08/duckdb:vortex-compact 375661628 / 501803414 / -25.1% 414305369 / 519390508 / -20.2% 0.91 / 0.97 / -6.1%
duckdb / parquet / ns (0.938x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 520287065 / 619545363 / -16.0% 577983614 / 616791479 / -6.3% 0.90 / 1.00 / -10.4%
fineweb_q01/duckdb:parquet 829220130 / 639596864 / +29.6% 608008284 / 630664608 / -3.6% 1.36 / 1.01 / +34.5%
fineweb_q02/duckdb:parquet 628895383 / 660891769 / -4.8% 738794859 / 709059260 / +4.2% 0.85 / 0.93 / -8.7%
fineweb_q03/duckdb:parquet 1495354068 / 1580802134 / -5.4% 1469944483 / 1634865389 / -10.1% 1.02 / 0.97 / +5.2%
fineweb_q04/duckdb:parquet 859552882 / 946684437 / -9.2% 910004728 / 874433601 / +4.1% 0.94 / 1.08 / -12.8%
fineweb_q05/duckdb:parquet 913450192 / 948513874 / -3.7% 937635933 / 1045149042 / -10.3% 0.97 / 0.91 / +7.3%
fineweb_q06/duckdb:parquet 1835522524 / 1848772744 / -0.7% 1816619801 / 1917568713 / -5.3% 1.01 / 0.96 / +4.8%
fineweb_q07/duckdb:parquet 1203107888 / 1450353696 / -17.0% 1323574631 / 1414620251 / -6.4% 0.91 / 1.03 / -11.3%
fineweb_q08/duckdb:parquet 550337122 / 693467226 / -20.6% 593973823 / 646218987 / -8.1% 0.93 / 1.07 / -13.7%

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 9c23a32b vs base 85e7acfa
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.006x ➖
Parquet (geomean): hot 1.005x ➖ · cold 0.997x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 53300364 / 52121711 / +2.3% 73339145 / 71908816 / +2.0% 0.73 / 0.72 / +0.3%
appian_q02/datafusion:vortex-compact 236168043 / 234499303 / +0.7% 266763072 / 266718429 / +0.0% 0.89 / 0.88 / +0.7%
appian_q03/datafusion:vortex-compact 146799979 / 147329372 / -0.4% 182546549 / 187040886 / -2.4% 0.80 / 0.79 / +2.1%
appian_q04/datafusion:vortex-compact 9899732441 / 9940533465 / -0.4% 9778051194 / 9837335796 / -0.6% 1.01 / 1.01 / +0.2%
appian_q05/datafusion:vortex-compact 137464407 / 135760127 / +1.3% 162267228 / 165733428 / -2.1% 0.85 / 0.82 / +3.4%
appian_q06/datafusion:vortex-compact 143374193 / 142043099 / +0.9% 164100064 / 164392282 / -0.2% 0.87 / 0.86 / +1.1%
appian_q07/datafusion:vortex-compact 164587030 / 166214215 / -1.0% 196115730 / 194745291 / +0.7% 0.84 / 0.85 / -1.7%
appian_q08/datafusion:vortex-compact 554999510 / 558345051 / -0.6% 578869581 / 589733546 / -1.8% 0.96 / 0.95 / +1.3%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 73060378 / 72979674 / +0.1% 92571516 / 93477568 / -1.0% 0.79 / 0.78 / +1.1%
appian_q02/datafusion:parquet 304619637 / 306971038 / -0.8% 345393405 / 334793395 / +3.2% 0.88 / 0.92 / -3.8%
appian_q03/datafusion:parquet 188932253 / 190640136 / -0.9% 226748104 / 225566311 / +0.5% 0.83 / 0.85 / -1.4%
appian_q04/datafusion:parquet 9931346241 / 9950252751 / -0.2% 9917471896 / 9782683729 / +1.4% 1.00 / 1.02 / -1.5%
appian_q05/datafusion:parquet 198504802 / 199068995 / -0.3% 223805943 / 223851055 / -0.0% 0.89 / 0.89 / -0.3%
appian_q06/datafusion:parquet 171026255 / 167785319 / +1.9% 201464277 / 191532265 / +5.2% 0.85 / 0.88 / -3.1%
appian_q07/datafusion:parquet 211383685 / 209529926 / +0.9% 238915884 / 242990537 / -1.7% 0.88 / 0.86 / +2.6%
appian_q08/datafusion:parquet 671911995 / 671839797 / +0.0% 688039094 / 682607118 / +0.8% 0.98 / 0.98 / -0.8%
duckdb / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 91058257 / 90613521 / +0.5% 107609936 / 108796293 / -1.1% 0.85 / 0.83 / +1.6%
appian_q02/duckdb:vortex-compact 215375092 / 210327970 / +2.4% 230200076 / 233303536 / -1.3% 0.94 / 0.90 / +3.8%
appian_q03/duckdb:vortex-compact 122264360 / 122792366 / -0.4% 137907699 / 137667552 / +0.2% 0.89 / 0.89 / -0.6%
appian_q04/duckdb:vortex-compact 564165472 / 573706722 / -1.7% 621181422 / 585928163 / +6.0% 0.91 / 0.98 / -7.2%
appian_q05/duckdb:vortex-compact 135048395 / 133481049 / +1.2% 162258882 / 153947253 / +5.4% 0.83 / 0.87 / -4.0%
appian_q06/duckdb:vortex-compact 396304006 / 399845639 / -0.9% 444447906 / 394560788 / +12.6% 🔴 0.89 / 1.01 / -12.0%
appian_q07/duckdb:vortex-compact 136762228 / 139011694 / -1.6% 156847166 / 162515764 / -3.5% 0.87 / 0.86 / +1.9%
appian_q08/duckdb:vortex-compact 433805283 / 428934882 / +1.1% 449400803 / 464311219 / -3.2% 0.97 / 0.92 / +4.5%
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 98746575 / 99162258 / -0.4% 107515381 / 119610982 / -10.1% 🟢 0.92 / 0.83 / +10.8%
appian_q02/duckdb:parquet 195869392 / 199254078 / -1.7% 199414961 / 201697083 / -1.1% 0.98 / 0.99 / -0.6%
appian_q03/duckdb:parquet 123628815 / 123703702 / -0.1% 136489832 / 132765476 / +2.8% 0.91 / 0.93 / -2.8%
appian_q04/duckdb:parquet 446072982 / 451787056 / -1.3% 447853984 / 450776752 / -0.6% 1.00 / 1.00 / -0.6%
appian_q05/duckdb:parquet 143431641 / 145342688 / -1.3% 161581099 / 157554585 / +2.6% 0.89 / 0.92 / -3.8%
appian_q06/duckdb:parquet 272833188 / 255709143 / +6.7% 273323825 / 286253036 / -4.5% 1.00 / 0.89 / +11.7%
appian_q07/duckdb:parquet 154161869 / 154115358 / +0.0% 176399115 / 172003758 / +2.6% 0.87 / 0.90 / -2.5%
appian_q08/duckdb:parquet 380998127 / 360905784 / +5.6% 369079015 / 381277476 / -3.2% 1.03 / 0.95 / +9.1%

File Size Changes (5 files changed, -0.0% overall, 2↑ 3↓)
File Scale Format Base HEAD Change %
categoryview.vortex 1.0 vortex-compact 16.98 KB 17.03 KB +48 B +0.3%
orderview.vortex 1.0 vortex-compact 31.01 MB 31.01 MB +176 B +0.0%
creditcardview.vortex 1.0 vortex-compact 32.19 MB 32.19 MB 16 B -0.0%
addressview.vortex 1.0 vortex-compact 24.50 MB 24.46 MB 48.24 KB -0.2%
productview.vortex 1.0 vortex-compact 15.99 KB 15.96 KB 32 B -0.2%

Totals:

  • vortex-compact: 271.86 MB → 271.81 MB (-0.0%)

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 9c23a32b vs base 85e7acfa
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1201610 / 1245820 / -3.5% 19739342 / 21130324 / -6.6% 0.06 / 0.06 / +3.2%
clickbench_q01/datafusion:vortex-file-compressed 5987731 / 5805440 / +3.1% 30327866 / 34486622 / -12.1% 🟢 0.20 / 0.17 / +17.3%
clickbench_q02/datafusion:vortex-file-compressed 10021418 / 10764510 / -6.9% 34110365 / 41326561 / -17.5% 🟢 0.29 / 0.26 / +12.8%
clickbench_q03/datafusion:vortex-file-compressed 11467084 / 11445126 / +0.2% 51456102 / 51764096 / -0.6% 0.22 / 0.22 / +0.8%
clickbench_q04/datafusion:vortex-file-compressed 56055600 / 55629730 / +0.8% 92668713 / 89553913 / +3.5% 0.60 / 0.62 / -2.6%
clickbench_q05/datafusion:vortex-file-compressed 74435998 / 76934703 / -3.2% 116650176 / 119084100 / -2.0% 0.64 / 0.65 / -1.2%
clickbench_q06/datafusion:vortex-file-compressed 1247838 / 1212323 / +2.9% 19373109 / 20243688 / -4.3% 0.06 / 0.06 / +7.6%
clickbench_q07/datafusion:vortex-file-compressed 9022198 / 9014596 / +0.1% 33170996 / 33718882 / -1.6% 0.27 / 0.27 / +1.7%
clickbench_q08/datafusion:vortex-file-compressed 76231175 / 76901370 / -0.9% 116844389 / 117813504 / -0.8% 0.65 / 0.65 / -0.0%
clickbench_q09/datafusion:vortex-file-compressed 169462665 / 170443200 / -0.6% 202186393 / 209632694 / -3.6% 0.84 / 0.81 / +3.1%
clickbench_q10/datafusion:vortex-file-compressed 23820194 / 23047841 / +3.4% 63367771 / 67248426 / -5.8% 0.38 / 0.34 / +9.7%
clickbench_q11/datafusion:vortex-file-compressed 26375140 / 25851192 / +2.0% 64953223 / 66244844 / -1.9% 0.41 / 0.39 / +4.1%
clickbench_q12/datafusion:vortex-file-compressed 72632948 / 73876460 / -1.7% 111449155 / 114809263 / -2.9% 0.65 / 0.64 / +1.3%
clickbench_q13/datafusion:vortex-file-compressed 120193173 / 120466651 / -0.2% 180887471 / 179530717 / +0.8% 0.66 / 0.67 / -1.0%
clickbench_q14/datafusion:vortex-file-compressed 75494248 / 74291697 / +1.6% 116996867 / 118370123 / -1.2% 0.65 / 0.63 / +2.8%
clickbench_q15/datafusion:vortex-file-compressed 62661026 / 62008066 / +1.1% 91870450 / 94859377 / -3.2% 0.68 / 0.65 / +4.3%
clickbench_q16/datafusion:vortex-file-compressed 148840978 / 150577589 / -1.2% 206978665 / 205550083 / +0.7% 0.72 / 0.73 / -1.8%
clickbench_q17/datafusion:vortex-file-compressed 148516114 / 152986253 / -2.9% 211104602 / 209416228 / +0.8% 0.70 / 0.73 / -3.7%
clickbench_q18/datafusion:vortex-file-compressed 293231036 / 293581438 / -0.1% 375235444 / 368123673 / +1.9% 0.78 / 0.80 / -2.0%
clickbench_q19/datafusion:vortex-file-compressed 7520463 / 7928484 / -5.1% 46206207 / 45947148 / +0.6% 0.16 / 0.17 / -5.7%
clickbench_q20/datafusion:vortex-file-compressed 62084038 / 63541226 / -2.3% 229298116 / 226610868 / +1.2% 0.27 / 0.28 / -3.4%
clickbench_q21/datafusion:vortex-file-compressed 91375259 / 90664266 / +0.8% 272842580 / 269762492 / +1.1% 0.33 / 0.34 / -0.4%
clickbench_q22/datafusion:vortex-file-compressed 101389538 / 99782560 / +1.6% 347293192 / 344240572 / +0.9% 0.29 / 0.29 / +0.7%
clickbench_q23/datafusion:vortex-file-compressed 186281500 / 197569418 / -5.7% 502617554 / 506204671 / -0.7% 0.37 / 0.39 / -5.0%
clickbench_q24/datafusion:vortex-file-compressed 15871180 / 15335112 / +3.5% 63091996 / 63469290 / -0.6% 0.25 / 0.24 / +4.1%
clickbench_q25/datafusion:vortex-file-compressed 17684085 / 17422104 / +1.5% 54173317 / 54890297 / -1.3% 0.33 / 0.32 / +2.8%
clickbench_q26/datafusion:vortex-file-compressed 16498576 / 16422887 / +0.5% 63010466 / 63029770 / -0.0% 0.26 / 0.26 / +0.5%
clickbench_q27/datafusion:vortex-file-compressed 98590604 / 101159696 / -2.5% 241199233 / 242127304 / -0.4% 0.41 / 0.42 / -2.2%
clickbench_q28/datafusion:vortex-file-compressed 562445904 / 565016673 / -0.5% 619172843 / 619730469 / -0.1% 0.91 / 0.91 / -0.4%
clickbench_q29/datafusion:vortex-file-compressed 23182512 / 23026138 / +0.7% 48092550 / 49403614 / -2.7% 0.48 / 0.47 / +3.4%
clickbench_q30/datafusion:vortex-file-compressed 57561780 / 60052312 / -4.1% 102793021 / 102755716 / +0.0% 0.56 / 0.58 / -4.2%
clickbench_q31/datafusion:vortex-file-compressed 71907325 / 69890924 / +2.9% 147786365 / 148507000 / -0.5% 0.49 / 0.47 / +3.4%
clickbench_q32/datafusion:vortex-file-compressed 301503779 / 300785388 / +0.2% 378390025 / 374924886 / +0.9% 0.80 / 0.80 / -0.7%
clickbench_q33/datafusion:vortex-file-compressed 330842080 / 331579362 / -0.2% 438847611 / 451761141 / -2.9% 0.75 / 0.73 / +2.7%
clickbench_q34/datafusion:vortex-file-compressed 335757438 / 333847166 / +0.6% 427268202 / 437481601 / -2.3% 0.79 / 0.76 / +3.0%
clickbench_q35/datafusion:vortex-file-compressed 56154496 / 54727516 / +2.6% 86515025 / 89289069 / -3.1% 0.65 / 0.61 / +5.9%
clickbench_q36/datafusion:vortex-file-compressed 37315290 / 37180273 / +0.4% 63639252 / 65357756 / -2.6% 0.59 / 0.57 / +3.1%
clickbench_q37/datafusion:vortex-file-compressed 21951508 / 21654351 / +1.4% 45942635 / 48064989 / -4.4% 0.48 / 0.45 / +6.1%
clickbench_q38/datafusion:vortex-file-compressed 11567490 / 11785876 / -1.9% 37875707 / 39054556 / -3.0% 0.31 / 0.30 / +1.2%
clickbench_q39/datafusion:vortex-file-compressed 77484277 / 77906114 / -0.5% 107835957 / 109946667 / -1.9% 0.72 / 0.71 / +1.4%
clickbench_q40/datafusion:vortex-file-compressed 11273280 / 11035370 / +2.2% 34282745 / 35677243 / -3.9% 0.33 / 0.31 / +6.3%
clickbench_q41/datafusion:vortex-file-compressed 10652548 / 10382458 / +2.6% 34619492 / 34852496 / -0.7% 0.31 / 0.30 / +3.3%
clickbench_q42/datafusion:vortex-file-compressed 11114647 / 11124660 / -0.1% 34329538 / 35144873 / -2.3% 0.32 / 0.32 / +2.3%
datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1229840 / 1237446 / -0.6% 18597040 / 20764967 / -10.4% 🟢 0.07 / 0.06 / +11.0%
clickbench_q01/datafusion:vortex-compact 6580414 / 6539844 / +0.6% 29701158 / 33784848 / -12.1% 🟢 0.22 / 0.19 / +14.5%
clickbench_q02/datafusion:vortex-compact 12163083 / 12430528 / -2.2% 35640561 / 35848227 / -0.6% 0.34 / 0.35 / -1.6%
clickbench_q03/datafusion:vortex-compact 11679294 / 11350288 / +2.9% 37462378 / 37065280 / +1.1% 0.31 / 0.31 / +1.8%
clickbench_q04/datafusion:vortex-compact 55619700 / 55463428 / +0.3% 89061574 / 89653163 / -0.7% 0.62 / 0.62 / +0.9%
clickbench_q05/datafusion:vortex-compact 80501763 / 81010106 / -0.6% 114597090 / 118553868 / -3.3% 0.70 / 0.68 / +2.8%
clickbench_q06/datafusion:vortex-compact 1241669 / 1209626 / +2.6% 18939428 / 20344679 / -6.9% 0.07 / 0.06 / +10.3%
clickbench_q07/datafusion:vortex-compact 10282748 / 10203156 / +0.8% 34126339 / 33321647 / +2.4% 0.30 / 0.31 / -1.6%
clickbench_q08/datafusion:vortex-compact 76387653 / 79164623 / -3.5% 108512763 / 111484731 / -2.7% 0.70 / 0.71 / -0.9%
clickbench_q09/datafusion:vortex-compact 174707444 / 172193100 / +1.5% 201602892 / 206720118 / -2.5% 0.87 / 0.83 / +4.0%
clickbench_q10/datafusion:vortex-compact 27025266 / 27380582 / -1.3% 56136712 / 56256935 / -0.2% 0.48 / 0.49 / -1.1%
clickbench_q11/datafusion:vortex-compact 32673553 / 31038510 / +5.3% 60265376 / 58870845 / +2.4% 0.54 / 0.53 / +2.8%
clickbench_q12/datafusion:vortex-compact 79392736 / 77433006 / +2.5% 119624121 / 121477552 / -1.5% 0.66 / 0.64 / +4.1%
clickbench_q13/datafusion:vortex-compact 126683678 / 129070570 / -1.8% 174756840 / 175241412 / -0.3% 0.72 / 0.74 / -1.6%
clickbench_q14/datafusion:vortex-compact 85567571 / 82366238 / +3.9% 122848809 / 121228041 / +1.3% 0.70 / 0.68 / +2.5%
clickbench_q15/datafusion:vortex-compact 61419872 / 62159630 / -1.2% 91689364 / 91073925 / +0.7% 0.67 / 0.68 / -1.9%
clickbench_q16/datafusion:vortex-compact 159317887 / 161821522 / -1.5% 212953677 / 209380057 / +1.7% 0.75 / 0.77 / -3.2%
clickbench_q17/datafusion:vortex-compact 154313450 / 158598814 / -2.7% 209370553 / 205324261 / +2.0% 0.74 / 0.77 / -4.6%
clickbench_q18/datafusion:vortex-compact 309665624 / 303837251 / +1.9% 369371367 / 364255203 / +1.4% 0.84 / 0.83 / +0.5%
clickbench_q19/datafusion:vortex-compact 8483690 / 8298236 / +2.2% 37928946 / 37258082 / +1.8% 0.22 / 0.22 / +0.4%
clickbench_q20/datafusion:vortex-compact 71277356 / 69945590 / +1.9% 188182125 / 192141188 / -2.1% 0.38 / 0.36 / +4.0%
clickbench_q21/datafusion:vortex-compact 101135426 / 99185816 / +2.0% 226480121 / 226841096 / -0.2% 0.45 / 0.44 / +2.1%
clickbench_q22/datafusion:vortex-compact 143681805 / 144183996 / -0.3% 266331837 / 268115376 / -0.7% 0.54 / 0.54 / +0.3%
clickbench_q23/datafusion:vortex-compact 266166920 / 272555273 / -2.3% 398324018 / 399143941 / -0.2% 0.67 / 0.68 / -2.1%
clickbench_q24/datafusion:vortex-compact 22322860 / 21784689 / +2.5% 52527239 / 57295953 / -8.3% 0.42 / 0.38 / +11.8%
clickbench_q25/datafusion:vortex-compact 26492054 / 26179126 / +1.2% 55405924 / 56659746 / -2.2% 0.48 / 0.46 / +3.5%
clickbench_q26/datafusion:vortex-compact 21855029 / 22729801 / -3.8% 51871811 / 53191864 / -2.5% 0.42 / 0.43 / -1.4%
clickbench_q27/datafusion:vortex-compact 102360084 / 102037618 / +0.3% 212378927 / 208013159 / +2.1% 0.48 / 0.49 / -1.7%
clickbench_q28/datafusion:vortex-compact 576883672 / 572982864 / +0.7% 631455718 / 618571628 / +2.1% 0.91 / 0.93 / -1.4%
clickbench_q29/datafusion:vortex-compact 24363028 / 24763738 / -1.6% 49948636 / 51020003 / -2.1% 0.49 / 0.49 / +0.5%
clickbench_q30/datafusion:vortex-compact 72804054 / 76289231 / -4.6% 108575133 / 114330872 / -5.0% 0.67 / 0.67 / +0.5%
clickbench_q31/datafusion:vortex-compact 84470174 / 84136164 / +0.4% 145632278 / 145846085 / -0.1% 0.58 / 0.58 / +0.5%
clickbench_q32/datafusion:vortex-compact 298863174 / 297996700 / +0.3% 372690494 / 382962369 / -2.7% 0.80 / 0.78 / +3.1%
clickbench_q33/datafusion:vortex-compact 338892742 / 341204616 / -0.7% 434139008 / 418461346 / +3.7% 0.78 / 0.82 / -4.3%
clickbench_q34/datafusion:vortex-compact 341395981 / 337721971 / +1.1% 424339678 / 415302973 / +2.2% 0.80 / 0.81 / -1.1%
clickbench_q35/datafusion:vortex-compact 56341910 / 60371272 / -6.7% 85785150 / 86960978 / -1.4% 0.66 / 0.69 / -5.4%
clickbench_q36/datafusion:vortex-compact 38524812 / 38711250 / -0.5% 64194837 / 66356099 / -3.3% 0.60 / 0.58 / +2.9%
clickbench_q37/datafusion:vortex-compact 22323600 / 22752704 / -1.9% 46326700 / 47598597 / -2.7% 0.48 / 0.48 / +0.8%
clickbench_q38/datafusion:vortex-compact 12895626 / 13356838 / -3.5% 38519111 / 40091175 / -3.9% 0.33 / 0.33 / +0.5%
clickbench_q39/datafusion:vortex-compact 78470074 / 78912281 / -0.6% 108851264 / 109666505 / -0.7% 0.72 / 0.72 / +0.2%
clickbench_q40/datafusion:vortex-compact 12425653 / 12478873 / -0.4% 34813764 / 36257631 / -4.0% 0.36 / 0.34 / +3.7%
clickbench_q41/datafusion:vortex-compact 11816474 / 11684832 / +1.1% 33384593 / 34086340 / -2.1% 0.35 / 0.34 / +3.3%
clickbench_q42/datafusion:vortex-compact 11118538 / 11206975 / -0.8% 33130725 / 34883722 / -5.0% 0.34 / 0.32 / +4.5%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1261028 / 1245732 / +1.2% 47779034 / 49851163 / -4.2% 0.03 / 0.02 / +5.6%
clickbench_q01/datafusion:parquet 15767196 / 16083384 / -2.0% 67522452 / 74954364 / -9.9% 0.23 / 0.21 / +8.8%
clickbench_q02/datafusion:parquet 19029089 / 18841183 / +1.0% 82834654 / 83469757 / -0.8% 0.23 / 0.23 / +1.8%
clickbench_q03/datafusion:parquet 17182016 / 17131430 / +0.3% 78749162 / 82442221 / -4.5% 0.22 / 0.21 / +5.0%
clickbench_q04/datafusion:parquet 63523486 / 62820002 / +1.1% 123596942 / 124811648 / -1.0% 0.51 / 0.50 / +2.1%
clickbench_q05/datafusion:parquet 88951898 / 88706940 / +0.3% 161533154 / 157942874 / +2.3% 0.55 / 0.56 / -2.0%
clickbench_q06/datafusion:parquet 1274533 / 1249356 / +2.0% 47987662 / 49574979 / -3.2% 0.03 / 0.03 / +5.4%
clickbench_q07/datafusion:parquet 16628098 / 16729829 / -0.6% 67344000 / 69609363 / -3.3% 0.25 / 0.24 / +2.7%
clickbench_q08/datafusion:parquet 86374285 / 86632988 / -0.3% 156236496 / 162735963 / -4.0% 0.55 / 0.53 / +3.8%
clickbench_q09/datafusion:parquet 186626659 / 187993242 / -0.7% 263251345 / 270652603 / -2.7% 0.71 / 0.69 / +2.1%
clickbench_q10/datafusion:parquet 36895144 / 36648352 / +0.7% 96755419 / 100859449 / -4.1% 0.38 / 0.36 / +4.9%
clickbench_q11/datafusion:parquet 43650320 / 44273151 / -1.4% 107867475 / 110640133 / -2.5% 0.40 / 0.40 / +1.1%
clickbench_q12/datafusion:parquet 96187433 / 95950970 / +0.2% 159390318 / 165522806 / -3.7% 0.60 / 0.58 / +4.1%
clickbench_q13/datafusion:parquet 147561340 / 148251941 / -0.5% 221188590 / 231679796 / -4.5% 0.67 / 0.64 / +4.3%
clickbench_q14/datafusion:parquet 101352418 / 101630320 / -0.3% 170210066 / 171227605 / -0.6% 0.60 / 0.59 / +0.3%
clickbench_q15/datafusion:parquet 71218586 / 72548374 / -1.8% 131296642 / 137128035 / -4.3% 0.54 / 0.53 / +2.5%
clickbench_q16/datafusion:parquet 156521520 / 158000494 / -0.9% 233274765 / 233202203 / +0.0% 0.67 / 0.68 / -1.0%
clickbench_q17/datafusion:parquet 157713332 / 158100721 / -0.2% 236675083 / 238361115 / -0.7% 0.67 / 0.66 / +0.5%
clickbench_q18/datafusion:parquet 315057754 / 313948858 / +0.4% 421244138 / 425443888 / -1.0% 0.75 / 0.74 / +1.4%
clickbench_q19/datafusion:parquet 18189056 / 18609676 / -2.3% 69768885 / 75491708 / -7.6% 0.26 / 0.25 / +5.8%
clickbench_q20/datafusion:parquet 178293806 / 179389378 / -0.6% 276501852 / 278432559 / -0.7% 0.64 / 0.64 / +0.1%
clickbench_q21/datafusion:parquet 173268530 / 173973791 / -0.4% 290449474 / 293026313 / -0.9% 0.60 / 0.59 / +0.5%
clickbench_q22/datafusion:parquet 263484516 / 262392024 / +0.4% 412206553 / 414259996 / -0.5% 0.64 / 0.63 / +0.9%
clickbench_q23/datafusion:parquet 1168754534 / 1204008827 / -2.9% 1219291225 / 1245331561 / -2.1% 0.96 / 0.97 / -0.9%
clickbench_q24/datafusion:parquet 30145846 / 30383935 / -0.8% 86505490 / 87955802 / -1.6% 0.35 / 0.35 / +0.9%
clickbench_q25/datafusion:parquet 37358582 / 37114206 / +0.7% 100445442 / 99599557 / +0.8% 0.37 / 0.37 / -0.2%
clickbench_q26/datafusion:parquet 31031028 / 30433270 / +2.0% 87703457 / 87121434 / +0.7% 0.35 / 0.35 / +1.3%
clickbench_q27/datafusion:parquet 194012490 / 193964770 / +0.0% 282893520 / 287664910 / -1.7% 0.69 / 0.67 / +1.7%
clickbench_q28/datafusion:parquet 623085802 / 622398580 / +0.1% 706719965 / 705280574 / +0.2% 0.88 / 0.88 / -0.1%
clickbench_q29/datafusion:parquet 28916590 / 29401145 / -1.6% 91874114 / 93579493 / -1.8% 0.31 / 0.31 / +0.2%
clickbench_q30/datafusion:parquet 90827166 / 92077631 / -1.4% 167711078 / 167123812 / +0.4% 0.54 / 0.55 / -1.7%
clickbench_q31/datafusion:parquet 104309706 / 103352188 / +0.9% 189734487 / 192052340 / -1.2% 0.55 / 0.54 / +2.2%
clickbench_q32/datafusion:parquet 325094122 / 326200472 / -0.3% 433269919 / 423064533 / +2.4% 0.75 / 0.77 / -2.7%
clickbench_q33/datafusion:parquet 386465762 / 381498998 / +1.3% 475845304 / 475950539 / -0.0% 0.81 / 0.80 / +1.3%
clickbench_q34/datafusion:parquet 386000630 / 383036374 / +0.8% 474769136 / 472533427 / +0.5% 0.81 / 0.81 / +0.3%
clickbench_q35/datafusion:parquet 65631250 / 64681400 / +1.5% 123636986 / 128960547 / -4.1% 0.53 / 0.50 / +5.8%
clickbench_q36/datafusion:parquet 73149562 / 73784310 / -0.9% 132927591 / 134199321 / -0.9% 0.55 / 0.55 / +0.1%
clickbench_q37/datafusion:parquet 35424542 / 35494924 / -0.2% 90039067 / 92082541 / -2.2% 0.39 / 0.39 / +2.1%
clickbench_q38/datafusion:parquet 47750312 / 47649785 / +0.2% 104075603 / 106607154 / -2.4% 0.46 / 0.45 / +2.6%
clickbench_q39/datafusion:parquet 144511173 / 143554840 / +0.7% 206002861 / 208785297 / -1.3% 0.70 / 0.69 / +2.0%
clickbench_q40/datafusion:parquet 20051906 / 19812773 / +1.2% 75524024 / 76161666 / -0.8% 0.27 / 0.26 / +2.1%
clickbench_q41/datafusion:parquet 19025072 / 19086885 / -0.3% 74544887 / 75858632 / -1.7% 0.26 / 0.25 / +1.4%
clickbench_q42/datafusion:parquet 19222685 / 19519842 / -1.5% 74263923 / 74563901 / -0.4% 0.26 / 0.26 / -1.1%
duckdb / vortex-file-compressed / ns (1.014x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1768600 / 1630580 / +8.5% 27574978 / 24126248 / +14.3% 🔴 0.06 / 0.07 / -5.1%
clickbench_q01/duckdb:vortex-file-compressed 13602456 / 14417472 / -5.7% 29034247 / 28267638 / +2.7% 0.47 / 0.51 / -8.1%
clickbench_q02/duckdb:vortex-file-compressed 13064801 / 15478276 / -15.6% 🟢 33940601 / 34107629 / -0.5% 0.38 / 0.45 / -15.2%
clickbench_q03/duckdb:vortex-file-compressed 17100417 / 17987086 / -4.9% 44793358 / 45163834 / -0.8% 0.38 / 0.40 / -4.1%
clickbench_q04/duckdb:vortex-file-compressed 69075040 / 67514702 / +2.3% 96834402 / 111895243 / -13.5% 🟢 0.71 / 0.60 / +18.2%
clickbench_q05/duckdb:vortex-file-compressed 69307501 / 67953223 / +2.0% 95185715 / 91489492 / +4.0% 0.73 / 0.74 / -2.0%
clickbench_q06/duckdb:vortex-file-compressed 1984995 / 1823501 / +8.9% 30721243 / 29339918 / +4.7% 0.06 / 0.06 / +4.0%
clickbench_q07/duckdb:vortex-file-compressed 16573892 / 13626988 / +21.6% 🔴 35749514 / 36433575 / -1.9% 0.46 / 0.37 / +24.0%
clickbench_q08/duckdb:vortex-file-compressed 83498666 / 83384910 / +0.1% 121439332 / 122999561 / -1.3% 0.69 / 0.68 / +1.4%
clickbench_q09/duckdb:vortex-file-compressed 116481120 / 107604964 / +8.2% 165265407 / 145015695 / +14.0% 🔴 0.70 / 0.74 / -5.0%
clickbench_q10/duckdb:vortex-file-compressed 33889591 / 32598078 / +4.0% 65550634 / 65608972 / -0.1% 0.52 / 0.50 / +4.1%
clickbench_q11/duckdb:vortex-file-compressed 35710904 / 34261490 / +4.2% 68825414 / 66853897 / +2.9% 0.52 / 0.51 / +1.2%
clickbench_q12/duckdb:vortex-file-compressed 75432544 / 75429574 / +0.0% 111492253 / 105949399 / +5.2% 0.68 / 0.71 / -5.0%
clickbench_q13/duckdb:vortex-file-compressed 138601295 / 134335075 / +3.2% 175751207 / 185694658 / -5.4% 0.79 / 0.72 / +9.0%
clickbench_q14/duckdb:vortex-file-compressed 77530556 / 80242602 / -3.4% 108219381 / 110837309 / -2.4% 0.72 / 0.72 / -1.0%
clickbench_q15/duckdb:vortex-file-compressed 92817732 / 92255434 / +0.6% 130357762 / 129579717 / +0.6% 0.71 / 0.71 / +0.0%
clickbench_q16/duckdb:vortex-file-compressed 161012275 / 162693558 / -1.0% 205957021 / 204318958 / +0.8% 0.78 / 0.80 / -1.8%
clickbench_q17/duckdb:vortex-file-compressed 163132034 / 173977501 / -6.2% 210052195 / 210063397 / -0.0% 0.78 / 0.83 / -6.2%
clickbench_q18/duckdb:vortex-file-compressed 319154996 / 328007964 / -2.7% 375584853 / 393871992 / -4.6% 0.85 / 0.83 / +2.0%
clickbench_q19/duckdb:vortex-file-compressed 16443725 / 19184188 / -14.3% 🟢 39906616 / 37025088 / +7.8% 0.41 / 0.52 / -20.5%
clickbench_q20/duckdb:vortex-file-compressed 108527714 / 109187572 / -0.6% 189613039 / 179069597 / +5.9% 0.57 / 0.61 / -6.1%
clickbench_q21/duckdb:vortex-file-compressed 156139935 / 155101610 / +0.7% 288066518 / 284058591 / +1.4% 0.54 / 0.55 / -0.7%
clickbench_q22/duckdb:vortex-file-compressed 237221256 / 233659628 / +1.5% 426887170 / 435935674 / -2.1% 0.56 / 0.54 / +3.7%
clickbench_q23/duckdb:vortex-file-compressed 58288214 / 62277791 / -6.4% 98288835 / 98900201 / -0.6% 0.59 / 0.63 / -5.8%
clickbench_q24/duckdb:vortex-file-compressed 25388526 / 27109427 / -6.3% 43785543 / 45230877 / -3.2% 0.58 / 0.60 / -3.3%
clickbench_q25/duckdb:vortex-file-compressed 32868882 / 30236530 / +8.7% 52479899 / 51134661 / +2.6% 0.63 / 0.59 / +5.9%
clickbench_q26/duckdb:vortex-file-compressed 21494936 / 20635000 / +4.2% 35736622 / 34684951 / +3.0% 0.60 / 0.59 / +1.1%
clickbench_q27/duckdb:vortex-file-compressed 136827676 / 132350098 / +3.4% 235748670 / 233837181 / +0.8% 0.58 / 0.57 / +2.5%
clickbench_q28/duckdb:vortex-file-compressed 794162117 / 599237372 / +32.5% 🔴 679173414 / 668355922 / +1.6% 1.17 / 0.90 / +30.4%
clickbench_q29/duckdb:vortex-file-compressed 19224676 / 17715592 / +8.5% 39174416 / 40834867 / -4.1% 0.49 / 0.43 / +13.1%
clickbench_q30/duckdb:vortex-file-compressed 65805272 / 66547182 / -1.1% 104652704 / 102855901 / +1.7% 0.63 / 0.65 / -2.8%
clickbench_q31/duckdb:vortex-file-compressed 125691125 / 124144200 / +1.2% 196836845 / 203095482 / -3.1% 0.64 / 0.61 / +4.5%
clickbench_q32/duckdb:vortex-file-compressed 445420306 / 437918054 / +1.7% 517552965 / 487170920 / +6.2% 0.86 / 0.90 / -4.3%
clickbench_q33/duckdb:vortex-file-compressed 396761246 / 393949138 / +0.7% 494025765 / 497564495 / -0.7% 0.80 / 0.79 / +1.4%
clickbench_q34/duckdb:vortex-file-compressed 411960995 / 417314936 / -1.3% 521173040 / 507907470 / +2.6% 0.79 / 0.82 / -3.8%
clickbench_q35/duckdb:vortex-file-compressed 103251681 / 101261958 / +2.0% 140319882 / 142243256 / -1.4% 0.74 / 0.71 / +3.4%
clickbench_q36/duckdb:vortex-file-compressed 15905590 / 15742750 / +1.0% 34976961 / 33094053 / +5.7% 0.45 / 0.48 / -4.4%
clickbench_q37/duckdb:vortex-file-compressed 11401666 / 10769852 / +5.9% 27460056 / 28577108 / -3.9% 0.42 / 0.38 / +10.2%
clickbench_q38/duckdb:vortex-file-compressed 13512164 / 12967746 / +4.2% 28903327 / 29297442 / -1.3% 0.47 / 0.44 / +5.6%
clickbench_q39/duckdb:vortex-file-compressed 22610673 / 22611468 / -0.0% 41601945 / 42070523 / -1.1% 0.54 / 0.54 / +1.1%
clickbench_q40/duckdb:vortex-file-compressed 10881777 / 11224378 / -3.1% 28231896 / 29166554 / -3.2% 0.39 / 0.38 / +0.2%
clickbench_q41/duckdb:vortex-file-compressed 12408965 / 11654834 / +6.5% 30762785 / 28119229 / +9.4% 0.40 / 0.41 / -2.7%
clickbench_q42/duckdb:vortex-file-compressed 11150771 / 11291455 / -1.2% 28523755 / 32277003 / -11.6% 🟢 0.39 / 0.35 / +11.7%
duckdb / vortex-compact / ns (1.006x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1779901 / 1517390 / +17.3% 🔴 26622636 / 23329725 / +14.1% 🔴 0.07 / 0.07 / +2.8%
clickbench_q01/duckdb:vortex-compact 12461096 / 13318696 / -6.4% 30902242 / 30933239 / -0.1% 0.40 / 0.43 / -6.3%
clickbench_q02/duckdb:vortex-compact 15570133 / 15453520 / +0.8% 37206269 / 32304897 / +15.2% 🔴 0.42 / 0.48 / -12.5%
clickbench_q03/duckdb:vortex-compact 17977415 / 17335780 / +3.7% 45069712 / 41747777 / +8.0% 0.40 / 0.42 / -3.9%
clickbench_q04/duckdb:vortex-compact 69853423 / 77575434 / -10.0% 99092420 / 102974059 / -3.8% 0.70 / 0.75 / -6.4%
clickbench_q05/duckdb:vortex-compact 73489010 / 74429120 / -1.3% 106073164 / 97191348 / +9.1% 0.69 / 0.77 / -9.5%
clickbench_q06/duckdb:vortex-compact 2001076 / 1839738 / +8.8% 32804050 / 31757385 / +3.3% 0.06 / 0.06 / +5.3%
clickbench_q07/duckdb:vortex-compact 14129705 / 16701740 / -15.4% 🟢 31166386 / 31933207 / -2.4% 0.45 / 0.52 / -13.3%
clickbench_q08/duckdb:vortex-compact 90717311 / 87192163 / +4.0% 128038409 / 122322829 / +4.7% 0.71 / 0.71 / -0.6%
clickbench_q09/duckdb:vortex-compact 122552922 / 120945532 / +1.3% 167906946 / 159588782 / +5.2% 0.73 / 0.76 / -3.7%
clickbench_q10/duckdb:vortex-compact 36548786 / 36795156 / -0.7% 71755360 / 81954411 / -12.4% 🟢 0.51 / 0.45 / +13.4%
clickbench_q11/duckdb:vortex-compact 40459260 / 40918456 / -1.1% 73513727 / 75611681 / -2.8% 0.55 / 0.54 / +1.7%
clickbench_q12/duckdb:vortex-compact 80437357 / 81199765 / -0.9% 116837472 / 115669466 / +1.0% 0.69 / 0.70 / -1.9%
clickbench_q13/duckdb:vortex-compact 155993608 / 154890102 / +0.7% 198515447 / 194837967 / +1.9% 0.79 / 0.79 / -1.2%
clickbench_q14/duckdb:vortex-compact 86904118 / 87127258 / -0.3% 119741812 / 120281786 / -0.4% 0.73 / 0.72 / +0.2%
clickbench_q15/duckdb:vortex-compact 92916650 / 93006572 / -0.1% 135187477 / 145974129 / -7.4% 0.69 / 0.64 / +7.9%
clickbench_q16/duckdb:vortex-compact 171481364 / 186196417 / -7.9% 221103559 / 217192575 / +1.8% 0.78 / 0.86 / -9.5%
clickbench_q17/duckdb:vortex-compact 172471525 / 177077770 / -2.6% 214378544 / 222107220 / -3.5% 0.80 / 0.80 / +0.9%
clickbench_q18/duckdb:vortex-compact 335523982 / 325991418 / +2.9% 417190905 / 376461371 / +10.8% 🔴 0.80 / 0.87 / -7.1%
clickbench_q19/duckdb:vortex-compact 17074486 / 15320180 / +11.5% 🔴 38398826 / 35967259 / +6.8% 0.44 / 0.43 / +4.4%
clickbench_q20/duckdb:vortex-compact 104480818 / 108995038 / -4.1% 164512587 / 177139224 / -7.1% 0.64 / 0.62 / +3.2%
clickbench_q21/duckdb:vortex-compact 161264002 / 160660552 / +0.4% 280970962 / 281565067 / -0.2% 0.57 / 0.57 / +0.6%
clickbench_q22/duckdb:vortex-compact 318866247 / 318823310 / +0.0% 472325270 / 471102407 / +0.3% 0.68 / 0.68 / -0.2%
clickbench_q23/duckdb:vortex-compact 67697238 / 67228370 / +0.7% 97137575 / 95608724 / +1.6% 0.70 / 0.70 / -0.9%
clickbench_q24/duckdb:vortex-compact 29881075 / 28241028 / +5.8% 47235126 / 45900362 / +2.9% 0.63 / 0.62 / +2.8%
clickbench_q25/duckdb:vortex-compact 37677669 / 37629938 / +0.1% 62602181 / 61819587 / +1.3% 0.60 / 0.61 / -1.1%
clickbench_q26/duckdb:vortex-compact 23821806 / 22430941 / +6.2% 39563880 / 43151134 / -8.3% 0.60 / 0.52 / +15.8%
clickbench_q27/duckdb:vortex-compact 188052156 / 187884272 / +0.1% 290584731 / 284761333 / +2.0% 0.65 / 0.66 / -1.9%
clickbench_q28/duckdb:vortex-compact 588521854 / 583793958 / +0.8% 697170366 / 711426662 / -2.0% 0.84 / 0.82 / +2.9%
clickbench_q29/duckdb:vortex-compact 20865166 / 17698716 / +17.9% 🔴 39097634 / 38277053 / +2.1% 0.53 / 0.46 / +15.4%
clickbench_q30/duckdb:vortex-compact 88369010 / 86417869 / +2.3% 125737767 / 122594191 / +2.6% 0.70 / 0.70 / -0.3%
clickbench_q31/duckdb:vortex-compact 148929746 / 150165736 / -0.8% 207353772 / 186240440 / +11.3% 🔴 0.72 / 0.81 / -10.9%
clickbench_q32/duckdb:vortex-compact 466308490 / 459211862 / +1.5% 494304507 / 485798353 / +1.8% 0.94 / 0.95 / -0.2%
clickbench_q33/duckdb:vortex-compact 393600732 / 401595619 / -2.0% 501507669 / 490646774 / +2.2% 0.78 / 0.82 / -4.1%
clickbench_q34/duckdb:vortex-compact 419846084 / 416849058 / +0.7% 517802241 / 529768153 / -2.3% 0.81 / 0.79 / +3.0%
clickbench_q35/duckdb:vortex-compact 103485436 / 101692706 / +1.8% 137067007 / 134479849 / +1.9% 0.75 / 0.76 / -0.2%
clickbench_q36/duckdb:vortex-compact 17125000 / 17141900 / -0.1% 37821296 / 36903134 / +2.5% 0.45 / 0.46 / -2.5%
clickbench_q37/duckdb:vortex-compact 13747977 / 13750440 / -0.0% 32672713 / 29496279 / +10.8% 🔴 0.42 / 0.47 / -9.7%
clickbench_q38/duckdb:vortex-compact 13898803 / 13907278 / -0.1% 30564375 / 33715949 / -9.3% 0.45 / 0.41 / +10.2%
clickbench_q39/duckdb:vortex-compact 24680042 / 27340038 / -9.7% 43714039 / 43648883 / +0.1% 0.56 / 0.63 / -9.9%
clickbench_q40/duckdb:vortex-compact 13387310 / 12411424 / +7.9% 30344072 / 32343295 / -6.2% 0.44 / 0.38 / +15.0%
clickbench_q41/duckdb:vortex-compact 12396672 / 11379377 / +8.9% 30129882 / 29943592 / +0.6% 0.41 / 0.38 / +8.3%
clickbench_q42/duckdb:vortex-compact 11539194 / 12593308 / -8.4% 29301833 / 31550091 / -7.1% 0.39 / 0.40 / -1.3%
duckdb / parquet / ns (1.001x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9821652 / 10095772 / -2.7% 19329357 / 21108242 / -8.4% 0.51 / 0.48 / +6.2%
clickbench_q01/duckdb:parquet 11099720 / 11958398 / -7.2% 18538965 / 21501197 / -13.8% 🟢 0.60 / 0.56 / +7.7%
clickbench_q02/duckdb:parquet 15821041 / 16035212 / -1.3% 31779819 / 30271247 / +5.0% 0.50 / 0.53 / -6.0%
clickbench_q03/duckdb:parquet 16537522 / 15682125 / +5.5% 50775231 / 50278628 / +1.0% 0.33 / 0.31 / +4.4%
clickbench_q04/duckdb:parquet 70174206 / 68778319 / +2.0% 92402983 / 88627538 / +4.3% 0.76 / 0.78 / -2.1%
clickbench_q05/duckdb:parquet 81765118 / 81008764 / +0.9% 121493499 / 114906262 / +5.7% 0.67 / 0.70 / -4.5%
clickbench_q06/duckdb:parquet 15570375 / 17812990 / -12.6% 🟢 27151279 / 28186614 / -3.7% 0.57 / 0.63 / -9.3%
clickbench_q07/duckdb:parquet 11284382 / 11340612 / -0.5% 20854294 / 20266591 / +2.9% 0.54 / 0.56 / -3.3%
clickbench_q08/duckdb:parquet 89583571 / 83363758 / +7.5% 132496580 / 125867108 / +5.3% 0.68 / 0.66 / +2.1%
clickbench_q09/duckdb:parquet 115215972 / 113702502 / +1.3% 159012673 / 152429125 / +4.3% 0.72 / 0.75 / -2.9%
clickbench_q10/duckdb:parquet 33087320 / 32764309 / +1.0% 68012707 / 68494995 / -0.7% 0.49 / 0.48 / +1.7%
clickbench_q11/duckdb:parquet 38379182 / 36902318 / +4.0% 78245895 / 76426130 / +2.4% 0.49 / 0.48 / +1.6%
clickbench_q12/duckdb:parquet 92327553 / 92501513 / -0.2% 128069365 / 129426035 / -1.0% 0.72 / 0.71 / +0.9%
clickbench_q13/duckdb:parquet 148277415 / 150262882 / -1.3% 210400331 / 210472723 / -0.0% 0.70 / 0.71 / -1.3%
clickbench_q14/duckdb:parquet 100280952 / 103753062 / -3.3% 141190328 / 141599070 / -0.3% 0.71 / 0.73 / -3.1%
clickbench_q15/duckdb:parquet 93332507 / 101644542 / -8.2% 134740267 / 124834767 / +7.9% 0.69 / 0.81 / -14.9%
clickbench_q16/duckdb:parquet 171751915 / 174808366 / -1.7% 232551073 / 223116903 / +4.2% 0.74 / 0.78 / -5.7%
clickbench_q17/duckdb:parquet 180321578 / 178569981 / +1.0% 233064279 / 229749012 / +1.4% 0.77 / 0.78 / -0.5%
clickbench_q18/duckdb:parquet 324883940 / 332852218 / -2.4% 404235550 / 400802714 / +0.9% 0.80 / 0.83 / -3.2%
clickbench_q19/duckdb:parquet 13710549 / 13631012 / +0.6% 39842637 / 39875747 / -0.1% 0.34 / 0.34 / +0.7%
clickbench_q20/duckdb:parquet 135370544 / 135004860 / +0.3% 244424430 / 251013325 / -2.6% 0.55 / 0.54 / +3.0%
clickbench_q21/duckdb:parquet 180217070 / 180175188 / +0.0% 322266264 / 310887237 / +3.7% 0.56 / 0.58 / -3.5%
clickbench_q22/duckdb:parquet 241248754 / 243652345 / -1.0% 409752287 / 405936851 / +0.9% 0.59 / 0.60 / -1.9%
clickbench_q23/duckdb:parquet 142044796 / 153637236 / -7.5% 161040912 / 170583563 / -5.6% 0.88 / 0.90 / -2.1%
clickbench_q24/duckdb:parquet 43016160 / 42805930 / +0.5% 59541298 / 59841989 / -0.5% 0.72 / 0.72 / +1.0%
clickbench_q25/duckdb:parquet 39688067 / 40238338 / -1.4% 87327363 / 89646623 / -2.6% 0.45 / 0.45 / +1.3%
clickbench_q26/duckdb:parquet 29369310 / 29266284 / +0.4% 46393178 / 46138198 / +0.6% 0.63 / 0.63 / -0.2%
clickbench_q27/duckdb:parquet 151633686 / 145333585 / +4.3% 259640240 / 263885738 / -1.6% 0.58 / 0.55 / +6.0%
clickbench_q28/duckdb:parquet 902666398 / 899781787 / +0.3% 979490927 / 980433576 / -0.1% 0.92 / 0.92 / +0.4%
clickbench_q29/duckdb:parquet 16707274 / 17410610 / -4.0% 32062680 / 30898730 / +3.8% 0.52 / 0.56 / -7.5%
clickbench_q30/duckdb:parquet 94422363 / 90376604 / +4.5% 179341831 / 173999310 / +3.1% 0.53 / 0.52 / +1.4%
clickbench_q31/duckdb:parquet 147256506 / 145452290 / +1.2% 285060124 / 261484459 / +9.0% 0.52 / 0.56 / -7.1%
clickbench_q32/duckdb:parquet 457839859 / 442374294 / +3.5% 493216190 / 479899201 / +2.8% 0.93 / 0.92 / +0.7%
clickbench_q33/duckdb:parquet 469420948 / 443069368 / +5.9% 477473080 / 483697990 / -1.3% 0.98 / 0.92 / +7.3%
clickbench_q34/duckdb:parquet 448538624 / 471732020 / -4.9% 475718319 / 510714016 / -6.9% 0.94 / 0.92 / +2.1%
clickbench_q35/duckdb:parquet 100936380 / 101009966 / -0.1% 116791167 / 133389327 / -12.4% 🟢 0.86 / 0.76 / +14.1%
clickbench_q36/duckdb:parquet 31296478 / 30893400 / +1.3% 41720843 / 40235134 / +3.7% 0.75 / 0.77 / -2.3%
clickbench_q37/duckdb:parquet 23240796 / 23137240 / +0.4% 31759925 / 32147471 / -1.2% 0.73 / 0.72 / +1.7%
clickbench_q38/duckdb:parquet 24585418 / 24280676 / +1.3% 33745957 / 33094087 / +2.0% 0.73 / 0.73 / -0.7%
clickbench_q39/duckdb:parquet 56869326 / 57397731 / -0.9% 67404119 / 66272952 / +1.7% 0.84 / 0.87 / -2.6%
clickbench_q40/duckdb:parquet 13235484 / 12608598 / +5.0% 23540842 / 22565626 / +4.3% 0.56 / 0.56 / +0.6%
clickbench_q41/duckdb:parquet 14324314 / 12868860 / +11.3% 🔴 25041825 / 22654148 / +10.5% 🔴 0.57 / 0.57 / +0.7%
clickbench_q42/duckdb:parquet 14972865 / 14295917 / +4.7% 24862269 / 25832595 / -3.8% 0.60 / 0.55 / +8.8%

File Size Changes (200 files changed, +0.0% overall, 122↑ 78↓)
File Scale Format Base HEAD Change %
hits_64.vortex 1.0 vortex-compact 53.86 MB 53.87 MB +14.67 KB +0.0%
hits_39.vortex 1.0 vortex-file-compressed 81.95 MB 81.97 MB +15.79 KB +0.0%
hits_99.vortex 1.0 vortex-compact 77.48 MB 77.49 MB +13.71 KB +0.0%
hits_35.vortex 1.0 vortex-file-compressed 119.41 MB 119.43 MB +19.41 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 105.54 MB 105.55 MB +16.68 KB +0.0%
hits_79.vortex 1.0 vortex-file-compressed 148.71 MB 148.73 MB +21.79 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 95.38 MB 95.39 MB +12.81 KB +0.0%
hits_98.vortex 1.0 vortex-file-compressed 121.52 MB 121.54 MB +14.34 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 183.49 MB 183.51 MB +21.59 KB +0.0%
hits_36.vortex 1.0 vortex-file-compressed 70.04 MB 70.05 MB +8.16 KB +0.0%
hits_86.vortex 1.0 vortex-file-compressed 71.04 MB 71.05 MB +8.14 KB +0.0%
hits_4.vortex 1.0 vortex-file-compressed 111.56 MB 111.58 MB +12.62 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 282.34 MB 282.37 MB +31.52 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 142.32 MB 142.34 MB +15.75 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 106.15 MB 106.16 MB +11.55 KB +0.0%
hits_32.vortex 1.0 vortex-file-compressed 68.73 MB 68.74 MB +7.41 KB +0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.92 MB 122.93 MB +13.15 KB +0.0%
hits_44.vortex 1.0 vortex-file-compressed 191.29 MB 191.31 MB +20.41 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 167.46 MB 167.48 MB +17.59 KB +0.0%
hits_26.vortex 1.0 vortex-file-compressed 111.65 MB 111.66 MB +11.65 KB +0.0%
hits_0.vortex 1.0 vortex-file-compressed 91.03 MB 91.04 MB +9.34 KB +0.0%
hits_2.vortex 1.0 vortex-file-compressed 191.98 MB 192.00 MB +19.59 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 143.99 MB 144.01 MB +14.70 KB +0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.43 MB 122.44 MB +12.48 KB +0.0%
hits_79.vortex 1.0 vortex-compact 86.10 MB 86.11 MB +8.72 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 76.47 MB 76.47 MB +7.72 KB +0.0%
hits_75.vortex 1.0 vortex-file-compressed 64.67 MB 64.67 MB +6.51 KB +0.0%
hits_95.vortex 1.0 vortex-file-compressed 100.60 MB 100.61 MB +10.11 KB +0.0%
hits_73.vortex 1.0 vortex-file-compressed 113.33 MB 113.34 MB +11.38 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 126.93 MB 126.94 MB +12.62 KB +0.0%
hits_84.vortex 1.0 vortex-file-compressed 120.84 MB 120.85 MB +11.85 KB +0.0%
hits_97.vortex 1.0 vortex-file-compressed 111.47 MB 111.48 MB +10.91 KB +0.0%
hits_89.vortex 1.0 vortex-file-compressed 188.24 MB 188.26 MB +18.38 KB +0.0%
hits_65.vortex 1.0 vortex-file-compressed 185.89 MB 185.91 MB +18.12 KB +0.0%
hits_28.vortex 1.0 vortex-file-compressed 120.48 MB 120.49 MB +11.72 KB +0.0%
hits_64.vortex 1.0 vortex-file-compressed 83.41 MB 83.42 MB +8.11 KB +0.0%
hits_67.vortex 1.0 vortex-file-compressed 188.26 MB 188.28 MB +18.23 KB +0.0%
hits_25.vortex 1.0 vortex-file-compressed 117.27 MB 117.28 MB +11.25 KB +0.0%
hits_82.vortex 1.0 vortex-file-compressed 102.24 MB 102.25 MB +9.80 KB +0.0%
hits_69.vortex 1.0 vortex-file-compressed 125.84 MB 125.85 MB +12.04 KB +0.0%
hits_87.vortex 1.0 vortex-file-compressed 176.86 MB 176.88 MB +16.72 KB +0.0%
hits_46.vortex 1.0 vortex-file-compressed 71.33 MB 71.33 MB +6.67 KB +0.0%
hits_31.vortex 1.0 vortex-file-compressed 92.31 MB 92.32 MB +8.53 KB +0.0%
hits_38.vortex 1.0 vortex-file-compressed 102.73 MB 102.74 MB +9.48 KB +0.0%
hits_17.vortex 1.0 vortex-file-compressed 91.92 MB 91.92 MB +8.47 KB +0.0%
hits_43.vortex 1.0 vortex-file-compressed 232.14 MB 232.16 MB +21.18 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 145.84 MB 145.85 MB +13.29 KB +0.0%
hits_8.vortex 1.0 vortex-file-compressed 94.67 MB 94.68 MB +8.60 KB +0.0%
hits_29.vortex 1.0 vortex-file-compressed 61.81 MB 61.82 MB +5.59 KB +0.0%
hits_63.vortex 1.0 vortex-file-compressed 71.21 MB 71.21 MB +6.38 KB +0.0%
hits_7.vortex 1.0 vortex-file-compressed 95.46 MB 95.47 MB +8.48 KB +0.0%
hits_91.vortex 1.0 vortex-file-compressed 102.22 MB 102.23 MB +9.05 KB +0.0%
hits_41.vortex 1.0 vortex-file-compressed 228.76 MB 228.78 MB +20.24 KB +0.0%
hits_6.vortex 1.0 vortex-file-compressed 94.81 MB 94.82 MB +8.35 KB +0.0%
hits_58.vortex 1.0 vortex-file-compressed 92.41 MB 92.41 MB +8.10 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 94.32 MB 94.33 MB +8.25 KB +0.0%
hits_62.vortex 1.0 vortex-file-compressed 122.25 MB 122.26 MB +10.66 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 108.38 MB 108.39 MB +9.42 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 227.72 MB 227.74 MB +19.72 KB +0.0%
hits_3.vortex 1.0 vortex-file-compressed 147.11 MB 147.12 MB +12.69 KB +0.0%
hits_72.vortex 1.0 vortex-file-compressed 88.42 MB 88.43 MB +7.59 KB +0.0%
hits_13.vortex 1.0 vortex-file-compressed 100.74 MB 100.75 MB +8.62 KB +0.0%
hits_81.vortex 1.0 vortex-file-compressed 103.75 MB 103.76 MB +8.80 KB +0.0%
hits_54.vortex 1.0 vortex-file-compressed 225.89 MB 225.91 MB +19.11 KB +0.0%
hits_74.vortex 1.0 vortex-file-compressed 122.66 MB 122.67 MB +10.31 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 131.87 MB 131.88 MB +11.02 KB +0.0%
hits_55.vortex 1.0 vortex-file-compressed 173.91 MB 173.93 MB +14.46 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 90.49 MB 90.50 MB +7.51 KB +0.0%
hits_60.vortex 1.0 vortex-file-compressed 108.74 MB 108.75 MB +8.96 KB +0.0%
hits_40.vortex 1.0 vortex-file-compressed 119.94 MB 119.95 MB +9.74 KB +0.0%
hits_12.vortex 1.0 vortex-file-compressed 103.74 MB 103.75 MB +8.30 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 93.54 MB 93.55 MB +7.39 KB +0.0%
hits_88.vortex 1.0 vortex-file-compressed 113.92 MB 113.93 MB +8.99 KB +0.0%
hits_14.vortex 1.0 vortex-file-compressed 113.63 MB 113.64 MB +8.88 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 103.91 MB 103.92 MB +8.09 KB +0.0%
hits_37.vortex 1.0 vortex-file-compressed 89.22 MB 89.23 MB +6.95 KB +0.0%
hits_9.vortex 1.0 vortex-file-compressed 101.80 MB 101.81 MB +7.92 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 143.30 MB 143.32 MB +11.12 KB +0.0%
hits_34.vortex 1.0 vortex-file-compressed 100.91 MB 100.91 MB +7.78 KB +0.0%
hits_16.vortex 1.0 vortex-file-compressed 80.66 MB 80.66 MB +6.20 KB +0.0%
hits_10.vortex 1.0 vortex-file-compressed 72.08 MB 72.09 MB +5.51 KB +0.0%
hits_15.vortex 1.0 vortex-file-compressed 91.21 MB 91.21 MB +6.96 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 96.78 MB 96.79 MB +7.27 KB +0.0%
hits_52.vortex 1.0 vortex-file-compressed 107.28 MB 107.29 MB +8.00 KB +0.0%
hits_53.vortex 1.0 vortex-file-compressed 88.40 MB 88.40 MB +6.39 KB +0.0%
hits_99.vortex 1.0 vortex-file-compressed 127.95 MB 127.96 MB +9.23 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 153.26 MB 153.27 MB +10.78 KB +0.0%
hits_77.vortex 1.0 vortex-file-compressed 172.89 MB 172.90 MB +12.10 KB +0.0%
hits_85.vortex 1.0 vortex-file-compressed 95.05 MB 95.06 MB +6.40 KB +0.0%
hits_21.vortex 1.0 vortex-file-compressed 96.11 MB 96.12 MB +6.21 KB +0.0%
hits_76.vortex 1.0 vortex-file-compressed 117.17 MB 117.17 MB +7.56 KB +0.0%
hits_68.vortex 1.0 vortex-file-compressed 127.53 MB 127.54 MB +8.19 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 64.29 MB 64.30 MB +3.81 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 93.26 MB 93.26 MB +5.50 KB +0.0%
hits_33.vortex 1.0 vortex-file-compressed 58.81 MB 58.81 MB +3.20 KB +0.0%
hits_24.vortex 1.0 vortex-file-compressed 76.75 MB 76.75 MB +4.02 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.95 MB 41.95 MB +2.16 KB +0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.21 MB 77.22 MB +3.84 KB +0.0%
hits_39.vortex 1.0 vortex-compact 49.99 MB 49.99 MB +2.43 KB +0.0%
hits_22.vortex 1.0 vortex-file-compressed 77.66 MB 77.66 MB +3.61 KB +0.0%
hits_3.vortex 1.0 vortex-compact 94.64 MB 94.64 MB +3.05 KB +0.0%
hits_18.vortex 1.0 vortex-file-compressed 109.81 MB 109.81 MB +2.36 KB +0.0%
hits_45.vortex 1.0 vortex-compact 75.96 MB 75.96 MB +968 B +0.0%
hits_54.vortex 1.0 vortex-compact 117.24 MB 117.24 MB +1.36 KB +0.0%
hits_36.vortex 1.0 vortex-compact 49.09 MB 49.09 MB +488 B +0.0%
hits_92.vortex 1.0 vortex-compact 94.22 MB 94.22 MB +688 B +0.0%
hits_50.vortex 1.0 vortex-compact 113.31 MB 113.31 MB +576 B +0.0%
hits_87.vortex 1.0 vortex-compact 118.80 MB 118.80 MB +584 B +0.0%
hits_44.vortex 1.0 vortex-compact 132.80 MB 132.80 MB +648 B +0.0%
hits_75.vortex 1.0 vortex-compact 45.10 MB 45.10 MB +184 B +0.0%
hits_83.vortex 1.0 vortex-compact 53.50 MB 53.50 MB +216 B +0.0%
hits_80.vortex 1.0 vortex-compact 68.65 MB 68.65 MB +240 B +0.0%
hits_57.vortex 1.0 vortex-compact 83.70 MB 83.70 MB +288 B +0.0%
hits_49.vortex 1.0 vortex-file-compressed 78.39 MB 78.39 MB +264 B +0.0%
hits_15.vortex 1.0 vortex-compact 48.66 MB 48.66 MB +136 B +0.0%
hits_65.vortex 1.0 vortex-compact 129.34 MB 129.34 MB +344 B +0.0%
hits_55.vortex 1.0 vortex-compact 92.44 MB 92.44 MB +200 B +0.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 60.05 MB +80 B +0.0%
hits_78.vortex 1.0 vortex-compact 97.79 MB 97.79 MB +120 B +0.0%
hits_94.vortex 1.0 vortex-compact 90.56 MB 90.56 MB +72 B +0.0%
hits_19.vortex 1.0 vortex-compact 49.96 MB 49.96 MB +24 B +0.0%
hits_72.vortex 1.0 vortex-compact 52.67 MB 52.67 MB +8 B +0.0%
hits_62.vortex 1.0 vortex-compact 74.91 MB 74.91 MB 8 B -0.0%
hits_81.vortex 1.0 vortex-compact 65.97 MB 65.97 MB 8 B -0.0%
hits_93.vortex 1.0 vortex-compact 59.13 MB 59.13 MB 24 B -0.0%
hits_91.vortex 1.0 vortex-compact 61.21 MB 61.21 MB 56 B -0.0%
hits_20.vortex 1.0 vortex-compact 38.33 MB 38.33 MB 40 B -0.0%
hits_28.vortex 1.0 vortex-compact 70.85 MB 70.85 MB 120 B -0.0%
hits_58.vortex 1.0 vortex-compact 61.21 MB 61.21 MB 120 B -0.0%
hits_25.vortex 1.0 vortex-compact 73.46 MB 73.46 MB 152 B -0.0%
hits_40.vortex 1.0 vortex-compact 76.69 MB 76.69 MB 168 B -0.0%
hits_17.vortex 1.0 vortex-compact 58.72 MB 58.72 MB 136 B -0.0%
hits_27.vortex 1.0 vortex-compact 69.91 MB 69.91 MB 168 B -0.0%
hits_23.vortex 1.0 vortex-compact 46.03 MB 46.03 MB 120 B -0.0%
hits_90.vortex 1.0 vortex-compact 82.11 MB 82.11 MB 216 B -0.0%
hits_67.vortex 1.0 vortex-compact 114.15 MB 114.15 MB 312 B -0.0%
hits_2.vortex 1.0 vortex-compact 129.11 MB 129.11 MB 424 B -0.0%
hits_34.vortex 1.0 vortex-compact 58.25 MB 58.25 MB 200 B -0.0%
hits_95.vortex 1.0 vortex-compact 58.10 MB 58.10 MB 200 B -0.0%
hits_74.vortex 1.0 vortex-compact 71.82 MB 71.82 MB 248 B -0.0%
hits_61.vortex 1.0 vortex-compact 57.46 MB 57.46 MB 200 B -0.0%
hits_73.vortex 1.0 vortex-compact 70.78 MB 70.78 MB 248 B -0.0%
hits_71.vortex 1.0 vortex-compact 69.50 MB 69.50 MB 248 B -0.0%
hits_97.vortex 1.0 vortex-compact 69.33 MB 69.33 MB 248 B -0.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 49.12 MB 200 B -0.0%
hits_7.vortex 1.0 vortex-compact 64.21 MB 64.21 MB 264 B -0.0%
hits_4.vortex 1.0 vortex-compact 71.96 MB 71.96 MB 296 B -0.0%
hits_14.vortex 1.0 vortex-compact 74.51 MB 74.51 MB 312 B -0.0%
hits_84.vortex 1.0 vortex-compact 74.13 MB 74.13 MB 312 B -0.0%
hits_82.vortex 1.0 vortex-compact 67.32 MB 67.32 MB 312 B -0.0%
hits_63.vortex 1.0 vortex-compact 46.04 MB 46.04 MB 232 B -0.0%
hits_30.vortex 1.0 vortex-compact 58.36 MB 58.36 MB 312 B -0.0%
hits_26.vortex 1.0 vortex-compact 71.97 MB 71.97 MB 392 B -0.0%
hits_24.vortex 1.0 vortex-compact 45.46 MB 45.46 MB 248 B -0.0%
hits_9.vortex 1.0 vortex-compact 66.33 MB 66.33 MB 392 B -0.0%
hits_31.vortex 1.0 vortex-compact 55.84 MB 55.83 MB 344 B -0.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 44.61 MB 280 B -0.0%
hits_12.vortex 1.0 vortex-compact 69.39 MB 69.39 MB 440 B -0.0%
hits_89.vortex 1.0 vortex-compact 114.19 MB 114.19 MB 752 B -0.0%
hits_0.vortex 1.0 vortex-compact 58.84 MB 58.84 MB 392 B -0.0%
hits_76.vortex 1.0 vortex-compact 77.07 MB 77.06 MB 520 B -0.0%
hits_22.vortex 1.0 vortex-compact 46.14 MB 46.14 MB 312 B -0.0%
hits_16.vortex 1.0 vortex-compact 49.46 MB 49.46 MB 360 B -0.0%
hits_5.vortex 1.0 vortex-compact 63.30 MB 63.30 MB 488 B -0.0%
hits_85.vortex 1.0 vortex-compact 52.87 MB 52.87 MB 408 B -0.0%
hits_10.vortex 1.0 vortex-compact 49.47 MB 49.47 MB 424 B -0.0%
hits_6.vortex 1.0 vortex-compact 63.54 MB 63.54 MB 552 B -0.0%
hits_51.vortex 1.0 vortex-compact 168.29 MB 168.29 MB 1.54 KB -0.0%
hits_8.vortex 1.0 vortex-compact 63.36 MB 63.36 MB 608 B -0.0%
hits_37.vortex 1.0 vortex-compact 54.31 MB 54.31 MB 552 B -0.0%
hits_13.vortex 1.0 vortex-compact 68.70 MB 68.70 MB 704 B -0.0%
hits_43.vortex 1.0 vortex-compact 169.20 MB 169.20 MB 1.70 KB -0.0%
hits_46.vortex 1.0 vortex-compact 42.19 MB 42.19 MB 496 B -0.0%
hits_38.vortex 1.0 vortex-compact 63.41 MB 63.41 MB 872 B -0.0%
hits_41.vortex 1.0 vortex-compact 166.02 MB 166.02 MB 2.55 KB -0.0%
hits_70.vortex 1.0 vortex-compact 61.85 MB 61.85 MB 1000 B -0.0%
hits_52.vortex 1.0 vortex-compact 65.03 MB 65.03 MB 1.11 KB -0.0%
hits_42.vortex 1.0 vortex-compact 164.50 MB 164.50 MB 2.84 KB -0.0%
hits_11.vortex 1.0 vortex-compact 55.41 MB 55.41 MB 1.19 KB -0.0%
hits_29.vortex 1.0 vortex-compact 36.61 MB 36.61 MB 840 B -0.0%
hits_56.vortex 1.0 vortex-compact 78.61 MB 78.61 MB 1.86 KB -0.0%
hits_68.vortex 1.0 vortex-compact 76.77 MB 76.77 MB 2.10 KB -0.0%
hits_47.vortex 1.0 vortex-compact 18.18 MB 18.18 MB 520 B -0.0%
hits_1.vortex 1.0 vortex-compact 90.64 MB 90.64 MB 2.84 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 83.70 MB 83.70 MB 2.92 KB -0.0%
hits_88.vortex 1.0 vortex-compact 73.51 MB 73.51 MB 4.28 KB -0.0%
hits_77.vortex 1.0 vortex-compact 118.71 MB 118.71 MB 7.57 KB -0.0%
hits_35.vortex 1.0 vortex-compact 75.28 MB 75.27 MB 6.13 KB -0.0%
hits_69.vortex 1.0 vortex-compact 80.93 MB 80.92 MB 6.95 KB -0.0%
hits_33.vortex 1.0 vortex-compact 35.84 MB 35.84 MB 3.60 KB -0.0%
hits_18.vortex 1.0 vortex-compact 64.87 MB 64.86 MB 6.54 KB -0.0%
hits_66.vortex 1.0 vortex-compact 53.66 MB 53.65 MB 5.67 KB -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.75 MB 28.74 MB 3.99 KB -0.0%
hits_59.vortex 1.0 vortex-compact 66.64 MB 66.63 MB 11.38 KB -0.0%
hits_49.vortex 1.0 vortex-compact 50.95 MB 50.95 MB 9.82 KB -0.0%
hits_96.vortex 1.0 vortex-compact 91.66 MB 91.64 MB 20.97 KB -0.0%
hits_60.vortex 1.0 vortex-compact 65.19 MB 65.18 MB 15.45 KB -0.0%
hits_98.vortex 1.0 vortex-compact 72.84 MB 72.82 MB 20.07 KB -0.0%
hits_48.vortex 1.0 vortex-compact 17.83 MB 17.83 MB 6.71 KB -0.0%
hits_21.vortex 1.0 vortex-compact 51.90 MB 51.86 MB 42.58 KB -0.1%

Totals:

  • vortex-compact: 7.10 GB → 7.10 GB (-0.0%)
  • vortex-file-compressed: 11.31 GB → 11.31 GB (+0.0%)

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 9c23a32b vs base 787fac76
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.3%, environment too noisy confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.010x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.001x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24438682 / 24361668 / +0.3% 43781522 / 44148455 / -0.8% 0.56 / 0.55 / +1.2%
tpcds_q02/datafusion:vortex-file-compressed 45451766 / 45239306 / +0.5% 60974402 / 62162961 / -1.9% 0.75 / 0.73 / +2.4%
tpcds_q03/datafusion:vortex-file-compressed 11502556 / 11578534 / -0.7% 29914070 / 28899902 / +3.5% 0.38 / 0.40 / -4.0%
tpcds_q04/datafusion:vortex-file-compressed 112456080 / 113442657 / -0.9% 144693602 / 137328705 / +5.4% 0.78 / 0.83 / -5.9%
tpcds_q05/datafusion:vortex-file-compressed 60481390 / 60192911 / +0.5% 81524500 / 80422542 / +1.4% 0.74 / 0.75 / -0.9%
tpcds_q06/datafusion:vortex-file-compressed 23482130 / 23952936 / -2.0% 46434156 / 45420959 / +2.2% 0.51 / 0.53 / -4.1%
tpcds_q07/datafusion:vortex-file-compressed 32574066 / 32443978 / +0.4% 57384187 / 57320411 / +0.1% 0.57 / 0.57 / +0.3%
tpcds_q08/datafusion:vortex-file-compressed 25374254 / 25461958 / -0.3% 46502826 / 44932518 / +3.5% 0.55 / 0.57 / -3.7%
tpcds_q09/datafusion:vortex-file-compressed 16546962 / 17067062 / -3.0% 36240650 / 34928617 / +3.8% 0.46 / 0.49 / -6.6%
tpcds_q10/datafusion:vortex-file-compressed 28628097 / 28489356 / +0.5% 49191249 / 48393344 / +1.6% 0.58 / 0.59 / -1.1%
tpcds_q11/datafusion:vortex-file-compressed 62028393 / 62689136 / -1.1% 91871269 / 89298387 / +2.9% 0.68 / 0.70 / -3.8%
tpcds_q12/datafusion:vortex-file-compressed 16420002 / 16464754 / -0.3% 33289199 / 32743789 / +1.7% 0.49 / 0.50 / -1.9%
tpcds_q13/datafusion:vortex-file-compressed 34346306 / 33748856 / +1.8% 54255237 / 53920423 / +0.6% 0.63 / 0.63 / +1.1%
tpcds_q14/datafusion:vortex-file-compressed 92089810 / 92206038 / -0.1% 120938594 / 115885226 / +4.4% 0.76 / 0.80 / -4.3%
tpcds_q15/datafusion:vortex-file-compressed 23780659 / 23620274 / +0.7% 44828498 / 43439831 / +3.2% 0.53 / 0.54 / -2.4%
tpcds_q16/datafusion:vortex-file-compressed 20430435 / 20701268 / -1.3% 42412393 / 41831541 / +1.4% 0.48 / 0.49 / -2.7%
tpcds_q17/datafusion:vortex-file-compressed 56648978 / 61895654 / -8.5% 79850048 / 75126778 / +6.3% 0.71 / 0.82 / -13.9%
tpcds_q18/datafusion:vortex-file-compressed 68497340 / 69401950 / -1.3% 95687076 / 95466777 / +0.2% 0.72 / 0.73 / -1.5%
tpcds_q19/datafusion:vortex-file-compressed 18020703 / 18284269 / -1.4% 40346598 / 39408087 / +2.4% 0.45 / 0.46 / -3.7%
tpcds_q20/datafusion:vortex-file-compressed 17755917 / 17315502 / +2.5% 35215369 / 36697570 / -4.0% 0.50 / 0.47 / +6.9%
tpcds_q21/datafusion:vortex-file-compressed 17034772 / 17789579 / -4.2% 40206832 / 42300875 / -5.0% 0.42 / 0.42 / +0.7%
tpcds_q22/datafusion:vortex-file-compressed 49365903 / 50141140 / -1.5% 70350265 / 73429575 / -4.2% 0.70 / 0.68 / +2.8%
tpcds_q23/datafusion:vortex-file-compressed 72627866 / 72011063 / +0.9% 98367569 / 99301717 / -0.9% 0.74 / 0.73 / +1.8%
tpcds_q24/datafusion:vortex-file-compressed 70215496 / 71641562 / -2.0% 93031715 / 93733756 / -0.7% 0.75 / 0.76 / -1.3%
tpcds_q25/datafusion:vortex-file-compressed 48400086 / 5671842 / -14.7% 🟢 89294834 / 82618640 / +8.1% 0.54 / 0.69 / -21.0%
tpcds_q26/datafusion:vortex-file-compressed 30576583 / 30210029 / +1.2% 52222973 / 50277653 / +3.9% 0.59 / 0.60 / -2.6%
tpcds_q27/datafusion:vortex-file-compressed 67001521 / 64622546 / +3.7% 88504932 / 97139815 / -8.9% 0.76 / 0.67 / +13.8%
tpcds_q28/datafusion:vortex-file-compressed 17750892 / 17708640 / +0.2% 38708436 / 38571016 / +0.4% 0.46 / 0.46 / -0.1%
tpcds_q29/datafusion:vortex-file-compressed 60503946 / 60987608 / -0.8% 83959627 / 77431899 / +8.4% 0.72 / 0.79 / -8.5%
tpcds_q30/datafusion:vortex-file-compressed 27498882 / 27466362 / +0.1% 46147044 / 48774588 / -5.4% 0.60 / 0.56 / +5.8%
tpcds_q31/datafusion:vortex-file-compressed 64217013 / 64527250 / -0.5% 92219238 / 92170220 / +0.1% 0.70 / 0.70 / -0.5%
tpcds_q32/datafusion:vortex-file-compressed 13537997 / 13888060 / -2.5% 31385732 / 31143596 / +0.8% 0.43 / 0.45 / -3.3%
tpcds_q33/datafusion:vortex-file-compressed 27518222 / 26940460 / +2.1% 49730866 / 47998562 / +3.6% 0.55 / 0.56 / -1.4%
tpcds_q34/datafusion:vortex-file-compressed 18848000 / 18716538 / +0.7% 38549611 / 39216772 / -1.7% 0.49 / 0.48 / +2.4%
tpcds_q35/datafusion:vortex-file-compressed 35552709 / 34876183 / +1.9% 57821915 / 56858361 / +1.7% 0.61 / 0.61 / +0.2%
tpcds_q36/datafusion:vortex-file-compressed 48594456 / 48846680 / -0.5% 71990661 / 71133053 / +1.2% 0.68 / 0.69 / -1.7%
tpcds_q37/datafusion:vortex-file-compressed 13443682 / 14235886 / -5.6% 35444260 / 33988721 / +4.3% 0.38 / 0.42 / -9.4%
tpcds_q38/datafusion:vortex-file-compressed 29499350 / 29717088 / -0.7% 53594661 / 51996110 / +3.1% 0.55 / 0.57 / -3.7%
tpcds_q39/datafusion:vortex-file-compressed 65679563 / 65921140 / -0.4% 89765731 / 89716994 / +0.1% 0.73 / 0.73 / -0.4%
tpcds_q40/datafusion:vortex-file-compressed 25635018 / 24968824 / +2.7% 47364493 / 46066097 / +2.8% 0.54 / 0.54 / -0.1%
tpcds_q41/datafusion:vortex-file-compressed 16591911 / 16552670 / +0.2% 30829451 / 31184720 / -1.1% 0.54 / 0.53 / +1.4%
tpcds_q42/datafusion:vortex-file-compressed 11356347 / 11330794 / +0.2% 27923260 / 28458898 / -1.9% 0.41 / 0.40 / +2.1%
tpcds_q43/datafusion:vortex-file-compressed 13539130 / 13430694 / +0.8% 32851871 / 32501113 / +1.1% 0.41 / 0.41 / -0.3%
tpcds_q44/datafusion:vortex-file-compressed 26489460 / 26429474 / +0.2% 49494851 / 48973684 / +1.1% 0.54 / 0.54 / -0.8%
tpcds_q45/datafusion:vortex-file-compressed 27733870 / 27751428 / -0.1% 47995041 / 48497292 / -1.0% 0.58 / 0.57 / +1.0%
tpcds_q46/datafusion:vortex-file-compressed 24925847 / 24568262 / +1.5% 47685237 / 47130263 / +1.2% 0.52 / 0.52 / +0.3%
tpcds_q47/datafusion:vortex-file-compressed 77311752 / 77882982 / -0.7% 105738820 / 108333458 / -2.4% 0.73 / 0.72 / +1.7%
tpcds_q48/datafusion:vortex-file-compressed 31441459 / 31762738 / -1.0% 53780747 / 53055142 / +1.4% 0.58 / 0.60 / -2.3%
tpcds_q49/datafusion:vortex-file-compressed 60194512 / 62049318 / -3.0% 84323935 / 83395235 / +1.1% 0.71 / 0.74 / -4.1%
tpcds_q50/datafusion:vortex-file-compressed 34672800 / 34677319 / -0.0% 55765272 / 54366809 / +2.6% 0.62 / 0.64 / -2.5%
tpcds_q51/datafusion:vortex-file-compressed 60632168 / 61209655 / -0.9% 84022466 / 83546507 / +0.6% 0.72 / 0.73 / -1.5%
tpcds_q52/datafusion:vortex-file-compressed 11744166 / 12025528 / -2.3% 29225487 / 28722931 / +1.7% 0.40 / 0.42 / -4.0%
tpcds_q53/datafusion:vortex-file-compressed 18839534 / 18230886 / +3.3% 38307019 / 37631983 / +1.8% 0.49 / 0.48 / +1.5%
tpcds_q54/datafusion:vortex-file-compressed 33306051 / 33720922 / -1.2% 58966993 / 61453915 / -4.0% 0.56 / 0.55 / +2.9%
tpcds_q55/datafusion:vortex-file-compressed 11535289 / 11508976 / +0.2% 28237694 / 27565412 / +2.4% 0.41 / 0.42 / -2.2%
tpcds_q56/datafusion:vortex-file-compressed 26968973 / 27125250 / -0.6% 50413425 / 48300998 / +4.4% 0.53 / 0.56 / -4.7%
tpcds_q57/datafusion:vortex-file-compressed 72674948 / 73022810 / -0.5% 98224497 / 98085598 / +0.1% 0.74 / 0.74 / -0.6%
tpcds_q58/datafusion:vortex-file-compressed 40646379 / 40576482 / +0.2% 67384219 / 67326117 / +0.1% 0.60 / 0.60 / +0.1%
tpcds_q59/datafusion:vortex-file-compressed 32158942 / 31555464 / +1.9% 52560332 / 53565245 / -1.9% 0.61 / 0.59 / +3.9%
tpcds_q60/datafusion:vortex-file-compressed 26633246 / 26607543 / +0.1% 49562074 / 47573732 / +4.2% 0.54 / 0.56 / -3.9%
tpcds_q61/datafusion:vortex-file-compressed 23815192 / 24388392 / -2.4% 48536950 / 46467436 / +4.5% 0.49 / 0.52 / -6.5%
tpcds_q62/datafusion:vortex-file-compressed 17201722 / 17479634 / -1.6% 34927239 / 34957660 / -0.1% 0.49 / 0.50 / -1.5%
tpcds_q63/datafusion:vortex-file-compressed 18670164 / 18673286 / -0.0% 37846869 / 37813584 / +0.1% 0.49 / 0.49 / -0.1%
tpcds_q64/datafusion:vortex-file-compressed 326316054 / 322179038 / +1.3% 350257460 / 367220154 / -4.6% 0.93 / 0.88 / +6.2%
tpcds_q65/datafusion:vortex-file-compressed 76114071 / 75547076 / +0.8% 96856296 / 96321487 / +0.6% 0.79 / 0.78 / +0.2%
tpcds_q66/datafusion:vortex-file-compressed 52413438 / 52585820 / -0.3% 75310474 / 74781459 / +0.7% 0.70 / 0.70 / -1.0%
tpcds_q67/datafusion:vortex-file-compressed 56036994 / 55973676 / +0.1% 85671236 / 85070014 / +0.7% 0.65 / 0.66 / -0.6%
tpcds_q68/datafusion:vortex-file-compressed 23873167 / 24193166 / -1.3% 48468698 / 47823384 / +1.3% 0.49 / 0.51 / -2.6%
tpcds_q69/datafusion:vortex-file-compressed 28363284 / 28817219 / -1.6% 49851430 / 48521042 / +2.7% 0.57 / 0.59 / -4.2%
tpcds_q70/datafusion:vortex-file-compressed 70200435 / 71961812 / -2.4% 91099238 / 94068789 / -3.2% 0.77 / 0.76 / +0.7%
tpcds_q71/datafusion:vortex-file-compressed 20327918 / 19888521 / +2.2% 40091585 / 38269533 / +4.8% 0.51 / 0.52 / -2.4%
tpcds_q72/datafusion:vortex-file-compressed 456923566 / 468913092 / -2.6% 500672483 / 501071161 / -0.1% 0.91 / 0.94 / -2.5%
tpcds_q73/datafusion:vortex-file-compressed 17101360 / 17430886 / -1.9% 38541278 / 38285019 / +0.7% 0.44 / 0.46 / -2.5%
tpcds_q74/datafusion:vortex-file-compressed 45009052 / 45495764 / -1.1% 70521467 / 69860676 / +0.9% 0.64 / 0.65 / -2.0%
tpcds_q75/datafusion:vortex-file-compressed 130700420 / 131148601 / -0.3% 158218795 / 165566427 / -4.4% 0.83 / 0.79 / +4.3%
tpcds_q76/datafusion:vortex-file-compressed 42185350 / 43357754 / -2.7% 63960517 / 62544709 / +2.3% 0.66 / 0.69 / -4.9%
tpcds_q77/datafusion:vortex-file-compressed 34606922 / 34715798 / -0.3% 59903817 / 61769433 / -3.0% 0.58 / 0.56 / +2.8%
tpcds_q78/datafusion:vortex-file-compressed 80826468 / 79951788 / +1.1% 111089314 / 109260841 / +1.7% 0.73 / 0.73 / -0.6%
tpcds_q79/datafusion:vortex-file-compressed 20678552 / 21240836 / -2.6% 42037439 / 42890812 / -2.0% 0.49 / 0.50 / -0.7%
tpcds_q80/datafusion:vortex-file-compressed 76321558 / 77000990 / -0.9% 109220866 / 108822361 / +0.4% 0.70 / 0.71 / -1.2%
tpcds_q81/datafusion:vortex-file-compressed 28466456 / 28445008 / +0.1% 47215528 / 45481155 / +3.8% 0.60 / 0.63 / -3.6%
tpcds_q82/datafusion:vortex-file-compressed 13933185 / 13700926 / +1.7% 35854395 / 34794808 / +3.0% 0.39 / 0.39 / -1.3%
tpcds_q83/datafusion:vortex-file-compressed 36111050 / 36168732 / -0.2% 58060580 / 57972006 / +0.2% 0.62 / 0.62 / -0.3%
tpcds_q84/datafusion:vortex-file-compressed 12521192 / 12213882 / +2.5% 28060359 / 28944418 / -3.1% 0.45 / 0.42 / +5.7%
tpcds_q85/datafusion:vortex-file-compressed 59490882 / 59855508 / -0.6% 84256850 / 84734693 / -0.6% 0.71 / 0.71 / -0.0%
tpcds_q86/datafusion:vortex-file-compressed 16520764 / 16634701 / -0.7% 32883145 / 33292394 / -1.2% 0.50 / 0.50 / +0.6%
tpcds_q87/datafusion:vortex-file-compressed 29976098 / 29740724 / +0.8% 51779412 / 53120927 / -2.5% 0.58 / 0.56 / +3.4%
tpcds_q88/datafusion:vortex-file-compressed 34717752 / 34689172 / +0.1% 60985025 / 63417755 / -3.8% 0.57 / 0.55 / +4.1%
tpcds_q89/datafusion:vortex-file-compressed 20950872 / 21374646 / -2.0% 41581699 / 42068915 / -1.2% 0.50 / 0.51 / -0.8%
tpcds_q90/datafusion:vortex-file-compressed 10205905 / 10284986 / -0.8% 25628318 / 26309968 / -2.6% 0.40 / 0.39 / +1.9%
tpcds_q91/datafusion:vortex-file-compressed 16476840 / 16617808 / -0.8% 34536082 / 34669820 / -0.4% 0.48 / 0.48 / -0.5%
tpcds_q92/datafusion:vortex-file-compressed 13655511 / 13793122 / -1.0% 32229870 / 30244723 / +6.6% 0.42 / 0.46 / -7.1%
tpcds_q93/datafusion:vortex-file-compressed 23658570 / 23955105 / -1.2% 42721198 / 45871792 / -6.9% 0.55 / 0.52 / +6.0%
tpcds_q94/datafusion:vortex-file-compressed 19651759 / 19696356 / -0.2% 39104601 / 39778842 / -1.7% 0.50 / 0.50 / +1.5%
tpcds_q95/datafusion:vortex-file-compressed 45781085 / 45686564 / +0.2% 68639907 / 67431265 / +1.8% 0.67 / 0.68 / -1.6%
tpcds_q96/datafusion:vortex-file-compressed 9808531 / 9707823 / +1.0% 25154389 / 25812514 / -2.5% 0.39 / 0.38 / +3.7%
tpcds_q97/datafusion:vortex-file-compressed 21475708 / 21128342 / +1.6% 43353450 / 42275816 / +2.5% 0.50 / 0.50 / -0.9%
tpcds_q98/datafusion:vortex-file-compressed 16896578 / 17004196 / -0.6% 38354267 / 36628089 / +4.7% 0.44 / 0.46 / -5.1%
tpcds_q99/datafusion:vortex-file-compressed 19468463 / 19558141 / -0.5% 37868310 / 37642031 / +0.6% 0.51 / 0.52 / -1.1%
datafusion / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 26420766 / 26126775 / +1.1% 44820209 / 44924453 / -0.2% 0.59 / 0.58 / +1.4%
tpcds_q02/datafusion:vortex-compact 45171351 / 44611564 / +1.3% 63193279 / 62690530 / +0.8% 0.71 / 0.71 / +0.4%
tpcds_q03/datafusion:vortex-compact 12334932 / 12359294 / -0.2% 35881852 / 32917693 / +9.0% 0.34 / 0.38 / -8.4%
tpcds_q04/datafusion:vortex-compact 118756412 / 119377836 / -0.5% 152522907 / 147320183 / +3.5% 0.78 / 0.81 / -3.9%
tpcds_q05/datafusion:vortex-compact 61282540 / 61295830 / -0.0% 83953061 / 82477344 / +1.8% 0.73 / 0.74 / -1.8%
tpcds_q06/datafusion:vortex-compact 24013556 / 24498594 / -2.0% 46966411 / 46463438 / +1.1% 0.51 / 0.53 / -3.0%
tpcds_q07/datafusion:vortex-compact 33785466 / 33454963 / +1.0% 52411012 / 57380284 / -8.7% 0.64 / 0.58 / +10.6%
tpcds_q08/datafusion:vortex-compact 28210214 / 28475231 / -0.9% 47908320 / 46175479 / +3.8% 0.59 / 0.62 / -4.5%
tpcds_q09/datafusion:vortex-compact 22008256 / 21810432 / +0.9% 40068571 / 38633209 / +3.7% 0.55 / 0.56 / -2.7%
tpcds_q10/datafusion:vortex-compact 32749306 / 32035180 / +2.2% 53917167 / 52877718 / +2.0% 0.61 / 0.61 / +0.3%
tpcds_q11/datafusion:vortex-compact 65584408 / 64424270 / +1.8% 90142633 / 89750317 / +0.4% 0.73 / 0.72 / +1.4%
tpcds_q12/datafusion:vortex-compact 20735050 / 20619606 / +0.6% 39367371 / 38685003 / +1.8% 0.53 / 0.53 / -1.2%
tpcds_q13/datafusion:vortex-compact 47294520 / 46002210 / +2.8% 65349453 / 66716342 / -2.0% 0.72 / 0.69 / +5.0%
tpcds_q14/datafusion:vortex-compact 94738521 / 95423790 / -0.7% 120612767 / 118790195 / +1.5% 0.79 / 0.80 / -2.2%
tpcds_q15/datafusion:vortex-compact 26506772 / 25889590 / +2.4% 46034051 / 45795095 / +0.5% 0.58 / 0.57 / +1.9%
tpcds_q16/datafusion:vortex-compact 21730068 / 21046414 / +3.2% 41060237 / 40860751 / +0.5% 0.53 / 0.52 / +2.7%
tpcds_q17/datafusion:vortex-compact 60367554 / 65342340 / -7.6% 88458382 / 78682515 / +12.4% 🔴 0.68 / 0.83 / -17.8%
tpcds_q18/datafusion:vortex-compact 66873627 / 65624434 / +1.9% 90220492 / 90479648 / -0.3% 0.74 / 0.73 / +2.2%
tpcds_q19/datafusion:vortex-compact 20826442 / 20082131 / +3.7% 42379534 / 41180744 / +2.9% 0.49 / 0.49 / +0.8%
tpcds_q20/datafusion:vortex-compact 21506590 / 21684346 / -0.8% 41353870 / 41261819 / +0.2% 0.52 / 0.53 / -1.0%
tpcds_q21/datafusion:vortex-compact 17899322 / 18762514 / -4.6% 42423285 / 41582852 / +2.0% 0.42 / 0.45 / -6.5%
tpcds_q22/datafusion:vortex-compact 49835580 / 50984856 / -2.3% 73285246 / 72843644 / +0.6% 0.68 / 0.70 / -2.8%
tpcds_q23/datafusion:vortex-compact 74609198 / 73629038 / +1.3% 102939309 / 97280785 / +5.8% 0.72 / 0.76 / -4.2%
tpcds_q24/datafusion:vortex-compact 73758246 / 74029895 / -0.4% 99063042 / 96339444 / +2.8% 0.74 / 0.77 / -3.1%
tpcds_q25/datafusion:vortex-compact 58659761 / 56242912 / +4.3% 85686955 / 85057484 / +0.7% 0.68 / 0.66 / +3.5%
tpcds_q26/datafusion:vortex-compact 31817632 / 30224926 / +5.3% 49703241 / 49401657 / +0.6% 0.64 / 0.61 / +4.6%
tpcds_q27/datafusion:vortex-compact 57712846 / 58561876 / -1.4% 85956292 / 85569120 / +0.5% 0.67 / 0.68 / -1.9%
tpcds_q28/datafusion:vortex-compact 27121624 / 28230726 / -3.9% 46379583 / 49889027 / -7.0% 0.58 / 0.57 / +3.3%
tpcds_q29/datafusion:vortex-compact 64655926 / 62875272 / +2.8% 89480339 / 85881930 / +4.2% 0.72 / 0.73 / -1.3%
tpcds_q30/datafusion:vortex-compact 30705545 / 31000513 / -1.0% 49911669 / 50841017 / -1.8% 0.62 / 0.61 / +0.9%
tpcds_q31/datafusion:vortex-compact 69429188 / 69878907 / -0.6% 98386128 / 97091078 / +1.3% 0.71 / 0.72 / -2.0%
tpcds_q32/datafusion:vortex-compact 15109968 / 14975822 / +0.9% 34646775 / 34787490 / -0.4% 0.44 / 0.43 / +1.3%
tpcds_q33/datafusion:vortex-compact 27057783 / 27530394 / -1.7% 50118372 / 49505725 / +1.2% 0.54 / 0.56 / -2.9%
tpcds_q34/datafusion:vortex-compact 18492533 / 18160618 / +1.8% 41238794 / 41240313 / -0.0% 0.45 / 0.44 / +1.8%
tpcds_q35/datafusion:vortex-compact 37506460 / 38138261 / -1.7% 62019526 / 61354931 / +1.1% 0.60 / 0.62 / -2.7%
tpcds_q36/datafusion:vortex-compact 49074517 / 49047920 / +0.1% 73679991 / 76336766 / -3.5% 0.67 / 0.64 / +3.7%
tpcds_q37/datafusion:vortex-compact 16042900 / 16070597 / -0.2% 38250120 / 37744162 / +1.3% 0.42 / 0.43 / -1.5%
tpcds_q38/datafusion:vortex-compact 29578460 / 30151338 / -1.9% 53931718 / 52982688 / +1.8% 0.55 / 0.57 / -3.6%
tpcds_q39/datafusion:vortex-compact 65414509 / 65889210 / -0.7% 90730878 / 90350302 / +0.4% 0.72 / 0.73 / -1.1%
tpcds_q40/datafusion:vortex-compact 26973356 / 26981854 / -0.0% 50280839 / 48499234 / +3.7% 0.54 / 0.56 / -3.6%
tpcds_q41/datafusion:vortex-compact 18798015 / 18431344 / +2.0% 33391739 / 33578920 / -0.6% 0.56 / 0.55 / +2.6%
tpcds_q42/datafusion:vortex-compact 11785020 / 11786818 / -0.0% 32333013 / 31859812 / +1.5% 0.36 / 0.37 / -1.5%
tpcds_q43/datafusion:vortex-compact 13772070 / 14541592 / -5.3% 33025871 / 33055522 / -0.1% 0.42 / 0.44 / -5.2%
tpcds_q44/datafusion:vortex-compact 27134948 / 26947234 / +0.7% 51649174 / 51627117 / +0.0% 0.53 / 0.52 / +0.7%
tpcds_q45/datafusion:vortex-compact 30223444 / 30298280 / -0.2% 50683835 / 48513851 / +4.5% 0.60 / 0.62 / -4.5%
tpcds_q46/datafusion:vortex-compact 24838580 / 25350567 / -2.0% 46406090 / 47493142 / -2.3% 0.54 / 0.53 / +0.3%
tpcds_q47/datafusion:vortex-compact 81944366 / 82380891 / -0.5% 113089962 / 112255920 / +0.7% 0.72 / 0.73 / -1.3%
tpcds_q48/datafusion:vortex-compact 43413041 / 43728556 / -0.7% 63087288 / 62642339 / +0.7% 0.69 / 0.70 / -1.4%
tpcds_q49/datafusion:vortex-compact 62716071 / 62785558 / -0.1% 86833024 / 86436049 / +0.5% 0.72 / 0.73 / -0.6%
tpcds_q50/datafusion:vortex-compact 34014888 / 34447056 / -1.3% 55727365 / 53745838 / +3.7% 0.61 / 0.64 / -4.8%
tpcds_q51/datafusion:vortex-compact 61983260 / 61832142 / +0.2% 84008092 / 83771448 / +0.3% 0.74 / 0.74 / -0.0%
tpcds_q52/datafusion:vortex-compact 11959356 / 11766122 / +1.6% 33834018 / 32513049 / +4.1% 0.35 / 0.36 / -2.3%
tpcds_q53/datafusion:vortex-compact 20145032 / 20528908 / -1.9% 41264665 / 40411603 / +2.1% 0.49 / 0.51 / -3.9%
tpcds_q54/datafusion:vortex-compact 35386932 / 35887296 / -1.4% 61263375 / 62260523 / -1.6% 0.58 / 0.58 / +0.2%
tpcds_q55/datafusion:vortex-compact 11693814 / 11636666 / +0.5% 31932119 / 32164622 / -0.7% 0.37 / 0.36 / +1.2%
tpcds_q56/datafusion:vortex-compact 27163912 / 27221117 / -0.2% 48904026 / 50352048 / -2.9% 0.56 / 0.54 / +2.7%
tpcds_q57/datafusion:vortex-compact 77682282 / 79095837 / -1.8% 107280933 / 105418791 / +1.8% 0.72 / 0.75 / -3.5%
tpcds_q58/datafusion:vortex-compact 45813488 / 45910853 / -0.2% 71696428 / 69488208 / +3.2% 0.64 / 0.66 / -3.3%
tpcds_q59/datafusion:vortex-compact 33557220 / 33370111 / +0.6% 53990298 / 55473634 / -2.7% 0.62 / 0.60 / +3.3%
tpcds_q60/datafusion:vortex-compact 26370758 / 27576945 / -4.4% 50500820 / 48402245 / +4.3% 0.52 / 0.57 / -8.3%
tpcds_q61/datafusion:vortex-compact 24912355 / 25698258 / -3.1% 48656383 / 46242778 / +5.2% 0.51 / 0.56 / -7.9%
tpcds_q62/datafusion:vortex-compact 17927166 / 17928551 / -0.0% 36100067 / 35671133 / +1.2% 0.50 / 0.50 / -1.2%
tpcds_q63/datafusion:vortex-compact 20708460 / 20729954 / -0.1% 40654485 / 40251544 / +1.0% 0.51 / 0.52 / -1.1%
tpcds_q64/datafusion:vortex-compact 441614530 / 445266451 / -0.8% 450406919 / 453441074 / -0.7% 0.98 / 0.98 / -0.2%
tpcds_q65/datafusion:vortex-compact 78971104 / 77604460 / +1.8% 99259438 / 96257334 / +3.1% 0.80 / 0.81 / -1.3%
tpcds_q66/datafusion:vortex-compact 54144562 / 53528684 / +1.2% 76253413 / 75457071 / +1.1% 0.71 / 0.71 / +0.1%
tpcds_q67/datafusion:vortex-compact 57614999 / 58446952 / -1.4% 87826675 / 88973667 / -1.3% 0.66 / 0.66 / -0.1%
tpcds_q68/datafusion:vortex-compact 24844322 / 25965224 / -4.3% 49054806 / 48386927 / +1.4% 0.51 / 0.54 / -5.6%
tpcds_q69/datafusion:vortex-compact 31598813 / 31345190 / +0.8% 52152421 / 51640182 / +1.0% 0.61 / 0.61 / -0.2%
tpcds_q70/datafusion:vortex-compact 72452944 / 71726100 / +1.0% 93847172 / 92630692 / +1.3% 0.77 / 0.77 / -0.3%
tpcds_q71/datafusion:vortex-compact 18075051 / 19563498 / -7.6% 39139883 / 39016926 / +0.3% 0.46 / 0.50 / -7.9%
tpcds_q72/datafusion:vortex-compact 460922222 / 475781516 / -3.1% 475596471 / 478594208 / -0.6% 0.97 / 0.99 / -2.5%
tpcds_q73/datafusion:vortex-compact 17453048 / 17298842 / +0.9% 38185035 / 38099125 / +0.2% 0.46 / 0.45 / +0.7%
tpcds_q74/datafusion:vortex-compact 47014416 / 46864920 / +0.3% 70009043 / 72414988 / -3.3% 0.67 / 0.65 / +3.8%
tpcds_q75/datafusion:vortex-compact 135626977 / 135016724 / +0.5% 156730787 / 170106241 / -7.9% 0.87 / 0.79 / +9.0%
tpcds_q76/datafusion:vortex-compact 40133984 / 41290848 / -2.8% 64596598 / 66911146 / -3.5% 0.62 / 0.62 / +0.7%
tpcds_q77/datafusion:vortex-compact 36836451 / 36859794 / -0.1% 63537979 / 60526296 / +5.0% 0.58 / 0.61 / -4.8%
tpcds_q78/datafusion:vortex-compact 82834825 / 82197658 / +0.8% 110875223 / 111416332 / -0.5% 0.75 / 0.74 / +1.3%
tpcds_q79/datafusion:vortex-compact 21434246 / 22566702 / -5.0% 43833568 / 40944977 / +7.1% 0.49 / 0.55 / -11.3%
tpcds_q80/datafusion:vortex-compact 78628336 / 79033344 / -0.5% 107499582 / 108334311 / -0.8% 0.73 / 0.73 / +0.3%
tpcds_q81/datafusion:vortex-compact 30387988 / 29451284 / +3.2% 47437434 / 47495304 / -0.1% 0.64 / 0.62 / +3.3%
tpcds_q82/datafusion:vortex-compact 15586906 / 15648448 / -0.4% 38587123 / 39081000 / -1.3% 0.40 / 0.40 / +0.9%
tpcds_q83/datafusion:vortex-compact 37052192 / 37307878 / -0.7% 59617260 / 59966442 / -0.6% 0.62 / 0.62 / -0.1%
tpcds_q84/datafusion:vortex-compact 13560802 / 13710360 / -1.1% 28715824 / 29629476 / -3.1% 0.47 / 0.46 / +2.1%
tpcds_q85/datafusion:vortex-compact 99572220 / 98839528 / +0.7% 125436721 / 124412283 / +0.8% 0.79 / 0.79 / -0.1%
tpcds_q86/datafusion:vortex-compact 17277428 / 17174079 / +0.6% 34809072 / 34880363 / -0.2% 0.50 / 0.49 / +0.8%
tpcds_q87/datafusion:vortex-compact 29264514 / 28980769 / +1.0% 52947979 / 52385403 / +1.1% 0.55 / 0.55 / -0.1%
tpcds_q88/datafusion:vortex-compact 34462760 / 35532548 / -3.0% 64149959 / 66920589 / -4.1% 0.54 / 0.53 / +1.2%
tpcds_q89/datafusion:vortex-compact 22849722 / 23188302 / -1.5% 45489680 / 45414821 / +0.2% 0.50 / 0.51 / -1.6%
tpcds_q90/datafusion:vortex-compact 10411232 / 10317794 / +0.9% 26245459 / 26320167 / -0.3% 0.40 / 0.39 / +1.2%
tpcds_q91/datafusion:vortex-compact 23041654 / 23159438 / -0.5% 42243918 / 42830637 / -1.4% 0.55 / 0.54 / +0.9%
tpcds_q92/datafusion:vortex-compact 15220251 / 15912428 / -4.3% 31776039 / 33454427 / -5.0% 0.48 / 0.48 / +0.7%
tpcds_q93/datafusion:vortex-compact 24986692 / 24571238 / +1.7% 47076737 / 46143664 / +2.0% 0.53 / 0.53 / -0.3%
tpcds_q94/datafusion:vortex-compact 21184615 / 20893561 / +1.4% 40127354 / 40358574 / -0.6% 0.53 / 0.52 / +2.0%
tpcds_q95/datafusion:vortex-compact 47387599 / 47803136 / -0.9% 67908784 / 68531876 / -0.9% 0.70 / 0.70 / +0.0%
tpcds_q96/datafusion:vortex-compact 8556190 / 8862137 / -3.5% 25124828 / 25146534 / -0.1% 0.34 / 0.35 / -3.4%
tpcds_q97/datafusion:vortex-compact 21476878 / 21319668 / +0.7% 43418137 / 43809833 / -0.9% 0.49 / 0.49 / +1.6%
tpcds_q98/datafusion:vortex-compact 21453174 / 21374617 / +0.4% 42971686 / 42361537 / +1.4% 0.50 / 0.50 / -1.1%
tpcds_q99/datafusion:vortex-compact 19613582 / 19668228 / -0.3% 37428710 / 37841347 / -1.1% 0.52 / 0.52 / +0.8%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31289684 / 32281240 / -3.1% 49333422 / 50408147 / -2.1% 0.63 / 0.64 / -1.0%
tpcds_q02/datafusion:parquet 40627041 / 39809106 / +2.1% 58615922 / 58839391 / -0.4% 0.69 / 0.68 / +2.4%
tpcds_q03/datafusion:parquet 16452254 / 16163972 / +1.8% 31260881 / 32132011 / -2.7% 0.53 / 0.50 / +4.6%
tpcds_q04/datafusion:parquet 201942346 / 202397644 / -0.2% 231667510 / 225866680 / +2.6% 0.87 / 0.90 / -2.7%
tpcds_q05/datafusion:parquet 71044805 / 72486976 / -2.0% 94698781 / 93147130 / +1.7% 0.75 / 0.78 / -3.6%
tpcds_q06/datafusion:parquet 28430868 / 28247289 / +0.6% 50017238 / 48761767 / +2.6% 0.57 / 0.58 / -1.9%
tpcds_q07/datafusion:parquet 46655278 / 46312160 / +0.7% 67385486 / 68045267 / -1.0% 0.69 / 0.68 / +1.7%
tpcds_q08/datafusion:parquet 30585110 / 31679252 / -3.5% 50744066 / 50495454 / +0.5% 0.60 / 0.63 / -3.9%
tpcds_q09/datafusion:parquet 32410188 / 32111144 / +0.9% 45261493 / 43989647 / +2.9% 0.72 / 0.73 / -1.9%
tpcds_q10/datafusion:parquet 41716256 / 42070318 / -0.8% 62890329 / 63513337 / -1.0% 0.66 / 0.66 / +0.1%
tpcds_q11/datafusion:parquet 95374871 / 95114643 / +0.3% 119214075 / 118946428 / +0.2% 0.80 / 0.80 / +0.0%
tpcds_q12/datafusion:parquet 21947376 / 21440618 / +2.4% 35825663 / 36650011 / -2.2% 0.61 / 0.59 / +4.7%
tpcds_q13/datafusion:parquet 41616043 / 43083074 / -3.4% 68173126 / 69089879 / -1.3% 0.61 / 0.62 / -2.1%
tpcds_q14/datafusion:parquet 126087888 / 127591468 / -1.2% 152459210 / 150103396 / +1.6% 0.83 / 0.85 / -2.7%
tpcds_q15/datafusion:parquet 33069622 / 33371345 / -0.9% 50297289 / 49776317 / +1.0% 0.66 / 0.67 / -1.9%
tpcds_q16/datafusion:parquet 36747116 / 37596738 / -2.3% 53117071 / 55965633 / -5.1% 0.69 / 0.67 / +3.0%
tpcds_q17/datafusion:parquet 77400480 / 76858848 / +0.7% 104378804 / 105285599 / -0.9% 0.74 / 0.73 / +1.6%
tpcds_q18/datafusion:parquet 61785436 / 59613346 / +3.6% 80404886 / 85821165 / -6.3% 0.77 / 0.69 / +10.6%
tpcds_q19/datafusion:parquet 26377476 / 26773022 / -1.5% 45042587 / 46449468 / -3.0% 0.59 / 0.58 / +1.6%
tpcds_q20/datafusion:parquet 23246705 / 22816162 / +1.9% 37531573 / 38561023 / -2.7% 0.62 / 0.59 / +4.7%
tpcds_q21/datafusion:parquet 17719256 / 17989972 / -1.5% 32074491 / 33467548 / -4.2% 0.55 / 0.54 / +2.8%
tpcds_q22/datafusion:parquet 74807574 / 76074572 / -1.7% 90747936 / 90693007 / +0.1% 0.82 / 0.84 / -1.7%
tpcds_q23/datafusion:parquet 108274861 / 106769008 / +1.4% 137884403 / 136496118 / +1.0% 0.79 / 0.78 / +0.4%
tpcds_q24/datafusion:parquet 96462418 / 95990190 / +0.5% 125911510 / 120929392 / +4.1% 0.77 / 0.79 / -3.5%
tpcds_q25/datafusion:parquet 78807644 / 77636259 / +1.5% 102245733 / 107099730 / -4.5% 0.77 / 0.72 / +6.3%
tpcds_q26/datafusion:parquet 43846640 / 43028817 / +1.9% 63945284 / 62319001 / +2.6% 0.69 / 0.69 / -0.7%
tpcds_q27/datafusion:parquet 74484438 / 76160162 / -2.2% 96523455 / 96613586 / -0.1% 0.77 / 0.79 / -2.1%
tpcds_q28/datafusion:parquet 27611518 / 27605501 / +0.0% 44205421 / 44012779 / +0.4% 0.62 / 0.63 / -0.4%
tpcds_q29/datafusion:parquet 78613887 / 78118353 / +0.6% 105511221 / 105229225 / +0.3% 0.75 / 0.74 / +0.4%
tpcds_q30/datafusion:parquet 44860720 / 44054258 / +1.8% 66002693 / 64672098 / +2.1% 0.68 / 0.68 / -0.2%
tpcds_q31/datafusion:parquet 80306996 / 81042142 / -0.9% 103256063 / 102025315 / +1.2% 0.78 / 0.79 / -2.1%
tpcds_q32/datafusion:parquet 23047998 / 23361528 / -1.3% 40170467 / 39413612 / +1.9% 0.57 / 0.59 / -3.2%
tpcds_q33/datafusion:parquet 32642272 / 33192470 / -1.7% 51133653 / 51069146 / +0.1% 0.64 / 0.65 / -1.8%
tpcds_q34/datafusion:parquet 23346677 / 22912867 / +1.9% 39643989 / 38886945 / +1.9% 0.59 / 0.59 / -0.1%
tpcds_q35/datafusion:parquet 50015866 / 51190898 / -2.3% 68705324 / 69067227 / -0.5% 0.73 / 0.74 / -1.8%
tpcds_q36/datafusion:parquet 53835255 / 52987378 / +1.6% 74673697 / 79830692 / -6.5% 0.72 / 0.66 / +8.6%
tpcds_q37/datafusion:parquet 22829653 / 22961535 / -0.6% 38279809 / 40061209 / -4.4% 0.60 / 0.57 / +4.1%
tpcds_q38/datafusion:parquet 43801151 / 43516144 / +0.7% 64840907 / 63544025 / +2.0% 0.68 / 0.68 / -1.4%
tpcds_q39/datafusion:parquet 71464604 / 71387547 / +0.1% 89641868 / 90874927 / -1.4% 0.80 / 0.79 / +1.5%
tpcds_q40/datafusion:parquet 30264202 / 29921021 / +1.1% 50844964 / 50393410 / +0.9% 0.60 / 0.59 / +0.2%
tpcds_q41/datafusion:parquet 17403098 / 17386562 / +0.1% 29414049 / 29808926 / -1.3% 0.59 / 0.58 / +1.4%
tpcds_q42/datafusion:parquet 15601008 / 15280238 / +2.1% 30153439 / 30107155 / +0.2% 0.52 / 0.51 / +1.9%
tpcds_q43/datafusion:parquet 17061265 / 17467698 / -2.3% 32532961 / 32283435 / +0.8% 0.52 / 0.54 / -3.1%
tpcds_q44/datafusion:parquet 33062798 / 33374672 / -0.9% 50845382 / 52396946 / -3.0% 0.65 / 0.64 / +2.1%
tpcds_q45/datafusion:parquet 37266352 / 37461106 / -0.5% 55799469 / 55648475 / +0.3% 0.67 / 0.67 / -0.8%
tpcds_q46/datafusion:parquet 28407632 / 28428908 / -0.1% 50338796 / 50543059 / -0.4% 0.56 / 0.56 / +0.3%
tpcds_q47/datafusion:parquet 96169558 / 96251108 / -0.1% 123657728 / 124129145 / -0.4% 0.78 / 0.78 / +0.3%
tpcds_q48/datafusion:parquet 38072036 / 38050050 / +0.1% 59432664 / 59138140 / +0.5% 0.64 / 0.64 / -0.4%
tpcds_q49/datafusion:parquet 76078258 / 75324264 / +1.0% 100218690 / 102248977 / -2.0% 0.76 / 0.74 / +3.0%
tpcds_q50/datafusion:parquet 49663402 / 49430142 / +0.5% 72360930 / 72673740 / -0.4% 0.69 / 0.68 / +0.9%
tpcds_q51/datafusion:parquet 66711532 / 67519482 / -1.2% 92907883 / 93055370 / -0.2% 0.72 / 0.73 / -1.0%
tpcds_q52/datafusion:parquet 15864398 / 15940254 / -0.5% 31033536 / 31821031 / -2.5% 0.51 / 0.50 / +2.0%
tpcds_q53/datafusion:parquet 21850826 / 21661396 / +0.9% 39773575 / 38485785 / +3.3% 0.55 / 0.56 / -2.4%
tpcds_q54/datafusion:parquet 45584690 / 45180012 / +0.9% 66977755 / 64449478 / +3.9% 0.68 / 0.70 / -2.9%
tpcds_q55/datafusion:parquet 15495316 / 15309337 / +1.2% 30609771 / 30177571 / +1.4% 0.51 / 0.51 / -0.2%
tpcds_q56/datafusion:parquet 32075836 / 31823182 / +0.8% 53008845 / 55085378 / -3.8% 0.61 / 0.58 / +4.7%
tpcds_q57/datafusion:parquet 98939220 / 99041231 / -0.1% 122735690 / 122544539 / +0.2% 0.81 / 0.81 / -0.3%
tpcds_q58/datafusion:parquet 64573724 / 64914018 / -0.5% 86014155 / 86474143 / -0.5% 0.75 / 0.75 / +0.0%
tpcds_q59/datafusion:parquet 42704306 / 43069616 / -0.8% 63568634 / 63360615 / +0.3% 0.67 / 0.68 / -1.2%
tpcds_q60/datafusion:parquet 31624990 / 32586226 / -2.9% 53957456 / 53441811 / +1.0% 0.59 / 0.61 / -3.9%
tpcds_q61/datafusion:parquet 34636256 / 34050339 / +1.7% 57336654 / 53652408 / +6.9% 0.60 / 0.63 / -4.8%
tpcds_q62/datafusion:parquet 24234681 / 24038384 / +0.8% 39207918 / 40380914 / -2.9% 0.62 / 0.60 / +3.8%
tpcds_q63/datafusion:parquet 22007516 / 22341353 / -1.5% 38336129 / 38593083 / -0.7% 0.57 / 0.58 / -0.8%
tpcds_q64/datafusion:parquet 204595886 / 205587435 / -0.5% 237287230 / 240107927 / -1.2% 0.86 / 0.86 / +0.7%
tpcds_q65/datafusion:parquet 38977471 / 39038035 / -0.2% 59117392 / 60100124 / -1.6% 0.66 / 0.65 / +1.5%
tpcds_q66/datafusion:parquet 63168146 / 62326104 / +1.4% 80523472 / 80455903 / +0.1% 0.78 / 0.77 / +1.3%
tpcds_q67/datafusion:parquet 70267842 / 70395766 / -0.2% 96177377 / 96023762 / +0.2% 0.73 / 0.73 / -0.3%
tpcds_q68/datafusion:parquet 28613084 / 29289780 / -2.3% 52494521 / 52117788 / +0.7% 0.55 / 0.56 / -3.0%
tpcds_q69/datafusion:parquet 40360268 / 42464273 / -5.0% 60286904 / 60596947 / -0.5% 0.67 / 0.70 / -4.5%
tpcds_q70/datafusion:parquet 32364806 / 32155638 / +0.7% 55415162 / 58252141 / -4.9% 0.58 / 0.55 / +5.8%
tpcds_q71/datafusion:parquet 24268905 / 23330172 / +4.0% 40327943 / 37978940 / +6.2% 0.60 / 0.61 / -2.0%
tpcds_q72/datafusion:parquet 551105369 / 547884373 / +0.6% 582980020 / 575691397 / +1.3% 0.95 / 0.95 / -0.7%
tpcds_q73/datafusion:parquet 22134065 / 21928678 / +0.9% 38844504 / 39228942 / -1.0% 0.57 / 0.56 / +1.9%
tpcds_q74/datafusion:parquet 67778172 / 66562858 / +1.8% 90445799 / 86967814 / +4.0% 0.75 / 0.77 / -2.1%
tpcds_q75/datafusion:parquet 148855186 / 150156579 / -0.9% 181521072 / 183977883 / -1.3% 0.82 / 0.82 / +0.5%
tpcds_q76/datafusion:parquet 48133578 / 47836186 / +0.6% 63906104 / 65449186 / -2.4% 0.75 / 0.73 / +3.1%
tpcds_q77/datafusion:parquet 55011916 / 53401257 / +3.0% 76243433 / 73452083 / +3.8% 0.72 / 0.73 / -0.8%
tpcds_q78/datafusion:parquet 91043164 / 92993546 / -2.1% 127380007 / 121377948 / +4.9% 0.71 / 0.77 / -6.7%
tpcds_q79/datafusion:parquet 26319247 / 25542148 / +3.0% 47096141 / 44545660 / +5.7% 0.56 / 0.57 / -2.5%
tpcds_q80/datafusion:parquet 81848750 / 83127648 / -1.5% 111294881 / 112851323 / -1.4% 0.74 / 0.74 / -0.2%
tpcds_q81/datafusion:parquet 39340048 / 38250425 / +2.8% 58304853 / 64687505 / -9.9% 0.67 / 0.59 / +14.1%
tpcds_q82/datafusion:parquet 25542542 / 25413183 / +0.5% 40321855 / 41487444 / -2.8% 0.63 / 0.61 / +3.4%
tpcds_q83/datafusion:parquet 48266411 / 48139248 / +0.3% 67634916 / 68492459 / -1.3% 0.71 / 0.70 / +1.5%
tpcds_q84/datafusion:parquet 29650736 / 30642353 / -3.2% 46388496 / 46594271 / -0.4% 0.64 / 0.66 / -2.8%
tpcds_q85/datafusion:parquet 86630507 / 86179434 / +0.5% 109271857 / 107726467 / +1.4% 0.79 / 0.80 / -0.9%
tpcds_q86/datafusion:parquet 20804669 / 20667898 / +0.7% 34476656 / 34774758 / -0.9% 0.60 / 0.59 / +1.5%
tpcds_q87/datafusion:parquet 41746250 / 42919750 / -2.7% 63719060 / 62353021 / +2.2% 0.66 / 0.69 / -4.8%
tpcds_q88/datafusion:parquet 38508976 / 37894726 / +1.6% 65930336 / 58127138 / +13.4% 🔴 0.58 / 0.65 / -10.4%
tpcds_q89/datafusion:parquet 25189242 / 25095709 / +0.4% 42909915 / 43043731 / -0.3% 0.59 / 0.58 / +0.7%
tpcds_q90/datafusion:parquet 15192982 / 15544135 / -2.3% 30732349 / 31268801 / -1.7% 0.49 / 0.50 / -0.6%
tpcds_q91/datafusion:parquet 31859996 / 32284374 / -1.3% 49346233 / 51503872 / -4.2% 0.65 / 0.63 / +3.0%
tpcds_q92/datafusion:parquet 23361206 / 23557744 / -0.8% 41022996 / 40868519 / +0.4% 0.57 / 0.58 / -1.2%
tpcds_q93/datafusion:parquet 27431974 / 27723424 / -1.1% 49898753 / 49411610 / +1.0% 0.55 / 0.56 / -2.0%
tpcds_q94/datafusion:parquet 31970069 / 32099830 / -0.4% 49411042 / 49707341 / -0.6% 0.65 / 0.65 / +0.2%
tpcds_q95/datafusion:parquet 65979012 / 65922832 / +0.1% 80468532 / 82340726 / -2.3% 0.82 / 0.80 / +2.4%
tpcds_q96/datafusion:parquet 13056463 / 12767522 / +2.3% 28603640 / 28575752 / +0.1% 0.46 / 0.45 / +2.2%
tpcds_q97/datafusion:parquet 31915540 / 32289906 / -1.2% 54294108 / 51722990 / +5.0% 0.59 / 0.62 / -5.8%
tpcds_q98/datafusion:parquet 22519173 / 22690576 / -0.8% 38159191 / 39148781 / -2.5% 0.59 / 0.58 / +1.8%
tpcds_q99/datafusion:parquet 28872912 / 28336486 / +1.9% 43265360 / 43820440 / -1.3% 0.67 / 0.65 / +3.2%
duckdb / vortex-file-compressed / ns (1.002x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15189268 / 15119516 / +0.5% 22653286 / 22343773 / +1.4% 0.67 / 0.68 / -0.9%
tpcds_q02/duckdb:vortex-file-compressed 14900715 / 15258448 / -2.3% 20992733 / 20321233 / +3.3% 0.71 / 0.75 / -5.5%
tpcds_q03/duckdb:vortex-file-compressed 11665286 / 12195850 / -4.4% 23861822 / 19322295 / +23.5% 🔴 0.49 / 0.63 / -22.5%
tpcds_q04/duckdb:vortex-file-compressed 51220190 / 49912428 / +2.6% 61239591 / 60671380 / +0.9% 0.84 / 0.82 / +1.7%
tpcds_q05/duckdb:vortex-file-compressed 19041076 / 18778858 / +1.4% 30777169 / 25950484 / +18.6% 🔴 0.62 / 0.72 / -14.5%
tpcds_q06/duckdb:vortex-file-compressed 27006988 / 26997931 / +0.0% 43912485 / 42087823 / +4.3% 0.62 / 0.64 / -4.1%
tpcds_q07/duckdb:vortex-file-compressed 16630055 / 15945318 / +4.3% 31190721 / 29385818 / +6.1% 0.53 / 0.54 / -1.7%
tpcds_q08/duckdb:vortex-file-compressed 18911914 / 18814704 / +0.5% 29990094 / 27532880 / +8.9% 0.63 / 0.68 / -7.7%
tpcds_q09/duckdb:vortex-file-compressed 13831350 / 13548806 / +2.1% 25286642 / 20436366 / +23.7% 🔴 0.55 / 0.66 / -17.5%
tpcds_q10/duckdb:vortex-file-compressed 27433512 / 27312542 / +0.4% 40045855 / 41155161 / -2.7% 0.69 / 0.66 / +3.2%
tpcds_q11/duckdb:vortex-file-compressed 40125893 / 40327276 / -0.5% 54635164 / 50697464 / +7.8% 0.73 / 0.80 / -7.7%
tpcds_q12/duckdb:vortex-file-compressed 10033799 / 10278692 / -2.4% 20027995 / 16378602 / +22.3% 🔴 0.50 / 0.63 / -20.2%
tpcds_q13/duckdb:vortex-file-compressed 21383874 / 21439286 / -0.3% 34937015 / 34724811 / +0.6% 0.61 / 0.62 / -0.9%
tpcds_q14/duckdb:vortex-file-compressed 60792425 / 58209799 / +4.4% 72788275 / 71112998 / +2.4% 0.84 / 0.82 / +2.0%
tpcds_q15/duckdb:vortex-file-compressed 20754256 / 21073598 / -1.5% 25751331 / 28112654 / -8.4% 0.81 / 0.75 / +7.5%
tpcds_q16/duckdb:vortex-file-compressed 17424584 / 17608117 / -1.0% 26230753 / 27083758 / -3.1% 0.66 / 0.65 / +2.2%
tpcds_q17/duckdb:vortex-file-compressed 30139322 / 29856804 / +0.9% 46581990 / 43506681 / +7.1% 0.65 / 0.69 / -5.7%
tpcds_q18/duckdb:vortex-file-compressed 28454221 / 28811196 / -1.2% 38793941 / 37649811 / +3.0% 0.73 / 0.77 / -4.2%
tpcds_q19/duckdb:vortex-file-compressed 23451143 / 23479608 / -0.1% 36444795 / 34051799 / +7.0% 0.64 / 0.69 / -6.7%
tpcds_q20/duckdb:vortex-file-compressed 10632722 / 10770220 / -1.3% 14759223 / 16001510 / -7.8% 0.72 / 0.67 / +7.0%
tpcds_q21/duckdb:vortex-file-compressed 9801834 / 10012905 / -2.1% 18964455 / 25795057 / -26.5% 🟢 0.52 / 0.39 / +33.2%
tpcds_q22/duckdb:vortex-file-compressed 28878098 / 30030375 / -3.8% 41703153 / 40673635 / +2.5% 0.69 / 0.74 / -6.2%
tpcds_q23/duckdb:vortex-file-compressed 36413108 / 37100676 / -1.9% 49019259 / 48668455 / +0.7% 0.74 / 0.76 / -2.6%
tpcds_q24/duckdb:vortex-file-compressed 27957132 / 29069076 / -3.8% 40748842 / 40312484 / +1.1% 0.69 / 0.72 / -4.9%
tpcds_q25/duckdb:vortex-file-compressed 26094908 / 25218285 / +3.5% 38631132 / 38196801 / +1.1% 0.68 / 0.66 / +2.3%
tpcds_q26/duckdb:vortex-file-compressed 13443824 / 13575702 / -1.0% 21362016 / 20650574 / +3.4% 0.63 / 0.66 / -4.3%
tpcds_q27/duckdb:vortex-file-compressed 17424737 / 16810777 / +3.7% 35471054 / 28783654 / +23.2% 🔴 0.49 / 0.58 / -15.9%
tpcds_q28/duckdb:vortex-file-compressed 12633918 / 12970640 / -2.6% 21429989 / 17616818 / +21.6% 🔴 0.59 / 0.74 / -19.9%
tpcds_q29/duckdb:vortex-file-compressed 28602450 / 28409486 / +0.7% 46100752 / 44199481 / +4.3% 0.62 / 0.64 / -3.5%
tpcds_q30/duckdb:vortex-file-compressed 19219324 / 19108167 / +0.6% 27964840 / 28256371 / -1.0% 0.69 / 0.68 / +1.6%
tpcds_q31/duckdb:vortex-file-compressed 19306838 / 19104747 / +1.1% 27654312 / 32364740 / -14.6% 🟢 0.70 / 0.59 / +18.3%
tpcds_q32/duckdb:vortex-file-compressed 9901460 / 9871078 / +0.3% 16092235 / 16905314 / -4.8% 0.62 / 0.58 / +5.4%
tpcds_q33/duckdb:vortex-file-compressed 16896734 / 16772226 / +0.7% 28541196 / 27052485 / +5.5% 0.59 / 0.62 / -4.5%
tpcds_q34/duckdb:vortex-file-compressed 15613986 / 15444234 / +1.1% 21766884 / 23733089 / -8.3% 0.72 / 0.65 / +10.2%
tpcds_q35/duckdb:vortex-file-compressed 47211635 / 46038052 / +2.5% 61429248 / 67698803 / -9.3% 0.77 / 0.68 / +13.0%
tpcds_q36/duckdb:vortex-file-compressed 15016457 / 16471123 / -8.8% 28123805 / 26464912 / +6.3% 0.53 / 0.62 / -14.2%
tpcds_q37/duckdb:vortex-file-compressed 13963987 / 14039618 / -0.5% 22818480 / 23590204 / -3.3% 0.61 / 0.60 / +2.8%
tpcds_q38/duckdb:vortex-file-compressed 22337294 / 22291022 / +0.2% 30735487 / 28440426 / +8.1% 0.73 / 0.78 / -7.3%
tpcds_q39/duckdb:vortex-file-compressed 18963288 / 18482006 / +2.6% 28594050 / 30224882 / -5.4% 0.66 / 0.61 / +8.5%
tpcds_q40/duckdb:vortex-file-compressed 13011350 / 13088346 / -0.6% 18611433 / 24512906 / -24.1% 🟢 0.70 / 0.53 / +30.9%
tpcds_q41/duckdb:vortex-file-compressed 6246882 / 6274609 / -0.4% 8948937 / 12466843 / -28.2% 🟢 0.70 / 0.50 / +38.7%
tpcds_q42/duckdb:vortex-file-compressed 8022739 / 8622092 / -7.0% 17672799 / 18789774 / -5.9% 0.45 / 0.46 / -1.1%
tpcds_q43/duckdb:vortex-file-compressed 11476734 / 9812302 / +17.0% 🔴 22501020 / 18088601 / +24.4% 🔴 0.51 / 0.54 / -6.0%
tpcds_q44/duckdb:vortex-file-compressed 15950076 / 16643585 / -4.2% 26066946 / 26881476 / -3.0% 0.61 / 0.62 / -1.2%
tpcds_q45/duckdb:vortex-file-compressed 22316914 / 22191888 / +0.6% 29455518 / 29601337 / -0.5% 0.76 / 0.75 / +1.1%
tpcds_q46/duckdb:vortex-file-compressed 18755346 / 18624784 / +0.7% 29396211 / 28692141 / +2.5% 0.64 / 0.65 / -1.7%
tpcds_q47/duckdb:vortex-file-compressed 30682982 / 32102406 / -4.4% 41817184 / 41162782 / +1.6% 0.73 / 0.78 / -5.9%
tpcds_q48/duckdb:vortex-file-compressed 19335878 / 19321740 / +0.1% 31436717 / 32324904 / -2.7% 0.62 / 0.60 / +2.9%
tpcds_q49/duckdb:vortex-file-compressed 16557450 / 16687204 / -0.8% 28718191 / 29040866 / -1.1% 0.58 / 0.57 / +0.3%
tpcds_q50/duckdb:vortex-file-compressed 16291594 / 16353860 / -0.4% 28332723 / 32712001 / -13.4% 🟢 0.58 / 0.50 / +15.0%
tpcds_q51/duckdb:vortex-file-compressed 65825572 / 77781581 / -15.4% 🟢 62344739 / 61783627 / +0.9% 1.06 / 1.26 / -16.1%
tpcds_q52/duckdb:vortex-file-compressed 8964921 / 8421898 / +6.4% 18037297 / 22878145 / -21.2% 🟢 0.50 / 0.37 / +35.0%
tpcds_q53/duckdb:vortex-file-compressed 14072388 / 14033304 / +0.3% 25175093 / 24182032 / +4.1% 0.56 / 0.58 / -3.7%
tpcds_q54/duckdb:vortex-file-compressed 21713635 / 19854394 / +9.4% 32801438 / 29739637 / +10.3% 🔴 0.66 / 0.67 / -0.8%
tpcds_q55/duckdb:vortex-file-compressed 9446428 / 10296834 / -8.3% 21192253 / 18864136 / +12.3% 🔴 0.45 / 0.55 / -18.3%
tpcds_q56/duckdb:vortex-file-compressed 16838010 / 18269036 / -7.8% 28774080 / 30516604 / -5.7% 0.59 / 0.60 / -2.3%
tpcds_q57/duckdb:vortex-file-compressed 25140521 / 24298162 / +3.5% 36846199 / 33617665 / +9.6% 0.68 / 0.72 / -5.6%
tpcds_q58/duckdb:vortex-file-compressed 17738722 / 17488612 / +1.4% 28711098 / 27651831 / +3.8% 0.62 / 0.63 / -2.3%
tpcds_q59/duckdb:vortex-file-compressed 19111644 / 18315174 / +4.3% 25486127 / 25977089 / -1.9% 0.75 / 0.71 / +6.4%
tpcds_q60/duckdb:vortex-file-compressed 17921958 / 17930870 / -0.0% 29889510 / 30003512 / -0.4% 0.60 / 0.60 / +0.3%
tpcds_q61/duckdb:vortex-file-compressed 19648716 / 19080313 / +3.0% 32470739 / 30133649 / +7.8% 0.61 / 0.63 / -4.4%
tpcds_q62/duckdb:vortex-file-compressed 11226542 / 9979820 / +12.5% 🔴 15908488 / 17727346 / -10.3% 🟢 0.71 / 0.56 / +25.4%
tpcds_q63/duckdb:vortex-file-compressed 13155296 / 13461705 / -2.3% 26073404 / 22616906 / +15.3% 🔴 0.50 / 0.60 / -15.2%
tpcds_q64/duckdb:vortex-file-compressed 63127854 / 63309766 / -0.3% 85026613 / 80553452 / +5.6% 0.74 / 0.79 / -5.5%
tpcds_q65/duckdb:vortex-file-compressed 16597131 / 15430762 / +7.6% 26757251 / 27741311 / -3.5% 0.62 / 0.56 / +11.5%
tpcds_q66/duckdb:vortex-file-compressed 21055984 / 21218204 / -0.8% 31588213 / 29909827 / +5.6% 0.67 / 0.71 / -6.0%
tpcds_q67/duckdb:vortex-file-compressed 65044818 / 65821184 / -1.2% 82892216 / 82853975 / +0.0% 0.78 / 0.79 / -1.2%
tpcds_q68/duckdb:vortex-file-compressed 18250773 / 18685912 / -2.3% 28141499 / 29965983 / -6.1% 0.65 / 0.62 / +4.0%
tpcds_q69/duckdb:vortex-file-compressed 28666736 / 29191996 / -1.8% 40314168 / 45970009 / -12.3% 🟢 0.71 / 0.64 / +12.0%
tpcds_q70/duckdb:vortex-file-compressed 18725785 / 18603976 / +0.7% 32698141 / 28133968 / +16.2% 🔴 0.57 / 0.66 / -13.4%
tpcds_q71/duckdb:vortex-file-compressed 12536878 / 12804974 / -2.1% 24131203 / 22437335 / +7.5% 0.52 / 0.57 / -9.0%
tpcds_q72/duckdb:vortex-file-compressed 62172844 / 62977106 / -1.3% 76805316 / 78482674 / -2.1% 0.81 / 0.80 / +0.9%
tpcds_q73/duckdb:vortex-file-compressed 14778654 / 14881838 / -0.7% 24002632 / 23218396 / +3.4% 0.62 / 0.64 / -3.9%
tpcds_q74/duckdb:vortex-file-compressed 27421278 / 27401129 / +0.1% 36516947 / 35560078 / +2.7% 0.75 / 0.77 / -2.5%
tpcds_q75/duckdb:vortex-file-compressed 28560830 / 30135953 / -5.2% 40140061 / 40134738 / +0.0% 0.71 / 0.75 / -5.2%
tpcds_q76/duckdb:vortex-file-compressed 12137844 / 12199748 / -0.5% 24817541 / 24449005 / +1.5% 0.49 / 0.50 / -2.0%
tpcds_q77/duckdb:vortex-file-compressed 15792730 / 15963454 / -1.1% 25412080 / 25880574 / -1.8% 0.62 / 0.62 / +0.8%
tpcds_q78/duckdb:vortex-file-compressed 37274968 / 37197787 / +0.2% 48284866 / 45925950 / +5.1% 0.77 / 0.81 / -4.7%
tpcds_q79/duckdb:vortex-file-compressed 14748436 / 14228388 / +3.7% 26857625 / 23170072 / +15.9% 🔴 0.55 / 0.61 / -10.6%
tpcds_q80/duckdb:vortex-file-compressed 27475909 / 27906697 / -1.5% 42488732 / 43018334 / -1.2% 0.65 / 0.65 / -0.3%
tpcds_q81/duckdb:vortex-file-compressed 22686387 / 22345602 / +1.5% 30432886 / 30180387 / +0.8% 0.75 / 0.74 / +0.7%
tpcds_q82/duckdb:vortex-file-compressed 32528446 / 32141395 / +1.2% 41116392 / 42314459 / -2.8% 0.79 / 0.76 / +4.2%
tpcds_q83/duckdb:vortex-file-compressed 19383786 / 19849765 / -2.3% 24028419 / 24874930 / -3.4% 0.81 / 0.80 / +1.1%
tpcds_q84/duckdb:vortex-file-compressed 12779354 / 12640178 / +1.1% 19393608 / 22013854 / -11.9% 🟢 0.66 / 0.57 / +14.8%
tpcds_q85/duckdb:vortex-file-compressed 31121374 / 31179083 / -0.2% 40089485 / 39923249 / +0.4% 0.78 / 0.78 / -0.6%
tpcds_q86/duckdb:vortex-file-compressed 13323546 / 10779680 / +23.6% 🔴 20929139 / 17596619 / +18.9% 🔴 0.64 / 0.61 / +3.9%
tpcds_q87/duckdb:vortex-file-compressed 23910534 / 24117584 / -0.9% 29685372 / 30306754 / -2.1% 0.81 / 0.80 / +1.2%
tpcds_q88/duckdb:vortex-file-compressed 32228375 / 31475456 / +2.4% 45390080 / 44788639 / +1.3% 0.71 / 0.70 / +1.0%
tpcds_q89/duckdb:vortex-file-compressed 13926028 / 13752106 / +1.3% 23901641 / 22875978 / +4.5% 0.58 / 0.60 / -3.1%
tpcds_q90/duckdb:vortex-file-compressed 8002371 / 8586364 / -6.8% 13146561 / 14466978 / -9.1% 0.61 / 0.59 / +2.6%
tpcds_q91/duckdb:vortex-file-compressed 15197990 / 15171636 / +0.2% 21771024 / 22093465 / -1.5% 0.70 / 0.69 / +1.7%
tpcds_q92/duckdb:vortex-file-compressed 12838880 / 12524236 / +2.5% 20729140 / 20130372 / +3.0% 0.62 / 0.62 / -0.4%
tpcds_q93/duckdb:vortex-file-compressed 17526802 / 17379642 / +0.8% 24359041 / 24282617 / +0.3% 0.72 / 0.72 / +0.5%
tpcds_q94/duckdb:vortex-file-compressed 16458380 / 16090056 / +2.3% 26875348 / 25235854 / +6.5% 0.61 / 0.64 / -4.0%
tpcds_q95/duckdb:vortex-file-compressed 45022311 / 45612376 / -1.3% 57145224 / 53228688 / +7.4% 0.79 / 0.86 / -8.1%
tpcds_q96/duckdb:vortex-file-compressed 7502976 / 7014168 / +7.0% 18565007 / 14315018 / +29.7% 🔴 0.40 / 0.49 / -17.5%
tpcds_q97/duckdb:vortex-file-compressed 22316002 / 22196233 / +0.5% 29127178 / 29677329 / -1.9% 0.77 / 0.75 / +2.4%
tpcds_q98/duckdb:vortex-file-compressed 13540126 / 13344176 / +1.5% 22927922 / 21753086 / +5.4% 0.59 / 0.61 / -3.7%
tpcds_q99/duckdb:vortex-file-compressed 13434885 / 13481773 / -0.3% 19442198 / 22497544 / -13.6% 🟢 0.69 / 0.60 / +15.3%
duckdb / vortex-compact / ns (0.999x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16597800 / 17005232 / -2.4% 23532196 / 23558577 / -0.1% 0.71 / 0.72 / -2.3%
tpcds_q02/duckdb:vortex-compact 14974032 / 14867687 / +0.7% 20540768 / 20252935 / +1.4% 0.73 / 0.73 / -0.7%
tpcds_q03/duckdb:vortex-compact 19583292 / 19656571 / -0.4% 30493042 / 30885926 / -1.3% 0.64 / 0.64 / +0.9%
tpcds_q04/duckdb:vortex-compact 52997648 / 55001172 / -3.6% 62821162 / 63389127 / -0.9% 0.84 / 0.87 / -2.8%
tpcds_q05/duckdb:vortex-compact 21185749 / 20729558 / +2.2% 31001491 / 27401713 / +13.1% 🔴 0.68 / 0.76 / -9.7%
tpcds_q06/duckdb:vortex-compact 28508410 / 28434915 / +0.3% 41057455 / 41591354 / -1.3% 0.69 / 0.68 / +1.6%
tpcds_q07/duckdb:vortex-compact 20394295 / 20374292 / +0.1% 32575734 / 30051192 / +8.4% 0.63 / 0.68 / -7.7%
tpcds_q08/duckdb:vortex-compact 31169008 / 29387774 / +6.1% 41615618 / 43171990 / -3.6% 0.75 / 0.68 / +10.0%
tpcds_q09/duckdb:vortex-compact 19230499 / 19144709 / +0.4% 26787312 / 26047027 / +2.8% 0.72 / 0.74 / -2.3%
tpcds_q10/duckdb:vortex-compact 33926726 / 33663381 / +0.8% 45670079 / 47275577 / -3.4% 0.74 / 0.71 / +4.3%
tpcds_q11/duckdb:vortex-compact 42223856 / 42649256 / -1.0% 56313381 / 54392603 / +3.5% 0.75 / 0.78 / -4.4%
tpcds_q12/duckdb:vortex-compact 13426072 / 13614264 / -1.4% 20107960 / 18889763 / +6.4% 0.67 / 0.72 / -7.4%
tpcds_q13/duckdb:vortex-compact 26125674 / 29929765 / -12.7% 🟢 39606004 / 40718360 / -2.7% 0.66 / 0.74 / -10.3%
tpcds_q14/duckdb:vortex-compact 61492451 / 62701237 / -1.9% 75863188 / 82565892 / -8.1% 0.81 / 0.76 / +6.7%
tpcds_q15/duckdb:vortex-compact 23611026 / 23393982 / +0.9% 28489805 / 29559929 / -3.6% 0.83 / 0.79 / +4.7%
tpcds_q16/duckdb:vortex-compact 19393626 / 19004977 / +2.0% 28952685 / 29420814 / -1.6% 0.67 / 0.65 / +3.7%
tpcds_q17/duckdb:vortex-compact 35146491 / 35113520 / +0.1% 49156682 / 47653574 / +3.2% 0.71 / 0.74 / -3.0%
tpcds_q18/duckdb:vortex-compact 31682460 / 32128664 / -1.4% 44339159 / 40671567 / +9.0% 0.71 / 0.79 / -9.5%
tpcds_q19/duckdb:vortex-compact 27788434 / 27821774 / -0.1% 38504275 / 36585774 / +5.2% 0.72 / 0.76 / -5.1%
tpcds_q20/duckdb:vortex-compact 13323590 / 13184610 / +1.1% 18517131 / 18748917 / -1.2% 0.72 / 0.70 / +2.3%
tpcds_q21/duckdb:vortex-compact 10481663 / 11530005 / -9.1% 18742809 / 19067585 / -1.7% 0.56 / 0.60 / -7.5%
tpcds_q22/duckdb:vortex-compact 30975468 / 30170620 / +2.7% 41629635 / 43397825 / -4.1% 0.74 / 0.70 / +7.0%
tpcds_q23/duckdb:vortex-compact 38907894 / 39118432 / -0.5% 52057417 / 52682459 / -1.2% 0.75 / 0.74 / +0.7%
tpcds_q24/duckdb:vortex-compact 31674258 / 31073316 / +1.9% 43484845 / 40506717 / +7.4% 0.73 / 0.77 / -5.0%
tpcds_q25/duckdb:vortex-compact 29967868 / 30301474 / -1.1% 42779978 / 41896193 / +2.1% 0.70 / 0.72 / -3.1%
tpcds_q26/duckdb:vortex-compact 19047802 / 18353692 / +3.8% 26543840 / 24966593 / +6.3% 0.72 / 0.74 / -2.4%
tpcds_q27/duckdb:vortex-compact 21702565 / 21220173 / +2.3% 31930046 / 31305000 / +2.0% 0.68 / 0.68 / +0.3%
tpcds_q28/duckdb:vortex-compact 22767238 / 21388182 / +6.4% 29398418 / 34070016 / -13.7% 🟢 0.77 / 0.63 / +23.4%
tpcds_q29/duckdb:vortex-compact 33732522 / 33823561 / -0.3% 47520215 / 47126942 / +0.8% 0.71 / 0.72 / -1.1%
tpcds_q30/duckdb:vortex-compact 22837406 / 22737558 / +0.4% 30490038 / 31054100 / -1.8% 0.75 / 0.73 / +2.3%
tpcds_q31/duckdb:vortex-compact 20738388 / 20908865 / -0.8% 33299524 / 29680031 / +12.2% 🔴 0.62 / 0.70 / -11.6%
tpcds_q32/duckdb:vortex-compact 12195012 / 12331562 / -1.1% 18876152 / 20219478 / -6.6% 0.65 / 0.61 / +5.9%
tpcds_q33/duckdb:vortex-compact 18920164 / 18543955 / +2.0% 33362258 / 29585579 / +12.8% 🔴 0.57 / 0.63 / -9.5%
tpcds_q34/duckdb:vortex-compact 17024438 / 16959250 / +0.4% 24423704 / 23219067 / +5.2% 0.70 / 0.73 / -4.6%
tpcds_q35/duckdb:vortex-compact 51390412 / 51751998 / -0.7% 64399434 / 68382786 / -5.8% 0.80 / 0.76 / +5.4%
tpcds_q36/duckdb:vortex-compact 17317160 / 17363530 / -0.3% 29257813 / 31058747 / -5.8% 0.59 / 0.56 / +5.9%
tpcds_q37/duckdb:vortex-compact 15025548 / 15271812 / -1.6% 28211176 / 25290604 / +11.5% 🔴 0.53 / 0.60 / -11.8%
tpcds_q38/duckdb:vortex-compact 23562966 / 23741745 / -0.8% 30930616 / 32064725 / -3.5% 0.76 / 0.74 / +2.9%
tpcds_q39/duckdb:vortex-compact 19242261 / 18985798 / +1.4% 28173298 / 29065313 / -3.1% 0.68 / 0.65 / +4.6%
tpcds_q40/duckdb:vortex-compact 14429128 / 14772654 / -2.3% 19633722 / 19313745 / +1.7% 0.73 / 0.76 / -3.9%
tpcds_q41/duckdb:vortex-compact 7497956 / 7352396 / +2.0% 10095028 / 10865365 / -7.1% 0.74 / 0.68 / +9.8%
tpcds_q42/duckdb:vortex-compact 9862114 / 9833158 / +0.3% 19368350 / 18502754 / +4.7% 0.51 / 0.53 / -4.2%
tpcds_q43/duckdb:vortex-compact 11791958 / 11340890 / +4.0% 20618407 / 20552348 / +0.3% 0.57 / 0.55 / +3.6%
tpcds_q44/duckdb:vortex-compact 18584318 / 19626346 / -5.3% 37265696 / 31871838 / +16.9% 🔴 0.50 / 0.62 / -19.0%
tpcds_q45/duckdb:vortex-compact 25575034 / 25334835 / +0.9% 32220295 / 32068894 / +0.5% 0.79 / 0.79 / +0.5%
tpcds_q46/duckdb:vortex-compact 20508298 / 19721664 / +4.0% 32631136 / 32432092 / +0.6% 0.63 / 0.61 / +3.4%
tpcds_q47/duckdb:vortex-compact 32747570 / 32564140 / +0.6% 48452253 / 43470186 / +11.5% 🔴 0.68 / 0.75 / -9.8%
tpcds_q48/duckdb:vortex-compact 23454605 / 23773140 / -1.3% 34387684 / 33533351 / +2.5% 0.68 / 0.71 / -3.8%
tpcds_q49/duckdb:vortex-compact 21388094 / 20654798 / +3.6% 35809439 / 32571692 / +9.9% 0.60 / 0.63 / -5.8%
tpcds_q50/duckdb:vortex-compact 19200812 / 19228494 / -0.1% 30481576 / 28939647 / +5.3% 0.63 / 0.66 / -5.2%
tpcds_q51/duckdb:vortex-compact 53483914 / 53642172 / -0.3% 64785041 / 90074689 / -28.1% 🟢 0.83 / 0.60 / +38.6%
tpcds_q52/duckdb:vortex-compact 12356594 / 10083128 / +22.5% 🔴 20521886 / 19030984 / +7.8% 0.60 / 0.53 / +13.6%
tpcds_q53/duckdb:vortex-compact 16081447 / 16215217 / -0.8% 29062161 / 27014608 / +7.6% 0.55 / 0.60 / -7.8%
tpcds_q54/duckdb:vortex-compact 22832454 / 22748798 / +0.4% 31560855 / 30699823 / +2.8% 0.72 / 0.74 / -2.4%
tpcds_q55/duckdb:vortex-compact 10038357 / 10416174 / -3.6% 19239418 / 21043000 / -8.6% 0.52 / 0.49 / +5.4%
tpcds_q56/duckdb:vortex-compact 19930775 / 20415218 / -2.4% 31517159 / 29629170 / +6.4% 0.63 / 0.69 / -8.2%
tpcds_q57/duckdb:vortex-compact 25626333 / 25634319 / -0.0% 39654025 / 34755305 / +14.1% 🔴 0.65 / 0.74 / -12.4%
tpcds_q58/duckdb:vortex-compact 19195891 / 20069797 / -4.4% 28839332 / 29348229 / -1.7% 0.67 / 0.68 / -2.7%
tpcds_q59/duckdb:vortex-compact 19315790 / 20353734 / -5.1% 26030124 / 27622004 / -5.8% 0.74 / 0.74 / +0.7%
tpcds_q60/duckdb:vortex-compact 20012322 / 20267780 / -1.3% 34854475 / 31045555 / +12.3% 🔴 0.57 / 0.65 / -12.1%
tpcds_q61/duckdb:vortex-compact 24875864 / 24729146 / +0.6% 38411962 / 35388340 / +8.5% 0.65 / 0.70 / -7.3%
tpcds_q62/duckdb:vortex-compact 11660024 / 11532229 / +1.1% 19879810 / 19425719 / +2.3% 0.59 / 0.59 / -1.2%
tpcds_q63/duckdb:vortex-compact 15454369 / 15375976 / +0.5% 24950338 / 22844088 / +9.2% 0.62 / 0.67 / -8.0%
tpcds_q64/duckdb:vortex-compact 71956943 / 72912268 / -1.3% 87634688 / 85054646 / +3.0% 0.82 / 0.86 / -4.2%
tpcds_q65/duckdb:vortex-compact 16826227 / 17292002 / -2.7% 26630951 / 26076034 / +2.1% 0.63 / 0.66 / -4.7%
tpcds_q66/duckdb:vortex-compact 23458585 / 22701748 / +3.3% 33273319 / 38057202 / -12.6% 🟢 0.71 / 0.60 / +18.2%
tpcds_q67/duckdb:vortex-compact 69414270 / 67248525 / +3.2% 83364807 / 81654911 / +2.1% 0.83 / 0.82 / +1.1%
tpcds_q68/duckdb:vortex-compact 19726252 / 19762946 / -0.2% 34763252 / 38148646 / -8.9% 0.57 / 0.52 / +9.5%
tpcds_q69/duckdb:vortex-compact 34806388 / 34997991 / -0.5% 46689889 / 47589286 / -1.9% 0.75 / 0.74 / +1.4%
tpcds_q70/duckdb:vortex-compact 21267928 / 21479518 / -1.0% 31024985 / 35234234 / -11.9% 🟢 0.69 / 0.61 / +12.4%
tpcds_q71/duckdb:vortex-compact 15358036 / 15046292 / +2.1% 28368700 / 25262079 / +12.3% 🔴 0.54 / 0.60 / -9.1%
tpcds_q72/duckdb:vortex-compact 68192756 / 65512116 / +4.1% 78067720 / 77159399 / +1.2% 0.87 / 0.85 / +2.9%
tpcds_q73/duckdb:vortex-compact 16370540 / 16324426 / +0.3% 21036223 / 21368171 / -1.6% 0.78 / 0.76 / +1.9%
tpcds_q74/duckdb:vortex-compact 28561231 / 28903264 / -1.2% 38905441 / 39337516 / -1.1% 0.73 / 0.73 / -0.1%
tpcds_q75/duckdb:vortex-compact 31119385 / 31078087 / +0.1% 41847334 / 46786528 / -10.6% 🟢 0.74 / 0.66 / +12.0%
tpcds_q76/duckdb:vortex-compact 15578967 / 14603969 / +6.7% 29170823 / 26306044 / +10.9% 🔴 0.53 / 0.56 / -3.8%
tpcds_q77/duckdb:vortex-compact 18987346 / 17845643 / +6.4% 27830628 / 27618465 / +0.8% 0.68 / 0.65 / +5.6%
tpcds_q78/duckdb:vortex-compact 38706448 / 38721780 / -0.0% 47577676 / 47999060 / -0.9% 0.81 / 0.81 / +0.8%
tpcds_q79/duckdb:vortex-compact 20043369 / 20376516 / -1.6% 44406294 / 28762763 / +54.4% 🔴 0.45 / 0.71 / -36.3%
tpcds_q80/duckdb:vortex-compact 31677110 / 30867363 / +2.6% 46861829 / 42687749 / +9.8% 0.68 / 0.72 / -6.5%
tpcds_q81/duckdb:vortex-compact 24381836 / 24336519 / +0.2% 31711305 / 31377827 / +1.1% 0.77 / 0.78 / -0.9%
tpcds_q82/duckdb:vortex-compact 35685725 / 35485802 / +0.6% 43619081 / 44900334 / -2.9% 0.82 / 0.79 / +3.5%
tpcds_q83/duckdb:vortex-compact 28171474 / 27754936 / +1.5% 32584210 / 31808416 / +2.4% 0.86 / 0.87 / -0.9%
tpcds_q84/duckdb:vortex-compact 14936262 / 14765641 / +1.2% 23353931 / 23805244 / -1.9% 0.64 / 0.62 / +3.1%
tpcds_q85/duckdb:vortex-compact 37023320 / 36960597 / +0.2% 46073771 / 44630775 / +3.2% 0.80 / 0.83 / -3.0%
tpcds_q86/duckdb:vortex-compact 12202240 / 12060190 / +1.2% 20341544 / 19212225 / +5.9% 0.60 / 0.63 / -4.4%
tpcds_q87/duckdb:vortex-compact 24885255 / 25312140 / -1.7% 32534725 / 32274733 / +0.8% 0.76 / 0.78 / -2.5%
tpcds_q88/duckdb:vortex-compact 40180612 / 40571912 / -1.0% 52926610 / 54957087 / -3.7% 0.76 / 0.74 / +2.8%
tpcds_q89/duckdb:vortex-compact 15814296 / 15933314 / -0.7% 26047401 / 25596661 / +1.8% 0.61 / 0.62 / -2.5%
tpcds_q90/duckdb:vortex-compact 9060910 / 9146658 / -0.9% 17209879 / 14221316 / +21.0% 🔴 0.53 / 0.64 / -18.1%
tpcds_q91/duckdb:vortex-compact 24876400 / 24888886 / -0.1% 33055001 / 32527781 / +1.6% 0.75 / 0.77 / -1.6%
tpcds_q92/duckdb:vortex-compact 20300662 / 20077994 / +1.1% 29237775 / 26428158 / +10.6% 🔴 0.69 / 0.76 / -8.6%
tpcds_q93/duckdb:vortex-compact 17659348 / 19034450 / -7.2% 27400442 / 26035556 / +5.2% 0.64 / 0.73 / -11.8%
tpcds_q94/duckdb:vortex-compact 18814448 / 18794199 / +0.1% 29405780 / 30536933 / -3.7% 0.64 / 0.62 / +4.0%
tpcds_q95/duckdb:vortex-compact 45631814 / 45753052 / -0.3% 54826559 / 51878191 / +5.7% 0.83 / 0.88 / -5.6%
tpcds_q96/duckdb:vortex-compact 8906063 / 9533576 / -6.6% 16442609 / 16545357 / -0.6% 0.54 / 0.58 / -6.0%
tpcds_q97/duckdb:vortex-compact 22697488 / 22996396 / -1.3% 33692172 / 30184623 / +11.6% 🔴 0.67 / 0.76 / -11.6%
tpcds_q98/duckdb:vortex-compact 16256600 / 16685936 / -2.6% 26269162 / 26163386 / +0.4% 0.62 / 0.64 / -3.0%
tpcds_q99/duckdb:vortex-compact 14307346 / 16045786 / -10.8% 🟢 20011582 / 23645664 / -15.4% 🟢 0.71 / 0.68 / +5.4%
duckdb / parquet / ns (0.998x ➖, 5↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24845223 / 25337164 / -1.9% 33242488 / 33041383 / +0.6% 0.75 / 0.77 / -2.5%
tpcds_q02/duckdb:parquet 18682593 / 15685204 / +19.1% 🔴 24259664 / 21276526 / +14.0% 🔴 0.77 / 0.74 / +4.5%
tpcds_q03/duckdb:parquet 9219864 / 9217806 / +0.0% 15486611 / 16121919 / -3.9% 0.60 / 0.57 / +4.1%
tpcds_q04/duckdb:parquet 129858612 / 130205324 / -0.3% 135654957 / 138671735 / -2.2% 0.96 / 0.94 / +2.0%
tpcds_q05/duckdb:parquet 22246581 / 23586796 / -5.7% 27151760 / 26340946 / +3.1% 0.82 / 0.90 / -8.5%
tpcds_q06/duckdb:parquet 29574247 / 27509198 / +7.5% 36712822 / 37529422 / -2.2% 0.81 / 0.73 / +9.9%
tpcds_q07/duckdb:parquet 18058824 / 15773743 / +14.5% 🔴 24334225 / 23273232 / +4.6% 0.74 / 0.68 / +9.5%
tpcds_q08/duckdb:parquet 26148152 / 26901420 / -2.8% 33811364 / 34179340 / -1.1% 0.77 / 0.79 / -1.7%
tpcds_q09/duckdb:parquet 19170224 / 19004842 / +0.9% 22641421 / 23227352 / -2.5% 0.85 / 0.82 / +3.5%
tpcds_q10/duckdb:parquet 28162778 / 28187298 / -0.1% 37587169 / 39031159 / -3.7% 0.75 / 0.72 / +3.8%
tpcds_q11/duckdb:parquet 73604560 / 73969478 / -0.5% 82606282 / 77998477 / +5.9% 0.89 / 0.95 / -6.0%
tpcds_q12/duckdb:parquet 13045710 / 13101526 / -0.4% 21205473 / 17985260 / +17.9% 🔴 0.62 / 0.73 / -15.5%
tpcds_q13/duckdb:parquet 24574866 / 24696600 / -0.5% 31240704 / 30617252 / +2.0% 0.79 / 0.81 / -2.5%
tpcds_q14/duckdb:parquet 62616645 / 62727159 / -0.2% 67634902 / 68231414 / -0.9% 0.93 / 0.92 / +0.7%
tpcds_q15/duckdb:parquet 25561154 / 25626422 / -0.3% 30217381 / 31686269 / -4.6% 0.85 / 0.81 / +4.6%
tpcds_q16/duckdb:parquet 21391017 / 22818154 / -6.3% 28642556 / 31953700 / -10.4% 🟢 0.75 / 0.71 / +4.6%
tpcds_q17/duckdb:parquet 33035679 / 32982964 / +0.2% 40320644 / 40481571 / -0.4% 0.82 / 0.81 / +0.6%
tpcds_q18/duckdb:parquet 40687091 / 41465200 / -1.9% 50185717 / 55188443 / -9.1% 0.81 / 0.75 / +7.9%
tpcds_q19/duckdb:parquet 25238748 / 25373630 / -0.5% 33177182 / 32704905 / +1.4% 0.76 / 0.78 / -1.9%
tpcds_q20/duckdb:parquet 14167138 / 14119569 / +0.3% 18606213 / 19480980 / -4.5% 0.76 / 0.72 / +5.1%
tpcds_q21/duckdb:parquet 9535008 / 9552380 / -0.2% 15760041 / 13789596 / +14.3% 🔴 0.61 / 0.69 / -12.7%
tpcds_q22/duckdb:parquet 35322710 / 35013420 / +0.9% 38947350 / 39930595 / -2.5% 0.91 / 0.88 / +3.4%
tpcds_q23/duckdb:parquet 41273670 / 43945887 / -6.1% 48432732 / 48355036 / +0.2% 0.85 / 0.91 / -6.2%
tpcds_q24/duckdb:parquet 34137847 / 34368974 / -0.7% 42256696 / 42545579 / -0.7% 0.81 / 0.81 / +0.0%
tpcds_q25/duckdb:parquet 31982101 / 31803530 / +0.6% 42558948 / 40626408 / +4.8% 0.75 / 0.78 / -4.0%
tpcds_q26/duckdb:parquet 33209208 / 31964950 / +3.9% 37658566 / 39299037 / -4.2% 0.88 / 0.81 / +8.4%
tpcds_q27/duckdb:parquet 32337676 / 32501528 / -0.5% 46865379 / 39585536 / +18.4% 🔴 0.69 / 0.82 / -16.0%
tpcds_q28/duckdb:parquet 17775678 / 17953662 / -1.0% 24542224 / 21984504 / +11.6% 🔴 0.72 / 0.82 / -11.3%
tpcds_q29/duckdb:parquet 31674113 / 31570250 / +0.3% 39297131 / 42707707 / -8.0% 0.81 / 0.74 / +9.0%
tpcds_q30/duckdb:parquet 34376468 / 34892058 / -1.5% 43379321 / 46651103 / -7.0% 0.79 / 0.75 / +6.0%
tpcds_q31/duckdb:parquet 20960568 / 20614658 / +1.7% 28301462 / 25634462 / +10.4% 🔴 0.74 / 0.80 / -7.9%
tpcds_q32/duckdb:parquet 12271332 / 14327500 / -14.4% 🟢 17725531 / 21925470 / -19.2% 🟢 0.69 / 0.65 / +5.9%
tpcds_q33/duckdb:parquet 16535121 / 16527030 / +0.0% 23486528 / 23246399 / +1.0% 0.70 / 0.71 / -1.0%
tpcds_q34/duckdb:parquet 16563230 / 16383355 / +1.1% 22313470 / 21976310 / +1.5% 0.74 / 0.75 / -0.4%
tpcds_q35/duckdb:parquet 48358186 / 47761104 / +1.3% 57252554 / 60921435 / -6.0% 0.84 / 0.78 / +7.7%
tpcds_q36/duckdb:parquet 16255672 / 17612496 / -7.7% 23449773 / 23438239 / +0.0% 0.69 / 0.75 / -7.7%
tpcds_q37/duckdb:parquet 12244428 / 11551232 / +6.0% 16590526 / 17053004 / -2.7% 0.74 / 0.68 / +9.0%
tpcds_q38/duckdb:parquet 27364902 / 26877734 / +1.8% 31259408 / 31542104 / -0.9% 0.88 / 0.85 / +2.7%
tpcds_q39/duckdb:parquet 24540182 / 25427113 / -3.5% 30090526 / 28922530 / +4.0% 0.82 / 0.88 / -7.2%
tpcds_q40/duckdb:parquet 16680544 / 16677333 / +0.0% 21212097 / 22553533 / -5.9% 0.79 / 0.74 / +6.3%
tpcds_q41/duckdb:parquet 7846880 / 7881816 / -0.4% 16917784 / 13889864 / +21.8% 🔴 0.46 / 0.57 / -18.3%
tpcds_q42/duckdb:parquet 8818693 / 8718653 / +1.1% 14848858 / 15977377 / -7.1% 0.59 / 0.55 / +8.8%
tpcds_q43/duckdb:parquet 10776688 / 10856924 / -0.7% 15068922 / 15245800 / -1.2% 0.72 / 0.71 / +0.4%
tpcds_q44/duckdb:parquet 15993324 / 16253044 / -1.6% 21768894 / 22226654 / -2.1% 0.73 / 0.73 / +0.5%
tpcds_q45/duckdb:parquet 23933001 / 23775202 / +0.7% 29652444 / 29049976 / +2.1% 0.81 / 0.82 / -1.4%
tpcds_q46/duckdb:parquet 37536705 / 37303852 / +0.6% 46617520 / 45336511 / +2.8% 0.81 / 0.82 / -2.1%
tpcds_q47/duckdb:parquet 31723210 / 31794197 / -0.2% 44633872 / 37098859 / +20.3% 🔴 0.71 / 0.86 / -17.1%
tpcds_q48/duckdb:parquet 21355352 / 21385961 / -0.1% 27731729 / 27230680 / +1.8% 0.77 / 0.79 / -1.9%
tpcds_q49/duckdb:parquet 20390764 / 20450476 / -0.3% 28604041 / 29463337 / -2.9% 0.71 / 0.69 / +2.7%
tpcds_q50/duckdb:parquet 18012378 / 17956066 / +0.3% 23870367 / 24642240 / -3.1% 0.75 / 0.73 / +3.6%
tpcds_q51/duckdb:parquet 53463272 / 54353570 / -1.6% 62236036 / 61707466 / +0.9% 0.86 / 0.88 / -2.5%
tpcds_q52/duckdb:parquet 8985247 / 8973611 / +0.1% 15581864 / 15980131 / -2.5% 0.58 / 0.56 / +2.7%
tpcds_q53/duckdb:parquet 12060480 / 12022686 / +0.3% 17667589 / 17337314 / +1.9% 0.68 / 0.69 / -1.6%
tpcds_q54/duckdb:parquet 20751160 / 20939010 / -0.9% 29268703 / 29243944 / +0.1% 0.71 / 0.72 / -1.0%
tpcds_q55/duckdb:parquet 9023519 / 8915722 / +1.2% 16028275 / 16187635 / -1.0% 0.56 / 0.55 / +2.2%
tpcds_q56/duckdb:parquet 17150822 / 17120304 / +0.2% 27248448 / 24670737 / +10.4% 🔴 0.63 / 0.69 / -9.3%
tpcds_q57/duckdb:parquet 29292444 / 29532620 / -0.8% 38040066 / 35887565 / +6.0% 0.77 / 0.82 / -6.4%
tpcds_q58/duckdb:parquet 20479202 / 19357593 / +5.8% 25933003 / 26523678 / -2.2% 0.79 / 0.73 / +8.2%
tpcds_q59/duckdb:parquet 20172128 / 23163900 / -12.9% 🟢 32996610 / 28237483 / +16.9% 🔴 0.61 / 0.82 / -25.5%
tpcds_q60/duckdb:parquet 19283054 / 17889946 / +7.8% 25766048 / 24874893 / +3.6% 0.75 / 0.72 / +4.1%
tpcds_q61/duckdb:parquet 22496266 / 22105492 / +1.8% 32752491 / 34255609 / -4.4% 0.69 / 0.65 / +6.4%
tpcds_q62/duckdb:parquet 11075738 / 11022696 / +0.5% 15001910 / 15460755 / -3.0% 0.74 / 0.71 / +3.6%
tpcds_q63/duckdb:parquet 11400600 / 11322218 / +0.7% 16518943 / 16936903 / -2.5% 0.69 / 0.67 / +3.2%
tpcds_q64/duckdb:parquet 53608747 / 53912760 / -0.6% 65380552 / 65978730 / -0.9% 0.82 / 0.82 / +0.3%
tpcds_q65/duckdb:parquet 14814436 / 14996594 / -1.2% 22801319 / 20491918 / +11.3% 🔴 0.65 / 0.73 / -11.2%
tpcds_q66/duckdb:parquet 25100838 / 25406481 / -1.2% 31708181 / 31277587 / +1.4% 0.79 / 0.81 / -2.5%
tpcds_q67/duckdb:parquet 78468729 / 77260878 / +1.6% 82743606 / 84666712 / -2.3% 0.95 / 0.91 / +3.9%
tpcds_q68/duckdb:parquet 30769712 / 30554298 / +0.7% 39919116 / 44431898 / -10.2% 🟢 0.77 / 0.69 / +12.1%
tpcds_q69/duckdb:parquet 30484168 / 30826769 / -1.1% 39543142 / 41718885 / -5.2% 0.77 / 0.74 / +4.3%
tpcds_q70/duckdb:parquet 16402428 / 18502023 / -11.3% 🟢 22974015 / 29435526 / -22.0% 🟢 0.71 / 0.63 / +13.6%
tpcds_q71/duckdb:parquet 15044348 / 15169854 / -0.8% 21702324 / 21144982 / +2.6% 0.69 / 0.72 / -3.4%
tpcds_q72/duckdb:parquet 82389021 / 81854325 / +0.7% 91781944 / 88587992 / +3.6% 0.90 / 0.92 / -2.8%
tpcds_q73/duckdb:parquet 13868210 / 15913268 / -12.9% 🟢 19435518 / 19346865 / +0.5% 0.71 / 0.82 / -13.2%
tpcds_q74/duckdb:parquet 100558165 / 101038620 / -0.5% 110284996 / 108021906 / +2.1% 0.91 / 0.94 / -2.5%
tpcds_q75/duckdb:parquet 40985106 / 41325528 / -0.8% 51233436 / 52093124 / -1.7% 0.80 / 0.79 / +0.8%
tpcds_q76/duckdb:parquet 13888138 / 13862922 / +0.2% 22047613 / 21723619 / +1.5% 0.63 / 0.64 / -1.3%
tpcds_q77/duckdb:parquet 17610134 / 17272245 / +2.0% 24801258 / 25210412 / -1.6% 0.71 / 0.69 / +3.6%
tpcds_q78/duckdb:parquet 49225417 / 48824192 / +0.8% 54841770 / 54236811 / +1.1% 0.90 / 0.90 / -0.3%
tpcds_q79/duckdb:parquet 21311428 / 21356528 / -0.2% 29195802 / 29054989 / +0.5% 0.73 / 0.74 / -0.7%
tpcds_q80/duckdb:parquet 32851646 / 33156586 / -0.9% 40707339 / 43054426 / -5.5% 0.81 / 0.77 / +4.8%
tpcds_q81/duckdb:parquet 31674460 / 32059190 / -1.2% 40165332 / 41396944 / -3.0% 0.79 / 0.77 / +1.8%
tpcds_q82/duckdb:parquet 14345806 / 12562030 / +14.2% 🔴 18861077 / 20824079 / -9.4% 0.76 / 0.60 / +26.1%
tpcds_q83/duckdb:parquet 17031548 / 16773096 / +1.5% 21570378 / 21763065 / -0.9% 0.79 / 0.77 / +2.4%
tpcds_q84/duckdb:parquet 18875516 / 18846160 / +0.2% 23898996 / 25061573 / -4.6% 0.79 / 0.75 / +5.0%
tpcds_q85/duckdb:parquet 36033662 / 35661823 / +1.0% 46083576 / 45476417 / +1.3% 0.78 / 0.78 / -0.3%
tpcds_q86/duckdb:parquet 12685680 / 11662110 / +8.8% 20175489 / 17010854 / +18.6% 🔴 0.63 / 0.69 / -8.3%
tpcds_q87/duckdb:parquet 28758707 / 28740790 / +0.1% 36301865 / 33382892 / +8.7% 0.79 / 0.86 / -8.0%
tpcds_q88/duckdb:parquet 27011385 / 27136588 / -0.5% 30911441 / 34069529 / -9.3% 0.87 / 0.80 / +9.7%
tpcds_q89/duckdb:parquet 13230421 / 13267372 / -0.3% 18750483 / 18909409 / -0.8% 0.71 / 0.70 / +0.6%
tpcds_q90/duckdb:parquet 7646670 / 9298802 / -17.8% 🟢 11371186 / 11674412 / -2.6% 0.67 / 0.80 / -15.6%
tpcds_q91/duckdb:parquet 21772288 / 21811136 / -0.2% 29074797 / 30326482 / -4.1% 0.75 / 0.72 / +4.1%
tpcds_q92/duckdb:parquet 12581106 / 12563782 / +0.1% 23912166 / 19099682 / +25.2% 🔴 0.53 / 0.66 / -20.0%
tpcds_q93/duckdb:parquet 22100218 / 21806148 / +1.3% 27339277 / 26929413 / +1.5% 0.81 / 0.81 / -0.2%
tpcds_q94/duckdb:parquet 17199822 / 17283582 / -0.5% 25487357 / 25546938 / -0.2% 0.67 / 0.68 / -0.3%
tpcds_q95/duckdb:parquet 91590441 / 89591156 / +2.2% 101315032 / 97242920 / +4.2% 0.90 / 0.92 / -1.9%
tpcds_q96/duckdb:parquet 7092530 / 7059270 / +0.5% 10695251 / 11149000 / -4.1% 0.66 / 0.63 / +4.7%
tpcds_q97/duckdb:parquet 26233951 / 26242258 / -0.0% 34179477 / 33105993 / +3.2% 0.77 / 0.79 / -3.2%
tpcds_q98/duckdb:parquet 15390173 / 15294929 / +0.6% 22483956 / 22566629 / -0.4% 0.68 / 0.68 / +1.0%
tpcds_q99/duckdb:parquet 17435149 / 17445656 / -0.1% 21370020 / 22135446 / -3.5% 0.82 / 0.79 / +3.5%

File Size Changes (42 files changed, +0.0% overall, 30↑ 12↓)
File Scale Format Base HEAD Change %
web_page.vortex 1.0 vortex-file-compressed 29.28 KB 29.64 KB +368 B +1.2%
call_center.vortex 1.0 vortex-file-compressed 53.21 KB 53.57 KB +360 B +0.7%
ship_mode.vortex 1.0 vortex-file-compressed 13.41 KB 13.46 KB +48 B +0.3%
household_demographics.vortex 1.0 vortex-file-compressed 16.27 KB 16.32 KB +56 B +0.3%
income_band.vortex 1.0 vortex-file-compressed 5.12 KB 5.13 KB +16 B +0.3%
web_page.vortex 1.0 vortex-compact 23.76 KB 23.82 KB +64 B +0.3%
store.vortex 1.0 vortex-compact 42.48 KB 42.55 KB +64 B +0.1%
ship_mode.vortex 1.0 vortex-compact 10.79 KB 10.81 KB +16 B +0.1%
date_dim.vortex 1.0 vortex-compact 140.82 KB 140.98 KB +168 B +0.1%
web_site.vortex 1.0 vortex-compact 41.64 KB 41.69 KB +48 B +0.1%
promotion.vortex 1.0 vortex-file-compressed 51.42 KB 51.45 KB +32 B +0.1%
date_dim.vortex 1.0 vortex-file-compressed 911.26 KB 911.78 KB +528 B +0.1%
catalog_page.vortex 1.0 vortex-file-compressed 585.83 KB 586.11 KB +288 B +0.0%
call_center.vortex 1.0 vortex-compact 46.71 KB 46.73 KB +16 B +0.0%
customer_address.vortex 1.0 vortex-file-compressed 886.18 KB 886.45 KB +272 B +0.0%
web_returns.vortex 1.0 vortex-file-compressed 3.48 MB 3.48 MB +1.00 KB +0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.48 MB 1.48 MB +384 B +0.0%
item.vortex 1.0 vortex-file-compressed 1.69 MB 1.69 MB +424 B +0.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.30 MB 7.30 MB +1.20 KB +0.0%
customer.vortex 1.0 vortex-file-compressed 4.29 MB 4.29 MB +544 B +0.0%
store_returns.vortex 1.0 vortex-file-compressed 11.12 MB 11.12 MB +1.20 KB +0.0%
web_sales.vortex 1.0 vortex-file-compressed 33.63 MB 33.64 MB +3.17 KB +0.0%
catalog_sales.vortex 1.0 vortex-file-compressed 69.36 MB 69.36 MB +4.67 KB +0.0%
inventory.vortex 1.0 vortex-file-compressed 36.63 MB 36.63 MB +2.14 KB +0.0%
store_sales.vortex 1.0 vortex-file-compressed 100.64 MB 100.65 MB +5.80 KB +0.0%
web_sales.vortex 1.0 vortex-compact 29.43 MB 29.43 MB +704 B +0.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 9.36 MB +208 B +0.0%
web_returns.vortex 1.0 vortex-compact 2.99 MB 2.99 MB +32 B +0.0%
catalog_sales.vortex 1.0 vortex-compact 59.56 MB 59.56 MB +176 B +0.0%
store_sales.vortex 1.0 vortex-compact 78.10 MB 78.10 MB +80 B +0.0%
customer.vortex 1.0 vortex-compact 3.30 MB 3.30 MB 16 B -0.0%
item.vortex 1.0 vortex-compact 994.80 KB 994.77 KB 32 B -0.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 16.06 MB 1.41 KB -0.0%
catalog_page.vortex 1.0 vortex-compact 361.59 KB 361.55 KB 32 B -0.0%
customer_demographics.vortex 1.0 vortex-compact 426.01 KB 425.96 KB 48 B -0.0%
customer_address.vortex 1.0 vortex-compact 643.80 KB 643.71 KB 96 B -0.0%
time_dim.vortex 1.0 vortex-file-compressed 441.94 KB 441.70 KB 240 B -0.1%
warehouse.vortex 1.0 vortex-file-compressed 24.17 KB 24.04 KB 136 B -0.5%
time_dim.vortex 1.0 vortex-compact 95.68 KB 94.61 KB 1.07 KB -1.1%
store.vortex 1.0 vortex-file-compressed 48.49 KB 47.91 KB 592 B -1.2%
web_site.vortex 1.0 vortex-file-compressed 54.26 KB 53.32 KB 968 B -1.7%
reason.vortex 1.0 vortex-file-compressed 7.63 KB 7.33 KB 304 B -3.9%

Totals:

  • vortex-compact: 207.99 MB → 207.98 MB (-0.0%)
  • vortex-file-compressed: 272.94 MB → 272.96 MB (+0.0%)

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 9c23a32b vs base 787fac76
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.953x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.977x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 96860236 / 98490185 / -1.7% 174605655 / 175611898 / -0.6% 0.55 / 0.56 / -1.1%
tpch_q02/datafusion:vortex-file-compressed 65271753 / 64308787 / +1.5% 96631219 / 97808230 / -1.2% 0.68 / 0.66 / +2.7%
tpch_q03/datafusion:vortex-file-compressed 64619802 / 65706249 / -1.7% 119742070 / 117899173 / +1.6% 0.54 / 0.56 / -3.2%
tpch_q04/datafusion:vortex-file-compressed 34510870 / 36109115 / -4.4% 79544156 / 81337163 / -2.2% 0.43 / 0.44 / -2.3%
tpch_q05/datafusion:vortex-file-compressed 118471582 / 118313634 / +0.1% 178749880 / 177878716 / +0.5% 0.66 / 0.67 / -0.4%
tpch_q06/datafusion:vortex-file-compressed 14495851 / 14521893 / -0.2% 72913371 / 73054507 / -0.2% 0.20 / 0.20 / +0.0%
tpch_q07/datafusion:vortex-file-compressed 138866767 / 140986777 / -1.5% 196830850 / 191347095 / +2.9% 0.71 / 0.74 / -4.2%
tpch_q08/datafusion:vortex-file-compressed 145064186 / 146763634 / -1.2% 204615461 / 210347253 / -2.7% 0.71 / 0.70 / +1.6%
tpch_q09/datafusion:vortex-file-compressed 188483900 / 184976192 / +1.9% 257112682 / 295742296 / -13.1% 🟢 0.73 / 0.63 / +17.2%
tpch_q10/datafusion:vortex-file-compressed 73563172 / 73141655 / +0.6% 146761927 / 139033566 / +5.6% 0.50 / 0.53 / -4.7%
tpch_q11/datafusion:vortex-file-compressed 43443122 / 42337441 / +2.6% 66054736 / 66204954 / -0.2% 0.66 / 0.64 / +2.8%
tpch_q12/datafusion:vortex-file-compressed 44825538 / 44468391 / +0.8% 96646331 / 102854909 / -6.0% 0.46 / 0.43 / +7.3%
tpch_q13/datafusion:vortex-file-compressed 44413967 / 46691230 / -4.9% 74723208 / 84136810 / -11.2% 🟢 0.59 / 0.55 / +7.1%
tpch_q14/datafusion:vortex-file-compressed 24563158 / 24805332 / -1.0% 97806909 / 102357374 / -4.4% 0.25 / 0.24 / +3.6%
tpch_q15/datafusion:vortex-file-compressed 36531944 / 36291301 / +0.7% 101460032 / 100501779 / +1.0% 0.36 / 0.36 / -0.3%
tpch_q16/datafusion:vortex-file-compressed 37904882 / 37653652 / +0.7% 68999229 / 69178678 / -0.3% 0.55 / 0.54 / +0.9%
tpch_q17/datafusion:vortex-file-compressed 174513864 / 176431601 / -1.1% 224692191 / 227819166 / -1.4% 0.78 / 0.77 / +0.3%
tpch_q18/datafusion:vortex-file-compressed 206865095 / 199986107 / +3.4% 269115663 / 269119273 / -0.0% 0.77 / 0.74 / +3.4%
tpch_q19/datafusion:vortex-file-compressed 35734324 / 35146773 / +1.7% 96741611 / 94130124 / +2.8% 0.37 / 0.37 / -1.1%
tpch_q20/datafusion:vortex-file-compressed 61781671 / 63208384 / -2.3% 124200356 / 124018547 / +0.1% 0.50 / 0.51 / -2.4%
tpch_q21/datafusion:vortex-file-compressed 182952833 / 189151333 / -3.3% 239783253 / 245097068 / -2.2% 0.76 / 0.77 / -1.1%
tpch_q22/datafusion:vortex-file-compressed 25439482 / 25872691 / -1.7% 52107610 / 54849825 / -5.0% 0.49 / 0.47 / +3.5%
datafusion / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 99554493 / 100804585 / -1.2% 146610899 / 157896752 / -7.1% 0.68 / 0.64 / +6.4%
tpch_q02/datafusion:vortex-compact 65600812 / 65839923 / -0.4% 93630692 / 95699373 / -2.2% 0.70 / 0.69 / +1.8%
tpch_q03/datafusion:vortex-compact 66463865 / 64990237 / +2.3% 109733911 / 110037356 / -0.3% 0.61 / 0.59 / +2.6%
tpch_q04/datafusion:vortex-compact 39435101 / 39216389 / +0.6% 76273675 / 78834804 / -3.2% 0.52 / 0.50 / +3.9%
tpch_q05/datafusion:vortex-compact 117515308 / 117159018 / +0.3% 168319485 / 170579391 / -1.3% 0.70 / 0.69 / +1.7%
tpch_q06/datafusion:vortex-compact 18216611 / 18245269 / -0.2% 57607611 / 64192851 / -10.3% 🟢 0.32 / 0.28 / +11.3%
tpch_q07/datafusion:vortex-compact 141568549 / 140269425 / +0.9% 177227138 / 182729333 / -3.0% 0.80 / 0.77 / +4.1%
tpch_q08/datafusion:vortex-compact 144877796 / 143756460 / +0.8% 202895110 / 208734323 / -2.8% 0.71 / 0.69 / +3.7%
tpch_q09/datafusion:vortex-compact 198357991 / 180606360 / +9.8% 248562484 / 284128063 / -12.5% 🟢 0.80 / 0.64 / +25.5%
tpch_q10/datafusion:vortex-compact 77113111 / 77701931 / -0.8% 125315618 / 124377302 / +0.8% 0.62 / 0.62 / -1.5%
tpch_q11/datafusion:vortex-compact 42864955 / 43032141 / -0.4% 68654429 / 68282825 / +0.5% 0.62 / 0.63 / -0.9%
tpch_q12/datafusion:vortex-compact 55922482 / 55045809 / +1.6% 93020430 / 97483176 / -4.6% 0.60 / 0.56 / +6.5%
tpch_q13/datafusion:vortex-compact 49985798 / 53139421 / -5.9% 75082178 / 83871702 / -10.5% 🟢 0.67 / 0.63 / +5.1%
tpch_q14/datafusion:vortex-compact 28178163 / 28199385 / -0.1% 100472083 / 95773301 / +4.9% 0.28 / 0.29 / -4.7%
tpch_q15/datafusion:vortex-compact 46157240 / 45275081 / +1.9% 100179856 / 93667501 / +7.0% 0.46 / 0.48 / -4.7%
tpch_q16/datafusion:vortex-compact 41654691 / 41193134 / +1.1% 71373347 / 70157598 / +1.7% 0.58 / 0.59 / -0.6%
tpch_q17/datafusion:vortex-compact 170301945 / 171785562 / -0.9% 213376777 / 218547227 / -2.4% 0.80 / 0.79 / +1.5%
tpch_q18/datafusion:vortex-compact 201305523 / 201060014 / +0.1% 253247359 / 255588363 / -0.9% 0.79 / 0.79 / +1.0%
tpch_q19/datafusion:vortex-compact 42031934 / 42069928 / -0.1% 85635652 / 90826747 / -5.7% 0.49 / 0.46 / +6.0%
tpch_q20/datafusion:vortex-compact 65054403 / 66156385 / -1.7% 118264079 / 118795672 / -0.4% 0.55 / 0.56 / -1.2%
tpch_q21/datafusion:vortex-compact 185917773 / 186639820 / -0.4% 245216034 / 239172175 / +2.5% 0.76 / 0.78 / -2.8%
tpch_q22/datafusion:vortex-compact 28756864 / 26525023 / +8.4% 55070103 / 53710683 / +2.5% 0.52 / 0.49 / +5.7%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86649125 / 86711558 / -0.1% 131831195 / 128894756 / +2.3% 0.66 / 0.67 / -2.3%
tpch_q02/datafusion:parquet 158507116 / 158978132 / -0.3% 182466512 / 191420006 / -4.7% 0.87 / 0.83 / +4.6%
tpch_q03/datafusion:parquet 143154605 / 142818334 / +0.2% 193416327 / 191699642 / +0.9% 0.74 / 0.75 / -0.7%
tpch_q04/datafusion:parquet 59626802 / 59597033 / +0.0% 98457542 / 96448286 / +2.1% 0.61 / 0.62 / -2.0%
tpch_q05/datafusion:parquet 181936795 / 180156531 / +1.0% 236666345 / 238909763 / -0.9% 0.77 / 0.75 / +1.9%
tpch_q06/datafusion:parquet 35246163 / 35142470 / +0.3% 78851663 / 78291753 / +0.7% 0.45 / 0.45 / -0.4%
tpch_q07/datafusion:parquet 229194017 / 228491641 / +0.3% 285001709 / 299648958 / -4.9% 0.80 / 0.76 / +5.5%
tpch_q08/datafusion:parquet 235105575 / 233705442 / +0.6% 299161149 / 301585788 / -0.8% 0.79 / 0.77 / +1.4%
tpch_q09/datafusion:parquet 314728856 / 316489627 / -0.6% 380195245 / 377657240 / +0.7% 0.83 / 0.84 / -1.2%
tpch_q10/datafusion:parquet 403184867 / 406334668 / -0.8% 455759464 / 459114075 / -0.7% 0.88 / 0.89 / -0.0%
tpch_q11/datafusion:parquet 104582360 / 104990704 / -0.4% 127286131 / 128261713 / -0.8% 0.82 / 0.82 / +0.4%
tpch_q12/datafusion:parquet 84560557 / 84974042 / -0.5% 125130339 / 128181121 / -2.4% 0.68 / 0.66 / +1.9%
tpch_q13/datafusion:parquet 227765536 / 228538886 / -0.3% 256996435 / 259114743 / -0.8% 0.89 / 0.88 / +0.5%
tpch_q14/datafusion:parquet 87876108 / 85184613 / +3.2% 202641713 / 197941926 / +2.4% 0.43 / 0.43 / +0.8%
tpch_q15/datafusion:parquet 92449408 / 90139682 / +2.6% 141120642 / 139798168 / +0.9% 0.66 / 0.64 / +1.6%
tpch_q16/datafusion:parquet 95466930 / 94717867 / +0.8% 123792190 / 123083479 / +0.6% 0.77 / 0.77 / +0.2%
tpch_q17/datafusion:parquet 216348438 / 213140379 / +1.5% 270740119 / 268579403 / +0.8% 0.80 / 0.79 / +0.7%
tpch_q18/datafusion:parquet 292237256 / 289494006 / +0.9% 330488400 / 339677697 / -2.7% 0.88 / 0.85 / +3.8%
tpch_q19/datafusion:parquet 109310183 / 109864983 / -0.5% 174992406 / 172559082 / +1.4% 0.62 / 0.64 / -1.9%
tpch_q20/datafusion:parquet 185027537 / 183957454 / +0.6% 246603670 / 241714843 / +2.0% 0.75 / 0.76 / -1.4%
tpch_q21/datafusion:parquet 244665199 / 246603855 / -0.8% 317233268 / 317635694 / -0.1% 0.77 / 0.78 / -0.7%
tpch_q22/datafusion:parquet 199568608 / 199431280 / +0.1% 223305384 / 221196574 / +1.0% 0.89 / 0.90 / -0.9%
duckdb / vortex-file-compressed / ns (0.973x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 53545402 / 54205130 / -1.2% 96027845 / 105626218 / -9.1% 0.56 / 0.51 / +8.7%
tpch_q02/duckdb:vortex-file-compressed 31623912 / 31838358 / -0.7% 45810065 / 47725741 / -4.0% 0.69 / 0.67 / +3.5%
tpch_q03/duckdb:vortex-file-compressed 58465489 / 59536532 / -1.8% 101508588 / 118253795 / -14.2% 🟢 0.58 / 0.50 / +14.4%
tpch_q04/duckdb:vortex-file-compressed 80649982 / 81531734 / -1.1% 120828568 / 126164719 / -4.2% 0.67 / 0.65 / +3.3%
tpch_q05/duckdb:vortex-file-compressed 64136975 / 64680334 / -0.8% 119621201 / 126433833 / -5.4% 0.54 / 0.51 / +4.8%
tpch_q06/duckdb:vortex-file-compressed 21297259 / 23633372 / -9.9% 58870921 / 71247618 / -17.4% 🟢 0.36 / 0.33 / +9.1%
tpch_q07/duckdb:vortex-file-compressed 58865974 / 60132823 / -2.1% 117105211 / 133340922 / -12.2% 🟢 0.50 / 0.45 / +11.5%
tpch_q08/duckdb:vortex-file-compressed 84596072 / 85227346 / -0.7% 144585154 / 161348388 / -10.4% 🟢 0.59 / 0.53 / +10.8%
tpch_q09/duckdb:vortex-file-compressed 165674656 / 163376627 / +1.4% 217982215 / 247198509 / -11.8% 🟢 0.76 / 0.66 / +15.0%
tpch_q10/duckdb:vortex-file-compressed 112467472 / 110405355 / +1.9% 153577096 / 171236323 / -10.3% 🟢 0.73 / 0.64 / +13.6%
tpch_q11/duckdb:vortex-file-compressed 17119530 / 17741879 / -3.5% 31738552 / 30923652 / +2.6% 0.54 / 0.57 / -6.0%
tpch_q12/duckdb:vortex-file-compressed 55144166 / 63311097 / -12.9% 🟢 101492086 / 124079132 / -18.2% 🟢 0.54 / 0.51 / +6.5%
tpch_q13/duckdb:vortex-file-compressed 86753549 / 91144110 / -4.8% 141008578 / 143371382 / -1.6% 0.62 / 0.64 / -3.2%
tpch_q14/duckdb:vortex-file-compressed 30561559 / 30249190 / +1.0% 73592969 / 80335296 / -8.4% 0.42 / 0.38 / +10.3%
tpch_q15/duckdb:vortex-file-compressed 40920295 / 38118172 / +7.4% 94098331 / 92812756 / +1.4% 0.43 / 0.41 / +5.9%
tpch_q16/duckdb:vortex-file-compressed 41959142 / 42517572 / -1.3% 55423164 / 54283721 / +2.1% 0.76 / 0.78 / -3.3%
tpch_q17/duckdb:vortex-file-compressed 56515136 / 58659933 / -3.7% 107765059 / 118431001 / -9.0% 0.52 / 0.50 / +5.9%
tpch_q18/duckdb:vortex-file-compressed 123720472 / 134951535 / -8.3% 154052935 / 171547506 / -10.2% 🟢 0.80 / 0.79 / +2.1%
tpch_q19/duckdb:vortex-file-compressed 42950328 / 42340818 / +1.4% 90085808 / 105064184 / -14.3% 🟢 0.48 / 0.40 / +18.3%
tpch_q20/duckdb:vortex-file-compressed 59516823 / 60056653 / -0.9% 117111176 / 130173250 / -10.0% 🟢 0.51 / 0.46 / +10.2%
tpch_q21/duckdb:vortex-file-compressed 236384602 / 247136411 / -4.4% 276507079 / 291456261 / -5.1% 0.85 / 0.85 / +0.8%
tpch_q22/duckdb:vortex-file-compressed 36900837 / 42079573 / -12.3% 🟢 51368207 / 60613326 / -15.3% 🟢 0.72 / 0.69 / +3.5%
duckdb / vortex-compact / ns (0.995x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 63088459 / 61332312 / +2.9% 93281889 / 96863861 / -3.7% 0.68 / 0.63 / +6.8%
tpch_q02/duckdb:vortex-compact 36010539 / 34441837 / +4.6% 49644177 / 52164691 / -4.8% 0.73 / 0.66 / +9.9%
tpch_q03/duckdb:vortex-compact 58742219 / 58753560 / -0.0% 95074014 / 101807452 / -6.6% 0.62 / 0.58 / +7.1%
tpch_q04/duckdb:vortex-compact 80905653 / 81602658 / -0.9% 113901013 / 117696522 / -3.2% 0.71 / 0.69 / +2.4%
tpch_q05/duckdb:vortex-compact 68360283 / 66775946 / +2.4% 113853251 / 119540352 / -4.8% 0.60 / 0.56 / +7.5%
tpch_q06/duckdb:vortex-compact 25135244 / 24498086 / +2.6% 58832693 / 65744066 / -10.5% 🟢 0.43 / 0.37 / +14.7%
tpch_q07/duckdb:vortex-compact 68874750 / 68227838 / +0.9% 122792757 / 139122652 / -11.7% 🟢 0.56 / 0.49 / +14.4%
tpch_q08/duckdb:vortex-compact 88747925 / 88813038 / -0.1% 138397484 / 148838296 / -7.0% 0.64 / 0.60 / +7.5%
tpch_q09/duckdb:vortex-compact 168322572 / 175153011 / -3.9% 225503214 / 243768234 / -7.5% 0.75 / 0.72 / +3.9%
tpch_q10/duckdb:vortex-compact 114204715 / 114216296 / -0.0% 154265035 / 163246245 / -5.5% 0.74 / 0.70 / +5.8%
tpch_q11/duckdb:vortex-compact 18156665 / 19191128 / -5.4% 32913739 / 33422705 / -1.5% 0.55 / 0.57 / -3.9%
tpch_q12/duckdb:vortex-compact 69004421 / 65616096 / +5.2% 104635487 / 112016318 / -6.6% 0.66 / 0.59 / +12.6%
tpch_q13/duckdb:vortex-compact 87056305 / 96319295 / -9.6% 119023899 / 148384743 / -19.8% 🟢 0.73 / 0.65 / +12.7%
tpch_q14/duckdb:vortex-compact 33972616 / 33836150 / +0.4% 69972975 / 76889796 / -9.0% 0.49 / 0.44 / +10.3%
tpch_q15/duckdb:vortex-compact 42407530 / 46989000 / -9.8% 92260893 / 106314440 / -13.2% 🟢 0.46 / 0.44 / +4.0%
tpch_q16/duckdb:vortex-compact 44715593 / 44650257 / +0.1% 57058199 / 55330862 / +3.1% 0.78 / 0.81 / -2.9%
tpch_q17/duckdb:vortex-compact 61952369 / 55620158 / +11.4% 🔴 121651411 / 105309644 / +15.5% 🔴 0.51 / 0.53 / -3.6%
tpch_q18/duckdb:vortex-compact 132614162 / 143506451 / -7.6% 149355407 / 160216771 / -6.8% 0.89 / 0.90 / -0.9%
tpch_q19/duckdb:vortex-compact 44836116 / 42425033 / +5.7% 86665698 / 83054000 / +4.3% 0.52 / 0.51 / +1.3%
tpch_q20/duckdb:vortex-compact 68061327 / 68314802 / -0.4% 127421247 / 132128479 / -3.6% 0.53 / 0.52 / +3.3%
tpch_q21/duckdb:vortex-compact 243689628 / 245921457 / -0.9% 273089063 / 279663914 / -2.4% 0.89 / 0.88 / +1.5%
tpch_q22/duckdb:vortex-compact 41382459 / 44175250 / -6.3% 57583847 / 69737203 / -17.4% 🟢 0.72 / 0.63 / +13.4%
duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 72344972 / 74813230 / -3.3% 85985528 / 104829295 / -18.0% 🟢 0.84 / 0.71 / +17.9%
tpch_q02/duckdb:parquet 80513141 / 80576622 / -0.1% 91218547 / 91042325 / +0.2% 0.88 / 0.89 / -0.3%
tpch_q03/duckdb:parquet 120789170 / 123426492 / -2.1% 146344307 / 151521175 / -3.4% 0.83 / 0.81 / +1.3%
tpch_q04/duckdb:parquet 74605344 / 75767735 / -1.5% 96999295 / 99413196 / -2.4% 0.77 / 0.76 / +0.9%
tpch_q05/duckdb:parquet 128639680 / 129673207 / -0.8% 162164357 / 174273196 / -6.9% 0.79 / 0.74 / +6.6%
tpch_q06/duckdb:parquet 34261519 / 33357754 / +2.7% 47178953 / 55633554 / -15.2% 🟢 0.73 / 0.60 / +21.1%
tpch_q07/duckdb:parquet 94236027 / 93566405 / +0.7% 127364487 / 132993963 / -4.2% 0.74 / 0.70 / +5.2%
tpch_q08/duckdb:parquet 150340702 / 155356047 / -3.2% 187688806 / 210749800 / -10.9% 🟢 0.80 / 0.74 / +8.7%
tpch_q09/duckdb:parquet 229022576 / 229545234 / -0.2% 267304435 / 263942581 / +1.3% 0.86 / 0.87 / -1.5%
tpch_q10/duckdb:parquet 514314104 / 512516653 / +0.4% 543001467 / 556374391 / -2.4% 0.95 / 0.92 / +2.8%
tpch_q11/duckdb:parquet 33588656 / 33719703 / -0.4% 39125673 / 38787199 / +0.9% 0.86 / 0.87 / -1.3%
tpch_q12/duckdb:parquet 76223270 / 78763576 / -3.2% 89907410 / 88275074 / +1.8% 0.85 / 0.89 / -5.0%
tpch_q13/duckdb:parquet 324011887 / 326739231 / -0.8% 332883270 / 341743252 / -2.6% 0.97 / 0.96 / +1.8%
tpch_q14/duckdb:parquet 108558987 / 109277260 / -0.7% 133741870 / 134411485 / -0.5% 0.81 / 0.81 / -0.2%
tpch_q15/duckdb:parquet 43110856 / 43663233 / -1.3% 68034003 / 86406325 / -21.3% 🟢 0.63 / 0.51 / +25.4%
tpch_q16/duckdb:parquet 118249334 / 118532615 / -0.2% 127997117 / 127310255 / +0.5% 0.92 / 0.93 / -0.8%
tpch_q17/duckdb:parquet 81747044 / 82218171 / -0.6% 112148219 / 108343368 / +3.5% 0.73 / 0.76 / -3.9%
tpch_q18/duckdb:parquet 202371883 / 216944869 / -6.7% 172654192 / 193705725 / -10.9% 🟢 1.17 / 1.12 / +4.7%
tpch_q19/duckdb:parquet 166160039 / 166011476 / +0.1% 194269784 / 205513642 / -5.5% 0.86 / 0.81 / +5.9%
tpch_q20/duckdb:parquet 134980309 / 135895671 / -0.7% 166788208 / 167183694 / -0.2% 0.81 / 0.81 / -0.4%
tpch_q21/duckdb:parquet 268884791 / 279595398 / -3.8% 322887057 / 297660736 / +8.5% 0.83 / 0.94 / -11.3%
tpch_q22/duckdb:parquet 266723039 / 268705705 / -0.7% 277540871 / 279544589 / -0.7% 0.96 / 0.96 / -0.0%

File Size Changes (14 files changed, -0.3% overall, 3↑ 11↓)
File Scale Format Base HEAD Change %
supplier.vortex 10.0 vortex-file-compressed 5.92 MB 6.09 MB +169.10 KB +2.8%
nation.vortex 10.0 vortex-file-compressed 10.68 KB 10.71 KB +32 B +0.3%
partsupp.vortex 10.0 vortex-file-compressed 251.87 MB 251.88 MB +4.11 KB +0.0%
partsupp.vortex 10.0 vortex-compact 203.87 MB 203.86 MB 14.42 KB -0.0%
customer.vortex 10.0 vortex-compact 74.00 MB 73.99 MB 15.25 KB -0.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 1.28 GB 1.36 MB -0.1%
orders.vortex 10.0 vortex-compact 344.29 MB 343.70 MB 607.10 KB -0.2%
supplier.vortex 10.0 vortex-compact 4.73 MB 4.72 MB 8.75 KB -0.2%
orders.vortex 10.0 vortex-file-compressed 491.44 MB 489.42 MB 2.03 MB -0.4%
part.vortex 10.0 vortex-file-compressed 53.85 MB 53.60 MB 260.40 KB -0.5%
lineitem.vortex 10.0 vortex-file-compressed 1.71 GB 1.70 GB 10.84 MB -0.6%
customer.vortex 10.0 vortex-file-compressed 91.33 MB 90.68 MB 671.08 KB -0.7%
part.vortex 10.0 vortex-compact 35.90 MB 35.63 MB 273.70 KB -0.7%
region.vortex 10.0 vortex-file-compressed 6.62 KB 6.25 KB 384 B -5.7%

Totals:

  • vortex-compact: 1.92 GB → 1.92 GB (-0.1%)
  • vortex-file-compressed: 2.59 GB → 2.57 GB (-0.5%)

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 9c23a32b vs base 787fac76
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 1.021x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1836086 / 1830644 / +0.3% 7184597 / 6114121 / +17.5% 🔴 0.26 / 0.30 / -14.6%
statpopgen_q01/datafusion:vortex-file-compressed 26276463 / 25364494 / +3.6% 32285292 / 26082058 / +23.8% 🔴 0.81 / 0.97 / -16.3%
statpopgen_q02/datafusion:vortex-file-compressed 109856004 / 109694986 / +0.1% 139603637 / 136318231 / +2.4% 0.79 / 0.80 / -2.2%
statpopgen_q03/datafusion:vortex-file-compressed 357643412 / 444057229 / -19.5% 🟢 398688936 / 389760891 / +2.3% 0.90 / 1.14 / -21.3%
statpopgen_q04/datafusion:vortex-file-compressed 346892318 / 347288891 / -0.1% 389198635 / 388733595 / +0.1% 0.89 / 0.89 / -0.2%
statpopgen_q05/datafusion:vortex-file-compressed 216964539 / 214721352 / +1.0% 360535384 / 255929591 / +40.9% 🔴 0.60 / 0.84 / -28.3%
statpopgen_q06/datafusion:vortex-file-compressed 753207636 / 753541752 / -0.0% 795829580 / 798901025 / -0.4% 0.95 / 0.94 / +0.3%
statpopgen_q07/datafusion:vortex-file-compressed 406497952 / 410203656 / -0.9% 433766966 / 426370844 / +1.7% 0.94 / 0.96 / -2.6%
statpopgen_q08/datafusion:vortex-file-compressed 405555272 / 411994690 / -1.6% 423551768 / 419132141 / +1.1% 0.96 / 0.98 / -2.6%
statpopgen_q09/datafusion:vortex-file-compressed 250889826 / 245750950 / +2.1% 287930573 / 286115106 / +0.6% 0.87 / 0.86 / +1.4%
statpopgen_q10/datafusion:vortex-file-compressed 752771428 / 757296626 / -0.6% 779944945 / 766341325 / +1.8% 0.97 / 0.99 / -2.3%
datafusion / vortex-compact / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1868664 / 1851634 / +0.9% 6511007 / 6223486 / +4.6% 0.29 / 0.30 / -3.5%
statpopgen_q01/datafusion:vortex-compact 25802242 / 28617053 / -9.8% 24945129 / 26469334 / -5.8% 1.03 / 1.08 / -4.3%
statpopgen_q02/datafusion:vortex-compact 210513908 / 212531846 / -0.9% 230406646 / 229781083 / +0.3% 0.91 / 0.92 / -1.2%
statpopgen_q03/datafusion:vortex-compact 471454558 / 471067508 / +0.1% 535495647 / 485184135 / +10.4% 🔴 0.88 / 0.97 / -9.3%
statpopgen_q04/datafusion:vortex-compact 459977952 / 459303980 / +0.1% 481979249 / 485487642 / -0.7% 0.95 / 0.95 / +0.9%
statpopgen_q05/datafusion:vortex-compact 319563136 / 319506980 / +0.0% 360894649 / 333243589 / +8.3% 0.89 / 0.96 / -7.6%
statpopgen_q06/datafusion:vortex-compact 877601589 / 883275962 / -0.6% 899584411 / 913096040 / -1.5% 0.98 / 0.97 / +0.8%
statpopgen_q07/datafusion:vortex-compact 944205876 / 937839756 / +0.7% 951065255 / 953516213 / -0.3% 0.99 / 0.98 / +0.9%
statpopgen_q08/datafusion:vortex-compact 936649204 / 945742651 / -1.0% 940468376 / 961599968 / -2.2% 1.00 / 0.98 / +1.3%
statpopgen_q09/datafusion:vortex-compact 364282859 / 366647890 / -0.6% 390083502 / 385152297 / +1.3% 0.93 / 0.95 / -1.9%
statpopgen_q10/datafusion:vortex-compact 980377214 / 974061680 / +0.6% 987238664 / 981927128 / +0.5% 0.99 / 0.99 / +0.1%
datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1981626 / 1991212 / -0.5% 91055517 / 90715471 / +0.4% 0.02 / 0.02 / -0.9%
statpopgen_q01/datafusion:parquet 162980148 / 163398204 / -0.3% 172385653 / 174306940 / -1.1% 0.95 / 0.94 / +0.9%
statpopgen_q02/datafusion:parquet 301205736 / 294273958 / +2.4% 436493794 / 428921594 / +1.8% 0.69 / 0.69 / +0.6%
statpopgen_q03/datafusion:parquet 399564033 / 394995673 / +1.2% 536595327 / 531263551 / +1.0% 0.74 / 0.74 / +0.2%
statpopgen_q04/datafusion:parquet 376407808 / 410623857 / -8.3% 524570694 / 502263357 / +4.4% 0.72 / 0.82 / -12.2%
statpopgen_q05/datafusion:parquet 318314758 / 323031344 / -1.5% 442364958 / 474714347 / -6.8% 0.72 / 0.68 / +5.7%
statpopgen_q06/datafusion:parquet 470283131 / 484388560 / -2.9% 629857087 / 629395612 / +0.1% 0.75 / 0.77 / -3.0%
statpopgen_q07/datafusion:parquet 442032408 / 434948442 / +1.6% 557533747 / 545206817 / +2.3% 0.79 / 0.80 / -0.6%
statpopgen_q08/datafusion:parquet 437908250 / 442501817 / -1.0% 562520899 / 549307064 / +2.4% 0.78 / 0.81 / -3.4%
statpopgen_q09/datafusion:parquet 370694224 / 366978650 / +1.0% 490004907 / 479405228 / +2.2% 0.76 / 0.77 / -1.2%
statpopgen_q10/datafusion:parquet 566625904 / 566894244 / -0.0% 701387717 / 689827333 / +1.7% 0.81 / 0.82 / -1.7%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9115689 / 9007850 / +1.2% 9470617 / 9408346 / +0.7% 0.96 / 0.96 / +0.5%
statpopgen_q01/duckdb:vortex-file-compressed 10192819 / 10249742 / -0.6% 14432602 / 14895563 / -3.1% 0.71 / 0.69 / +2.6%
statpopgen_q02/duckdb:vortex-file-compressed 304418398 / 311569620 / -2.3% 332834250 / 350283450 / -5.0% 0.91 / 0.89 / +2.8%
statpopgen_q03/duckdb:vortex-file-compressed 815249895 / 808568054 / +0.8% 819026395 / 818572198 / +0.1% 1.00 / 0.99 / +0.8%
statpopgen_q04/duckdb:vortex-file-compressed 812671693 / 819696993 / -0.9% 831676622 / 825367109 / +0.8% 0.98 / 0.99 / -1.6%
statpopgen_q05/duckdb:vortex-file-compressed 321708612 / 323216982 / -0.5% 344474209 / 343517370 / +0.3% 0.93 / 0.94 / -0.7%
statpopgen_q06/duckdb:vortex-file-compressed 1148531508 / 1135325166 / +1.2% 1145407217 / 1176982644 / -2.7% 1.00 / 0.96 / +4.0%
statpopgen_q07/duckdb:vortex-file-compressed 377105254 / 367913306 / +2.5% 392500082 / 415370528 / -5.5% 0.96 / 0.89 / +8.5%
statpopgen_q08/duckdb:vortex-file-compressed 381593658 / 378160968 / +0.9% 442180394 / 381527735 / +15.9% 🔴 0.86 / 0.99 / -12.9%
statpopgen_q09/duckdb:vortex-file-compressed 609355021 / 611621104 / -0.4% 618886814 / 633805556 / -2.4% 0.98 / 0.96 / +2.0%
statpopgen_q10/duckdb:vortex-file-compressed 1901091440 / 1909120612 / -0.4% 1879891360 / 1895228436 / -0.8% 1.01 / 1.01 / +0.4%
duckdb / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 8992965 / 9106272 / -1.2% 9438460 / 9586303 / -1.5% 0.95 / 0.95 / +0.3%
statpopgen_q01/duckdb:vortex-compact 10301480 / 10142442 / +1.6% 13514938 / 13864563 / -2.5% 0.76 / 0.73 / +4.2%
statpopgen_q02/duckdb:vortex-compact 385892535 / 382511342 / +0.9% 401973517 / 395083913 / +1.7% 0.96 / 0.97 / -0.8%
statpopgen_q03/duckdb:vortex-compact 897882680 / 899261645 / -0.2% 906790248 / 912845337 / -0.7% 0.99 / 0.99 / +0.5%
statpopgen_q04/duckdb:vortex-compact 903239102 / 903127855 / +0.0% 905463482 / 901697015 / +0.4% 1.00 / 1.00 / -0.4%
statpopgen_q05/duckdb:vortex-compact 431527484 / 430878248 / +0.2% 439256287 / 440415319 / -0.3% 0.98 / 0.98 / +0.4%
statpopgen_q06/duckdb:vortex-compact 1170613036 / 1173956744 / -0.3% 1170727184 / 1172524395 / -0.2% 1.00 / 1.00 / -0.1%
statpopgen_q07/duckdb:vortex-compact 915306024 / 920704351 / -0.6% 915535484 / 917691632 / -0.2% 1.00 / 1.00 / -0.4%
statpopgen_q08/duckdb:vortex-compact 924652049 / 926706445 / -0.2% 923553533 / 926880863 / -0.4% 1.00 / 1.00 / +0.1%
statpopgen_q09/duckdb:vortex-compact 706661256 / 698250385 / +1.2% 738275880 / 721927521 / +2.3% 0.96 / 0.97 / -1.0%
statpopgen_q10/duckdb:vortex-compact 2023697822 / 2011553076 / +0.6% 1989534204 / 1969019110 / +1.0% 1.02 / 1.02 / -0.4%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245198876 / 245000884 / +0.1% 244110943 / 245118832 / -0.4% 1.00 / 1.00 / +0.5%
statpopgen_q01/duckdb:parquet 302518372 / 300664800 / +0.6% 305565144 / 302068068 / +1.2% 0.99 / 1.00 / -0.5%
statpopgen_q02/duckdb:parquet 578726066 / 543918182 / +6.4% 598353835 / 555169594 / +7.8% 0.97 / 0.98 / -1.3%
statpopgen_q03/duckdb:parquet 869699544 / 837198106 / +3.9% 857062998 / 829597842 / +3.3% 1.01 / 1.01 / +0.6%
statpopgen_q04/duckdb:parquet 832729244 / 833383427 / -0.1% 841988622 / 845257363 / -0.4% 0.99 / 0.99 / +0.3%
statpopgen_q05/duckdb:parquet 576687425 / 569428354 / +1.3% 571925838 / 575771629 / -0.7% 1.01 / 0.99 / +2.0%
statpopgen_q06/duckdb:parquet 695776152 / 719626256 / -3.3% 725233223 / 722884250 / +0.3% 0.96 / 1.00 / -3.6%
statpopgen_q07/duckdb:parquet 607462150 / 610734862 / -0.5% 703367465 / 693763889 / +1.4% 0.86 / 0.88 / -1.9%
statpopgen_q08/duckdb:parquet 617080161 / 616200888 / +0.1% 733684709 / 706732499 / +3.8% 0.84 / 0.87 / -3.5%
statpopgen_q09/duckdb:parquet 801466769 / 812876823 / -1.4% 802859568 / 827636712 / -3.0% 1.00 / 0.98 / +1.6%
statpopgen_q10/duckdb:parquet 1427579566 / 1539562912 / -7.3% 1235911508 / 1376259043 / -10.2% 🟢 1.16 / 1.12 / +3.3%

File Size Changes (2 files changed, +0.0% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.80 GB 1.80 GB +61.65 KB +0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.63 MB 960.66 MB +31.99 KB +0.0%

Totals:

  • vortex-compact: 960.89 MB → 960.92 MB (+0.0%)
  • vortex-file-compressed: 1.80 GB → 1.80 GB (+0.0%)

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 9c23a32b vs base 787fac76


vortex / vortex-file-compressed / ms (0.812x ✅, 6↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.399561 / 32.982635 / -1.8%
read/clickbench/URL/shard-0/onpair-12 19.504627 / 21.092136 / -7.5%
read/tpch/l_comment/fsst 51.682477 / 57.615675 / -10.3% 🟢
read/tpch/l_comment/onpair-12 43.645195 / 53.070138 / -17.8% 🟢
write/clickbench/URL/shard-0/fsst 491.162264 / 602.877592 / -18.5% 🟢
write/clickbench/URL/shard-0/onpair-12 824.247739 / 973.095902 / -15.3% 🟢
write/tpch/l_comment/fsst 1138.48162 / 1922.71196 / -40.8% 🟢
write/tpch/l_comment/onpair-12 1423.99623 / 2060.98059 / -30.9% 🟢
vortex / vortex-file-compressed / % (0.952x ➖, 1↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.3744121 / 47.4075024 / -0.1%
size/clickbench/URL/shard-0/onpair-12 28.3410988 / 30.2301956 / -6.2%
size/tpch/l_comment/fsst 30.1093362 / 30.5867239 / -1.6%
size/tpch/l_comment/onpair-12 23.0415004 / 25.8644092 / -10.9% 🟢

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 9c23a32b vs base 787fac76
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.0%
Engines: DataFusion No clear signal (-11.4%, environment too noisy confidence) · DuckDB No clear signal (+6.2%, environment too noisy confidence)
Vortex (geomean): hot 0.898x ➖ · cold 0.884x ➖
Parquet (geomean): hot 0.925x ➖ · cold 0.918x ➖
Shifts: Parquet (control) -7.5% · Median polish -7.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.950x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 246626398 / 245159991 / +0.6% 798065959 / 582456473 / +37.0% 🔴 0.31 / 0.42 / -26.6%
tpch_q02/datafusion:vortex-file-compressed 354030128 / 386910705 / -8.5% 720123978 / 927320484 / -22.3% 0.49 / 0.42 / +17.8%
tpch_q03/datafusion:vortex-file-compressed 372378965 / 372624670 / -0.1% 1053509547 / 1184274584 / -11.0% 0.35 / 0.31 / +12.3%
tpch_q04/datafusion:vortex-file-compressed 212715027 / 220760653 / -3.6% 392078689 / 404829198 / -3.1% 0.54 / 0.55 / -0.5%
tpch_q05/datafusion:vortex-file-compressed 408961291 / 411816580 / -0.7% 658009552 / 576338375 / +14.2% 0.62 / 0.71 / -13.0%
tpch_q06/datafusion:vortex-file-compressed 266479167 / 272752215 / -2.3% 446801091 / 451458679 / -1.0% 0.60 / 0.60 / -1.3%
tpch_q07/datafusion:vortex-file-compressed 658844901 / 419905628 / +56.9% 🔴 755059539 / 567655234 / +33.0% 🔴 0.87 / 0.74 / +18.0%
tpch_q08/datafusion:vortex-file-compressed 544320150 / 595539952 / -8.6% 633826131 / 753794757 / -15.9% 0.86 / 0.79 / +8.7%
tpch_q09/datafusion:vortex-file-compressed 522720959 / 446189822 / +17.2% 745322676 / 575392097 / +29.5% 0.70 / 0.78 / -9.6%
tpch_q10/datafusion:vortex-file-compressed 383633639 / 356811536 / +7.5% 538738064 / 496956247 / +8.4% 0.71 / 0.72 / -0.8%
tpch_q11/datafusion:vortex-file-compressed 283638197 / 345214232 / -17.8% 400175508 / 445874844 / -10.2% 0.71 / 0.77 / -8.5%
tpch_q12/datafusion:vortex-file-compressed 315934618 / 353574223 / -10.6% 746358355 / 626004822 / +19.2% 0.42 / 0.56 / -25.1%
tpch_q13/datafusion:vortex-file-compressed 149896934 / 281725974 / -46.8% 🟢 396208823 / 637977211 / -37.9% 🟢 0.38 / 0.44 / -14.3%
tpch_q14/datafusion:vortex-file-compressed 189989682 / 193155434 / -1.6% 390566557 / 325098178 / +20.1% 0.49 / 0.59 / -18.1%
tpch_q15/datafusion:vortex-file-compressed 320059879 / 326378851 / -1.9% 504753548 / 649616190 / -22.3% 0.63 / 0.50 / +26.2%
tpch_q16/datafusion:vortex-file-compressed 175114812 / 182374194 / -4.0% 306767426 / 336933895 / -9.0% 0.57 / 0.54 / +5.5%
tpch_q17/datafusion:vortex-file-compressed 365902422 / 378547147 / -3.3% 469674244 / 808857315 / -41.9% 🟢 0.78 / 0.47 / +66.5%
tpch_q18/datafusion:vortex-file-compressed 307674959 / 338784458 / -9.2% 463748866 / 542647520 / -14.5% 0.66 / 0.62 / +6.3%
tpch_q19/datafusion:vortex-file-compressed 399463547 / 516048807 / -22.6% 596024714 / 597600401 / -0.3% 0.67 / 0.86 / -22.4%
tpch_q20/datafusion:vortex-file-compressed 301494511 / 344696916 / -12.5% 499904353 / 647858484 / -22.8% 0.60 / 0.53 / +13.4%
tpch_q21/datafusion:vortex-file-compressed 501611885 / 522624156 / -4.0% 787694203 / 730452078 / +7.8% 0.64 / 0.72 / -11.0%
tpch_q22/datafusion:vortex-file-compressed 188857371 / 188818275 / +0.0% 546183152 / 425938670 / +28.2% 0.35 / 0.44 / -22.0%
datafusion / vortex-compact / ns (0.747x ➖, 7↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 221040819 / 228524734 / -3.3% 646967931 / 811069984 / -20.2% 0.34 / 0.28 / +21.3%
tpch_q02/datafusion:vortex-compact 316509584 / 411125064 / -23.0% 643840659 / 708792799 / -9.2% 0.49 / 0.58 / -15.2%
tpch_q03/datafusion:vortex-compact 329036950 / 660398917 / -50.2% 🟢 836828174 / 1047607250 / -20.1% 0.39 / 0.63 / -37.6%
tpch_q04/datafusion:vortex-compact 159276853 / 250981604 / -36.5% 🟢 446256452 / 867984969 / -48.6% 🟢 0.36 / 0.29 / +23.4%
tpch_q05/datafusion:vortex-compact 384912734 / 423929602 / -9.2% 642448738 / 655596144 / -2.0% 0.60 / 0.65 / -7.3%
tpch_q06/datafusion:vortex-compact 293342657 / 421294085 / -30.4% 🟢 425832442 / 519414742 / -18.0% 0.69 / 0.81 / -15.1%
tpch_q07/datafusion:vortex-compact 343248643 / 437106479 / -21.5% 528087069 / 627450743 / -15.8% 0.65 / 0.70 / -6.7%
tpch_q08/datafusion:vortex-compact 413371473 / 560669384 / -26.3% 611583335 / 898015475 / -31.9% 🟢 0.68 / 0.62 / +8.3%
tpch_q09/datafusion:vortex-compact 462424678 / 411911946 / +12.3% 632592322 / 640136447 / -1.2% 0.73 / 0.64 / +13.6%
tpch_q10/datafusion:vortex-compact 324319034 / 397939077 / -18.5% 511441619 / 758190393 / -32.5% 🟢 0.63 / 0.52 / +20.8%
tpch_q11/datafusion:vortex-compact 341323074 / 293675425 / +16.2% 484351579 / 461197702 / +5.0% 0.70 / 0.64 / +10.7%
tpch_q12/datafusion:vortex-compact 288868371 / 551627434 / -47.6% 🟢 445041953 / 926535124 / -52.0% 🟢 0.65 / 0.60 / +9.0%
tpch_q13/datafusion:vortex-compact 130080687 / 293155981 / -55.6% 🟢 404190852 / 841287411 / -52.0% 🟢 0.32 / 0.35 / -7.6%
tpch_q14/datafusion:vortex-compact 170353832 / 302125329 / -43.6% 🟢 324245610 / 448339850 / -27.7% 0.53 / 0.67 / -22.0%
tpch_q15/datafusion:vortex-compact 344601182 / 326636862 / +5.5% 685976652 / 524334887 / +30.8% 🔴 0.50 / 0.62 / -19.4%
tpch_q16/datafusion:vortex-compact 160352000 / 171833721 / -6.7% 317184760 / 368758530 / -14.0% 0.51 / 0.47 / +8.5%
tpch_q17/datafusion:vortex-compact 307561907 / 403715897 / -23.8% 461235168 / 854443082 / -46.0% 🟢 0.67 / 0.47 / +41.1%
tpch_q18/datafusion:vortex-compact 254797712 / 911912948 / -72.1% 🟢 493883106 / 1432013717 / -65.5% 🟢 0.52 / 0.64 / -19.0%
tpch_q19/datafusion:vortex-compact 450310489 / 493339416 / -8.7% 550933216 / 703175245 / -21.7% 0.82 / 0.70 / +16.5%
tpch_q20/datafusion:vortex-compact 265473037 / 315782350 / -15.9% 404666436 / 458231117 / -11.7% 0.66 / 0.69 / -4.8%
tpch_q21/datafusion:vortex-compact 503360719 / 581852643 / -13.5% 715741938 / 922115984 / -22.4% 0.70 / 0.63 / +11.5%
tpch_q22/datafusion:vortex-compact 154609494 / 158814718 / -2.6% 278407902 / 542101903 / -48.6% 🟢 0.56 / 0.29 / +89.6%
datafusion / parquet / ns (0.950x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 185078842 / 160741940 / +15.1% 534596633 / 394918732 / +35.4% 🔴 0.35 / 0.41 / -14.9%
tpch_q02/datafusion:parquet 293353068 / 337320029 / -13.0% 525033935 / 632978113 / -17.1% 0.56 / 0.53 / +4.8%
tpch_q03/datafusion:parquet 253851325 / 282214118 / -10.1% 631712171 / 666629914 / -5.2% 0.40 / 0.42 / -5.1%
tpch_q04/datafusion:parquet 154245249 / 181848667 / -15.2% 303658938 / 380356905 / -20.2% 0.51 / 0.48 / +6.2%
tpch_q05/datafusion:parquet 341611990 / 375396015 / -9.0% 519145664 / 523201121 / -0.8% 0.66 / 0.72 / -8.3%
tpch_q06/datafusion:parquet 144199651 / 134460430 / +7.2% 254809181 / 241977261 / +5.3% 0.57 / 0.56 / +1.8%
tpch_q07/datafusion:parquet 346976195 / 388273961 / -10.6% 465311250 / 532092057 / -12.6% 0.75 / 0.73 / +2.2%
tpch_q08/datafusion:parquet 469200734 / 432849386 / +8.4% 533580516 / 578327909 / -7.7% 0.88 / 0.75 / +17.5%
tpch_q09/datafusion:parquet 415358693 / 406391310 / +2.2% 597494781 / 566252713 / +5.5% 0.70 / 0.72 / -3.1%
tpch_q10/datafusion:parquet 359961128 / 437407391 / -17.7% 507891133 / 680875528 / -25.4% 0.71 / 0.64 / +10.3%
tpch_q11/datafusion:parquet 297750283 / 266361741 / +11.8% 735648431 / 492746399 / +49.3% 🔴 0.40 / 0.54 / -25.1%
tpch_q12/datafusion:parquet 190826577 / 184384399 / +3.5% 289330470 / 426882154 / -32.2% 🟢 0.66 / 0.43 / +52.7%
tpch_q13/datafusion:parquet 371491092 / 372518836 / -0.3% 461669783 / 655126571 / -29.5% 0.80 / 0.57 / +41.5%
tpch_q14/datafusion:parquet 175703945 / 158747533 / +10.7% 288597870 / 281314347 / +2.6% 0.61 / 0.56 / +7.9%
tpch_q15/datafusion:parquet 344370747 / 371172185 / -7.2% 455876358 / 630901747 / -27.7% 0.76 / 0.59 / +28.4%
tpch_q16/datafusion:parquet 114365022 / 129790914 / -11.9% 233666853 / 256665934 / -9.0% 0.49 / 0.51 / -3.2%
tpch_q17/datafusion:parquet 306006900 / 335247664 / -8.7% 575445167 / 507090144 / +13.5% 0.53 / 0.66 / -19.6%
tpch_q18/datafusion:parquet 378131868 / 439709278 / -14.0% 603044371 / 580283629 / +3.9% 0.63 / 0.76 / -17.2%
tpch_q19/datafusion:parquet 177689635 / 237681489 / -25.2% 340371013 / 297811253 / +14.3% 0.52 / 0.80 / -34.6%
tpch_q20/datafusion:parquet 279553262 / 269313590 / +3.8% 525752249 / 479175761 / +9.7% 0.53 / 0.56 / -5.4%
tpch_q21/datafusion:parquet 382133429 / 408513737 / -6.5% 452418557 / 625692834 / -27.7% 0.84 / 0.65 / +29.4%
tpch_q22/datafusion:parquet 160661617 / 178516262 / -10.0% 386836795 / 416082774 / -7.0% 0.42 / 0.43 / -3.2%
duckdb / vortex-file-compressed / ns (1.020x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 205044033 / 201484592 / +1.8% 312822898 / 385162204 / -18.8% 0.66 / 0.52 / +25.3%
tpch_q02/duckdb:vortex-file-compressed 429128477 / 439104670 / -2.3% 439286965 / 665032047 / -33.9% 🟢 0.98 / 0.66 / +47.9%
tpch_q03/duckdb:vortex-file-compressed 471083645 / 473661846 / -0.5% 633896224 / 768317670 / -17.5% 0.74 / 0.62 / +20.5%
tpch_q04/duckdb:vortex-file-compressed 278835855 / 313779487 / -11.1% 354912694 / 344616572 / +3.0% 0.79 / 0.91 / -13.7%
tpch_q05/duckdb:vortex-file-compressed 418910922 / 477703420 / -12.3% 616190705 / 512069056 / +20.3% 0.68 / 0.93 / -27.1%
tpch_q06/duckdb:vortex-file-compressed 288019403 / 294516890 / -2.2% 300593990 / 308104435 / -2.4% 0.96 / 0.96 / +0.2%
tpch_q07/duckdb:vortex-file-compressed 536258174 / 508923755 / +5.4% 573007452 / 520052700 / +10.2% 0.94 / 0.98 / -4.4%
tpch_q08/duckdb:vortex-file-compressed 640380004 / 607113842 / +5.5% 658014672 / 647377000 / +1.6% 0.97 / 0.94 / +3.8%
tpch_q09/duckdb:vortex-file-compressed 763241098 / 529103926 / +44.3% 🔴 645546874 / 554435437 / +16.4% 1.18 / 0.95 / +23.9%
tpch_q10/duckdb:vortex-file-compressed 522400892 / 527856111 / -1.0% 596978636 / 549199541 / +8.7% 0.88 / 0.96 / -9.0%
tpch_q11/duckdb:vortex-file-compressed 207321728 / 208945622 / -0.8% 215671175 / 232602013 / -7.3% 0.96 / 0.90 / +7.0%
tpch_q12/duckdb:vortex-file-compressed 600578032 / 462566390 / +29.8% 634149361 / 588544904 / +7.7% 0.95 / 0.79 / +20.5%
tpch_q13/duckdb:vortex-file-compressed 312979626 / 330200367 / -5.2% 339008314 / 414853980 / -18.3% 0.92 / 0.80 / +16.0%
tpch_q14/duckdb:vortex-file-compressed 260393787 / 239745606 / +8.6% 264085081 / 322380193 / -18.1% 0.99 / 0.74 / +32.6%
tpch_q15/duckdb:vortex-file-compressed 161243759 / 169869885 / -5.1% 228752061 / 217155046 / +5.3% 0.70 / 0.78 / -9.9%
tpch_q16/duckdb:vortex-file-compressed 190585270 / 188728148 / +1.0% 203208228 / 237858025 / -14.6% 0.94 / 0.79 / +18.2%
tpch_q17/duckdb:vortex-file-compressed 473076530 / 478734536 / -1.2% 461585280 / 536687523 / -14.0% 1.02 / 0.89 / +14.9%
tpch_q18/duckdb:vortex-file-compressed 420230927 / 516090949 / -18.6% 607980427 / 567556644 / +7.1% 0.69 / 0.91 / -24.0%
tpch_q19/duckdb:vortex-file-compressed 364502187 / 338672664 / +7.6% 352871855 / 351353578 / +0.4% 1.03 / 0.96 / +7.2%
tpch_q20/duckdb:vortex-file-compressed 416266572 / 427770756 / -2.7% 578931600 / 494537955 / +17.1% 0.72 / 0.86 / -16.9%
tpch_q21/duckdb:vortex-file-compressed 876885203 / 670198470 / +30.8% 🔴 1076672212 / 763525827 / +41.0% 🔴 0.81 / 0.88 / -7.2%
tpch_q22/duckdb:vortex-file-compressed 178094159 / 192994244 / -7.7% 199552695 / 203521890 / -2.0% 0.89 / 0.95 / -5.9%
duckdb / vortex-compact / ns (0.897x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 215349811 / 222854121 / -3.4% 345805496 / 254155051 / +36.1% 🔴 0.62 / 0.88 / -29.0%
tpch_q02/duckdb:vortex-compact 429684951 / 431331207 / -0.4% 461105398 / 523589414 / -11.9% 0.93 / 0.82 / +13.1%
tpch_q03/duckdb:vortex-compact 427586994 / 689621775 / -38.0% 🟢 470841574 / 1011612128 / -53.5% 🟢 0.91 / 0.68 / +33.2%
tpch_q04/duckdb:vortex-compact 242208198 / 343425593 / -29.5% 315586765 / 363513614 / -13.2% 0.77 / 0.94 / -18.8%
tpch_q05/duckdb:vortex-compact 376287277 / 451802320 / -16.7% 523839873 / 541382177 / -3.2% 0.72 / 0.83 / -13.9%
tpch_q06/duckdb:vortex-compact 317644565 / 325893185 / -2.5% 369350074 / 335601016 / +10.1% 0.86 / 0.97 / -11.4%
tpch_q07/duckdb:vortex-compact 452100188 / 527985324 / -14.4% 448085224 / 572479082 / -21.7% 1.01 / 0.92 / +9.4%
tpch_q08/duckdb:vortex-compact 622666958 / 758640431 / -17.9% 596253449 / 659095514 / -9.5% 1.04 / 1.15 / -9.3%
tpch_q09/duckdb:vortex-compact 529360573 / 440843305 / +20.1% 451970719 / 686623159 / -34.2% 🟢 1.17 / 0.64 / +82.4%
tpch_q10/duckdb:vortex-compact 433080521 / 473193841 / -8.5% 499299769 / 527864831 / -5.4% 0.87 / 0.90 / -3.2%
tpch_q11/duckdb:vortex-compact 193752290 / 232031650 / -16.5% 213099288 / 477110106 / -55.3% 🟢 0.91 / 0.49 / +87.0%
tpch_q12/duckdb:vortex-compact 424801834 / 512301591 / -17.1% 440926373 / 540825736 / -18.5% 0.96 / 0.95 / +1.7%
tpch_q13/duckdb:vortex-compact 204586250 / 310695488 / -34.2% 🟢 228385484 / 354354874 / -35.5% 🟢 0.90 / 0.88 / +2.2%
tpch_q14/duckdb:vortex-compact 248356157 / 253922033 / -2.2% 259296892 / 319687670 / -18.9% 0.96 / 0.79 / +20.6%
tpch_q15/duckdb:vortex-compact 162104538 / 156843742 / +3.4% 368051475 / 171721734 / +114.3% 🔴 0.44 / 0.91 / -51.8%
tpch_q16/duckdb:vortex-compact 177541631 / 190802554 / -7.0% 202604417 / 183168043 / +10.6% 0.88 / 1.04 / -15.9%
tpch_q17/duckdb:vortex-compact 411957027 / 425882902 / -3.3% 478298795 / 468587687 / +2.1% 0.86 / 0.91 / -5.2%
tpch_q18/duckdb:vortex-compact 274597296 / 363281463 / -24.4% 311067904 / 400482869 / -22.3% 0.88 / 0.91 / -2.7%
tpch_q19/duckdb:vortex-compact 385949874 / 425070956 / -9.2% 334793137 / 433888884 / -22.8% 1.15 / 0.98 / +17.7%
tpch_q20/duckdb:vortex-compact 408935491 / 403027261 / +1.5% 392608518 / 438614692 / -10.5% 1.04 / 0.92 / +13.4%
tpch_q21/duckdb:vortex-compact 853387839 / 621385012 / +37.3% 🔴 726553007 / 686917419 / +5.8% 1.17 / 0.90 / +29.8%
tpch_q22/duckdb:vortex-compact 182136516 / 208314743 / -12.6% 212765252 / 190697446 / +11.6% 0.86 / 1.09 / -21.6%
duckdb / parquet / ns (0.900x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 312395142 / 324153306 / -3.6% 362033007 / 362468214 / -0.1% 0.86 / 0.89 / -3.5%
tpch_q02/duckdb:parquet 786311185 / 659127108 / +19.3% 624225103 / 720494007 / -13.4% 1.26 / 0.91 / +37.7%
tpch_q03/duckdb:parquet 732814305 / 939061299 / -22.0% 776999968 / 1027660047 / -24.4% 0.94 / 0.91 / +3.2%
tpch_q04/duckdb:parquet 477862431 / 599607830 / -20.3% 550134975 / 687370803 / -20.0% 0.87 / 0.87 / -0.4%
tpch_q05/duckdb:parquet 1021772794 / 1128860883 / -9.5% 1017866055 / 1259682157 / -19.2% 1.00 / 0.90 / +12.0%
tpch_q06/duckdb:parquet 306972269 / 360465788 / -14.8% 369818907 / 347815198 / +6.3% 0.83 / 1.04 / -19.9%
tpch_q07/duckdb:parquet 966170762 / 1042979451 / -7.4% 882187292 / 1030316831 / -14.4% 1.10 / 1.01 / +8.2%
tpch_q08/duckdb:parquet 1068243990 / 1255934242 / -14.9% 1199067346 / 1239488587 / -3.3% 0.89 / 1.01 / -12.1%
tpch_q09/duckdb:parquet 1111449441 / 1114233215 / -0.2% 1241654032 / 1094479748 / +13.4% 0.90 / 1.02 / -12.1%
tpch_q10/duckdb:parquet 1044802126 / 1302518603 / -19.8% 1002997596 / 1265614526 / -20.8% 1.04 / 1.03 / +1.2%
tpch_q11/duckdb:parquet 461957586 / 443497176 / +4.2% 416689370 / 376700532 / +10.6% 1.11 / 1.18 / -5.8%
tpch_q12/duckdb:parquet 564015702 / 590186868 / -4.4% 631256583 / 690679690 / -8.6% 0.89 / 0.85 / +4.6%
tpch_q13/duckdb:parquet 716150636 / 875091447 / -18.2% 796414492 / 1149748776 / -30.7% 🟢 0.90 / 0.76 / +18.1%
tpch_q14/duckdb:parquet 594080759 / 532445951 / +11.6% 558217715 / 563899657 / -1.0% 1.06 / 0.94 / +12.7%
tpch_q15/duckdb:parquet 418419128 / 383743029 / +9.0% 484948178 / 353885188 / +37.0% 🔴 0.86 / 1.08 / -20.4%
tpch_q16/duckdb:parquet 482801280 / 505205599 / -4.4% 478774910 / 481595565 / -0.6% 1.01 / 1.05 / -3.9%
tpch_q17/duckdb:parquet 449891181 / 513409223 / -12.4% 455657072 / 492018444 / -7.4% 0.99 / 1.04 / -5.4%
tpch_q18/duckdb:parquet 613200809 / 1038212427 / -40.9% 🟢 630525770 / 1167842696 / -46.0% 🟢 0.97 / 0.89 / +9.4%
tpch_q19/duckdb:parquet 572894610 / 633902988 / -9.6% 566690112 / 991259508 / -42.8% 🟢 1.01 / 0.64 / +58.1%
tpch_q20/duckdb:parquet 863177892 / 1094827015 / -21.2% 835184419 / 957536312 / -12.8% 1.03 / 1.14 / -9.6%
tpch_q21/duckdb:parquet 774278385 / 749461841 / +3.3% 1576245587 / 871279892 / +80.9% 🔴 0.49 / 0.86 / -42.9%
tpch_q22/duckdb:parquet 425573045 / 537718066 / -20.9% 324491753 / 535912927 / -39.5% 🟢 1.31 / 1.00 / +30.7%

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 9c23a32b vs base 787fac76


vortex / vortex-file-compressed / ns (0.963x ➖, 3↑ 2↓)
name ns (PR / base / %diff)
compress time/Arade 761117707 / 737484401 / +3.2%
compress time/Bimbo 3585322294 / 3564156164 / +0.6%
compress time/CMSprovider 2417684138 / 2439179989 / -0.9%
compress time/Euro2016 263023081 / 254972953 / +3.2%
compress time/Food 317142244 / 271504520 / +16.8% 🔴
compress time/HashTags 458805472 / 461074410 / -0.5%
compress time/TPC-H l_comment canonical 603633202 / 581221453 / +3.9%
compress time/TPC-H l_comment chunked 604335576 / 593500266 / +1.8%
compress time/taxi 386329659 / 378361398 / +2.1%
compress time/wide table cols=100 chunks=1 rows=1000 7068136 / 7142391 / -1.0%
compress time/wide table cols=100 chunks=50 rows=1000 7053758 / 7351261 / -4.0%
compress time/wide table cols=1000 chunks=1 rows=1000 69373160 / 71850854 / -3.4%
compress time/wide table cols=1000 chunks=50 rows=1000 70529513 / 69765238 / +1.1%
compress time/wide table cols=10000 chunks=1 rows=1000 762939780 / 776823522 / -1.8%
compress time/wide table cols=10000 chunks=50 rows=1000 762494530 / 764134185 / -0.2%
decompress time/Arade 9162100 / 9352135 / -2.0%
decompress time/Bimbo 37335441 / 38832310 / -3.9%
decompress time/CMSprovider 27225428 / 29976410 / -9.2%
decompress time/Euro2016 10037456 / 6790829 / +47.8% 🔴
decompress time/Food 2458527 / 2969784 / -17.2% 🟢
decompress time/HashTags 46919731 / 46617778 / +0.6%
decompress time/TPC-H l_comment canonical 10775342 / 22179730 / -51.4% 🟢
decompress time/TPC-H l_comment chunked 11106880 / 22190294 / -49.9% 🟢
decompress time/taxi 5655292 / 5549729 / +1.9%
decompress time/wide table cols=100 chunks=1 rows=1000 1935540 / 1934235 / +0.1%
decompress time/wide table cols=100 chunks=50 rows=1000 1920979 / 1953382 / -1.7%
decompress time/wide table cols=1000 chunks=1 rows=1000 18475496 / 18451050 / +0.1%
decompress time/wide table cols=1000 chunks=50 rows=1000 18615860 / 18464633 / +0.8%
decompress time/wide table cols=10000 chunks=1 rows=1000 220866751 / 218968730 / +0.9%
decompress time/wide table cols=10000 chunks=50 rows=1000 217124990 / 215848529 / +0.6%
vortex / vortex-file-compressed / bytes (1.002x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142213756 / 142212268 / +0.0%
vortex-file-compressed size/Bimbo 458581260 / 458553996 / +0.0%
vortex-file-compressed size/CMSprovider 420794836 / 420781172 / +0.0%
vortex-file-compressed size/Euro2016 164130260 / 164051500 / +0.0%
vortex-file-compressed size/Food 38950752 / 38949688 / +0.0%
vortex-file-compressed size/HashTags 196170516 / 190348476 / +3.1%
vortex-file-compressed size/TPC-H l_comment canonical 178688232 / 179857112 / -0.6%
vortex-file-compressed size/TPC-H l_comment chunked 178688232 / 179857112 / -0.6%
vortex-file-compressed size/taxi 49998092 / 49994396 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 934080 / 932480 / +0.2%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 934080 / 932480 / +0.2%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9325680 / 9309680 / +0.2%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9325680 / 9309680 / +0.2%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93277680 / 93117680 / +0.2%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93277680 / 93117680 / +0.2%
vortex / vortex-file-compressed / ratio (0.976x ➖, 3↑ 2↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.338861331 / 0.327953189 / +3.3%
vortex:parquet-zstd ratio compress time/Bimbo 0.303747746 / 0.301329356 / +0.8%
vortex:parquet-zstd ratio compress time/CMSprovider 0.377644285 / 0.381049241 / -0.9%
vortex:parquet-zstd ratio compress time/Euro2016 0.2436388 / 0.236220362 / +3.1%
vortex:parquet-zstd ratio compress time/Food 0.429284844 / 0.366631578 / +17.1% 🔴
vortex:parquet-zstd ratio compress time/HashTags 0.250724558 / 0.252339695 / -0.6%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.229985467 / 0.221169724 / +4.0%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.229787898 / 0.225810598 / +1.8%
vortex:parquet-zstd ratio compress time/taxi 0.354043997 / 0.34646753 / +2.2%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.78241625 / 1.8187013 / -2.0%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.77441113 / 1.84303149 / -3.7%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.55567797 / 1.6070623 / -3.2%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.58807305 / 1.56290409 / +1.6%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.66018324 / 1.69472382 / -2.0%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.64984199 / 1.66040037 / -0.6%
vortex:parquet-zstd ratio decompress time/Arade 0.0164625509 / 0.0167616238 / -1.8%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0232639827 / 0.0241970304 / -3.9%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0200162811 / 0.0220418186 / -9.2%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0301569849 / 0.0203614233 / +48.1% 🔴
vortex:parquet-zstd ratio decompress time/Food 0.0144970911 / 0.0174819216 / -17.1% 🟢
vortex:parquet-zstd ratio decompress time/HashTags 0.0910712151 / 0.0901595938 / +1.0%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0216680882 / 0.0444430227 / -51.2% 🟢
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0223209297 / 0.0444835174 / -49.8% 🟢
vortex:parquet-zstd ratio decompress time/taxi 0.0260305526 / 0.0255181022 / +2.0%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.944429833 / 0.944835907 / -0.0%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.926285482 / 0.941644408 / -1.6%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.787355835 / 0.782664821 / +0.6%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.802747854 / 0.787999038 / +1.9%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.902752712 / 0.901400439 / +0.2%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.866057867 / 0.877834108 / -1.3%
vortex:parquet-zstd size/Arade 0.551185597 / 0.55117983 / +0.0%
vortex:parquet-zstd size/Bimbo 1.19261544 / 1.19254454 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11649863 / 1.11646237 / +0.0%
vortex:parquet-zstd size/Euro2016 1.33461969 / 1.33397925 / +0.0%
vortex:parquet-zstd size/Food 1.09107276 / 1.09104296 / +0.0%
vortex:parquet-zstd size/HashTags 1.46946859 / 1.42585702 / +3.1%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.12837977 / 1.13576101 / -0.6%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.12837977 / 1.13576101 / -0.6%
vortex:parquet-zstd size/taxi 0.904392267 / 0.904325412 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.0017975 / 1.00008151 / +0.2%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.0017975 / 1.00008151 / +0.2%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 1.00017975 / 0.99846375 / +0.2%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 1.00017975 / 0.99846375 / +0.2%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 1.00040408 / 0.998688074 / +0.2%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 1.00040408 / 0.998688074 / +0.2%
vortex / parquet / ns (1.000x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2246103754 / 2248748986 / -0.1%
parquet_rs-zstd compress time/Bimbo 11803617777 / 11828107987 / -0.2%
parquet_rs-zstd compress time/CMSprovider 6402014359 / 6401219910 / +0.0%
parquet_rs-zstd compress time/Euro2016 1079561550 / 1079386005 / +0.0%
parquet_rs-zstd compress time/Food 738768789 / 740537740 / -0.2%
parquet_rs-zstd compress time/HashTags 1829918357 / 1827197303 / +0.1%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2624658032 / 2627943111 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2629971295 / 2628310059 / +0.1%
parquet_rs-zstd compress time/taxi 1091191102 / 1092054422 / -0.1%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3965480 / 3927193 / +1.0%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3975267 / 3988679 / -0.3%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44593522 / 44709439 / -0.3%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 44412008 / 44638208 / -0.5%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 459551549 / 458377649 / +0.3%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 462162156 / 460210802 / +0.4%
parquet_rs-zstd decompress time/Arade 556541940 / 557949223 / -0.3%
parquet_rs-zstd decompress time/Bimbo 1604860247 / 1604837839 / +0.0%
parquet_rs-zstd decompress time/CMSprovider 1360164152 / 1359978983 / +0.0%
parquet_rs-zstd decompress time/Euro2016 332840171 / 333514455 / -0.2%
parquet_rs-zstd decompress time/Food 169587608 / 169877435 / -0.2%
parquet_rs-zstd decompress time/HashTags 515198254 / 517058430 / -0.4%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 497290850 / 499059890 / -0.4%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 497599346 / 498843061 / -0.2%
parquet_rs-zstd decompress time/taxi 217255933 / 217482043 / -0.1%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2049427 / 2047165 / +0.1%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2073852 / 2074437 / -0.0%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23465243 / 23574651 / -0.5%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23190171 / 23432304 / -1.0%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 244659194 / 242920594 / +0.7%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 250704945 / 245887608 / +2.0%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (1.018x ➖, 0↑ 4↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 98812571 / 100182705 / -1.4%
arrow-ipc compress time/Bimbo 616199597 / 627929928 / -1.9%
arrow-ipc compress time/CMSprovider 382515049 / 387265457 / -1.2%
arrow-ipc compress time/Euro2016 38329404 / 38719664 / -1.0%
arrow-ipc compress time/Food 33743584 / 34235646 / -1.4%
arrow-ipc compress time/HashTags 78814992 / 79483760 / -0.8%
arrow-ipc compress time/TPC-H l_comment canonical 522013240 / 498697740 / +4.7%
arrow-ipc compress time/TPC-H l_comment chunked 501365980 / 504175257 / -0.6%
arrow-ipc compress time/taxi 74811775 / 75726365 / -1.2%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 203972 / 212687 / -4.1%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 203206 / 204569 / -0.7%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2236312 / 2267485 / -1.4%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2239913 / 2261142 / -0.9%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25753043 / 25998824 / -0.9%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25578189 / 26063830 / -1.9%
arrow-ipc decompress time/Arade 180859601 / 141411931 / +27.9% 🔴
arrow-ipc decompress time/Bimbo 411263743 / 410274332 / +0.2%
arrow-ipc decompress time/CMSprovider 583179462 / 584533182 / -0.2%
arrow-ipc decompress time/Euro2016 74573697 / 64357036 / +15.9% 🔴
arrow-ipc decompress time/Food 58148577 / 49003155 / +18.7% 🔴
arrow-ipc decompress time/HashTags 143606065 / 121252759 / +18.4% 🔴
arrow-ipc decompress time/TPC-H l_comment canonical 532364415 / 533257137 / -0.2%
arrow-ipc decompress time/TPC-H l_comment chunked 529545869 / 530614766 / -0.2%
arrow-ipc decompress time/taxi 48077744 / 45387499 / +5.9%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 321213 / 322357 / -0.4%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 319805 / 352357 / -9.2%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3459964 / 3590783 / -3.6%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3715481 / 3493757 / +6.3%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 36809164 / 37396461 / -1.6%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 36747055 / 36990040 / -0.7%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 9c23a32b vs base 85e7acfa
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (+10.3%, environment too noisy confidence) · DuckDB No clear signal (-10.5%, environment too noisy confidence)
Vortex (geomean): hot 1.095x ➖ · cold 1.043x ➖
Parquet (geomean): hot 1.102x ➖ · cold 1.127x ➖
Shifts: Parquet (control) +10.2% · Median polish +8.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.131x ➖, 0↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 360989846 / 345437670 / +4.5% 1210028382 / 808778077 / +49.6% 🔴 0.30 / 0.43 / -30.2%
tpch_q02/datafusion:vortex-compact 520684819 / 550578285 / -5.4% 934619647 / 1020444135 / -8.4% 0.56 / 0.54 / +3.3%
tpch_q03/datafusion:vortex-compact 595918087 / 452426279 / +31.7% 🔴 1418047633 / 1548398973 / -8.4% 0.42 / 0.29 / +43.8%
tpch_q04/datafusion:vortex-compact 303250395 / 348569509 / -13.0% 662403470 / 548287198 / +20.8% 0.46 / 0.64 / -28.0%
tpch_q05/datafusion:vortex-compact 839799102 / 639662371 / +31.3% 🔴 975153287 / 787968135 / +23.8% 0.86 / 0.81 / +6.1%
tpch_q06/datafusion:vortex-compact 462459229 / 299158632 / +54.6% 🔴 478300627 / 475611255 / +0.6% 0.97 / 0.63 / +53.7%
tpch_q07/datafusion:vortex-compact 554662961 / 500805903 / +10.8% 680780091 / 922776863 / -26.2% 0.81 / 0.54 / +50.1%
tpch_q08/datafusion:vortex-compact 896307525 / 861855497 / +4.0% 1189543082 / 1016800544 / +17.0% 0.75 / 0.85 / -11.1%
tpch_q09/datafusion:vortex-compact 708153987 / 694870497 / +1.9% 1032401292 / 1074934374 / -4.0% 0.69 / 0.65 / +6.1%
tpch_q10/datafusion:vortex-compact 546384025 / 546912022 / -0.1% 896241742 / 1079004940 / -16.9% 0.61 / 0.51 / +20.3%
tpch_q11/datafusion:vortex-compact 368240036 / 335736528 / +9.7% 656459570 / 596160939 / +10.1% 0.56 / 0.56 / -0.4%
tpch_q12/datafusion:vortex-compact 763971768 / 472055968 / +61.8% 🔴 1210772829 / 666004215 / +81.8% 🔴 0.63 / 0.71 / -11.0%
tpch_q13/datafusion:vortex-compact 366559616 / 198437067 / +84.7% 🔴 519874473 / 688063287 / -24.4% 0.71 / 0.29 / +144.5%
tpch_q14/datafusion:vortex-compact 418510861 / 396372838 / +5.6% 556294474 / 610472687 / -8.9% 0.75 / 0.65 / +15.9%
tpch_q15/datafusion:vortex-compact 737738253 / 726437026 / +1.6% 942479114 / 719926930 / +30.9% 🔴 0.78 / 1.01 / -22.4%
tpch_q16/datafusion:vortex-compact 319340993 / 277516005 / +15.1% 503536051 / 458341594 / +9.9% 0.63 / 0.61 / +4.7%
tpch_q17/datafusion:vortex-compact 813048523 / 811601476 / +0.2% 1030020300 / 910209217 / +13.2% 0.79 / 0.89 / -11.5%
tpch_q18/datafusion:vortex-compact 565821919 / 560608145 / +0.9% 573593586 / 630625093 / -9.0% 0.99 / 0.89 / +11.0%
tpch_q19/datafusion:vortex-compact 526811296 / 535891387 / -1.7% 707328710 / 742869200 / -4.8% 0.74 / 0.72 / +3.2%
tpch_q20/datafusion:vortex-compact 897418805 / 614296705 / +46.1% 🔴 875773330 / 771138946 / +13.6% 1.02 / 0.80 / +28.6%
tpch_q21/datafusion:vortex-compact 767223466 / 818636411 / -6.3% 836316383 / 929412479 / -10.0% 0.92 / 0.88 / +4.2%
tpch_q22/datafusion:vortex-compact 319531237 / 313191712 / +2.0% 559676772 / 545243021 / +2.6% 0.57 / 0.57 / -0.6%
datafusion / parquet / ns (1.026x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 344215257 / 225321660 / +52.8% 🔴 692135493 / 636471617 / +8.7% 0.50 / 0.35 / +40.5%
tpch_q02/datafusion:parquet 505755024 / 622399962 / -18.7% 1015522286 / 1028428572 / -1.3% 0.50 / 0.61 / -17.7%
tpch_q03/datafusion:parquet 531819821 / 403504453 / +31.8% 🔴 1024509990 / 997808715 / +2.7% 0.52 / 0.40 / +28.4%
tpch_q04/datafusion:parquet 406056872 / 369658890 / +9.8% 550768184 / 518602749 / +6.2% 0.74 / 0.71 / +3.4%
tpch_q05/datafusion:parquet 647854327 / 623702337 / +3.9% 964374438 / 991876741 / -2.8% 0.67 / 0.63 / +6.8%
tpch_q06/datafusion:parquet 280093305 / 177893513 / +57.4% 🔴 455248052 / 359261004 / +26.7% 0.62 / 0.50 / +24.3%
tpch_q07/datafusion:parquet 648840124 / 1293217464 / -49.8% 🟢 810900596 / 874797945 / -7.3% 0.80 / 1.48 / -45.9%
tpch_q08/datafusion:parquet 711243873 / 778105524 / -8.6% 1002532044 / 1012542556 / -1.0% 0.71 / 0.77 / -7.7%
tpch_q09/datafusion:parquet 955468003 / 870350143 / +9.8% 1297808605 / 1007864713 / +28.8% 0.74 / 0.86 / -14.7%
tpch_q10/datafusion:parquet 1330527982 / 1335641262 / -0.4% 1530054855 / 1674245565 / -8.6% 0.87 / 0.80 / +9.0%
tpch_q11/datafusion:parquet 428855123 / 364949282 / +17.5% 647984050 / 499930833 / +29.6% 0.66 / 0.73 / -9.3%
tpch_q12/datafusion:parquet 436035609 / 412204303 / +5.8% 683298987 / 596717665 / +14.5% 0.64 / 0.69 / -7.6%
tpch_q13/datafusion:parquet 497425882 / 431808776 / +15.2% 1261989804 / 655368275 / +92.6% 🔴 0.39 / 0.66 / -40.2%
tpch_q14/datafusion:parquet 422916590 / 440266562 / -3.9% 614860235 / 685511217 / -10.3% 0.69 / 0.64 / +7.1%
tpch_q15/datafusion:parquet 650820096 / 711527396 / -8.5% 852336971 / 958204042 / -11.0% 0.76 / 0.74 / +2.8%
tpch_q16/datafusion:parquet 260403605 / 233249632 / +11.6% 476461736 / 394355733 / +20.8% 0.55 / 0.59 / -7.6%
tpch_q17/datafusion:parquet 665810342 / 637022222 / +4.5% 830070205 / 793513115 / +4.6% 0.80 / 0.80 / -0.1%
tpch_q18/datafusion:parquet 767759746 / 957318995 / -19.8% 803733670 / 1553487597 / -48.3% 🟢 0.96 / 0.62 / +55.0%
tpch_q19/datafusion:parquet 446124066 / 450694769 / -1.0% 645284099 / 602552484 / +7.1% 0.69 / 0.75 / -7.6%
tpch_q20/datafusion:parquet 736995725 / 696243259 / +5.9% 915835298 / 824881120 / +11.0% 0.80 / 0.84 / -4.7%
tpch_q21/datafusion:parquet 1067385428 / 1084260189 / -1.6% 1265264559 / 1248403343 / +1.4% 0.84 / 0.87 / -2.9%
tpch_q22/datafusion:parquet 512187866 / 522189396 / -1.9% 754152283 / 757315580 / -0.4% 0.68 / 0.69 / -1.5%
duckdb / vortex-compact / ns (1.059x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 962827200 / 1046178274 / -8.0% 1511809524 / 1857920202 / -18.6% 0.64 / 0.56 / +13.1%
tpch_q02/duckdb:vortex-compact 573798671 / 507863499 / +13.0% 598017804 / 667392786 / -10.4% 0.96 / 0.76 / +26.1%
tpch_q03/duckdb:vortex-compact 1310710998 / 1045915077 / +25.3% 1610549863 / 1786997759 / -9.9% 0.81 / 0.59 / +39.0%
tpch_q04/duckdb:vortex-compact 756995565 / 694825199 / +8.9% 898619218 / 824358964 / +9.0% 0.84 / 0.84 / -0.1%
tpch_q05/duckdb:vortex-compact 1189003831 / 1058020407 / +12.4% 1413836095 / 1619792669 / -12.7% 0.84 / 0.65 / +28.8%
tpch_q06/duckdb:vortex-compact 1434382711 / 1106706235 / +29.6% 1341549293 / 1105558850 / +21.3% 1.07 / 1.00 / +6.8%
tpch_q07/duckdb:vortex-compact 1558162238 / 1408102175 / +10.7% 1592834707 / 1504157870 / +5.9% 0.98 / 0.94 / +4.5%
tpch_q08/duckdb:vortex-compact 1453138522 / 1405685761 / +3.4% 1675943069 / 1510271830 / +11.0% 0.87 / 0.93 / -6.8%
tpch_q09/duckdb:vortex-compact 1915650010 / 1644771528 / +16.5% 2162456719 / 1860991657 / +16.2% 0.89 / 0.88 / +0.2%
tpch_q10/duckdb:vortex-compact 1537273236 / 1407901012 / +9.2% 1881901033 / 1570631373 / +19.8% 0.82 / 0.90 / -8.9%
tpch_q11/duckdb:vortex-compact 520354534 / 476306827 / +9.2% 833889373 / 591534329 / +41.0% 🔴 0.62 / 0.81 / -22.5%
tpch_q12/duckdb:vortex-compact 2083451813 / 1942390099 / +7.3% 2404543068 / 2032552564 / +18.3% 0.87 / 0.96 / -9.3%
tpch_q13/duckdb:vortex-compact 712089903 / 1108529164 / -35.8% 🟢 1011551411 / 1465087423 / -31.0% 🟢 0.70 / 0.76 / -7.0%
tpch_q14/duckdb:vortex-compact 944211370 / 862556054 / +9.5% 1088878253 / 941889677 / +15.6% 0.87 / 0.92 / -5.3%
tpch_q15/duckdb:vortex-compact 1000667995 / 893548297 / +12.0% 1273654190 / 888475271 / +43.4% 🔴 0.79 / 1.01 / -21.9%
tpch_q16/duckdb:vortex-compact 246668645 / 223674210 / +10.3% 280180662 / 277604633 / +0.9% 0.88 / 0.81 / +9.3%
tpch_q17/duckdb:vortex-compact 1418519698 / 1315449132 / +7.8% 1496362312 / 1301653127 / +15.0% 0.95 / 1.01 / -6.2%
tpch_q18/duckdb:vortex-compact 1089462501 / 1172036554 / -7.0% 1133535862 / 1263357220 / -10.3% 0.96 / 0.93 / +3.6%
tpch_q19/duckdb:vortex-compact 1304148864 / 1149859842 / +13.4% 1213968808 / 1277273533 / -5.0% 1.07 / 0.90 / +19.3%
tpch_q20/duckdb:vortex-compact 1622589586 / 1614319168 / +0.5% 1984990388 / 1750623953 / +13.4% 0.82 / 0.92 / -11.4%
tpch_q21/duckdb:vortex-compact 2592686108 / 2328099330 / +11.4% 2606069409 / 2431399630 / +7.2% 0.99 / 0.96 / +3.9%
tpch_q22/duckdb:vortex-compact 403433512 / 446300560 / -9.6% 555502253 / 662097415 / -16.1% 0.73 / 0.67 / +7.7%
duckdb / parquet / ns (1.184x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 542507469 / 373524673 / +45.2% 🔴 527083910 / 326787071 / +61.3% 🔴 1.03 / 1.14 / -10.0%
tpch_q02/duckdb:parquet 763924700 / 750557342 / +1.8% 1027662089 / 1480097308 / -30.6% 🟢 0.74 / 0.51 / +46.6%
tpch_q03/duckdb:parquet 976827152 / 807453245 / +21.0% 1176587945 / 1223343910 / -3.8% 0.83 / 0.66 / +25.8%
tpch_q04/duckdb:parquet 632812292 / 520185258 / +21.7% 728128662 / 568128916 / +28.2% 0.87 / 0.92 / -5.1%
tpch_q05/duckdb:parquet 1164185087 / 968448825 / +20.2% 1624858424 / 1399764038 / +16.1% 0.72 / 0.69 / +3.6%
tpch_q06/duckdb:parquet 523632938 / 327148300 / +60.1% 🔴 586023448 / 330646096 / +77.2% 🔴 0.89 / 0.99 / -9.7%
tpch_q07/duckdb:parquet 1048508499 / 946855209 / +10.7% 1244640914 / 852063786 / +46.1% 🔴 0.84 / 1.11 / -24.2%
tpch_q08/duckdb:parquet 1360063615 / 1253532646 / +8.5% 1514784020 / 1309702112 / +15.7% 0.90 / 0.96 / -6.2%
tpch_q09/duckdb:parquet 1361665556 / 1154089465 / +18.0% 1928184226 / 1122999502 / +71.7% 🔴 0.71 / 1.03 / -31.3%
tpch_q10/duckdb:parquet 1952597520 / 1751243625 / +11.5% 2518408837 / 2361805954 / +6.6% 0.78 / 0.74 / +4.6%
tpch_q11/duckdb:parquet 495568694 / 475791429 / +4.2% 647676984 / 457278106 / +41.6% 🔴 0.77 / 1.04 / -26.5%
tpch_q12/duckdb:parquet 816808707 / 609985245 / +33.9% 🔴 890363151 / 705838153 / +26.1% 0.92 / 0.86 / +6.2%
tpch_q13/duckdb:parquet 837468576 / 756264297 / +10.7% 996324797 / 885312911 / +12.5% 0.84 / 0.85 / -1.6%
tpch_q14/duckdb:parquet 775035656 / 575060095 / +34.8% 🔴 811203078 / 593656342 / +36.6% 🔴 0.96 / 0.97 / -1.4%
tpch_q15/duckdb:parquet 516161884 / 399074514 / +29.3% 379047490 / 381173359 / -0.6% 1.36 / 1.05 / +30.1%
tpch_q16/duckdb:parquet 616655417 / 625772862 / -1.5% 800502704 / 658316973 / +21.6% 0.77 / 0.95 / -19.0%
tpch_q17/duckdb:parquet 753323691 / 648469114 / +16.2% 715782055 / 579328172 / +23.6% 1.05 / 1.12 / -6.0%
tpch_q18/duckdb:parquet 795183258 / 744619266 / +6.8% 828140535 / 800880841 / +3.4% 0.96 / 0.93 / +3.3%
tpch_q19/duckdb:parquet 751838088 / 711426680 / +5.7% 977402058 / 838794923 / +16.5% 0.77 / 0.85 / -9.3%
tpch_q20/duckdb:parquet 1396034584 / 990729077 / +40.9% 🔴 1320187066 / 1225701518 / +7.7% 1.06 / 0.81 / +30.8%
tpch_q21/duckdb:parquet 1021723074 / 895285334 / +14.1% 973046775 / 878856547 / +10.7% 1.05 / 1.02 / +3.1%
tpch_q22/duckdb:parquet 784742783 / 712372706 / +10.2% 1055847928 / 784664411 / +34.6% 🔴 0.74 / 0.91 / -18.1%

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 9c23a32b vs base 787fac76
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.4%
Engines: random-access No clear signal (-1.4%, environment too noisy confidence)
Vortex (geomean): hot 0.985x ➖
Parquet (geomean): hot 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.999x ➖, 1↑ 2↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 73510 / 70641 / +4.1%
random-access/arrow-tokio-local-disk-footer 165877 / 164630 / +0.8%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 2524709 / 2269002 / +11.3% 🔴
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 3220001 / 2049711 / +57.1% 🔴
random-access/feature-vectors/uniform/arrow-tokio-local-disk 33132423 / 55438018 / -40.2% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 33056176 / 32127988 / +2.9%
random-access/nested-lists/correlated/arrow-tokio-local-disk 58980 / 61050 / -3.4%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 104741 / 105389 / -0.6%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1102097 / 1164271 / -5.3%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1174214 / 1224037 / -4.1%
random-access/nested-structs/correlated/arrow-tokio-local-disk 52376 / 54952 / -4.7%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 93731 / 94489 / -0.8%
random-access/nested-structs/uniform/arrow-tokio-local-disk 871522 / 885896 / -1.6%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 926356 / 954302 / -2.9%
random-access/taxi/correlated/arrow-tokio-local-disk 123555 / 119151 / +3.7%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 220474 / 218114 / +1.1%
random-access/taxi/uniform/arrow-tokio-local-disk 2886942 / 2858365 / +1.0%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 3076957 / 2939904 / +4.7%
random-access / vortex-file-compressed / ns (0.985x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 244934 / 245406 / -0.2%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1215452 / 1273601 / -4.6%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1422590 / 1408858 / +1.0%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2640797 / 2705926 / -2.4%
random-access/nested-lists/correlated/vortex-tokio-local-disk 219128 / 209352 / +4.7%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 371932 / 367935 / +1.1%
random-access/nested-lists/uniform/vortex-tokio-local-disk 748222 / 734095 / +1.9%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 935922 / 958129 / -2.3%
random-access/nested-structs/correlated/vortex-tokio-local-disk 280514 / 279742 / +0.3%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 512759 / 535923 / -4.3%
random-access/nested-structs/uniform/vortex-tokio-local-disk 615148 / 625503 / -1.7%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 927659 / 960477 / -3.4%
random-access/taxi/correlated/vortex-tokio-local-disk 642181 / 686223 / -6.4%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1440514 / 1457322 / -1.2%
random-access/taxi/uniform/vortex-tokio-local-disk 2635549 / 2662646 / -1.0%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3854605 / 3857140 / -0.1%
random-access/vortex-tokio-local-disk 440677 / 458591 / -3.9%
random-access/vortex-tokio-local-disk-footer 1074149 / 1110477 / -3.3%
random-access / parquet / ns (1.000x ➖, 1↑ 1↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 107501398341 / 163289722985 / -34.2% 🟢
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 107559873599 / 108555663943 / -0.9%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 158266242869 / 107475935768 / +47.3% 🔴
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 107881799256 / 108194680656 / -0.3%
random-access/nested-lists/correlated/parquet-tokio-local-disk 147968200 / 147421846 / +0.4%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 146038176 / 144692177 / +0.9%
random-access/nested-lists/uniform/parquet-tokio-local-disk 147102940 / 147788900 / -0.5%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 148290972 / 147589109 / +0.5%
random-access/nested-structs/correlated/parquet-tokio-local-disk 44920854 / 44012932 / +2.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 44995514 / 44208789 / +1.8%
random-access/nested-structs/uniform/parquet-tokio-local-disk 44180605 / 43982896 / +0.4%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 44248763 / 44223443 / +0.1%
random-access/parquet-tokio-local-disk 118897693 / 120176665 / -1.1%
random-access/parquet-tokio-local-disk-footer 118821303 / 118739116 / +0.1%
random-access/taxi/correlated/parquet-tokio-local-disk 178419250 / 179713852 / -0.7%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 178092538 / 178765110 / -0.4%
random-access/taxi/uniform/parquet-tokio-local-disk 191978257 / 187697065 / +2.3%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 187933676 / 192223861 / -2.2%
random-access / lance / ns (0.993x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 212759 / 214925 / -1.0%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1029386 / 994578 / +3.5%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1080784 / 1092827 / -1.1%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1857550 / 1895239 / -2.0%
random-access/lance-tokio-local-disk 549092 / 558784 / -1.7%
random-access/lance-tokio-local-disk-footer 1301312 / 1324592 / -1.8%
random-access/nested-lists/correlated/lance-tokio-local-disk 160498 / 161725 / -0.8%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 490429 / 499367 / -1.8%
random-access/nested-lists/uniform/lance-tokio-local-disk 900420 / 922298 / -2.4%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1419072 / 1448786 / -2.1%
random-access/nested-structs/correlated/lance-tokio-local-disk 276033 / 281479 / -1.9%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 561026 / 568879 / -1.4%
random-access/nested-structs/uniform/lance-tokio-local-disk 2415172 / 2315865 / +4.3%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2682025 / 2598638 / +3.2%
random-access/taxi/correlated/lance-tokio-local-disk 794719 / 807436 / -1.6%
random-access/taxi/correlated/lance-tokio-local-disk-footer 1816078 / 1849882 / -1.8%
random-access/taxi/uniform/lance-tokio-local-disk 8143750 / 8139988 / +0.0%
random-access/taxi/uniform/lance-tokio-local-disk-footer 8748354 / 8893666 / -1.6%

@github-actions

ghost commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR 9c23a32b vs base 85e7acfa
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.4%
Engines: random-access No clear signal (-6.4%, environment too noisy confidence)
Vortex (geomean): hot 0.964x ➖
Parquet (geomean): hot 1.030x ➖
Shifts: Parquet (control) +3.0% · Median polish +2.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (0.964x ➖, 3↑ 2↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3 52769943 / 45242413 / +16.6%
random-access/feature-vectors/correlated/vortex-tokio-s3-footer 146919511 / 123214930 / +19.2%
random-access/feature-vectors/uniform/vortex-tokio-s3 111351666 / 81951951 / +35.9% 🔴
random-access/feature-vectors/uniform/vortex-tokio-s3-footer 267559830 / 154082393 / +73.6% 🔴
random-access/nested-lists/correlated/vortex-tokio-s3 47271979 / 43491912 / +8.7%
random-access/nested-lists/correlated/vortex-tokio-s3-footer 95292343 / 91733030 / +3.9%
random-access/nested-lists/uniform/vortex-tokio-s3 164212488 / 160776086 / +2.1%
random-access/nested-lists/uniform/vortex-tokio-s3-footer 201469435 / 197972768 / +1.8%
random-access/nested-structs/correlated/vortex-tokio-s3 53274349 / 49577269 / +7.5%
random-access/nested-structs/correlated/vortex-tokio-s3-footer 104284188 / 90723539 / +14.9%
random-access/nested-structs/uniform/vortex-tokio-s3 172187620 / 169677656 / +1.5%
random-access/nested-structs/uniform/vortex-tokio-s3-footer 225534359 / 209147260 / +7.8%
random-access/taxi/correlated/vortex-tokio-s3 98846383 / 95867071 / +3.1%
random-access/taxi/correlated/vortex-tokio-s3-footer 137166718 / 158960620 / -13.7%
random-access/taxi/uniform/vortex-tokio-s3 174333606 / 177063264 / -1.5%
random-access/taxi/uniform/vortex-tokio-s3-footer 219509863 / 451780231 / -51.4% 🟢
random-access/vortex-tokio-s3 56784290 / 115337926 / -50.8% 🟢
random-access/vortex-tokio-s3-footer 96203149 / 203013456 / -52.6% 🟢
random-access / parquet / ns (1.030x ➖, 0↑ 1↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3 171087334221 / 175046728386 / -2.3%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer 172404676497 / 172799124341 / -0.2%
random-access/feature-vectors/uniform/parquet-tokio-s3 171476680954 / 161161943796 / +6.4%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer 170031412922 / 167530292627 / +1.5%
random-access/nested-lists/correlated/parquet-tokio-s3 1027734845 / 1034115472 / -0.6%
random-access/nested-lists/correlated/parquet-tokio-s3-footer 1485449443 / 1114658608 / +33.3% 🔴
random-access/nested-lists/uniform/parquet-tokio-s3 1033802260 / 1024560106 / +0.9%
random-access/nested-lists/uniform/parquet-tokio-s3-footer 1138632661 / 1112754614 / +2.3%
random-access/nested-structs/correlated/parquet-tokio-s3 452244257 / 453778848 / -0.3%
random-access/nested-structs/correlated/parquet-tokio-s3-footer 557915219 / 536808527 / +3.9%
random-access/nested-structs/uniform/parquet-tokio-s3 452109785 / 454298885 / -0.5%
random-access/nested-structs/uniform/parquet-tokio-s3-footer 549301838 / 550690688 / -0.3%
random-access/parquet-tokio-s3 488443844 / 479205151 / +1.9%
random-access/parquet-tokio-s3-footer 543274734 / 537390431 / +1.1%
random-access/taxi/correlated/parquet-tokio-s3 721758939 / 715846706 / +0.8%
random-access/taxi/correlated/parquet-tokio-s3-footer 849713663 / 775589479 / +9.6%
random-access/taxi/uniform/parquet-tokio-s3 782514946 / 783668300 / -0.1%
random-access/taxi/uniform/parquet-tokio-s3-footer 837608343 / 826140537 / +1.4%
random-access / lance / ns (1.166x ➖, 0↑ 4↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3 45497790 / 45868407 / -0.8%
random-access/feature-vectors/correlated/lance-tokio-s3-footer 221564993 / 188134127 / +17.8%
random-access/feature-vectors/uniform/lance-tokio-s3 121550204 / 165608624 / -26.6%
random-access/feature-vectors/uniform/lance-tokio-s3-footer 244305712 / 216783320 / +12.7%
random-access/lance-tokio-s3 88927408 / 57620273 / +54.3% 🔴
random-access/lance-tokio-s3-footer 286242905 / 244522502 / +17.1%
random-access/nested-lists/correlated/lance-tokio-s3 44291347 / 38837871 / +14.0%
random-access/nested-lists/correlated/lance-tokio-s3-footer 263656190 / 223040051 / +18.2%
random-access/nested-lists/uniform/lance-tokio-s3 91528140 / 79021774 / +15.8%
random-access/nested-lists/uniform/lance-tokio-s3-footer 300123368 / 266481526 / +12.6%
random-access/nested-structs/correlated/lance-tokio-s3 67916258 / 44594129 / +52.3% 🔴
random-access/nested-structs/correlated/lance-tokio-s3-footer 291626226 / 226262991 / +28.9%
random-access/nested-structs/uniform/lance-tokio-s3 176710259 / 116304187 / +51.9% 🔴
random-access/nested-structs/uniform/lance-tokio-s3-footer 314337226 / 292053995 / +7.6%
random-access/taxi/correlated/lance-tokio-s3 107846567 / 73010962 / +47.7% 🔴
random-access/taxi/correlated/lance-tokio-s3-footer 277351216 / 252885091 / +9.7%
random-access/taxi/uniform/lance-tokio-s3 237545235 / 242700968 / -2.1%
random-access/taxi/uniform/lance-tokio-s3-footer 492335574 / 481946329 / +2.2%

@joseph-isaacs
joseph-isaacs enabled auto-merge (squash) October 12, 2026 16:01
…ressor-baseline

Signed-off-by: Claude <noreply@anthropic.com>

# Conflicts:
#	vortex-file/src/tests.rs
@joseph-isaacs
joseph-isaacs merged commit d42e7c9 into develop Oct 12, 2026
@joseph-isaacs
joseph-isaacs deleted the ji/exact-size-compressor-baseline branch October 12, 2026 16:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants