Skip to content

Default DuckDB to Scan V2 and optimize sparse and wide scans - #10964

Draft
joseph-isaacs wants to merge 8 commits into
developfrom
ji/codex/scan-v2-topk-feedback
Draft

joseph-isaacs wants to merge 8 commits into
developfrom
ji/codex/scan-v2-topk-feedback

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

DuckDB extension scans default to Scan V2; VORTEX_SCAN_V2=0 restores V1. An explicit benchmark --scan-v2 true/false overrides the default and environment. Develop's per-suite orchestrator selection is preserved.

The scan keeps exact (file, row) pairs during late payload retrieval, schedules selected regions for sparse input, and gathers referenced dictionary values before conversion. Dense inputs retain vectorized execution. Mutable TopK bounds are excluded from dictionary predicate memoization; queued pruning and row filters refresh when the bound changes before projection.

Integration with develop

Rebased onto 7baa376169, including develop's layout-aware DuckDB scheduler, allocator configuration, and Spark nested projection changes. The test-helper conflict is resolved using the shared counting source, retaining the sparse/dynamic regression tests. Layout boundaries stay on one worker so dictionary expressions are not duplicated across workers. Each worker reserves actual queued work under DuckDB's global lock and executes it outside the lock. This replaces the earlier estimated file/worker budgets and shared root-planner lock. Root chunked results retain their individual dictionary encodings before export.

Sparse random-access retrieval bypasses broad layout parts. The optional 8K startup path and diagnostics remain available; startup defaults to zero. Wide full-row projections retain byte-based chunk sizing. File scans also preserve query column order when files store columns in a different order.

Native local performance

Measurements and completed benchmark comparisons below are pinned to 1f41995f5e against 19dcd2f2. The final rebase to 7dcaf5612c changes Java/JNI code and Rust test helpers; the measured DuckDB and production shared scan paths are unchanged.

release_debug with RUSTFLAGS='-C target-cpu=native -C force-frame-pointers=yes'. Xeon 6975P-C, 16 physical / 32 logical cores. ClickBench has 99,997,497 rows across 100 files. Modes run sequentially on pinned cores, without connection reuse; foreign benchmark/compiler overlap is excluded.

The focused comparison uses 48 warm samples per mode in reversed orders, excluding the first three iterations of each 27-iteration run:

Query, 32 threads V1 median ms V2 median ms V2 vs V1
Q1 9.360 10.361 +10.7%
Q2 12.847 12.732 -0.9%
Q5 115.965 117.238 +1.1%
Q7 11.656 13.032 +11.8%
Q23 49.175 37.756 -23.2%

Q23 p95 is 50.94 ms V1 / 39.02 ms V2; CV is 2.01% / 2.14%. First-query medians are 80.86 / 62.80 ms with the filesystem cache left intact. The earlier high-variance Q5/Q23 samples are superseded by these longer repeats.

Matching CI's files-per-worker ratio locally gives Q5 37.41 ms V1 / 38.35 ms V2 with 34 files / 32 workers (16 warm samples, CV 2.50% / 2.89%). The 17-file / 16-physical-core control is also nearly flat: 28.90 / 29.17 ms.

Full native screens use four warm samples per query:

Suite Queries V2 vs V1 geomean
ClickBench, 32 threads 43 -4.2%
TPC-DS SF1, 8 threads 99 +3.5%
FineWeb, 32 threads 9 -6.9%

Q1/Q7 remain slower. TPC-DS Q62 is 11.09 vs 9.18 ms in the short screen; Q43 is 14.26 vs 12.47 ms. The earlier large Q39 gaps do not appear in this screen: ClickBench 26.60 vs 27.07 ms; TPC-DS 24.66 vs 24.74 ms. This is not a universal-speedup claim. CI uses 94 physical ARM cores, so absolute local times are not directly comparable.

Q23 diagnostics

Separate debug-enabled native runs: first DuckDB batch about 2.02 ms; first observed TopK bound 2.94 ms. Around 221 dynamic pruning rechecks and 44 row-filter rechecks occur as the bound tightens. Payload retrieval plans seven chunks covering about twelve row coordinates and returns exactly ten selected rows from seven files.

Discovery takes about 20 ms and payload retrieval/export about 19 ms in those instrumented runs. Predicate, pruning, compute, and I/O-wait counters sum work across workers and must not be added as query wall time. Counts vary with scheduling. Logs confirm both learned orders: most chunks use EventTime first, while 7–21 chunks per warm query use URL first as their preferred order, plus 7–15 exploration chunks.

Validation and CI

  • 1,924 DuckDB/layout/DataFusion library tests passed after the final rebase; two skipped.
  • 35 focused scan tests passed, including reserved work and startup/bulk exact-once coverage.
  • 55 DuckDB SQL tests passed; large TPC-H/TPC-DS SQL fixtures excluded locally.
  • Five full 105-column Q23 EXCEPT ALL comparisons and the exact Q5 count match V1 on the native build.
  • Workspace all-target/all-feature Clippy with warnings denied, pinned nightly formatting, changed-file C++ formatting, and whitespace checks passed after the final rebase.

The fresh main CI run and all seven jobs in the SQL benchmark run pass on 1f41995f5e.

CI compares the PR against develop 19dcd2f2, rather than the local V1-mode baseline:

  • ClickBench: DuckDB raw hot geomean 0.963x; attributed -3.6%, low confidence. Q23 is 32.39 vs 41.04 ms (-21.1%); Q5 is 64.24 vs 67.21 ms (-4.4%). Q1 is +3.2%; Q7 is -2.2%.
  • TPC-DS SF1: DuckDB raw hot 0.995x; attributed -0.6%, low confidence, roughly flat.
  • TPC-H SF1: attributed -0.1%, roughly flat. SF10: +0.5%, roughly flat.
  • FineWeb: attributed +1.3%, low confidence. The orchestrator selects V1 for this suite; the local native comparison above supplies V2 coverage.

The original Codspeed run lost its self-hosted runner during shard 7, confirmed by the check annotation. Its logs are unavailable, and retries later failed before creating jobs. No code failure was identified.

Final head 7dcaf5612c is pushed and mergeable against 7baa376169. Fresh main CI and Codspeed runs have started, along with SQL benchmarks. These current-head checks are still in progress or queued at the last check. The PR remains a draft.

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from e503266 to f0752c6 Compare October 29, 2026 14:44
@codspeed

codspeed Bot commented Oct 29, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 5.77%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 3 benchmarks with a significant change ran in a different software environment

Their base and head results were measured with a different OS or toolchain, such as compiler, runtime or library versions, so the changes might come from this difference rather than from the code. Open an affected benchmark to see what changed.

See affected benchmarks

⚡ 4 improved benchmarks
❌ 6 regressed benchmarks
✅ 2308 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation filter_powerlaw_by_random[10000] 993.7 ns 1,300.8 ns -23.61%
❌ CPU Simulation bench_compare_varbin[(50000, 2)] 132.2 µs 162.1 µs -18.45%
❌ CPU Simulation bench_compare_varbin[(50000, 64)] 134.2 µs 164 µs -18.2%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(7500, 10000)] 199.3 µs 227.7 µs -12.47%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(1000, 10000)] 77.8 µs 88.8 µs -12.4%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(10000, 10000)] 205.6 µs 234 µs -12.15%
⚡ CPU Simulation take_filter_primitive_small_uncached_random_mask_random_indices[4096, 10] 23.9 µs 20.7 µs +15.63%
⚡ CPU Simulation test_repeated_scan_filter[int] 2.4 ms 2.1 ms +12.96%
⚡ CPU Simulation test_scan_filter_to_arrow_array[int] 2.8 ms 2.5 ms +11.25%
⚡ CPU Simulation test_scan_filter[int] 2.9 ms 2.6 ms +10.69%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/codex/scan-v2-topk-feedback (7dcaf56) with develop (7baa376)

Open in CodSpeed

@joseph-isaacs
joseph-isaacs force-pushed the ji/codex/scan-v2-topk-feedback branch from 47bbb02 to e1d38d8 Compare October 29, 2026 15:11
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Oct 29, 2026 — with ChatGPT Codex Connector
Base automatically changed from ji/scan-v2-clickbench-tpcds to develop October 29, 2026 15:21
@joseph-isaacs
joseph-isaacs force-pushed the ji/codex/scan-v2-topk-feedback branch from e1d38d8 to d3f067e Compare October 29, 2026 15:32
@joseph-isaacs joseph-isaacs removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7dcaf56 clickbench-nvme 1 Explore Profiling Data
🟢 Done 7dcaf56 polarsignals 1 Explore Profiling Data
🟢 Done 7dcaf56 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 7dcaf56 fineweb 1 Explore Profiling Data
🟢 Done 7dcaf56 tpch-s3 1 Explore Profiling Data
🟢 Done 7dcaf56 tpch-nvme 1 Explore Profiling Data
🟢 Done 7dcaf56 tpcds-nvme 1 Explore Profiling Data
Previous Runs (56)
Status Commit Job Attempt Link
🟢 Done 1f41995 clickbench-nvme 1 Explore Profiling Data
🟢 Done 1f41995 polarsignals 1 Explore Profiling Data
🟢 Done 1f41995 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 1f41995 tpcds-nvme 1 Explore Profiling Data
🟢 Done 1f41995 fineweb 1 Explore Profiling Data
🟢 Done 1f41995 tpch-s3 1 Explore Profiling Data
🟢 Done 1f41995 tpch-nvme 1 Explore Profiling Data
🟢 Done 026e354 clickbench-nvme 1 Explore Profiling Data
🟢 Done 026e354 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 026e354 polarsignals 1 Explore Profiling Data
🟢 Done 026e354 tpcds-nvme 1 Explore Profiling Data
🟢 Done 026e354 fineweb 1 Explore Profiling Data
🟢 Done 026e354 tpch-s3 1 Explore Profiling Data
🟢 Done 026e354 tpch-nvme 1 Explore Profiling Data
🟢 Done 3b3f8d8 clickbench-nvme 1 Explore Profiling Data
🟢 Done 3b3f8d8 tpch-s3 1 Explore Profiling Data
🟢 Done 3b3f8d8 polarsignals 1 Explore Profiling Data
🟢 Done 3b3f8d8 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 3b3f8d8 fineweb 1 Explore Profiling Data
🟢 Done 3b3f8d8 tpch-nvme 1 Explore Profiling Data
🟢 Done 3b3f8d8 tpcds-nvme 1 Explore Profiling Data
🟢 Done 92b8101 clickbench-nvme 1 Explore Profiling Data
🟢 Done 92b8101 polarsignals 1 Explore Profiling Data
🟢 Done 92b8101 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 92b8101 tpch-s3 1 Explore Profiling Data
🟢 Done 92b8101 tpch-nvme 1 Explore Profiling Data
🟢 Done 92b8101 tpcds-nvme 1 Explore Profiling Data
🟢 Done 92b8101 fineweb 1 Explore Profiling Data
🟢 Done dc98c59 clickbench-nvme 1 Explore Profiling Data
🟢 Done dc98c59 tpch-nvme-10 1 Explore Profiling Data
🟢 Done dc98c59 polarsignals 1 Explore Profiling Data
🟢 Done dc98c59 tpch-s3 1 Explore Profiling Data
🟢 Done dc98c59 fineweb 1 Explore Profiling Data
🟢 Done dc98c59 tpch-nvme 1 Explore Profiling Data
🟢 Done dc98c59 tpcds-nvme 1 Explore Profiling Data
🟢 Done 83d5434 clickbench-nvme 1 Explore Profiling Data
🟢 Done 83d5434 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 83d5434 polarsignals 1 Explore Profiling Data
🟢 Done 83d5434 fineweb 1 Explore Profiling Data
🟢 Done 83d5434 tpcds-nvme 1 Explore Profiling Data
🟢 Done 83d5434 tpch-nvme 1 Explore Profiling Data
🟢 Done 83d5434 tpch-s3 1 Explore Profiling Data
🟢 Done 5799b04 clickbench-nvme 2 Explore Profiling Data
🟢 Done 5799b04 tpch-nvme-10 2 Explore Profiling Data
🟢 Done 5799b04 polarsignals 2 Explore Profiling Data
🟢 Done 5799b04 fineweb 2 Explore Profiling Data
🟢 Done 5799b04 tpch-s3 2 Explore Profiling Data
🟢 Done 5799b04 tpch-nvme 2 Explore Profiling Data
🟢 Done 5799b04 tpcds-nvme 2 Explore Profiling Data
🟢 Done d3f067e polarsignals 2 Explore Profiling Data
🟢 Done d3f067e tpch-nvme-10 2 Explore Profiling Data
🟢 Done d3f067e fineweb 2 Explore Profiling Data
🟢 Done d3f067e tpch-nvme 2 Explore Profiling Data
🟢 Done d3f067e tpcds-nvme 1 Explore Profiling Data
🟢 Done d3f067e clickbench-nvme 1 Explore Profiling Data
🟢 Done d3f067e tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 7dcaf561 vs base 19dcd2f2
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.4%
Engines: DataFusion No clear signal (-6.3%, environment too noisy confidence) · DuckDB No clear signal (+1.7%, environment too noisy confidence)
Vortex (geomean): hot 1.006x ➖ · cold 1.022x ➖
Parquet (geomean): hot 1.030x ➖ · cold 1.016x ➖
Shifts: Parquet (control) +3.0% · Median polish +4.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.978x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 264652383 / 225101151 / +17.6% 863206317 / 819874295 / +5.3% 0.31 / 0.27 / +11.7%
tpch_q02/datafusion:vortex-file-compressed 322331052 / 318534689 / +1.2% 681285260 / 723751029 / -5.9% 0.47 / 0.44 / +7.5%
tpch_q03/datafusion:vortex-file-compressed 667662634 / 377368788 / +76.9% 🔴 1573113590 / 999232984 / +57.4% 🔴 0.42 / 0.38 / +12.4%
tpch_q04/datafusion:vortex-file-compressed 374456814 / 198635278 / +88.5% 🔴 573989540 / 477424781 / +20.2% 0.65 / 0.42 / +56.8%
tpch_q05/datafusion:vortex-file-compressed 384111289 / 393827139 / -2.5% 596366385 / 629883322 / -5.3% 0.64 / 0.63 / +3.0%
tpch_q06/datafusion:vortex-file-compressed 136140047 / 143980039 / -5.4% 316464471 / 326680898 / -3.1% 0.43 / 0.44 / -2.4%
tpch_q07/datafusion:vortex-file-compressed 410069865 / 459619010 / -10.8% 714533350 / 603682077 / +18.4% 0.57 / 0.76 / -24.6%
tpch_q08/datafusion:vortex-file-compressed 593505250 / 480151339 / +23.6% 741113670 / 646130135 / +14.7% 0.80 / 0.74 / +7.8%
tpch_q09/datafusion:vortex-file-compressed 269225697 / 280196019 / -3.9% 502568247 / 569775944 / -11.8% 0.54 / 0.49 / +8.9%
tpch_q10/datafusion:vortex-file-compressed 355473046 / 335800983 / +5.9% 497608902 / 563854563 / -11.7% 0.71 / 0.60 / +20.0%
tpch_q11/datafusion:vortex-file-compressed 280004135 / 253028894 / +10.7% 470515406 / 411167746 / +14.4% 0.60 / 0.62 / -3.3%
tpch_q12/datafusion:vortex-file-compressed 223970454 / 247200676 / -9.4% 422152508 / 424206320 / -0.5% 0.53 / 0.58 / -9.0%
tpch_q13/datafusion:vortex-file-compressed 145515271 / 135457122 / +7.4% 411120094 / 327371805 / +25.6% 0.35 / 0.41 / -14.5%
tpch_q14/datafusion:vortex-file-compressed 189802118 / 168918289 / +12.4% 405241049 / 339885825 / +19.2% 0.47 / 0.50 / -5.8%
tpch_q15/datafusion:vortex-file-compressed 292893379 / 313396373 / -6.5% 559499195 / 671975736 / -16.7% 0.52 / 0.47 / +12.2%
tpch_q16/datafusion:vortex-file-compressed 145020425 / 154269699 / -6.0% 291090946 / 342273739 / -15.0% 0.50 / 0.45 / +10.5%
tpch_q17/datafusion:vortex-file-compressed 243246998 / 235285287 / +3.4% 475925629 / 448085308 / +6.2% 0.51 / 0.53 / -2.7%
tpch_q18/datafusion:vortex-file-compressed 252728340 / 577341508 / -56.2% 🟢 757060867 / 832055263 / -9.0% 0.33 / 0.69 / -51.9%
tpch_q19/datafusion:vortex-file-compressed 267110530 / 276418853 / -3.4% 385070101 / 444435959 / -13.4% 0.69 / 0.62 / +11.5%
tpch_q20/datafusion:vortex-file-compressed 282640510 / 306719206 / -7.9% 513717817 / 675470284 / -23.9% 0.55 / 0.45 / +21.2%
tpch_q21/datafusion:vortex-file-compressed 515632045 / 599463599 / -14.0% 1038948443 / 958500706 / +8.4% 0.50 / 0.63 / -20.6%
tpch_q22/datafusion:vortex-file-compressed 167322133 / 415277462 / -59.7% 🟢 413735290 / 1050283869 / -60.6% 🟢 0.40 / 0.40 / +2.3%
datafusion / parquet / ns (1.043x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 154927057 / 241682856 / -35.9% 🟢 531627968 / 487531007 / +9.0% 0.29 / 0.50 / -41.2%
tpch_q02/datafusion:parquet 307808632 / 269956217 / +14.0% 714605500 / 609423406 / +17.3% 0.43 / 0.44 / -2.8%
tpch_q03/datafusion:parquet 260704684 / 251068913 / +3.8% 769659240 / 663935581 / +15.9% 0.34 / 0.38 / -10.4%
tpch_q04/datafusion:parquet 150257328 / 144199922 / +4.2% 472624147 / 450930959 / +4.8% 0.32 / 0.32 / -0.6%
tpch_q05/datafusion:parquet 362114193 / 355148108 / +2.0% 506896333 / 521470490 / -2.8% 0.71 / 0.68 / +4.9%
tpch_q06/datafusion:parquet 149596414 / 123561347 / +21.1% 307525892 / 220313766 / +39.6% 🔴 0.49 / 0.56 / -13.3%
tpch_q07/datafusion:parquet 337315098 / 374411551 / -9.9% 475291419 / 517618666 / -8.2% 0.71 / 0.72 / -1.9%
tpch_q08/datafusion:parquet 472010202 / 425276503 / +11.0% 522354289 / 533330822 / -2.1% 0.90 / 0.80 / +13.3%
tpch_q09/datafusion:parquet 427187524 / 396498657 / +7.7% 559871608 / 623882092 / -10.3% 0.76 / 0.64 / +20.1%
tpch_q10/datafusion:parquet 394202983 / 311949145 / +26.4% 491903256 / 452955570 / +8.6% 0.80 / 0.69 / +16.4%
tpch_q11/datafusion:parquet 262948312 / 247927590 / +6.1% 370828170 / 351353202 / +5.5% 0.71 / 0.71 / +0.5%
tpch_q12/datafusion:parquet 181565773 / 165576091 / +9.7% 356201209 / 290563979 / +22.6% 0.51 / 0.57 / -10.5%
tpch_q13/datafusion:parquet 282102615 / 278650002 / +1.2% 476948698 / 475941381 / +0.2% 0.59 / 0.59 / +1.0%
tpch_q14/datafusion:parquet 168862792 / 215575299 / -21.7% 394486533 / 465756460 / -15.3% 0.43 / 0.46 / -7.5%
tpch_q15/datafusion:parquet 391449363 / 314097726 / +24.6% 604946257 / 437056563 / +38.4% 🔴 0.65 / 0.72 / -10.0%
tpch_q16/datafusion:parquet 106079568 / 102227252 / +3.8% 256312241 / 196549578 / +30.4% 🔴 0.41 / 0.52 / -20.4%
tpch_q17/datafusion:parquet 277909073 / 295249476 / -5.9% 435280270 / 424664867 / +2.5% 0.64 / 0.70 / -8.2%
tpch_q18/datafusion:parquet 329358377 / 315661264 / +4.3% 471418986 / 534625462 / -11.8% 0.70 / 0.59 / +18.3%
tpch_q19/datafusion:parquet 256287207 / 160275591 / +59.9% 🔴 330941595 / 288539952 / +14.7% 0.77 / 0.56 / +39.4%
tpch_q20/datafusion:parquet 247869120 / 259105255 / -4.3% 429620681 / 375574076 / +14.4% 0.58 / 0.69 / -16.4%
tpch_q21/datafusion:parquet 315813880 / 328233636 / -3.8% 473950877 / 595891416 / -20.5% 0.67 / 0.55 / +21.0%
tpch_q22/datafusion:parquet 167401893 / 151945497 / +10.2% 340981852 / 336477683 / +1.3% 0.49 / 0.45 / +8.7%
duckdb / vortex-file-compressed / ns (1.035x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 306592294 / 242713738 / +26.3% 367162153 / 290906301 / +26.2% 0.84 / 0.83 / +0.1%
tpch_q02/duckdb:vortex-file-compressed 423466202 / 395133430 / +7.2% 543108823 / 503306863 / +7.9% 0.78 / 0.79 / -0.7%
tpch_q03/duckdb:vortex-file-compressed 447082056 / 403958513 / +10.7% 499259326 / 506631264 / -1.5% 0.90 / 0.80 / +12.3%
tpch_q04/duckdb:vortex-file-compressed 319301180 / 275371920 / +16.0% 335047945 / 264656780 / +26.6% 0.95 / 1.04 / -8.4%
tpch_q05/duckdb:vortex-file-compressed 728618107 / 554927492 / +31.3% 🔴 653802498 / 635027040 / +3.0% 1.11 / 0.87 / +27.5%
tpch_q06/duckdb:vortex-file-compressed 172269480 / 264305141 / -34.8% 🟢 209778824 / 217836159 / -3.7% 0.82 / 1.21 / -32.3%
tpch_q07/duckdb:vortex-file-compressed 439635175 / 470551583 / -6.6% 480285553 / 591002499 / -18.7% 0.92 / 0.80 / +15.0%
tpch_q08/duckdb:vortex-file-compressed 737878789 / 677708070 / +8.9% 721742284 / 790424730 / -8.7% 1.02 / 0.86 / +19.2%
tpch_q09/duckdb:vortex-file-compressed 444903647 / 414257896 / +7.4% 527122320 / 421773998 / +25.0% 0.84 / 0.98 / -14.1%
tpch_q10/duckdb:vortex-file-compressed 585539584 / 565809056 / +3.5% 574967855 / 532322473 / +8.0% 1.02 / 1.06 / -4.2%
tpch_q11/duckdb:vortex-file-compressed 516987402 / 331444316 / +56.0% 🔴 509945525 / 326000481 / +56.4% 🔴 1.01 / 1.02 / -0.3%
tpch_q12/duckdb:vortex-file-compressed 264013277 / 300240325 / -12.1% 307889127 / 293824998 / +4.8% 0.86 / 1.02 / -16.1%
tpch_q13/duckdb:vortex-file-compressed 207268176 / 234634397 / -11.7% 223653400 / 285599348 / -21.7% 0.93 / 0.82 / +12.8%
tpch_q14/duckdb:vortex-file-compressed 240326788 / 226387254 / +6.2% 313430969 / 250340989 / +25.2% 0.77 / 0.90 / -15.2%
tpch_q15/duckdb:vortex-file-compressed 272944026 / 244667904 / +11.6% 346160566 / 274125844 / +26.3% 0.79 / 0.89 / -11.7%
tpch_q16/duckdb:vortex-file-compressed 222363089 / 207480636 / +7.2% 273332429 / 212283893 / +28.8% 0.81 / 0.98 / -16.8%
tpch_q17/duckdb:vortex-file-compressed 298543369 / 304429247 / -1.9% 356996551 / 400945885 / -11.0% 0.84 / 0.76 / +10.1%
tpch_q18/duckdb:vortex-file-compressed 354608683 / 442479898 / -19.9% 436669257 / 396598793 / +10.1% 0.81 / 1.12 / -27.2%
tpch_q19/duckdb:vortex-file-compressed 294167048 / 347257411 / -15.3% 319748207 / 333079622 / -4.0% 0.92 / 1.04 / -11.8%
tpch_q20/duckdb:vortex-file-compressed 378172505 / 356522154 / +6.1% 482563279 / 525593522 / -8.2% 0.78 / 0.68 / +15.5%
tpch_q21/duckdb:vortex-file-compressed 897294166 / 669563383 / +34.0% 🔴 896691019 / 768477162 / +16.7% 1.00 / 0.87 / +14.9%
tpch_q22/duckdb:vortex-file-compressed 249576440 / 288118977 / -13.4% 319857360 / 321455013 / -0.5% 0.78 / 0.90 / -12.9%
duckdb / parquet / ns (1.017x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 163900750 / 157928349 / +3.8% 234705730 / 272690714 / -13.9% 0.70 / 0.58 / +20.6%
tpch_q02/duckdb:parquet 434792829 / 466918592 / -6.9% 567321911 / 471472543 / +20.3% 0.77 / 0.99 / -22.6%
tpch_q03/duckdb:parquet 409859026 / 467561365 / -12.3% 526587098 / 447868293 / +17.6% 0.78 / 1.04 / -25.4%
tpch_q04/duckdb:parquet 252638821 / 241132863 / +4.8% 312590153 / 346699496 / -9.8% 0.81 / 0.70 / +16.2%
tpch_q05/duckdb:parquet 634021622 / 601681209 / +5.4% 735582806 / 642800358 / +14.4% 0.86 / 0.94 / -7.9%
tpch_q06/duckdb:parquet 179068183 / 157205162 / +13.9% 237389365 / 194250011 / +22.2% 0.75 / 0.81 / -6.8%
tpch_q07/duckdb:parquet 446452010 / 483254002 / -7.6% 642171192 / 1107993230 / -42.0% 🟢 0.70 / 0.44 / +59.4%
tpch_q08/duckdb:parquet 647193562 / 654285856 / -1.1% 647003509 / 669007016 / -3.3% 1.00 / 0.98 / +2.3%
tpch_q09/duckdb:parquet 806435544 / 644494164 / +25.1% 661971231 / 718771676 / -7.9% 1.22 / 0.90 / +35.9%
tpch_q10/duckdb:parquet 711675614 / 530902132 / +34.1% 🔴 689368932 / 637249426 / +8.2% 1.03 / 0.83 / +23.9%
tpch_q11/duckdb:parquet 294079461 / 303673870 / -3.2% 303895218 / 325318246 / -6.6% 0.97 / 0.93 / +3.7%
tpch_q12/duckdb:parquet 288532136 / 215585071 / +33.8% 🔴 316572357 / 266896912 / +18.6% 0.91 / 0.81 / +12.8%
tpch_q13/duckdb:parquet 353593186 / 358775974 / -1.4% 504479431 / 449605311 / +12.2% 0.70 / 0.80 / -12.2%
tpch_q14/duckdb:parquet 259501282 / 328300491 / -21.0% 403446715 / 540192412 / -25.3% 0.64 / 0.61 / +5.8%
tpch_q15/duckdb:parquet 216697493 / 193853728 / +11.8% 244829188 / 275208554 / -11.0% 0.89 / 0.70 / +25.7%
tpch_q16/duckdb:parquet 287322945 / 265133880 / +8.4% 336959963 / 323161613 / +4.3% 0.85 / 0.82 / +3.9%
tpch_q17/duckdb:parquet 294626121 / 350853382 / -16.0% 345900065 / 381556280 / -9.3% 0.85 / 0.92 / -7.4%
tpch_q18/duckdb:parquet 387918256 / 345691529 / +12.2% 416782473 / 368650896 / +13.1% 0.93 / 0.94 / -0.7%
tpch_q19/duckdb:parquet 263387003 / 299979187 / -12.2% 310611930 / 345698365 / -10.1% 0.85 / 0.87 / -2.3%
tpch_q20/duckdb:parquet 497779582 / 506822076 / -1.8% 510486103 / 594115221 / -14.1% 0.98 / 0.85 / +14.3%
tpch_q21/duckdb:parquet 500364000 / 478529087 / +4.6% 604902740 / 523115452 / +15.6% 0.83 / 0.91 / -9.6%
tpch_q22/duckdb:parquet 302254543 / 351512104 / -14.0% 360964688 / 431678340 / -16.4% 0.84 / 0.81 / +2.8%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 7dcaf561 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.4%
Engines: DataFusion No clear signal (-1.5%, low confidence) · DuckDB No clear signal (-5.2%, low confidence)
Vortex (geomean): hot 0.974x ➖ · cold 0.938x ➖
Parquet (geomean): hot 1.008x ➖ · cold 0.985x ➖
Shifts: Parquet (control) +0.8% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.983x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1243053 / 1222020 / +1.7% 20744969 / 25360366 / -18.2% 🟢 0.06 / 0.05 / +24.4%
clickbench_q01/datafusion:vortex-file-compressed 6153596 / 6291710 / -2.2% 29881462 / 31998400 / -6.6% 0.21 / 0.20 / +4.7%
clickbench_q02/datafusion:vortex-file-compressed 11017466 / 10743920 / +2.5% 35046021 / 48726078 / -28.1% 🟢 0.31 / 0.22 / +42.6%
clickbench_q03/datafusion:vortex-file-compressed 12812852 / 13578266 / -5.6% 50052845 / 60406156 / -17.1% 🟢 0.26 / 0.22 / +13.9%
clickbench_q04/datafusion:vortex-file-compressed 56101027 / 58875622 / -4.7% 95652541 / 104057010 / -8.1% 0.59 / 0.57 / +3.7%
clickbench_q05/datafusion:vortex-file-compressed 74807776 / 78364650 / -4.5% 115590376 / 125165765 / -7.7% 0.65 / 0.63 / +3.4%
clickbench_q06/datafusion:vortex-file-compressed 1228835 / 1245802 / -1.4% 21245700 / 24916123 / -14.7% 🟢 0.06 / 0.05 / +15.7%
clickbench_q07/datafusion:vortex-file-compressed 9913885 / 9440024 / +5.0% 33415911 / 36665765 / -8.9% 0.30 / 0.26 / +15.2%
clickbench_q08/datafusion:vortex-file-compressed 79236416 / 79572816 / -0.4% 113368879 / 128596494 / -11.8% 🟢 0.70 / 0.62 / +13.0%
clickbench_q09/datafusion:vortex-file-compressed 169354561 / 176945813 / -4.3% 198280237 / 220521609 / -10.1% 🟢 0.85 / 0.80 / +6.4%
clickbench_q10/datafusion:vortex-file-compressed 23128900 / 23324689 / -0.8% 67421391 / 75508962 / -10.7% 🟢 0.34 / 0.31 / +11.1%
clickbench_q11/datafusion:vortex-file-compressed 25044150 / 26075788 / -4.0% 69247160 / 77361491 / -10.5% 🟢 0.36 / 0.34 / +7.3%
clickbench_q12/datafusion:vortex-file-compressed 72118173 / 72198817 / -0.1% 127383835 / 127734875 / -0.3% 0.57 / 0.57 / +0.2%
clickbench_q13/datafusion:vortex-file-compressed 116976202 / 117074480 / -0.1% 179088021 / 185295836 / -3.4% 0.65 / 0.63 / +3.4%
clickbench_q14/datafusion:vortex-file-compressed 75225450 / 76569906 / -1.8% 122154539 / 133017726 / -8.2% 0.62 / 0.58 / +7.0%
clickbench_q15/datafusion:vortex-file-compressed 62574650 / 63096343 / -0.8% 97666328 / 103450927 / -5.6% 0.64 / 0.61 / +5.0%
clickbench_q16/datafusion:vortex-file-compressed 152991996 / 153318888 / -0.2% 204439909 / 222694391 / -8.2% 0.75 / 0.69 / +8.7%
clickbench_q17/datafusion:vortex-file-compressed 148778790 / 153766540 / -3.2% 212039482 / 233396981 / -9.2% 0.70 / 0.66 / +6.5%
clickbench_q18/datafusion:vortex-file-compressed 299641308 / 295032098 / +1.6% 376721537 / 398720609 / -5.5% 0.80 / 0.74 / +7.5%
clickbench_q19/datafusion:vortex-file-compressed 8397476 / 8264734 / +1.6% 44963921 / 52445244 / -14.3% 🟢 0.19 / 0.16 / +18.5%
clickbench_q20/datafusion:vortex-file-compressed 68402692 / 69601585 / -1.7% 246205398 / 255050274 / -3.5% 0.28 / 0.27 / +1.8%
clickbench_q21/datafusion:vortex-file-compressed 58624269 / 79545494 / -26.3% 🟢 276367192 / 303920860 / -9.1% 0.21 / 0.26 / -19.0%
clickbench_q22/datafusion:vortex-file-compressed 76880112 / 92281360 / -16.7% 🟢 390624477 / 409072596 / -4.5% 0.20 / 0.23 / -12.8%
clickbench_q23/datafusion:vortex-file-compressed 191627984 / 186630780 / +2.7% 569700919 / 582812959 / -2.2% 0.34 / 0.32 / +5.0%
clickbench_q24/datafusion:vortex-file-compressed 15196024 / 15971598 / -4.9% 68274399 / 75248446 / -9.3% 0.22 / 0.21 / +4.9%
clickbench_q25/datafusion:vortex-file-compressed 19555492 / 19327944 / +1.2% 60732396 / 65544239 / -7.3% 0.32 / 0.29 / +9.2%
clickbench_q26/datafusion:vortex-file-compressed 16205378 / 16570822 / -2.2% 67062382 / 69223643 / -3.1% 0.24 / 0.24 / +0.9%
clickbench_q27/datafusion:vortex-file-compressed 101976356 / 104236139 / -2.2% 256058021 / 267629648 / -4.3% 0.40 / 0.39 / +2.3%
clickbench_q28/datafusion:vortex-file-compressed 565268256 / 554970976 / +1.9% 647573784 / 640981632 / +1.0% 0.87 / 0.87 / +0.8%
clickbench_q29/datafusion:vortex-file-compressed 26517162 / 24996223 / +6.1% 52886028 / 58416640 / -9.5% 0.50 / 0.43 / +17.2%
clickbench_q30/datafusion:vortex-file-compressed 56970658 / 58566897 / -2.7% 109849193 / 115415423 / -4.8% 0.52 / 0.51 / +2.2%
clickbench_q31/datafusion:vortex-file-compressed 64002352 / 66520857 / -3.8% 153424261 / 163467318 / -6.1% 0.42 / 0.41 / +2.5%
clickbench_q32/datafusion:vortex-file-compressed 285306034 / 288811144 / -1.2% 392843762 / 398601613 / -1.4% 0.73 / 0.72 / +0.2%
clickbench_q33/datafusion:vortex-file-compressed 328915442 / 323220982 / +1.8% 467417056 / 442745470 / +5.6% 0.70 / 0.73 / -3.6%
clickbench_q34/datafusion:vortex-file-compressed 327993472 / 323787036 / +1.3% 475197550 / 439727390 / +8.1% 0.69 / 0.74 / -6.3%
clickbench_q35/datafusion:vortex-file-compressed 56124429 / 56474642 / -0.6% 84912533 / 95239632 / -10.8% 🟢 0.66 / 0.59 / +11.5%
clickbench_q36/datafusion:vortex-file-compressed 37943108 / 37786497 / +0.4% 65254617 / 70220251 / -7.1% 0.58 / 0.54 / +8.1%
clickbench_q37/datafusion:vortex-file-compressed 21198976 / 21112899 / +0.4% 45687619 / 52236069 / -12.5% 🟢 0.46 / 0.40 / +14.8%
clickbench_q38/datafusion:vortex-file-compressed 13112732 / 13238210 / -0.9% 40353268 / 45728369 / -11.8% 🟢 0.32 / 0.29 / +12.2%
clickbench_q39/datafusion:vortex-file-compressed 78589810 / 79489746 / -1.1% 110971074 / 117000884 / -5.2% 0.71 / 0.68 / +4.2%
clickbench_q40/datafusion:vortex-file-compressed 10642196 / 10678944 / -0.3% 34014053 / 38994551 / -12.8% 🟢 0.31 / 0.27 / +14.2%
clickbench_q41/datafusion:vortex-file-compressed 10594059 / 10146938 / +4.4% 34006242 / 37697537 / -9.8% 0.31 / 0.27 / +15.7%
clickbench_q42/datafusion:vortex-file-compressed 10693698 / 10580150 / +1.1% 34481942 / 40151466 / -14.1% 🟢 0.31 / 0.26 / +17.7%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1267224 / 1252390 / +1.2% 47575089 / 49858886 / -4.6% 0.03 / 0.03 / +6.0%
clickbench_q01/datafusion:parquet 15976067 / 15787223 / +1.2% 65086582 / 67905785 / -4.2% 0.25 / 0.23 / +5.6%
clickbench_q02/datafusion:parquet 19039366 / 19202549 / -0.8% 80517263 / 80765269 / -0.3% 0.24 / 0.24 / -0.5%
clickbench_q03/datafusion:parquet 16585214 / 16825988 / -1.4% 78111941 / 79107161 / -1.3% 0.21 / 0.21 / -0.2%
clickbench_q04/datafusion:parquet 62807268 / 64070752 / -2.0% 123138113 / 123746561 / -0.5% 0.51 / 0.52 / -1.5%
clickbench_q05/datafusion:parquet 88346430 / 89193812 / -1.0% 150464934 / 155866707 / -3.5% 0.59 / 0.57 / +2.6%
clickbench_q06/datafusion:parquet 1220154 / 1271545 / -4.0% 48688782 / 50022393 / -2.7% 0.03 / 0.03 / -1.4%
clickbench_q07/datafusion:parquet 17028740 / 16725616 / +1.8% 67558280 / 67183619 / +0.6% 0.25 / 0.25 / +1.2%
clickbench_q08/datafusion:parquet 85423491 / 86360220 / -1.1% 151286309 / 161677570 / -6.4% 0.56 / 0.53 / +5.7%
clickbench_q09/datafusion:parquet 188379665 / 189811070 / -0.8% 261212228 / 272037328 / -4.0% 0.72 / 0.70 / +3.4%
clickbench_q10/datafusion:parquet 35739950 / 35867330 / -0.4% 94941237 / 99994609 / -5.1% 0.38 / 0.36 / +4.9%
clickbench_q11/datafusion:parquet 42868736 / 41799902 / +2.6% 106543300 / 107840232 / -1.2% 0.40 / 0.39 / +3.8%
clickbench_q12/datafusion:parquet 94991762 / 95834502 / -0.9% 158728902 / 164548538 / -3.5% 0.60 / 0.58 / +2.8%
clickbench_q13/datafusion:parquet 146495700 / 145974546 / +0.4% 219989869 / 229047253 / -4.0% 0.67 / 0.64 / +4.5%
clickbench_q14/datafusion:parquet 101182290 / 102005408 / -0.8% 167281525 / 171671822 / -2.6% 0.60 / 0.59 / +1.8%
clickbench_q15/datafusion:parquet 72372120 / 71461450 / +1.3% 128418806 / 130790451 / -1.8% 0.56 / 0.55 / +3.1%
clickbench_q16/datafusion:parquet 156204267 / 156397034 / -0.1% 231038654 / 233902360 / -1.2% 0.68 / 0.67 / +1.1%
clickbench_q17/datafusion:parquet 155959091 / 157819059 / -1.2% 229269143 / 236051334 / -2.9% 0.68 / 0.67 / +1.7%
clickbench_q18/datafusion:parquet 307619003 / 307951774 / -0.1% 414084414 / 413174846 / +0.2% 0.74 / 0.75 / -0.3%
clickbench_q19/datafusion:parquet 19665005 / 19050488 / +3.2% 76968148 / 77455643 / -0.6% 0.26 / 0.25 / +3.9%
clickbench_q20/datafusion:parquet 177376436 / 179151449 / -1.0% 272973546 / 286433806 / -4.7% 0.65 / 0.63 / +3.9%
clickbench_q21/datafusion:parquet 172366556 / 172313051 / +0.0% 288299625 / 303072635 / -4.9% 0.60 / 0.57 / +5.2%
clickbench_q22/datafusion:parquet 259291333 / 263455818 / -1.6% 411166505 / 429668613 / -4.3% 0.63 / 0.61 / +2.8%
clickbench_q23/datafusion:parquet 1013161082 / 1015026952 / -0.2% 1178590994 / 1186808838 / -0.7% 0.86 / 0.86 / +0.5%
clickbench_q24/datafusion:parquet 30028812 / 30571946 / -1.8% 85268646 / 89809691 / -5.1% 0.35 / 0.34 / +3.5%
clickbench_q25/datafusion:parquet 37498881 / 37111422 / +1.0% 99925659 / 102893012 / -2.9% 0.38 / 0.36 / +4.0%
clickbench_q26/datafusion:parquet 30869985 / 31127172 / -0.8% 86384837 / 89186979 / -3.1% 0.36 / 0.35 / +2.4%
clickbench_q27/datafusion:parquet 192201476 / 193620522 / -0.7% 282044854 / 289723884 / -2.7% 0.68 / 0.67 / +2.0%
clickbench_q28/datafusion:parquet 624526163 / 617527624 / +1.1% 700327802 / 702331735 / -0.3% 0.89 / 0.88 / +1.4%
clickbench_q29/datafusion:parquet 29686804 / 28774798 / +3.2% 89626040 / 90223686 / -0.7% 0.33 / 0.32 / +3.9%
clickbench_q30/datafusion:parquet 89729148 / 89604524 / +0.1% 164579486 / 173512200 / -5.1% 0.55 / 0.52 / +5.6%
clickbench_q31/datafusion:parquet 102296154 / 103528343 / -1.2% 188878838 / 200819036 / -5.9% 0.54 / 0.52 / +5.1%
clickbench_q32/datafusion:parquet 306856669 / 308568780 / -0.6% 421359079 / 431256499 / -2.3% 0.73 / 0.72 / +1.8%
clickbench_q33/datafusion:parquet 375385549 / 377940900 / -0.7% 469458056 / 479131033 / -2.0% 0.80 / 0.79 / +1.4%
clickbench_q34/datafusion:parquet 376935834 / 379057750 / -0.6% 466951169 / 480750972 / -2.9% 0.81 / 0.79 / +2.4%
clickbench_q35/datafusion:parquet 67524653 / 65543578 / +3.0% 124149908 / 124134655 / +0.0% 0.54 / 0.53 / +3.0%
clickbench_q36/datafusion:parquet 73017632 / 73387590 / -0.5% 133230721 / 135774569 / -1.9% 0.55 / 0.54 / +1.4%
clickbench_q37/datafusion:parquet 35442470 / 35617999 / -0.5% 90207419 / 91810520 / -1.7% 0.39 / 0.39 / +1.3%
clickbench_q38/datafusion:parquet 47621840 / 47860311 / -0.5% 105635062 / 110026773 / -4.0% 0.45 / 0.43 / +3.6%
clickbench_q39/datafusion:parquet 143705437 / 143836521 / -0.1% 206298633 / 214263836 / -3.7% 0.70 / 0.67 / +3.8%
clickbench_q40/datafusion:parquet 19760288 / 20048918 / -1.4% 76936256 / 78849852 / -2.4% 0.26 / 0.25 / +1.0%
clickbench_q41/datafusion:parquet 18587350 / 18839682 / -1.3% 75255573 / 78602562 / -4.3% 0.25 / 0.24 / +3.0%
clickbench_q42/datafusion:parquet 19384446 / 19448928 / -0.3% 74481990 / 80271917 / -7.2% 0.26 / 0.24 / +7.4%
duckdb / vortex-file-compressed / ns (0.964x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2221572 / 2316356 / -4.1% 23636371 / 23309937 / +1.4% 0.09 / 0.10 / -5.4%
clickbench_q01/duckdb:vortex-file-compressed 7526222 / 7539062 / -0.2% 27171371 / 26697318 / +1.8% 0.28 / 0.28 / -1.9%
clickbench_q02/duckdb:vortex-file-compressed 8696701 / 8955982 / -2.9% 34218974 / 35695040 / -4.1% 0.25 / 0.25 / +1.3%
clickbench_q03/duckdb:vortex-file-compressed 13683432 / 13975386 / -2.1% 45900864 / 49335517 / -7.0% 0.30 / 0.28 / +5.2%
clickbench_q04/duckdb:vortex-file-compressed 56257214 / 58896211 / -4.5% 86757339 / 92282346 / -6.0% 0.65 / 0.64 / +1.6%
clickbench_q05/duckdb:vortex-file-compressed 65337444 / 67206239 / -2.8% 94190818 / 96372538 / -2.3% 0.69 / 0.70 / -0.5%
clickbench_q06/duckdb:vortex-file-compressed 2598438 / 2622598 / -0.9% 30512990 / 29238338 / +4.4% 0.09 / 0.09 / -5.1%
clickbench_q07/duckdb:vortex-file-compressed 9310038 / 9600068 / -3.0% 29608851 / 29770566 / -0.5% 0.31 / 0.32 / -2.5%
clickbench_q08/duckdb:vortex-file-compressed 68494809 / 70062960 / -2.2% 99303533 / 105800127 / -6.1% 0.69 / 0.66 / +4.2%
clickbench_q09/duckdb:vortex-file-compressed 93813555 / 94451218 / -0.7% 131985598 / 127163205 / +3.8% 0.71 / 0.74 / -4.3%
clickbench_q10/duckdb:vortex-file-compressed 27613324 / 27782772 / -0.6% 65796479 / 72279743 / -9.0% 0.42 / 0.38 / +9.2%
clickbench_q11/duckdb:vortex-file-compressed 30513800 / 30687561 / -0.6% 67655925 / 74359750 / -9.0% 0.45 / 0.41 / +9.3%
clickbench_q12/duckdb:vortex-file-compressed 70885482 / 72237397 / -1.9% 100933353 / 103652304 / -2.6% 0.70 / 0.70 / +0.8%
clickbench_q13/duckdb:vortex-file-compressed 129291110 / 127851810 / +1.1% 160974446 / 168822427 / -4.6% 0.80 / 0.76 / +6.1%
clickbench_q14/duckdb:vortex-file-compressed 74432646 / 76230723 / -2.4% 100421560 / 106914135 / -6.1% 0.74 / 0.71 / +4.0%
clickbench_q15/duckdb:vortex-file-compressed 75652404 / 76408312 / -1.0% 107847451 / 108616047 / -0.7% 0.70 / 0.70 / -0.3%
clickbench_q16/duckdb:vortex-file-compressed 139508884 / 140833212 / -0.9% 173003674 / 178949293 / -3.3% 0.81 / 0.79 / +2.5%
clickbench_q17/duckdb:vortex-file-compressed 137030074 / 145359782 / -5.7% 169896962 / 181211144 / -6.2% 0.81 / 0.80 / +0.5%
clickbench_q18/duckdb:vortex-file-compressed 257001534 / 256850284 / +0.1% 311317108 / 313893640 / -0.8% 0.83 / 0.82 / +0.9%
clickbench_q19/duckdb:vortex-file-compressed 9493958 / 9464116 / +0.3% 38350230 / 37478588 / +2.3% 0.25 / 0.25 / -2.0%
clickbench_q20/duckdb:vortex-file-compressed 66296554 / 69316572 / -4.4% 163235010 / 170472456 / -4.2% 0.41 / 0.41 / -0.1%
clickbench_q21/duckdb:vortex-file-compressed 76752670 / 87218998 / -12.0% 🟢 178446860 / 201513382 / -11.4% 🟢 0.43 / 0.43 / -0.6%
clickbench_q22/duckdb:vortex-file-compressed 114150698 / 174846654 / -34.7% 🟢 312704049 / 367208660 / -14.8% 🟢 0.37 / 0.48 / -23.3%
clickbench_q23/duckdb:vortex-file-compressed 31819430 / 41038768 / -22.5% 🟢 67052518 / 82961725 / -19.2% 🟢 0.47 / 0.49 / -4.1%
clickbench_q24/duckdb:vortex-file-compressed 13172856 / 15160866 / -13.1% 🟢 30958982 / 34968266 / -11.5% 🟢 0.43 / 0.43 / -1.9%
clickbench_q25/duckdb:vortex-file-compressed 19477630 / 19345222 / +0.7% 51459219 / 52265793 / -1.5% 0.38 / 0.37 / +2.3%
clickbench_q26/duckdb:vortex-file-compressed 10998960 / 11666164 / -5.7% 33569511 / 37230065 / -9.8% 0.33 / 0.31 / +4.6%
clickbench_q27/duckdb:vortex-file-compressed 54042060 / 54071963 / -0.1% 167079428 / 179248733 / -6.8% 0.32 / 0.30 / +7.2%
clickbench_q28/duckdb:vortex-file-compressed 526119577 / 521783236 / +0.8% 565626556 / 584919271 / -3.3% 0.93 / 0.89 / +4.3%
clickbench_q29/duckdb:vortex-file-compressed 17780269 / 18144333 / -2.0% 43703125 / 41948890 / +4.2% 0.41 / 0.43 / -5.9%
clickbench_q30/duckdb:vortex-file-compressed 61257262 / 61457455 / -0.3% 104057555 / 112065220 / -7.1% 0.59 / 0.55 / +7.3%
clickbench_q31/duckdb:vortex-file-compressed 111201206 / 112605193 / -1.2% 189184343 / 176967995 / +6.9% 0.59 / 0.64 / -7.6%
clickbench_q32/duckdb:vortex-file-compressed 364177662 / 376110058 / -3.2% 404754990 / 406967585 / -0.5% 0.90 / 0.92 / -2.6%
clickbench_q33/duckdb:vortex-file-compressed 346365248 / 341811647 / +1.3% 413055124 / 401498204 / +2.9% 0.84 / 0.85 / -1.5%
clickbench_q34/duckdb:vortex-file-compressed 354595902 / 359692298 / -1.4% 423452211 / 421374281 / +0.5% 0.84 / 0.85 / -1.9%
clickbench_q35/duckdb:vortex-file-compressed 57312532 / 59653987 / -3.9% 85054166 / 90891251 / -6.4% 0.67 / 0.66 / +2.7%
clickbench_q36/duckdb:vortex-file-compressed 11766934 / 11699479 / +0.6% 27726440 / 31365789 / -11.6% 🟢 0.42 / 0.37 / +13.8%
clickbench_q37/duckdb:vortex-file-compressed 8370876 / 8226245 / +1.8% 26228348 / 27060925 / -3.1% 0.32 / 0.30 / +5.0%
clickbench_q38/duckdb:vortex-file-compressed 8705072 / 8761657 / -0.6% 26608855 / 28743146 / -7.4% 0.33 / 0.30 / +7.3%
clickbench_q39/duckdb:vortex-file-compressed 18937677 / 18934137 / +0.0% 40135236 / 41063311 / -2.3% 0.47 / 0.46 / +2.3%
clickbench_q40/duckdb:vortex-file-compressed 7401106 / 7565950 / -2.2% 26525780 / 27136661 / -2.3% 0.28 / 0.28 / +0.1%
clickbench_q41/duckdb:vortex-file-compressed 8318138 / 8713054 / -4.5% 28570599 / 29103500 / -1.8% 0.29 / 0.30 / -2.8%
clickbench_q42/duckdb:vortex-file-compressed 7418430 / 7453789 / -0.5% 27497509 / 29052559 / -5.4% 0.27 / 0.26 / +5.2%
duckdb / parquet / ns (1.018x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 12292998 / 10659744 / +15.3% 🔴 18793630 / 18978727 / -1.0% 0.65 / 0.56 / +16.5%
clickbench_q01/duckdb:parquet 17504162 / 16886617 / +3.7% 25158421 / 25296916 / -0.5% 0.70 / 0.67 / +4.2%
clickbench_q02/duckdb:parquet 25118213 / 24098232 / +4.2% 36081870 / 37071171 / -2.7% 0.70 / 0.65 / +7.1%
clickbench_q03/duckdb:parquet 25715328 / 24782620 / +3.8% 39910603 / 39824349 / +0.2% 0.64 / 0.62 / +3.5%
clickbench_q04/duckdb:parquet 64909012 / 63683324 / +1.9% 79638808 / 77506227 / +2.8% 0.82 / 0.82 / -0.8%
clickbench_q05/duckdb:parquet 85806487 / 85826466 / -0.0% 104589068 / 107119166 / -2.4% 0.82 / 0.80 / +2.4%
clickbench_q06/duckdb:parquet 22971718 / 22226085 / +3.4% 33494662 / 33590690 / -0.3% 0.69 / 0.66 / +3.7%
clickbench_q07/duckdb:parquet 19615853 / 19221367 / +2.1% 26167241 / 25706882 / +1.8% 0.75 / 0.75 / +0.3%
clickbench_q08/duckdb:parquet 78457331 / 77522808 / +1.2% 93735682 / 92848832 / +1.0% 0.84 / 0.83 / +0.2%
clickbench_q09/duckdb:parquet 106049566 / 104704682 / +1.3% 125405361 / 125363634 / +0.0% 0.85 / 0.84 / +1.3%
clickbench_q10/duckdb:parquet 43818096 / 42519106 / +3.1% 60315272 / 59927647 / +0.6% 0.73 / 0.71 / +2.4%
clickbench_q11/duckdb:parquet 48336828 / 47981428 / +0.7% 64330758 / 65672662 / -2.0% 0.75 / 0.73 / +2.8%
clickbench_q12/duckdb:parquet 94615954 / 95665316 / -1.1% 111881546 / 114826720 / -2.6% 0.85 / 0.83 / +1.5%
clickbench_q13/duckdb:parquet 153905887 / 153472152 / +0.3% 172515714 / 175809711 / -1.9% 0.89 / 0.87 / +2.2%
clickbench_q14/duckdb:parquet 104739302 / 102001694 / +2.7% 135884512 / 130684375 / +4.0% 0.77 / 0.78 / -1.2%
clickbench_q15/duckdb:parquet 89366508 / 90067308 / -0.8% 107121853 / 104927022 / +2.1% 0.83 / 0.86 / -2.8%
clickbench_q16/duckdb:parquet 170652648 / 176342836 / -3.2% 194099963 / 188023501 / +3.2% 0.88 / 0.94 / -6.3%
clickbench_q17/duckdb:parquet 174144530 / 177250039 / -1.8% 192538009 / 192559334 / -0.0% 0.90 / 0.92 / -1.7%
clickbench_q18/duckdb:parquet 303671130 / 308633344 / -1.6% 347582074 / 337205069 / +3.1% 0.87 / 0.92 / -4.5%
clickbench_q19/duckdb:parquet 21795926 / 22413691 / -2.8% 30631312 / 29637447 / +3.4% 0.71 / 0.76 / -5.9%
clickbench_q20/duckdb:parquet 187650363 / 186276237 / +0.7% 232179920 / 238066293 / -2.5% 0.81 / 0.78 / +3.3%
clickbench_q21/duckdb:parquet 230072310 / 227868066 / +1.0% 274878528 / 270418878 / +1.6% 0.84 / 0.84 / -0.7%
clickbench_q22/duckdb:parquet 325782712 / 309103402 / +5.4% 377434723 / 367922241 / +2.6% 0.86 / 0.84 / +2.7%
clickbench_q23/duckdb:parquet 170282170 / 170096610 / +0.1% 250625597 / 249917834 / +0.3% 0.68 / 0.68 / -0.2%
clickbench_q24/duckdb:parquet 32781396 / 32568394 / +0.7% 39153956 / 50429952 / -22.4% 🟢 0.84 / 0.65 / +29.6%
clickbench_q25/duckdb:parquet 44766300 / 45180834 / -0.9% 63998867 / 65172683 / -1.8% 0.70 / 0.69 / +0.9%
clickbench_q26/duckdb:parquet 33035937 / 33653694 / -1.8% 52189559 / 48840762 / +6.9% 0.63 / 0.69 / -8.1%
clickbench_q27/duckdb:parquet 201649500 / 194425344 / +3.7% 230070021 / 234323287 / -1.8% 0.88 / 0.83 / +5.6%
clickbench_q28/duckdb:parquet 997541312 / 993376018 / +0.4% 1009509630 / 978268921 / +3.2% 0.99 / 1.02 / -2.7%
clickbench_q29/duckdb:parquet 27087761 / 26075564 / +3.9% 36244223 / 35006863 / +3.5% 0.75 / 0.74 / +0.3%
clickbench_q30/duckdb:parquet 109886320 / 109086891 / +0.7% 139981987 / 141744231 / -1.2% 0.79 / 0.77 / +2.0%
clickbench_q31/duckdb:parquet 163378090 / 149473362 / +9.3% 186408926 / 181919472 / +2.5% 0.88 / 0.82 / +6.7%
clickbench_q32/duckdb:parquet 403752292 / 407535979 / -0.9% 421675059 / 415126757 / +1.6% 0.96 / 0.98 / -2.5%
clickbench_q33/duckdb:parquet 492717018 / 487845054 / +1.0% 469034506 / 477973659 / -1.9% 1.05 / 1.02 / +2.9%
clickbench_q34/duckdb:parquet 488609704 / 483134955 / +1.1% 499932429 / 474109910 / +5.4% 0.98 / 1.02 / -4.1%
clickbench_q35/duckdb:parquet 64888549 / 64853068 / +0.1% 78585689 / 78830710 / -0.3% 0.83 / 0.82 / +0.4%
clickbench_q36/duckdb:parquet 32061038 / 31689553 / +1.2% 40406191 / 40649108 / -0.6% 0.79 / 0.78 / +1.8%
clickbench_q37/duckdb:parquet 24990582 / 25055420 / -0.3% 35108021 / 33971986 / +3.3% 0.71 / 0.74 / -3.5%
clickbench_q38/duckdb:parquet 26804796 / 25376014 / +5.6% 34132173 / 34548555 / -1.2% 0.79 / 0.73 / +6.9%
clickbench_q39/duckdb:parquet 55747606 / 55054473 / +1.3% 65020835 / 65475996 / -0.7% 0.86 / 0.84 / +2.0%
clickbench_q40/duckdb:parquet 16151722 / 16160134 / -0.1% 25581423 / 25043946 / +2.1% 0.63 / 0.65 / -2.2%
clickbench_q41/duckdb:parquet 17718824 / 16865376 / +5.1% 24160539 / 24902932 / -3.0% 0.73 / 0.68 / +8.3%
clickbench_q42/duckdb:parquet 17124172 / 15796464 / +8.4% 25423366 / 26446483 / -3.9% 0.67 / 0.60 / +12.8%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 7dcaf561 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.008x ➖
Parquet (geomean): hot 1.007x ➖ · cold 0.999x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21073768 / 20662877 / +2.0% 39807463 / 38388298 / +3.7% 0.53 / 0.54 / -1.6%
tpcds_q02/datafusion:vortex-file-compressed 45548683 / 44071682 / +3.4% 66651218 / 64203849 / +3.8% 0.68 / 0.69 / -0.4%
tpcds_q03/datafusion:vortex-file-compressed 11345992 / 11095395 / +2.3% 27871645 / 26770394 / +4.1% 0.41 / 0.41 / -1.8%
tpcds_q04/datafusion:vortex-file-compressed 89081320 / 85937970 / +3.7% 124963901 / 120762373 / +3.5% 0.71 / 0.71 / +0.2%
tpcds_q05/datafusion:vortex-file-compressed 57962747 / 56220694 / +3.1% 85336417 / 76967535 / +10.9% 🔴 0.68 / 0.73 / -7.0%
tpcds_q06/datafusion:vortex-file-compressed 22381618 / 21976346 / +1.8% 42165374 / 43424391 / -2.9% 0.53 / 0.51 / +4.9%
tpcds_q07/datafusion:vortex-file-compressed 29130468 / 28753308 / +1.3% 53278131 / 51675554 / +3.1% 0.55 / 0.56 / -1.7%
tpcds_q08/datafusion:vortex-file-compressed 23967432 / 24541650 / -2.3% 42155800 / 43475451 / -3.0% 0.57 / 0.56 / +0.7%
tpcds_q09/datafusion:vortex-file-compressed 18040555 / 20105705 / -10.3% 🟢 37309751 / 37029178 / +0.8% 0.48 / 0.54 / -10.9%
tpcds_q10/datafusion:vortex-file-compressed 26654912 / 26771250 / -0.4% 48686856 / 50455373 / -3.5% 0.55 / 0.53 / +3.2%
tpcds_q11/datafusion:vortex-file-compressed 52454120 / 51942594 / +1.0% 86716840 / 83041366 / +4.4% 0.60 / 0.63 / -3.3%
tpcds_q12/datafusion:vortex-file-compressed 14964084 / 14909005 / +0.4% 34265520 / 32866199 / +4.3% 0.44 / 0.45 / -3.7%
tpcds_q13/datafusion:vortex-file-compressed 31207872 / 31125908 / +0.3% 58376778 / 56678644 / +3.0% 0.53 / 0.55 / -2.7%
tpcds_q14/datafusion:vortex-file-compressed 486793048 / 487173892 / -0.1% 547667781 / 549971662 / -0.4% 0.89 / 0.89 / +0.3%
tpcds_q15/datafusion:vortex-file-compressed 12404766 / 12454406 / -0.4% 35126603 / 33623513 / +4.5% 0.35 / 0.37 / -4.7%
tpcds_q16/datafusion:vortex-file-compressed 18683873 / 18526448 / +0.8% 38534194 / 38010837 / +1.4% 0.48 / 0.49 / -0.5%
tpcds_q17/datafusion:vortex-file-compressed 55101886 / 50769293 / +8.5% 79179446 / 75447269 / +4.9% 0.70 / 0.67 / +3.4%
tpcds_q18/datafusion:vortex-file-compressed 63538088 / 63588463 / -0.1% 86937681 / 85468521 / +1.7% 0.73 / 0.74 / -1.8%
tpcds_q19/datafusion:vortex-file-compressed 16759136 / 17047396 / -1.7% 39195738 / 38742283 / +1.2% 0.43 / 0.44 / -2.8%
tpcds_q20/datafusion:vortex-file-compressed 16136628 / 16464230 / -2.0% 36251788 / 35800079 / +1.3% 0.45 / 0.46 / -3.2%
tpcds_q21/datafusion:vortex-file-compressed 15981284 / 15940484 / +0.3% 42831342 / 37502958 / +14.2% 🔴 0.37 / 0.43 / -12.2%
tpcds_q22/datafusion:vortex-file-compressed 49753698 / 49830978 / -0.2% 73539610 / 73429530 / +0.1% 0.68 / 0.68 / -0.3%
tpcds_q23/datafusion:vortex-file-compressed 70742223 / 71127504 / -0.5% 99117942 / 95266102 / +4.0% 0.71 / 0.75 / -4.4%
tpcds_q24/datafusion:vortex-file-compressed 64732510 / 65827480 / -1.7% 86939767 / 87950060 / -1.1% 0.74 / 0.75 / -0.5%
tpcds_q25/datafusion:vortex-file-compressed 41361682 / 48552602 / -14.8% 🟢 75207295 / 69532625 / +8.2% 0.55 / 0.70 / -21.2%
tpcds_q26/datafusion:vortex-file-compressed 25801946 / 25883028 / -0.3% 47963227 / 45868290 / +4.6% 0.54 / 0.56 / -4.7%
tpcds_q27/datafusion:vortex-file-compressed 60475267 / 63281436 / -4.4% 86827217 / 80805852 / +7.5% 0.70 / 0.78 / -11.1%
tpcds_q28/datafusion:vortex-file-compressed 18701600 / 26229064 / -28.7% 🟢 37093797 / 40810592 / -9.1% 0.50 / 0.64 / -21.6%
tpcds_q29/datafusion:vortex-file-compressed 53288264 / 53880442 / -1.1% 78314056 / 75632558 / +3.5% 0.68 / 0.71 / -4.5%
tpcds_q30/datafusion:vortex-file-compressed 26225866 / 25882580 / +1.3% 45713342 / 45306891 / +0.9% 0.57 / 0.57 / +0.4%
tpcds_q31/datafusion:vortex-file-compressed 58053009 / 58167868 / -0.2% 85718144 / 83805563 / +2.3% 0.68 / 0.69 / -2.4%
tpcds_q32/datafusion:vortex-file-compressed 12445826 / 12486154 / -0.3% 30428736 / 29878584 / +1.8% 0.41 / 0.42 / -2.1%
tpcds_q33/datafusion:vortex-file-compressed 27804162 / 27470150 / +1.2% 50395890 / 50803280 / -0.8% 0.55 / 0.54 / +2.0%
tpcds_q34/datafusion:vortex-file-compressed 17457611 / 17355034 / +0.6% 37027750 / 37376510 / -0.9% 0.47 / 0.46 / +1.5%
tpcds_q35/datafusion:vortex-file-compressed 30070326 / 30165718 / -0.3% 55351680 / 54544146 / +1.5% 0.54 / 0.55 / -1.8%
tpcds_q36/datafusion:vortex-file-compressed 47439530 / 48307158 / -1.8% 70561344 / 67264121 / +4.9% 0.67 / 0.72 / -6.4%
tpcds_q37/datafusion:vortex-file-compressed 11892701 / 11857472 / +0.3% 32689532 / 34111657 / -4.2% 0.36 / 0.35 / +4.7%
tpcds_q38/datafusion:vortex-file-compressed 25744314 / 25514558 / +0.9% 47993322 / 48241747 / -0.5% 0.54 / 0.53 / +1.4%
tpcds_q39/datafusion:vortex-file-compressed 64833723 / 64890302 / -0.1% 92044875 / 89633580 / +2.7% 0.70 / 0.72 / -2.7%
tpcds_q40/datafusion:vortex-file-compressed 23474293 / 23494010 / -0.1% 43349671 / 43948484 / -1.4% 0.54 / 0.53 / +1.3%
tpcds_q41/datafusion:vortex-file-compressed 21012177 / 20495924 / +2.5% 35220237 / 32839414 / +7.2% 0.60 / 0.62 / -4.4%
tpcds_q42/datafusion:vortex-file-compressed 10918867 / 10944217 / -0.2% 28195737 / 26800473 / +5.2% 0.39 / 0.41 / -5.2%
tpcds_q43/datafusion:vortex-file-compressed 12549010 / 12235502 / +2.6% 32295364 / 32362966 / -0.2% 0.39 / 0.38 / +2.8%
tpcds_q44/datafusion:vortex-file-compressed 27187694 / 28950501 / -6.1% 52502094 / 53633308 / -2.1% 0.52 / 0.54 / -4.1%
tpcds_q45/datafusion:vortex-file-compressed 16001745 / 16086212 / -0.5% 37348562 / 36240197 / +3.1% 0.43 / 0.44 / -3.5%
tpcds_q46/datafusion:vortex-file-compressed 24246752 / 23330782 / +3.9% 49035849 / 46023788 / +6.5% 0.49 / 0.51 / -2.5%
tpcds_q47/datafusion:vortex-file-compressed 75293390 / 74638130 / +0.9% 104938446 / 104471851 / +0.4% 0.72 / 0.71 / +0.4%
tpcds_q48/datafusion:vortex-file-compressed 29202464 / 28355408 / +3.0% 52278214 / 52242427 / +0.1% 0.56 / 0.54 / +2.9%
tpcds_q49/datafusion:vortex-file-compressed 60449034 / 57975552 / +4.3% 78239958 / 80249136 / -2.5% 0.77 / 0.72 / +6.9%
tpcds_q50/datafusion:vortex-file-compressed 31056326 / 30773469 / +0.9% 55671594 / 53329113 / +4.4% 0.56 / 0.58 / -3.3%
tpcds_q51/datafusion:vortex-file-compressed 66482993 / 66370124 / +0.2% 90215660 / 87949849 / +2.6% 0.74 / 0.75 / -2.3%
tpcds_q52/datafusion:vortex-file-compressed 11584977 / 11303700 / +2.5% 28086322 / 28114971 / -0.1% 0.41 / 0.40 / +2.6%
tpcds_q53/datafusion:vortex-file-compressed 17974837 / 17817615 / +0.9% 41066131 / 39106120 / +5.0% 0.44 / 0.46 / -3.9%
tpcds_q54/datafusion:vortex-file-compressed 31790151 / 30815867 / +3.2% 56053384 / 53633024 / +4.5% 0.57 / 0.57 / -1.3%
tpcds_q55/datafusion:vortex-file-compressed 10827384 / 10947926 / -1.1% 28052637 / 26268641 / +6.8% 0.39 / 0.42 / -7.4%
tpcds_q56/datafusion:vortex-file-compressed 26890390 / 25893575 / +3.8% 49333720 / 48418478 / +1.9% 0.55 / 0.53 / +1.9%
tpcds_q57/datafusion:vortex-file-compressed 62600524 / 61658540 / +1.5% 87140781 / 88488887 / -1.5% 0.72 / 0.70 / +3.1%
tpcds_q58/datafusion:vortex-file-compressed 37996994 / 38139050 / -0.4% 64274141 / 62952715 / +2.1% 0.59 / 0.61 / -2.4%
tpcds_q59/datafusion:vortex-file-compressed 30025822 / 29773657 / +0.8% 54286527 / 54576681 / -0.5% 0.55 / 0.55 / +1.4%
tpcds_q60/datafusion:vortex-file-compressed 26059368 / 25763284 / +1.1% 47690546 / 47311516 / +0.8% 0.55 / 0.54 / +0.3%
tpcds_q61/datafusion:vortex-file-compressed 21441768 / 21212998 / +1.1% 43184270 / 43808218 / -1.4% 0.50 / 0.48 / +2.5%
tpcds_q62/datafusion:vortex-file-compressed 16273996 / 16226768 / +0.3% 35263859 / 34675741 / +1.7% 0.46 / 0.47 / -1.4%
tpcds_q63/datafusion:vortex-file-compressed 17669842 / 17479711 / +1.1% 40175196 / 38987535 / +3.0% 0.44 / 0.45 / -1.9%
tpcds_q64/datafusion:vortex-file-compressed 213138527 / 212632786 / +0.2% 256178167 / 245822306 / +4.2% 0.83 / 0.86 / -3.8%
tpcds_q65/datafusion:vortex-file-compressed 74500355 / 72326343 / +3.0% 93800048 / 92518043 / +1.4% 0.79 / 0.78 / +1.6%
tpcds_q66/datafusion:vortex-file-compressed 50699469 / 50841554 / -0.3% 75192997 / 72759471 / +3.3% 0.67 / 0.70 / -3.5%
tpcds_q67/datafusion:vortex-file-compressed 50366170 / 51321318 / -1.9% 84338653 / 84264967 / +0.1% 0.60 / 0.61 / -1.9%
tpcds_q68/datafusion:vortex-file-compressed 23529490 / 22754568 / +3.4% 49229280 / 46535563 / +5.8% 0.48 / 0.49 / -2.3%
tpcds_q69/datafusion:vortex-file-compressed 25269144 / 25748720 / -1.9% 49203148 / 47728418 / +3.1% 0.51 / 0.54 / -4.8%
tpcds_q70/datafusion:vortex-file-compressed 70981435 / 70768666 / +0.3% 94787441 / 94483406 / +0.3% 0.75 / 0.75 / -0.0%
tpcds_q71/datafusion:vortex-file-compressed 19029926 / 19265814 / -1.2% 40649377 / 40165351 / +1.2% 0.47 / 0.48 / -2.4%
tpcds_q72/datafusion:vortex-file-compressed 339733877 / 346150522 / -1.9% 379985789 / 397297658 / -4.4% 0.89 / 0.87 / +2.6%
tpcds_q73/datafusion:vortex-file-compressed 16273366 / 15934651 / +2.1% 38728883 / 35011866 / +10.6% 🔴 0.42 / 0.46 / -7.7%
tpcds_q74/datafusion:vortex-file-compressed 40665228 / 39780041 / +2.2% 67483505 / 66803203 / +1.0% 0.60 / 0.60 / +1.2%
tpcds_q75/datafusion:vortex-file-compressed 137439686 / 135714753 / +1.3% 168699433 / 162660370 / +3.7% 0.81 / 0.83 / -2.4%
tpcds_q76/datafusion:vortex-file-compressed 29730093 / 29291308 / +1.5% 51084421 / 47924547 / +6.6% 0.58 / 0.61 / -4.8%
tpcds_q77/datafusion:vortex-file-compressed 44896078 / 44660360 / +0.5% 66355748 / 65734489 / +0.9% 0.68 / 0.68 / -0.4%
tpcds_q78/datafusion:vortex-file-compressed 65842480 / 63632236 / +3.5% 94200485 / 94010583 / +0.2% 0.70 / 0.68 / +3.3%
tpcds_q79/datafusion:vortex-file-compressed 19878587 / 19924334 / -0.2% 43496800 / 42878743 / +1.4% 0.46 / 0.46 / -1.6%
tpcds_q80/datafusion:vortex-file-compressed 73768577 / 72991048 / +1.1% 104155951 / 100489903 / +3.6% 0.71 / 0.73 / -2.5%
tpcds_q81/datafusion:vortex-file-compressed 26291981 / 26190294 / +0.4% 44432616 / 44415165 / +0.0% 0.59 / 0.59 / +0.3%
tpcds_q82/datafusion:vortex-file-compressed 11851135 / 12373004 / -4.2% 34353041 / 33916690 / +1.3% 0.34 / 0.36 / -5.4%
tpcds_q83/datafusion:vortex-file-compressed 32828757 / 32776157 / +0.2% 54352676 / 50511779 / +7.6% 0.60 / 0.65 / -6.9%
tpcds_q84/datafusion:vortex-file-compressed 10143087 / 10014122 / +1.3% 26769326 / 26553087 / +0.8% 0.38 / 0.38 / +0.5%
tpcds_q85/datafusion:vortex-file-compressed 53769849 / 53044578 / +1.4% 81745041 / 80954298 / +1.0% 0.66 / 0.66 / +0.4%
tpcds_q86/datafusion:vortex-file-compressed 15736986 / 15658548 / +0.5% 34555653 / 32311558 / +6.9% 0.46 / 0.48 / -6.0%
tpcds_q87/datafusion:vortex-file-compressed 25307880 / 25551026 / -1.0% 52204223 / 46861588 / +11.4% 🔴 0.48 / 0.55 / -11.1%
tpcds_q88/datafusion:vortex-file-compressed 31673960 / 31550716 / +0.4% 53034670 / 54227953 / -2.2% 0.60 / 0.58 / +2.6%
tpcds_q89/datafusion:vortex-file-compressed 21110661 / 21217704 / -0.5% 44693466 / 40149772 / +11.3% 🔴 0.47 / 0.53 / -10.6%
tpcds_q90/datafusion:vortex-file-compressed 9754782 / 9912202 / -1.6% 25522741 / 24923081 / +2.4% 0.38 / 0.40 / -3.9%
tpcds_q91/datafusion:vortex-file-compressed 15379126 / 16331088 / -5.8% 38041162 / 36210118 / +5.1% 0.40 / 0.45 / -10.4%
tpcds_q92/datafusion:vortex-file-compressed 13083306 / 12712254 / +2.9% 29323501 / 29043054 / +1.0% 0.45 / 0.44 / +1.9%
tpcds_q93/datafusion:vortex-file-compressed 19803279 / 20005716 / -1.0% 42692042 / 40530909 / +5.3% 0.46 / 0.49 / -6.0%
tpcds_q94/datafusion:vortex-file-compressed 18812223 / 18455416 / +1.9% 38176684 / 37274216 / +2.4% 0.49 / 0.50 / -0.5%
tpcds_q95/datafusion:vortex-file-compressed 42330892 / 42223247 / +0.3% 64189171 / 61088035 / +5.1% 0.66 / 0.69 / -4.6%
tpcds_q96/datafusion:vortex-file-compressed 7729291 / 7643602 / +1.1% 25133144 / 24204839 / +3.8% 0.31 / 0.32 / -2.6%
tpcds_q97/datafusion:vortex-file-compressed 16965296 / 17142063 / -1.0% 38143478 / 36143924 / +5.5% 0.44 / 0.47 / -6.2%
tpcds_q98/datafusion:vortex-file-compressed 16328810 / 16025235 / +1.9% 39679826 / 36067472 / +10.0% 🔴 0.41 / 0.44 / -7.4%
tpcds_q99/datafusion:vortex-file-compressed 16148608 / 15816152 / +2.1% 35815676 / 35033983 / +2.2% 0.45 / 0.45 / -0.1%
datafusion / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43572638 / 41037398 / +6.2% 59768879 / 60468031 / -1.2% 0.73 / 0.68 / +7.4%
tpcds_q02/datafusion:parquet 55337328 / 55294162 / +0.1% 69653493 / 72584598 / -4.0% 0.79 / 0.76 / +4.3%
tpcds_q03/datafusion:parquet 19482616 / 19145511 / +1.8% 30962526 / 31737576 / -2.4% 0.63 / 0.60 / +4.3%
tpcds_q04/datafusion:parquet 180440322 / 179148961 / +0.7% 206792832 / 207193262 / -0.2% 0.87 / 0.86 / +0.9%
tpcds_q05/datafusion:parquet 67633892 / 67866314 / -0.3% 88567976 / 93269797 / -5.0% 0.76 / 0.73 / +4.9%
tpcds_q06/datafusion:parquet 33246979 / 34548628 / -3.8% 46600693 / 48650311 / -4.2% 0.71 / 0.71 / +0.5%
tpcds_q07/datafusion:parquet 47360630 / 47252786 / +0.2% 65500089 / 68512135 / -4.4% 0.72 / 0.69 / +4.8%
tpcds_q08/datafusion:parquet 31768934 / 31369000 / +1.3% 46862387 / 45820766 / +2.3% 0.68 / 0.68 / -1.0%
tpcds_q09/datafusion:parquet 33650064 / 34307494 / -1.9% 47498414 / 43105925 / +10.2% 🔴 0.71 / 0.80 / -11.0%
tpcds_q10/datafusion:parquet 45891978 / 44551387 / +3.0% 61005300 / 60617616 / +0.6% 0.75 / 0.73 / +2.4%
tpcds_q11/datafusion:parquet 98638766 / 98283752 / +0.4% 121149944 / 121127398 / +0.0% 0.81 / 0.81 / +0.3%
tpcds_q12/datafusion:parquet 24734245 / 24266474 / +1.9% 36735777 / 36327580 / +1.1% 0.67 / 0.67 / +0.8%
tpcds_q13/datafusion:parquet 47254124 / 46580310 / +1.4% 66672179 / 67994465 / -1.9% 0.71 / 0.69 / +3.5%
tpcds_q14/datafusion:parquet 534038446 / 535803457 / -0.3% 586061196 / 576399589 / +1.7% 0.91 / 0.93 / -2.0%
tpcds_q15/datafusion:parquet 23030740 / 23987052 / -4.0% 38948043 / 38772857 / +0.5% 0.59 / 0.62 / -4.4%
tpcds_q16/datafusion:parquet 37388216 / 37385275 / +0.0% 52140212 / 50808144 / +2.6% 0.72 / 0.74 / -2.5%
tpcds_q17/datafusion:parquet 75279132 / 74179220 / +1.5% 96923235 / 99947249 / -3.0% 0.78 / 0.74 / +4.6%
tpcds_q18/datafusion:parquet 70360170 / 68176314 / +3.2% 90902178 / 90601495 / +0.3% 0.77 / 0.75 / +2.9%
tpcds_q19/datafusion:parquet 30030168 / 29979450 / +0.2% 43378498 / 42461266 / +2.2% 0.69 / 0.71 / -1.9%
tpcds_q20/datafusion:parquet 24992392 / 25299084 / -1.2% 37279327 / 38763993 / -3.8% 0.67 / 0.65 / +2.7%
tpcds_q21/datafusion:parquet 20389180 / 20143853 / +1.2% 31603562 / 32533897 / -2.9% 0.65 / 0.62 / +4.2%
tpcds_q22/datafusion:parquet 77495056 / 77992354 / -0.6% 89307456 / 88630266 / +0.8% 0.87 / 0.88 / -1.4%
tpcds_q23/datafusion:parquet 93608128 / 92070006 / +1.7% 117779006 / 115685844 / +1.8% 0.79 / 0.80 / -0.1%
tpcds_q24/datafusion:parquet 91627223 / 91320906 / +0.3% 116296049 / 114776797 / +1.3% 0.79 / 0.80 / -1.0%
tpcds_q25/datafusion:parquet 83968345 / 80147062 / +4.8% 102750732 / 100467329 / +2.3% 0.82 / 0.80 / +2.4%
tpcds_q26/datafusion:parquet 43358165 / 43368406 / -0.0% 59900096 / 62993503 / -4.9% 0.72 / 0.69 / +5.1%
tpcds_q27/datafusion:parquet 78054937 / 77766271 / +0.4% 97803902 / 95385028 / +2.5% 0.80 / 0.82 / -2.1%
tpcds_q28/datafusion:parquet 28004760 / 28898218 / -3.1% 42511415 / 41658255 / +2.0% 0.66 / 0.69 / -5.0%
tpcds_q29/datafusion:parquet 76771554 / 74946869 / +2.4% 96406778 / 95881548 / +0.5% 0.80 / 0.78 / +1.9%
tpcds_q30/datafusion:parquet 46540550 / 43893362 / +6.0% 59444072 / 59749504 / -0.5% 0.78 / 0.73 / +6.6%
tpcds_q31/datafusion:parquet 83592687 / 81440329 / +2.6% 100991615 / 100055168 / +0.9% 0.83 / 0.81 / +1.7%
tpcds_q32/datafusion:parquet 26882767 / 27143890 / -1.0% 41420476 / 40303899 / +2.8% 0.65 / 0.67 / -3.6%
tpcds_q33/datafusion:parquet 37858862 / 37398043 / +1.2% 52598188 / 54795235 / -4.0% 0.72 / 0.68 / +5.5%
tpcds_q34/datafusion:parquet 24611306 / 24635061 / -0.1% 36106329 / 36342546 / -0.6% 0.68 / 0.68 / +0.6%
tpcds_q35/datafusion:parquet 50627191 / 50802148 / -0.3% 63810190 / 64573709 / -1.2% 0.79 / 0.79 / +0.8%
tpcds_q36/datafusion:parquet 52983413 / 52685074 / +0.6% 71698867 / 74511270 / -3.8% 0.74 / 0.71 / +4.5%
tpcds_q37/datafusion:parquet 21890701 / 21130209 / +3.6% 33564342 / 32955418 / +1.8% 0.65 / 0.64 / +1.7%
tpcds_q38/datafusion:parquet 45594193 / 45074440 / +1.2% 59823822 / 61169495 / -2.2% 0.76 / 0.74 / +3.4%
tpcds_q39/datafusion:parquet 69276397 / 67143299 / +3.2% 85004783 / 87798285 / -3.2% 0.81 / 0.76 / +6.6%
tpcds_q40/datafusion:parquet 29644380 / 31732224 / -6.6% 49808353 / 51366919 / -3.0% 0.60 / 0.62 / -3.7%
tpcds_q41/datafusion:parquet 19574095 / 19560677 / +0.1% 32370800 / 30927269 / +4.7% 0.60 / 0.63 / -4.4%
tpcds_q42/datafusion:parquet 18461157 / 18303020 / +0.9% 30498489 / 30195041 / +1.0% 0.61 / 0.61 / -0.1%
tpcds_q43/datafusion:parquet 19424091 / 19552828 / -0.7% 32550706 / 32452403 / +0.3% 0.60 / 0.60 / -1.0%
tpcds_q44/datafusion:parquet 35105261 / 35238887 / -0.4% 50056851 / 50018816 / +0.1% 0.70 / 0.70 / -0.5%
tpcds_q45/datafusion:parquet 26014457 / 27571686 / -5.6% 41497172 / 42507478 / -2.4% 0.63 / 0.65 / -3.4%
tpcds_q46/datafusion:parquet 29850426 / 29861832 / -0.0% 46587758 / 46926615 / -0.7% 0.64 / 0.64 / +0.7%
tpcds_q47/datafusion:parquet 98462644 / 98146604 / +0.3% 121842392 / 122067336 / -0.2% 0.81 / 0.80 / +0.5%
tpcds_q48/datafusion:parquet 42105757 / 42447005 / -0.8% 61407274 / 59145720 / +3.8% 0.69 / 0.72 / -4.5%
tpcds_q49/datafusion:parquet 71324101 / 72220930 / -1.2% 94085875 / 96046791 / -2.0% 0.76 / 0.75 / +0.8%
tpcds_q50/datafusion:parquet 48299366 / 47512774 / +1.7% 66752397 / 71800733 / -7.0% 0.72 / 0.66 / +9.3%
tpcds_q51/datafusion:parquet 75230407 / 75603896 / -0.5% 96040050 / 96356391 / -0.3% 0.78 / 0.78 / -0.2%
tpcds_q52/datafusion:parquet 18862468 / 18667056 / +1.0% 30307329 / 29454574 / +2.9% 0.62 / 0.63 / -1.8%
tpcds_q53/datafusion:parquet 22839342 / 23176485 / -1.5% 40022241 / 39182736 / +2.1% 0.57 / 0.59 / -3.5%
tpcds_q54/datafusion:parquet 52298668 / 51885012 / +0.8% 68151613 / 69416818 / -1.8% 0.77 / 0.75 / +2.7%
tpcds_q55/datafusion:parquet 18510274 / 18301546 / +1.1% 31655134 / 31877199 / -0.7% 0.58 / 0.57 / +1.9%
tpcds_q56/datafusion:parquet 41418302 / 39632970 / +4.5% 55856427 / 55628203 / +0.4% 0.74 / 0.71 / +4.1%
tpcds_q57/datafusion:parquet 102556086 / 100454820 / +2.1% 115344553 / 121808907 / -5.3% 0.89 / 0.82 / +7.8%
tpcds_q58/datafusion:parquet 65451090 / 65082382 / +0.6% 84087498 / 84884800 / -0.9% 0.78 / 0.77 / +1.5%
tpcds_q59/datafusion:parquet 48482888 / 47924398 / +1.2% 66933317 / 68304504 / -2.0% 0.72 / 0.70 / +3.2%
tpcds_q60/datafusion:parquet 39847254 / 42313918 / -5.8% 54756280 / 60333944 / -9.2% 0.73 / 0.70 / +3.8%
tpcds_q61/datafusion:parquet 37654708 / 36404834 / +3.4% 52799500 / 50470158 / +4.6% 0.71 / 0.72 / -1.1%
tpcds_q62/datafusion:parquet 25594602 / 25240186 / +1.4% 38638305 / 37930554 / +1.9% 0.66 / 0.67 / -0.5%
tpcds_q63/datafusion:parquet 22389012 / 22274464 / +0.5% 39625048 / 40137287 / -1.3% 0.57 / 0.55 / +1.8%
tpcds_q64/datafusion:parquet 289934999 / 291825881 / -0.6% 331479683 / 326894100 / +1.4% 0.87 / 0.89 / -2.0%
tpcds_q65/datafusion:parquet 123357898 / 121713454 / +1.4% 142038813 / 142669978 / -0.4% 0.87 / 0.85 / +1.8%
tpcds_q66/datafusion:parquet 60587228 / 59440828 / +1.9% 77779074 / 75640564 / +2.8% 0.78 / 0.79 / -0.9%
tpcds_q67/datafusion:parquet 69596240 / 68348957 / +1.8% 92880056 / 93585303 / -0.8% 0.75 / 0.73 / +2.6%
tpcds_q68/datafusion:parquet 29853626 / 29525206 / +1.1% 48889159 / 49365427 / -1.0% 0.61 / 0.60 / +2.1%
tpcds_q69/datafusion:parquet 44890105 / 42326063 / +6.1% 58895165 / 56487138 / +4.3% 0.76 / 0.75 / +1.7%
tpcds_q70/datafusion:parquet 81183434 / 80186448 / +1.2% 98830119 / 98784851 / +0.0% 0.82 / 0.81 / +1.2%
tpcds_q71/datafusion:parquet 26321428 / 26321141 / +0.0% 38186549 / 36794416 / +3.8% 0.69 / 0.72 / -3.6%
tpcds_q72/datafusion:parquet 522817065 / 524180635 / -0.3% 540442837 / 558063742 / -3.2% 0.97 / 0.94 / +3.0%
tpcds_q73/datafusion:parquet 24300439 / 24084504 / +0.9% 38247210 / 36840445 / +3.8% 0.64 / 0.65 / -2.8%
tpcds_q74/datafusion:parquet 71863422 / 70174123 / +2.4% 89925283 / 90258255 / -0.4% 0.80 / 0.78 / +2.8%
tpcds_q75/datafusion:parquet 153563304 / 156896393 / -2.1% 175327600 / 184038891 / -4.7% 0.88 / 0.85 / +2.7%
tpcds_q76/datafusion:parquet 34970678 / 34224952 / +2.2% 48125123 / 50692625 / -5.1% 0.73 / 0.68 / +7.6%
tpcds_q77/datafusion:parquet 57405112 / 58233668 / -1.4% 75846192 / 76077433 / -0.3% 0.76 / 0.77 / -1.1%
tpcds_q78/datafusion:parquet 85292700 / 85428305 / -0.2% 121526322 / 118447829 / +2.6% 0.70 / 0.72 / -2.7%
tpcds_q79/datafusion:parquet 27576164 / 27134527 / +1.6% 43330058 / 42881579 / +1.0% 0.64 / 0.63 / +0.6%
tpcds_q80/datafusion:parquet 81847898 / 80657915 / +1.5% 108582197 / 110802292 / -2.0% 0.75 / 0.73 / +3.6%
tpcds_q81/datafusion:parquet 38363928 / 37777232 / +1.6% 51582788 / 53177596 / -3.0% 0.74 / 0.71 / +4.7%
tpcds_q82/datafusion:parquet 22621674 / 21830275 / +3.6% 34623705 / 35544461 / -2.6% 0.65 / 0.61 / +6.4%
tpcds_q83/datafusion:parquet 58621210 / 58296937 / +0.6% 75532896 / 74616736 / +1.2% 0.78 / 0.78 / -0.7%
tpcds_q84/datafusion:parquet 27356429 / 26330226 / +3.9% 42950613 / 42384381 / +1.3% 0.64 / 0.62 / +2.5%
tpcds_q85/datafusion:parquet 80618814 / 81149270 / -0.7% 106321534 / 105837872 / +0.5% 0.76 / 0.77 / -1.1%
tpcds_q86/datafusion:parquet 21129938 / 21226134 / -0.5% 33620102 / 33972858 / -1.0% 0.63 / 0.62 / +0.6%
tpcds_q87/datafusion:parquet 45852366 / 43655820 / +5.0% 64491633 / 61819470 / +4.3% 0.71 / 0.71 / +0.7%
tpcds_q88/datafusion:parquet 37362124 / 37317510 / +0.1% 51653414 / 52037306 / -0.7% 0.72 / 0.72 / +0.9%
tpcds_q89/datafusion:parquet 26368700 / 25620515 / +2.9% 41352451 / 43168659 / -4.2% 0.64 / 0.59 / +7.4%
tpcds_q90/datafusion:parquet 14539488 / 14700265 / -1.1% 26879005 / 26744264 / +0.5% 0.54 / 0.55 / -1.6%
tpcds_q91/datafusion:parquet 32541103 / 32536375 / +0.0% 47106086 / 46834523 / +0.6% 0.69 / 0.69 / -0.6%
tpcds_q92/datafusion:parquet 27373004 / 26925968 / +1.7% 40821934 / 41562779 / -1.8% 0.67 / 0.65 / +3.5%
tpcds_q93/datafusion:parquet 27619476 / 27737618 / -0.4% 48997875 / 47560036 / +3.0% 0.56 / 0.58 / -3.3%
tpcds_q94/datafusion:parquet 35635714 / 34987990 / +1.9% 48818209 / 49838089 / -2.0% 0.73 / 0.70 / +4.0%
tpcds_q95/datafusion:parquet 62949043 / 63986628 / -1.6% 77676405 / 82628090 / -6.0% 0.81 / 0.77 / +4.6%
tpcds_q96/datafusion:parquet 12481748 / 12515555 / -0.3% 25045515 / 24364474 / +2.8% 0.50 / 0.51 / -3.0%
tpcds_q97/datafusion:parquet 36089270 / 35645164 / +1.2% 51407760 / 49168462 / +4.6% 0.70 / 0.72 / -3.2%
tpcds_q98/datafusion:parquet 25284464 / 24769713 / +2.1% 38308676 / 39883907 / -3.9% 0.66 / 0.62 / +6.3%
tpcds_q99/datafusion:parquet 29728304 / 29456394 / +0.9% 42989801 / 42511842 / +1.1% 0.69 / 0.69 / -0.2%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16030694 / 16444475 / -2.5% 25118624 / 25468340 / -1.4% 0.64 / 0.65 / -1.2%
tpcds_q02/duckdb:vortex-file-compressed 16231771 / 16460483 / -1.4% 23420904 / 23822245 / -1.7% 0.69 / 0.69 / +0.3%
tpcds_q03/duckdb:vortex-file-compressed 7087608 / 7076496 / +0.2% 15927037 / 16811089 / -5.3% 0.45 / 0.42 / +5.7%
tpcds_q04/duckdb:vortex-file-compressed 45794054 / 45671773 / +0.3% 57509332 / 56795457 / +1.3% 0.80 / 0.80 / -1.0%
tpcds_q05/duckdb:vortex-file-compressed 23457885 / 23444196 / +0.1% 33120392 / 33922893 / -2.4% 0.71 / 0.69 / +2.5%
tpcds_q06/duckdb:vortex-file-compressed 24744801 / 24544822 / +0.8% 37603239 / 39101350 / -3.8% 0.66 / 0.63 / +4.8%
tpcds_q07/duckdb:vortex-file-compressed 13287765 / 13574572 / -2.1% 24011252 / 23853354 / +0.7% 0.55 / 0.57 / -2.8%
tpcds_q08/duckdb:vortex-file-compressed 17632220 / 17694292 / -0.4% 26447203 / 27427836 / -3.6% 0.67 / 0.65 / +3.3%
tpcds_q09/duckdb:vortex-file-compressed 19149548 / 19230780 / -0.4% 29317784 / 29232867 / +0.3% 0.65 / 0.66 / -0.7%
tpcds_q10/duckdb:vortex-file-compressed 27436700 / 28127254 / -2.5% 41272279 / 41633782 / -0.9% 0.66 / 0.68 / -1.6%
tpcds_q11/duckdb:vortex-file-compressed 37081073 / 36907482 / +0.5% 46117034 / 45373610 / +1.6% 0.80 / 0.81 / -1.1%
tpcds_q12/duckdb:vortex-file-compressed 10055526 / 10175710 / -1.2% 16384958 / 17230057 / -4.9% 0.61 / 0.59 / +3.9%
tpcds_q13/duckdb:vortex-file-compressed 21000516 / 21038962 / -0.2% 33603841 / 34714581 / -3.2% 0.62 / 0.61 / +3.1%
tpcds_q14/duckdb:vortex-file-compressed 56089680 / 57724936 / -2.8% 68304748 / 68632960 / -0.5% 0.82 / 0.84 / -2.4%
tpcds_q15/duckdb:vortex-file-compressed 11234321 / 11248794 / -0.1% 17510565 / 18537256 / -5.5% 0.64 / 0.61 / +5.7%
tpcds_q16/duckdb:vortex-file-compressed 24682956 / 24567762 / +0.5% 34905623 / 35296980 / -1.1% 0.71 / 0.70 / +1.6%
tpcds_q17/duckdb:vortex-file-compressed 24513742 / 24773062 / -1.0% 38189769 / 36689010 / +4.1% 0.64 / 0.68 / -4.9%
tpcds_q18/duckdb:vortex-file-compressed 31678800 / 31704231 / -0.1% 41130095 / 41795055 / -1.6% 0.77 / 0.76 / +1.5%
tpcds_q19/duckdb:vortex-file-compressed 79122752 / 78453346 / +0.9% 90165496 / 88861136 / +1.5% 0.88 / 0.88 / -0.6%
tpcds_q20/duckdb:vortex-file-compressed 11191455 / 11302434 / -1.0% 17889971 / 17921560 / -0.2% 0.63 / 0.63 / -0.8%
tpcds_q21/duckdb:vortex-file-compressed 9770344 / 9613981 / +1.6% 23214798 / 21618546 / +7.4% 0.42 / 0.44 / -5.4%
tpcds_q22/duckdb:vortex-file-compressed 17949798 / 17475264 / +2.7% 30100481 / 29801515 / +1.0% 0.60 / 0.59 / +1.7%
tpcds_q23/duckdb:vortex-file-compressed 37557678 / 38469427 / -2.4% 49116812 / 50493626 / -2.7% 0.76 / 0.76 / +0.4%
tpcds_q24/duckdb:vortex-file-compressed 26669072 / 27034658 / -1.4% 37492521 / 38258066 / -2.0% 0.71 / 0.71 / +0.7%
tpcds_q25/duckdb:vortex-file-compressed 23094462 / 23233486 / -0.6% 36353228 / 35619880 / +2.1% 0.64 / 0.65 / -2.6%
tpcds_q26/duckdb:vortex-file-compressed 13126594 / 13489824 / -2.7% 21653922 / 21359876 / +1.4% 0.61 / 0.63 / -4.0%
tpcds_q27/duckdb:vortex-file-compressed 16003005 / 16130987 / -0.8% 27383866 / 27091120 / +1.1% 0.58 / 0.60 / -1.9%
tpcds_q28/duckdb:vortex-file-compressed 15237384 / 15571143 / -2.1% 24441715 / 26383560 / -7.4% 0.62 / 0.59 / +5.6%
tpcds_q29/duckdb:vortex-file-compressed 23319906 / 23097506 / +1.0% 35517238 / 35788503 / -0.8% 0.66 / 0.65 / +1.7%
tpcds_q30/duckdb:vortex-file-compressed 16452938 / 16286234 / +1.0% 24501463 / 24987373 / -1.9% 0.67 / 0.65 / +3.0%
tpcds_q31/duckdb:vortex-file-compressed 17854182 / 18038853 / -1.0% 26188751 / 26835741 / -2.4% 0.68 / 0.67 / +1.4%
tpcds_q32/duckdb:vortex-file-compressed 11818927 / 12118126 / -2.5% 22014111 / 21035329 / +4.7% 0.54 / 0.58 / -6.8%
tpcds_q33/duckdb:vortex-file-compressed 19032245 / 19145275 / -0.6% 28745334 / 28982771 / -0.8% 0.66 / 0.66 / +0.2%
tpcds_q34/duckdb:vortex-file-compressed 12718049 / 13291362 / -4.3% 22613315 / 23346380 / -3.1% 0.56 / 0.57 / -1.2%
tpcds_q35/duckdb:vortex-file-compressed 28683605 / 29057151 / -1.3% 40321304 / 41060035 / -1.8% 0.71 / 0.71 / +0.5%
tpcds_q36/duckdb:vortex-file-compressed 14376725 / 14673114 / -2.0% 25317161 / 25300723 / +0.1% 0.57 / 0.58 / -2.1%
tpcds_q37/duckdb:vortex-file-compressed 9498966 / 9811254 / -3.2% 25935018 / 24475303 / +6.0% 0.37 / 0.40 / -8.6%
tpcds_q38/duckdb:vortex-file-compressed 24541830 / 24605265 / -0.3% 31752692 / 32323829 / -1.8% 0.77 / 0.76 / +1.5%
tpcds_q39/duckdb:vortex-file-compressed 18854825 / 18754580 / +0.5% 30104792 / 31312343 / -3.9% 0.63 / 0.60 / +4.6%
tpcds_q40/duckdb:vortex-file-compressed 14364153 / 14358350 / +0.0% 21580495 / 21137017 / +2.1% 0.67 / 0.68 / -2.0%
tpcds_q41/duckdb:vortex-file-compressed 19119008 / 19083947 / +0.2% 26013545 / 26661569 / -2.4% 0.73 / 0.72 / +2.7%
tpcds_q42/duckdb:vortex-file-compressed 7134784 / 7055646 / +1.1% 15877461 / 15785619 / +0.6% 0.45 / 0.45 / +0.5%
tpcds_q43/duckdb:vortex-file-compressed 10438764 / 10468877 / -0.3% 19842672 / 20047716 / -1.0% 0.53 / 0.52 / +0.7%
tpcds_q44/duckdb:vortex-file-compressed 12818627 / 12765054 / +0.4% 23686899 / 24035788 / -1.5% 0.54 / 0.53 / +1.9%
tpcds_q45/duckdb:vortex-file-compressed 23637981 / 24095519 / -1.9% 30824547 / 31439773 / -2.0% 0.77 / 0.77 / +0.1%
tpcds_q46/duckdb:vortex-file-compressed 19822460 / 19944214 / -0.6% 28312393 / 28498573 / -0.7% 0.70 / 0.70 / +0.0%
tpcds_q47/duckdb:vortex-file-compressed 34680118 / 34362920 / +0.9% 45055092 / 45200024 / -0.3% 0.77 / 0.76 / +1.2%
tpcds_q48/duckdb:vortex-file-compressed 23346881 / 23537748 / -0.8% 35444861 / 35171768 / +0.8% 0.66 / 0.67 / -1.6%
tpcds_q49/duckdb:vortex-file-compressed 19198456 / 20061539 / -4.3% 30321846 / 31020788 / -2.3% 0.63 / 0.65 / -2.1%
tpcds_q50/duckdb:vortex-file-compressed 17200390 / 17224026 / -0.1% 29134055 / 28249732 / +3.1% 0.59 / 0.61 / -3.2%
tpcds_q51/duckdb:vortex-file-compressed 49279593 / 49558842 / -0.6% 61449438 / 59142497 / +3.9% 0.80 / 0.84 / -4.3%
tpcds_q52/duckdb:vortex-file-compressed 7154960 / 7471124 / -4.2% 16127778 / 16155821 / -0.2% 0.44 / 0.46 / -4.1%
tpcds_q53/duckdb:vortex-file-compressed 11661801 / 11708613 / -0.4% 20570645 / 20430202 / +0.7% 0.57 / 0.57 / -1.1%
tpcds_q54/duckdb:vortex-file-compressed 20359297 / 20517178 / -0.8% 31117957 / 30341791 / +2.6% 0.65 / 0.68 / -3.2%
tpcds_q55/duckdb:vortex-file-compressed 6945856 / 7086945 / -2.0% 15405455 / 16614933 / -7.3% 0.45 / 0.43 / +5.7%
tpcds_q56/duckdb:vortex-file-compressed 18524245 / 18390555 / +0.7% 28764715 / 28690113 / +0.3% 0.64 / 0.64 / +0.5%
tpcds_q57/duckdb:vortex-file-compressed 26179010 / 26501728 / -1.2% 34522596 / 35075063 / -1.6% 0.76 / 0.76 / +0.4%
tpcds_q58/duckdb:vortex-file-compressed 20527432 / 20471580 / +0.3% 31103209 / 30978872 / +0.4% 0.66 / 0.66 / -0.1%
tpcds_q59/duckdb:vortex-file-compressed 19925804 / 20144962 / -1.1% 28471209 / 28840927 / -1.3% 0.70 / 0.70 / +0.2%
tpcds_q60/duckdb:vortex-file-compressed 18886172 / 18663288 / +1.2% 29588216 / 29105972 / +1.7% 0.64 / 0.64 / -0.5%
tpcds_q61/duckdb:vortex-file-compressed 24911653 / 25454070 / -2.1% 34764361 / 35467454 / -2.0% 0.72 / 0.72 / -0.2%
tpcds_q62/duckdb:vortex-file-compressed 11977108 / 12066966 / -0.7% 18931585 / 19142635 / -1.1% 0.63 / 0.63 / +0.4%
tpcds_q63/duckdb:vortex-file-compressed 10878102 / 11315712 / -3.9% 19759199 / 20240474 / -2.4% 0.55 / 0.56 / -1.5%
tpcds_q64/duckdb:vortex-file-compressed 50513092 / 50298476 / +0.4% 66143641 / 68843128 / -3.9% 0.76 / 0.73 / +4.5%
tpcds_q65/duckdb:vortex-file-compressed 13203640 / 13261522 / -0.4% 23389719 / 23640025 / -1.1% 0.56 / 0.56 / +0.6%
tpcds_q66/duckdb:vortex-file-compressed 29792838 / 29356364 / +1.5% 38907677 / 38953267 / -0.1% 0.77 / 0.75 / +1.6%
tpcds_q67/duckdb:vortex-file-compressed 58623420 / 58699637 / -0.1% 67489411 / 67480625 / +0.0% 0.87 / 0.87 / -0.1%
tpcds_q68/duckdb:vortex-file-compressed 19539748 / 19803436 / -1.3% 28068277 / 28546143 / -1.7% 0.70 / 0.69 / +0.3%
tpcds_q69/duckdb:vortex-file-compressed 23098637 / 23406440 / -1.3% 38161424 / 38019199 / +0.4% 0.61 / 0.62 / -1.7%
tpcds_q70/duckdb:vortex-file-compressed 15702131 / 16057534 / -2.2% 26821875 / 28434674 / -5.7% 0.59 / 0.56 / +3.7%
tpcds_q71/duckdb:vortex-file-compressed 12858929 / 13083326 / -1.7% 23793991 / 24266057 / -1.9% 0.54 / 0.54 / +0.2%
tpcds_q72/duckdb:vortex-file-compressed 53693742 / 53306598 / +0.7% 65494239 / 66841585 / -2.0% 0.82 / 0.80 / +2.8%
tpcds_q73/duckdb:vortex-file-compressed 11533524 / 12089608 / -4.6% 21250385 / 21036740 / +1.0% 0.54 / 0.57 / -5.6%
tpcds_q74/duckdb:vortex-file-compressed 26207156 / 26070268 / +0.5% 34300791 / 34365954 / -0.2% 0.76 / 0.76 / +0.7%
tpcds_q75/duckdb:vortex-file-compressed 28073668 / 28699944 / -2.2% 38425319 / 39734586 / -3.3% 0.73 / 0.72 / +1.2%
tpcds_q76/duckdb:vortex-file-compressed 13252828 / 13454318 / -1.5% 26217923 / 25508048 / +2.8% 0.51 / 0.53 / -4.2%
tpcds_q77/duckdb:vortex-file-compressed 21422816 / 21028818 / +1.9% 33769160 / 32628785 / +3.5% 0.63 / 0.64 / -1.6%
tpcds_q78/duckdb:vortex-file-compressed 43704620 / 43216690 / +1.1% 53637589 / 54126335 / -0.9% 0.81 / 0.80 / +2.1%
tpcds_q79/duckdb:vortex-file-compressed 13259328 / 13435902 / -1.3% 22240828 / 23432828 / -5.1% 0.60 / 0.57 / +4.0%
tpcds_q80/duckdb:vortex-file-compressed 37843766 / 37202952 / +1.7% 50508841 / 51588198 / -2.1% 0.75 / 0.72 / +3.9%
tpcds_q81/duckdb:vortex-file-compressed 21410422 / 21286061 / +0.6% 30141296 / 30091464 / +0.2% 0.71 / 0.71 / +0.4%
tpcds_q82/duckdb:vortex-file-compressed 9692960 / 9434022 / +2.7% 25788266 / 25789878 / -0.0% 0.38 / 0.37 / +2.8%
tpcds_q83/duckdb:vortex-file-compressed 18050802 / 18050168 / +0.0% 24976957 / 24595920 / +1.5% 0.72 / 0.73 / -1.5%
tpcds_q84/duckdb:vortex-file-compressed 15741464 / 15788435 / -0.3% 23846245 / 23186803 / +2.8% 0.66 / 0.68 / -3.1%
tpcds_q85/duckdb:vortex-file-compressed 24629850 / 24704460 / -0.3% 37422404 / 36707520 / +1.9% 0.66 / 0.67 / -2.2%
tpcds_q86/duckdb:vortex-file-compressed 9838940 / 9966084 / -1.3% 16391524 / 16937119 / -3.2% 0.60 / 0.59 / +2.0%
tpcds_q87/duckdb:vortex-file-compressed 25823346 / 26271254 / -1.7% 34052971 / 33892892 / +0.5% 0.76 / 0.78 / -2.2%
tpcds_q88/duckdb:vortex-file-compressed 31339779 / 31419104 / -0.3% 40105695 / 39845592 / +0.7% 0.78 / 0.79 / -0.9%
tpcds_q89/duckdb:vortex-file-compressed 12491962 / 12523714 / -0.3% 21990036 / 22366688 / -1.7% 0.57 / 0.56 / +1.5%
tpcds_q90/duckdb:vortex-file-compressed 8169636 / 8234150 / -0.8% 16201763 / 16219806 / -0.1% 0.50 / 0.51 / -0.7%
tpcds_q91/duckdb:vortex-file-compressed 14909708 / 14875414 / +0.2% 22535219 / 23432472 / -3.8% 0.66 / 0.63 / +4.2%
tpcds_q92/duckdb:vortex-file-compressed 12219895 / 12185658 / +0.3% 20620603 / 21289808 / -3.1% 0.59 / 0.57 / +3.5%
tpcds_q93/duckdb:vortex-file-compressed 10351945 / 10200146 / +1.5% 23866107 / 24307062 / -1.8% 0.43 / 0.42 / +3.4%
tpcds_q94/duckdb:vortex-file-compressed 22162710 / 22700503 / -2.4% 31918179 / 32522349 / -1.9% 0.69 / 0.70 / -0.5%
tpcds_q95/duckdb:vortex-file-compressed 63564527 / 63017334 / +0.9% 71550485 / 71429073 / +0.2% 0.89 / 0.88 / +0.7%
tpcds_q96/duckdb:vortex-file-compressed 6803724 / 7044906 / -3.4% 15926401 / 16074625 / -0.9% 0.43 / 0.44 / -2.5%
tpcds_q97/duckdb:vortex-file-compressed 22939070 / 23644552 / -3.0% 32501025 / 32299442 / +0.6% 0.71 / 0.73 / -3.6%
tpcds_q98/duckdb:vortex-file-compressed 11577500 / 11336208 / +2.1% 20339264 / 21107734 / -3.6% 0.57 / 0.54 / +6.0%
tpcds_q99/duckdb:vortex-file-compressed 14912908 / 15282436 / -2.4% 23248457 / 24087996 / -3.5% 0.64 / 0.63 / +1.1%
duckdb / parquet / ns (1.007x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24427815 / 24461415 / -0.1% 31783702 / 31889119 / -0.3% 0.77 / 0.77 / +0.2%
tpcds_q02/duckdb:parquet 18221686 / 18477803 / -1.4% 24495606 / 24904542 / -1.6% 0.74 / 0.74 / +0.3%
tpcds_q03/duckdb:parquet 9836060 / 9885219 / -0.5% 16008570 / 15716141 / +1.9% 0.61 / 0.63 / -2.3%
tpcds_q04/duckdb:parquet 117946690 / 118340878 / -0.3% 126256351 / 127118353 / -0.7% 0.93 / 0.93 / +0.3%
tpcds_q05/duckdb:parquet 28792596 / 28904132 / -0.4% 33849971 / 34074757 / -0.7% 0.85 / 0.85 / +0.3%
tpcds_q06/duckdb:parquet 27299078 / 26612744 / +2.6% 35839322 / 36038010 / -0.6% 0.76 / 0.74 / +3.1%
tpcds_q07/duckdb:parquet 33031368 / 30889214 / +6.9% 41505032 / 39478001 / +5.1% 0.80 / 0.78 / +1.7%
tpcds_q08/duckdb:parquet 20301234 / 20187230 / +0.6% 26684597 / 26525878 / +0.6% 0.76 / 0.76 / -0.0%
tpcds_q09/duckdb:parquet 27019888 / 27513464 / -1.8% 30622827 / 31524831 / -2.9% 0.88 / 0.87 / +1.1%
tpcds_q10/duckdb:parquet 33154632 / 33222414 / -0.2% 41029609 / 40837713 / +0.5% 0.81 / 0.81 / -0.7%
tpcds_q11/duckdb:parquet 68792138 / 68731161 / +0.1% 76528168 / 76879564 / -0.5% 0.90 / 0.89 / +0.5%
tpcds_q12/duckdb:parquet 14339906 / 14144158 / +1.4% 19534898 / 19819277 / -1.4% 0.73 / 0.71 / +2.9%
tpcds_q13/duckdb:parquet 31939855 / 31292196 / +2.1% 40371545 / 40289029 / +0.2% 0.79 / 0.78 / +1.9%
tpcds_q14/duckdb:parquet 64670632 / 64338646 / +0.5% 73966276 / 71335260 / +3.7% 0.87 / 0.90 / -3.1%
tpcds_q15/duckdb:parquet 16777090 / 17339696 / -3.2% 23367850 / 23248232 / +0.5% 0.72 / 0.75 / -3.7%
tpcds_q16/duckdb:parquet 30424393 / 30578287 / -0.5% 37714125 / 37670788 / +0.1% 0.81 / 0.81 / -0.6%
tpcds_q17/duckdb:parquet 34973092 / 35393214 / -1.2% 41217123 / 41074208 / +0.3% 0.85 / 0.86 / -1.5%
tpcds_q18/duckdb:parquet 48604602 / 47513666 / +2.3% 55864770 / 55915480 / -0.1% 0.87 / 0.85 / +2.4%
tpcds_q19/duckdb:parquet 18972826 / 18908272 / +0.3% 26383985 / 25869161 / +2.0% 0.72 / 0.73 / -1.6%
tpcds_q20/duckdb:parquet 15062647 / 15117726 / -0.4% 20322768 / 20319039 / +0.0% 0.74 / 0.74 / -0.4%
tpcds_q21/duckdb:parquet 10768600 / 10958786 / -1.7% 16762864 / 16915770 / -0.9% 0.64 / 0.65 / -0.8%
tpcds_q22/duckdb:parquet 20933878 / 21167452 / -1.1% 27085059 / 27090109 / -0.0% 0.77 / 0.78 / -1.1%
tpcds_q23/duckdb:parquet 42433292 / 42076472 / +0.8% 48052627 / 50375183 / -4.6% 0.88 / 0.84 / +5.7%
tpcds_q24/duckdb:parquet 30684228 / 30720912 / -0.1% 36957164 / 36885762 / +0.2% 0.83 / 0.83 / -0.3%
tpcds_q25/duckdb:parquet 31056386 / 30979612 / +0.2% 37690746 / 38374618 / -1.8% 0.82 / 0.81 / +2.1%
tpcds_q26/duckdb:parquet 29440530 / 29260556 / +0.6% 35694520 / 35609138 / +0.2% 0.82 / 0.82 / +0.4%
tpcds_q27/duckdb:parquet 33891984 / 33134471 / +2.3% 42599613 / 43669624 / -2.5% 0.80 / 0.76 / +4.9%
tpcds_q28/duckdb:parquet 26059346 / 26638018 / -2.2% 34421574 / 32338357 / +6.4% 0.76 / 0.82 / -8.1%
tpcds_q29/duckdb:parquet 32548546 / 32629098 / -0.2% 40544540 / 40449665 / +0.2% 0.80 / 0.81 / -0.5%
tpcds_q30/duckdb:parquet 36516184 / 36216204 / +0.8% 45660385 / 44941640 / +1.6% 0.80 / 0.81 / -0.8%
tpcds_q31/duckdb:parquet 37487328 / 36054844 / +4.0% 43072853 / 43183235 / -0.3% 0.87 / 0.83 / +4.2%
tpcds_q32/duckdb:parquet 14573056 / 14508078 / +0.4% 21519049 / 21278004 / +1.1% 0.68 / 0.68 / -0.7%
tpcds_q33/duckdb:parquet 24192212 / 23632444 / +2.4% 29417290 / 29707542 / -1.0% 0.82 / 0.80 / +3.4%
tpcds_q34/duckdb:parquet 17383918 / 17264167 / +0.7% 24787327 / 24340721 / +1.8% 0.70 / 0.71 / -1.1%
tpcds_q35/duckdb:parquet 35805966 / 35442622 / +1.0% 45194738 / 44681249 / +1.1% 0.79 / 0.79 / -0.1%
tpcds_q36/duckdb:parquet 42237494 / 40503322 / +4.3% 48674096 / 48119798 / +1.2% 0.87 / 0.84 / +3.1%
tpcds_q37/duckdb:parquet 13313087 / 13397750 / -0.6% 19709126 / 20708401 / -4.8% 0.68 / 0.65 / +4.4%
tpcds_q38/duckdb:parquet 29989096 / 29717562 / +0.9% 34109056 / 34213448 / -0.3% 0.88 / 0.87 / +1.2%
tpcds_q39/duckdb:parquet 23847275 / 23829380 / +0.1% 30534520 / 30449128 / +0.3% 0.78 / 0.78 / -0.2%
tpcds_q40/duckdb:parquet 16453782 / 16238836 / +1.3% 21851484 / 22101711 / -1.1% 0.75 / 0.73 / +2.5%
tpcds_q41/duckdb:parquet 12351401 / 12288706 / +0.5% 18582002 / 18367545 / +1.2% 0.66 / 0.67 / -0.6%
tpcds_q42/duckdb:parquet 9720477 / 9703324 / +0.2% 15908673 / 16110618 / -1.3% 0.61 / 0.60 / +1.4%
tpcds_q43/duckdb:parquet 12532602 / 12636840 / -0.8% 18558533 / 19017623 / -2.4% 0.68 / 0.66 / +1.6%
tpcds_q44/duckdb:parquet 20406657 / 20847950 / -2.1% 27770638 / 27075740 / +2.6% 0.73 / 0.77 / -4.6%
tpcds_q45/duckdb:parquet 21406751 / 21206582 / +0.9% 28407685 / 28532503 / -0.4% 0.75 / 0.74 / +1.4%
tpcds_q46/duckdb:parquet 37377041 / 36380140 / +2.7% 44481685 / 44539173 / -0.1% 0.84 / 0.82 / +2.9%
tpcds_q47/duckdb:parquet 34961147 / 34586680 / +1.1% 41879211 / 42107682 / -0.5% 0.83 / 0.82 / +1.6%
tpcds_q48/duckdb:parquet 29402831 / 30210846 / -2.7% 37723056 / 39878588 / -5.4% 0.78 / 0.76 / +2.9%
tpcds_q49/duckdb:parquet 29356216 / 30182184 / -2.7% 37620045 / 38576647 / -2.5% 0.78 / 0.78 / -0.3%
tpcds_q50/duckdb:parquet 20790795 / 19863609 / +4.7% 26363896 / 25976470 / +1.5% 0.79 / 0.76 / +3.1%
tpcds_q51/duckdb:parquet 52599014 / 52434272 / +0.3% 61757605 / 60969027 / +1.3% 0.85 / 0.86 / -1.0%
tpcds_q52/duckdb:parquet 9705328 / 9779850 / -0.8% 15821291 / 15736745 / +0.5% 0.61 / 0.62 / -1.3%
tpcds_q53/duckdb:parquet 14163488 / 13933530 / +1.7% 21311908 / 21080535 / +1.1% 0.66 / 0.66 / +0.5%
tpcds_q54/duckdb:parquet 25655765 / 25205726 / +1.8% 32664672 / 32379265 / +0.9% 0.79 / 0.78 / +0.9%
tpcds_q55/duckdb:parquet 9687961 / 9660020 / +0.3% 15675995 / 15334710 / +2.2% 0.62 / 0.63 / -1.9%
tpcds_q56/duckdb:parquet 26823644 / 26182610 / +2.4% 31514814 / 30957666 / +1.8% 0.85 / 0.85 / +0.6%
tpcds_q57/duckdb:parquet 31060317 / 30862125 / +0.6% 36149369 / 36547991 / -1.1% 0.86 / 0.84 / +1.8%
tpcds_q58/duckdb:parquet 24527398 / 24194040 / +1.4% 30384761 / 30112757 / +0.9% 0.81 / 0.80 / +0.5%
tpcds_q59/duckdb:parquet 23636656 / 23510052 / +0.5% 29905380 / 29836645 / +0.2% 0.79 / 0.79 / +0.3%
tpcds_q60/duckdb:parquet 26817956 / 26534511 / +1.1% 32978721 / 32916450 / +0.2% 0.81 / 0.81 / +0.9%
tpcds_q61/duckdb:parquet 26120779 / 24342124 / +7.3% 29939984 / 29132643 / +2.8% 0.87 / 0.84 / +4.4%
tpcds_q62/duckdb:parquet 13187944 / 13237418 / -0.4% 18462011 / 18208809 / +1.4% 0.71 / 0.73 / -1.7%
tpcds_q63/duckdb:parquet 13515708 / 13446420 / +0.5% 20688462 / 20085179 / +3.0% 0.65 / 0.67 / -2.4%
tpcds_q64/duckdb:parquet 71775772 / 71414432 / +0.5% 82281608 / 83765544 / -1.8% 0.87 / 0.85 / +2.3%
tpcds_q65/duckdb:parquet 20266977 / 19600975 / +3.4% 26067820 / 25574005 / +1.9% 0.78 / 0.77 / +1.4%
tpcds_q66/duckdb:parquet 35472074 / 35508789 / -0.1% 42153231 / 42329909 / -0.4% 0.84 / 0.84 / +0.3%
tpcds_q67/duckdb:parquet 61649096 / 64194316 / -4.0% 67917216 / 68576216 / -1.0% 0.91 / 0.94 / -3.0%
tpcds_q68/duckdb:parquet 31821076 / 28915509 / +10.0% 🔴 37407886 / 37384155 / +0.1% 0.85 / 0.77 / +10.0%
tpcds_q69/duckdb:parquet 26532774 / 26301866 / +0.9% 35640381 / 34493925 / +3.3% 0.74 / 0.76 / -2.4%
tpcds_q70/duckdb:parquet 21073836 / 19675632 / +7.1% 27759332 / 27386182 / +1.4% 0.76 / 0.72 / +5.7%
tpcds_q71/duckdb:parquet 17380943 / 17448006 / -0.4% 24190144 / 23990855 / +0.8% 0.72 / 0.73 / -1.2%
tpcds_q72/duckdb:parquet 54891094 / 54660460 / +0.4% 62254325 / 62275059 / -0.0% 0.88 / 0.88 / +0.5%
tpcds_q73/duckdb:parquet 15226972 / 15029432 / +1.3% 22073042 / 22152164 / -0.4% 0.69 / 0.68 / +1.7%
tpcds_q74/duckdb:parquet 83720825 / 84385634 / -0.8% 92049729 / 92185818 / -0.1% 0.91 / 0.92 / -0.6%
tpcds_q75/duckdb:parquet 44670941 / 45624206 / -2.1% 51722301 / 51356188 / +0.7% 0.86 / 0.89 / -2.8%
tpcds_q76/duckdb:parquet 19709696 / 18870968 / +4.4% 24078442 / 24356332 / -1.1% 0.82 / 0.77 / +5.6%
tpcds_q77/duckdb:parquet 25782558 / 24975692 / +3.2% 32505009 / 32645863 / -0.4% 0.79 / 0.77 / +3.7%
tpcds_q78/duckdb:parquet 78984354 / 78898743 / +0.1% 86945534 / 87809925 / -1.0% 0.91 / 0.90 / +1.1%
tpcds_q79/duckdb:parquet 23294016 / 22444963 / +3.8% 29608373 / 29362751 / +0.8% 0.79 / 0.76 / +2.9%
tpcds_q80/duckdb:parquet 36852740 / 36329628 / +1.4% 44705939 / 45211720 / -1.1% 0.82 / 0.80 / +2.6%
tpcds_q81/duckdb:parquet 36927613 / 36806600 / +0.3% 45578340 / 45327130 / +0.6% 0.81 / 0.81 / -0.2%
tpcds_q82/duckdb:parquet 13780624 / 13701072 / +0.6% 20992845 / 20843699 / +0.7% 0.66 / 0.66 / -0.1%
tpcds_q83/duckdb:parquet 20480434 / 20663900 / -0.9% 25475415 / 25360106 / +0.5% 0.80 / 0.81 / -1.3%
tpcds_q84/duckdb:parquet 23309822 / 23496624 / -0.8% 29190745 / 28978214 / +0.7% 0.80 / 0.81 / -1.5%
tpcds_q85/duckdb:parquet 33299305 / 32590619 / +2.2% 40133897 / 39990406 / +0.4% 0.83 / 0.81 / +1.8%
tpcds_q86/duckdb:parquet 12009128 / 12013802 / -0.0% 17501844 / 17020865 / +2.8% 0.69 / 0.71 / -2.8%
tpcds_q87/duckdb:parquet 31538521 / 31554158 / -0.0% 35678232 / 35597054 / +0.2% 0.88 / 0.89 / -0.3%
tpcds_q88/duckdb:parquet 38427526 / 39290797 / -2.2% 46716864 / 45373845 / +3.0% 0.82 / 0.87 / -5.0%
tpcds_q89/duckdb:parquet 14418532 / 14373810 / +0.3% 21992604 / 21425400 / +2.6% 0.66 / 0.67 / -2.3%
tpcds_q90/duckdb:parquet 10329962 / 10363688 / -0.3% 15532705 / 15705175 / -1.1% 0.67 / 0.66 / +0.8%
tpcds_q91/duckdb:parquet 21350556 / 21451967 / -0.5% 29338387 / 28956635 / +1.3% 0.73 / 0.74 / -1.8%
tpcds_q92/duckdb:parquet 15823255 / 15754876 / +0.4% 22250520 / 23375593 / -4.8% 0.71 / 0.67 / +5.5%
tpcds_q93/duckdb:parquet 14386458 / 14160048 / +1.6% 20759802 / 20900109 / -0.7% 0.69 / 0.68 / +2.3%
tpcds_q94/duckdb:parquet 25803033 / 25906744 / -0.4% 33199175 / 33051190 / +0.4% 0.78 / 0.78 / -0.8%
tpcds_q95/duckdb:parquet 43920020 / 44138026 / -0.5% 49866195 / 49404315 / +0.9% 0.88 / 0.89 / -1.4%
tpcds_q96/duckdb:parquet 8494222 / 8380358 / +1.4% 14026920 / 14018596 / +0.1% 0.61 / 0.60 / +1.3%
tpcds_q97/duckdb:parquet 27562481 / 27546754 / +0.1% 34806765 / 34328255 / +1.4% 0.79 / 0.80 / -1.3%
tpcds_q98/duckdb:parquet 16764571 / 16864316 / -0.6% 23871950 / 23676181 / +0.8% 0.70 / 0.71 / -1.4%
tpcds_q99/duckdb:parquet 19163453 / 19262517 / -0.5% 25145070 / 25183158 / -0.2% 0.76 / 0.76 / -0.4%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 7dcaf561 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-2.7%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.988x ➖ · cold 1.027x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.017x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.975x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 89023162 / 89255051 / -0.3% 142221951 / 151798817 / -6.3% 0.63 / 0.59 / +6.5%
tpch_q02/datafusion:vortex-file-compressed 64383842 / 65015788 / -1.0% 98141732 / 94942848 / +3.4% 0.66 / 0.68 / -4.2%
tpch_q03/datafusion:vortex-file-compressed 64032977 / 63658261 / +0.6% 122219313 / 111980694 / +9.1% 0.52 / 0.57 / -7.8%
tpch_q04/datafusion:vortex-file-compressed 34153987 / 34921471 / -2.2% 76267719 / 74731673 / +2.1% 0.45 / 0.47 / -4.2%
tpch_q05/datafusion:vortex-file-compressed 114613746 / 118970563 / -3.7% 172840482 / 186045364 / -7.1% 0.66 / 0.64 / +3.7%
tpch_q06/datafusion:vortex-file-compressed 9734042 / 10394960 / -6.4% 63135879 / 58729342 / +7.5% 0.15 / 0.18 / -12.9%
tpch_q07/datafusion:vortex-file-compressed 133971465 / 131980165 / +1.5% 212002555 / 199639612 / +6.2% 0.63 / 0.66 / -4.4%
tpch_q08/datafusion:vortex-file-compressed 139878146 / 142366362 / -1.7% 209441020 / 219277583 / -4.5% 0.67 / 0.65 / +2.9%
tpch_q09/datafusion:vortex-file-compressed 177281996 / 187171657 / -5.3% 249466551 / 257992349 / -3.3% 0.71 / 0.73 / -2.0%
tpch_q10/datafusion:vortex-file-compressed 69394073 / 70744077 / -1.9% 140639423 / 137653868 / +2.2% 0.49 / 0.51 / -4.0%
tpch_q11/datafusion:vortex-file-compressed 42945070 / 43769055 / -1.9% 71408069 / 70094330 / +1.9% 0.60 / 0.62 / -3.7%
tpch_q12/datafusion:vortex-file-compressed 34292744 / 35277279 / -2.8% 77513556 / 79113006 / -2.0% 0.44 / 0.45 / -0.8%
tpch_q13/datafusion:vortex-file-compressed 48619636 / 48858778 / -0.5% 82339078 / 83565410 / -1.5% 0.59 / 0.58 / +1.0%
tpch_q14/datafusion:vortex-file-compressed 21436811 / 21868695 / -2.0% 93215440 / 86598582 / +7.6% 0.23 / 0.25 / -8.9%
tpch_q15/datafusion:vortex-file-compressed 33777226 / 33975185 / -0.6% 94111862 / 92668034 / +1.6% 0.36 / 0.37 / -2.1%
tpch_q16/datafusion:vortex-file-compressed 36774265 / 37287766 / -1.4% 69949639 / 67877977 / +3.1% 0.53 / 0.55 / -4.3%
tpch_q17/datafusion:vortex-file-compressed 170449443 / 175172740 / -2.7% 216349787 / 220666595 / -2.0% 0.79 / 0.79 / -0.8%
tpch_q18/datafusion:vortex-file-compressed 197250069 / 206146884 / -4.3% 257045769 / 273649921 / -6.1% 0.77 / 0.75 / +1.9%
tpch_q19/datafusion:vortex-file-compressed 26408124 / 30422100 / -13.2% 🟢 85061166 / 92046105 / -7.6% 0.31 / 0.33 / -6.1%
tpch_q20/datafusion:vortex-file-compressed 59700005 / 61082053 / -2.3% 121452513 / 118547042 / +2.5% 0.49 / 0.52 / -4.6%
tpch_q21/datafusion:vortex-file-compressed 176155859 / 178607107 / -1.4% 238060210 / 241924423 / -1.6% 0.74 / 0.74 / +0.2%
tpch_q22/datafusion:vortex-file-compressed 24849956 / 24864567 / -0.1% 53419889 / 53580925 / -0.3% 0.47 / 0.46 / +0.2%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87359458 / 87368696 / -0.0% 126859282 / 127861995 / -0.8% 0.69 / 0.68 / +0.8%
tpch_q02/datafusion:parquet 175855902 / 174083826 / +1.0% 201316045 / 198946077 / +1.2% 0.87 / 0.88 / -0.2%
tpch_q03/datafusion:parquet 137025126 / 137844778 / -0.6% 184660171 / 183410886 / +0.7% 0.74 / 0.75 / -1.3%
tpch_q04/datafusion:parquet 59550354 / 58571544 / +1.7% 95318552 / 92920319 / +2.6% 0.62 / 0.63 / -0.9%
tpch_q05/datafusion:parquet 170008481 / 169683774 / +0.2% 222663082 / 224735109 / -0.9% 0.76 / 0.76 / +1.1%
tpch_q06/datafusion:parquet 37590405 / 37122976 / +1.3% 78023615 / 74947577 / +4.1% 0.48 / 0.50 / -2.7%
tpch_q07/datafusion:parquet 216580988 / 219518387 / -1.3% 271535414 / 275445618 / -1.4% 0.80 / 0.80 / +0.1%
tpch_q08/datafusion:parquet 222880525 / 222240942 / +0.3% 287494757 / 291393698 / -1.3% 0.78 / 0.76 / +1.6%
tpch_q09/datafusion:parquet 314928773 / 315267250 / -0.1% 384249409 / 378803120 / +1.4% 0.82 / 0.83 / -1.5%
tpch_q10/datafusion:parquet 320782992 / 321445702 / -0.2% 384689998 / 378830252 / +1.5% 0.83 / 0.85 / -1.7%
tpch_q11/datafusion:parquet 126388697 / 126573780 / -0.1% 149587733 / 151706161 / -1.4% 0.84 / 0.83 / +1.3%
tpch_q12/datafusion:parquet 84345933 / 84151856 / +0.2% 122084699 / 119202767 / +2.4% 0.69 / 0.71 / -2.1%
tpch_q13/datafusion:parquet 216629498 / 216495289 / +0.1% 248608810 / 244560647 / +1.7% 0.87 / 0.89 / -1.6%
tpch_q14/datafusion:parquet 87792466 / 88496640 / -0.8% 196584135 / 201728581 / -2.6% 0.45 / 0.44 / +1.8%
tpch_q15/datafusion:parquet 106534371 / 106076789 / +0.4% 157009085 / 155328519 / +1.1% 0.68 / 0.68 / -0.6%
tpch_q16/datafusion:parquet 98101798 / 95964632 / +2.2% 123146600 / 120010701 / +2.6% 0.80 / 0.80 / -0.4%
tpch_q17/datafusion:parquet 212568233 / 213016847 / -0.2% 263745922 / 258511536 / +2.0% 0.81 / 0.82 / -2.2%
tpch_q18/datafusion:parquet 269160834 / 271451611 / -0.8% 319200608 / 314651552 / +1.4% 0.84 / 0.86 / -2.3%
tpch_q19/datafusion:parquet 108861254 / 108017781 / +0.8% 172894044 / 169517847 / +2.0% 0.63 / 0.64 / -1.2%
tpch_q20/datafusion:parquet 189645058 / 190210191 / -0.3% 253397407 / 240188488 / +5.5% 0.75 / 0.79 / -5.5%
tpch_q21/datafusion:parquet 246141871 / 244828138 / +0.5% 315860403 / 308775289 / +2.3% 0.78 / 0.79 / -1.7%
tpch_q22/datafusion:parquet 153812031 / 153559494 / +0.2% 176849345 / 178194678 / -0.8% 0.87 / 0.86 / +0.9%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33739054 / 34628583 / -2.6% 68772254 / 63148371 / +8.9% 0.49 / 0.55 / -10.5%
tpch_q02/duckdb:vortex-file-compressed 28555873 / 28265284 / +1.0% 43097728 / 42869080 / +0.5% 0.66 / 0.66 / +0.5%
tpch_q03/duckdb:vortex-file-compressed 53159507 / 52134304 / +2.0% 103341819 / 97373188 / +6.1% 0.51 / 0.54 / -3.9%
tpch_q04/duckdb:vortex-file-compressed 51406726 / 50388682 / +2.0% 89272812 / 82805613 / +7.8% 0.58 / 0.61 / -5.4%
tpch_q05/duckdb:vortex-file-compressed 67918047 / 69552039 / -2.3% 112669037 / 105896848 / +6.4% 0.60 / 0.66 / -8.2%
tpch_q06/duckdb:vortex-file-compressed 15424819 / 15655028 / -1.5% 52932295 / 49233880 / +7.5% 0.29 / 0.32 / -8.4%
tpch_q07/duckdb:vortex-file-compressed 55685776 / 55924649 / -0.4% 115409717 / 102703022 / +12.4% 🔴 0.48 / 0.54 / -11.4%
tpch_q08/duckdb:vortex-file-compressed 87815112 / 87648586 / +0.2% 138250133 / 128820535 / +7.3% 0.64 / 0.68 / -6.6%
tpch_q09/duckdb:vortex-file-compressed 103511287 / 101895414 / +1.6% 156884830 / 153843362 / +2.0% 0.66 / 0.66 / -0.4%
tpch_q10/duckdb:vortex-file-compressed 94968121 / 95578746 / -0.6% 146997321 / 138864358 / +5.9% 0.65 / 0.69 / -6.1%
tpch_q11/duckdb:vortex-file-compressed 13477452 / 13359125 / +0.9% 29776335 / 29133955 / +2.2% 0.45 / 0.46 / -1.3%
tpch_q12/duckdb:vortex-file-compressed 44053341 / 44778474 / -1.6% 83935623 / 80033923 / +4.9% 0.52 / 0.56 / -6.2%
tpch_q13/duckdb:vortex-file-compressed 72397540 / 73185545 / -1.1% 100436240 / 95541761 / +5.1% 0.72 / 0.77 / -5.9%
tpch_q14/duckdb:vortex-file-compressed 28599407 / 28694401 / -0.3% 74095817 / 69184778 / +7.1% 0.39 / 0.41 / -6.9%
tpch_q15/duckdb:vortex-file-compressed 25175286 / 24917046 / +1.0% 62961325 / 61375732 / +2.6% 0.40 / 0.41 / -1.5%
tpch_q16/duckdb:vortex-file-compressed 48664024 / 47849508 / +1.7% 59614574 / 58544628 / +1.8% 0.82 / 0.82 / -0.1%
tpch_q17/duckdb:vortex-file-compressed 34553196 / 35386705 / -2.4% 70131054 / 65592778 / +6.9% 0.49 / 0.54 / -8.7%
tpch_q18/duckdb:vortex-file-compressed 107215105 / 105387928 / +1.7% 121402057 / 120554783 / +0.7% 0.88 / 0.87 / +1.0%
tpch_q19/duckdb:vortex-file-compressed 27553964 / 27879632 / -1.2% 75882676 / 72375475 / +4.8% 0.36 / 0.39 / -5.7%
tpch_q20/duckdb:vortex-file-compressed 41943652 / 41873332 / +0.2% 94219265 / 89530338 / +5.2% 0.45 / 0.47 / -4.8%
tpch_q21/duckdb:vortex-file-compressed 96896898 / 96352501 / +0.6% 152934305 / 143914571 / +6.3% 0.63 / 0.67 / -5.4%
tpch_q22/duckdb:vortex-file-compressed 33253150 / 32234491 / +3.2% 50196569 / 48211625 / +4.1% 0.66 / 0.67 / -0.9%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 69048473 / 68884852 / +0.2% 90722536 / 90032929 / +0.8% 0.76 / 0.77 / -0.5%
tpch_q02/duckdb:parquet 87894523 / 87634295 / +0.3% 99382624 / 98800141 / +0.6% 0.88 / 0.89 / -0.3%
tpch_q03/duckdb:parquet 111152058 / 111393685 / -0.2% 143142626 / 143939319 / -0.6% 0.78 / 0.77 / +0.3%
tpch_q04/duckdb:parquet 76414274 / 78761710 / -3.0% 101622703 / 96907681 / +4.9% 0.75 / 0.81 / -7.5%
tpch_q05/duckdb:parquet 124100689 / 125473048 / -1.1% 158401938 / 157708809 / +0.4% 0.78 / 0.80 / -1.5%
tpch_q06/duckdb:parquet 36095080 / 36143926 / -0.1% 64827648 / 57665594 / +12.4% 🔴 0.56 / 0.63 / -11.2%
tpch_q07/duckdb:parquet 119513874 / 117157091 / +2.0% 156119111 / 155070011 / +0.7% 0.77 / 0.76 / +1.3%
tpch_q08/duckdb:parquet 150418029 / 149051786 / +0.9% 196661764 / 190406433 / +3.3% 0.76 / 0.78 / -2.3%
tpch_q09/duckdb:parquet 237854046 / 241388962 / -1.5% 283454930 / 284144788 / -0.2% 0.84 / 0.85 / -1.2%
tpch_q10/duckdb:parquet 314896888 / 316818482 / -0.6% 343374642 / 340358055 / +0.9% 0.92 / 0.93 / -1.5%
tpch_q11/duckdb:parquet 44015898 / 44058957 / -0.1% 51189598 / 51642228 / -0.9% 0.86 / 0.85 / +0.8%
tpch_q12/duckdb:parquet 72909346 / 72613282 / +0.4% 94338124 / 92369855 / +2.1% 0.77 / 0.79 / -1.7%
tpch_q13/duckdb:parquet 294065682 / 295602456 / -0.5% 310193074 / 311037836 / -0.3% 0.95 / 0.95 / -0.2%
tpch_q14/duckdb:parquet 103058631 / 102641437 / +0.4% 149702744 / 137537356 / +8.8% 0.69 / 0.75 / -7.8%
tpch_q15/duckdb:parquet 58515659 / 58562796 / -0.1% 87493208 / 87341612 / +0.2% 0.67 / 0.67 / -0.3%
tpch_q16/duckdb:parquet 101904572 / 101516941 / +0.4% 109005067 / 107924096 / +1.0% 0.93 / 0.94 / -0.6%
tpch_q17/duckdb:parquet 82353977 / 82982497 / -0.8% 132102077 / 116477291 / +13.4% 🔴 0.62 / 0.71 / -12.5%
tpch_q18/duckdb:parquet 156867374 / 162781413 / -3.6% 171482099 / 176107872 / -2.6% 0.91 / 0.92 / -1.0%
tpch_q19/duckdb:parquet 100157855 / 100644327 / -0.5% 133679171 / 129160526 / +3.5% 0.75 / 0.78 / -3.8%
tpch_q20/duckdb:parquet 148300111 / 147762874 / +0.4% 195377078 / 181776837 / +7.5% 0.76 / 0.81 / -6.6%
tpch_q21/duckdb:parquet 253835916 / 256842317 / -1.2% 270683554 / 275377695 / -1.7% 0.94 / 0.93 / +0.5%
tpch_q22/duckdb:parquet 170069098 / 169184411 / +0.5% 183962210 / 183870885 / +0.0% 0.92 / 0.92 / +0.5%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 7dcaf561 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+1.7%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.025x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.970x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.013x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6907822 / 6914164 / -0.1% 17270969 / 15894016 / +8.7% 0.40 / 0.44 / -8.1%
fineweb_q01/datafusion:vortex-file-compressed 9369721 / 8207537 / +14.2% 🔴 42794097 / 42273090 / +1.2% 0.22 / 0.19 / +12.8%
fineweb_q02/datafusion:vortex-file-compressed 9269546 / 9825386 / -5.7% 51210457 / 45991505 / +11.3% 🔴 0.18 / 0.21 / -15.3%
fineweb_q03/datafusion:vortex-file-compressed 20156939 / 19985364 / +0.9% 105411979 / 112849457 / -6.6% 0.19 / 0.18 / +8.0%
fineweb_q04/datafusion:vortex-file-compressed 66783490 / 67072209 / -0.4% 146238089 / 154793659 / -5.5% 0.46 / 0.43 / +5.4%
fineweb_q05/datafusion:vortex-file-compressed 66848301 / 67066206 / -0.3% 143272523 / 152013803 / -5.8% 0.47 / 0.44 / +5.8%
fineweb_q06/datafusion:vortex-file-compressed 19783496 / 19077528 / +3.7% 110881583 / 116530631 / -4.8% 0.18 / 0.16 / +9.0%
fineweb_q07/datafusion:vortex-file-compressed 19129742 / 19804552 / -3.4% 101905882 / 111729640 / -8.8% 0.19 / 0.18 / +5.9%
fineweb_q08/datafusion:vortex-file-compressed 9620990 / 9231922 / +4.2% 46673864 / 44729078 / +4.3% 0.21 / 0.21 / -0.1%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9187006 / 9298051 / -1.2% 33230630 / 32161720 / +3.3% 0.28 / 0.29 / -4.4%
fineweb_q01/datafusion:parquet 74284096 / 75948676 / -2.2% 152304403 / 158050833 / -3.6% 0.49 / 0.48 / +1.5%
fineweb_q02/datafusion:parquet 75415994 / 74828561 / +0.8% 153225707 / 169180315 / -9.4% 0.49 / 0.44 / +11.3%
fineweb_q03/datafusion:parquet 74400942 / 75375235 / -1.3% 155445215 / 164650672 / -5.6% 0.48 / 0.46 / +4.6%
fineweb_q04/datafusion:parquet 82277804 / 82536988 / -0.3% 154265707 / 162124376 / -4.8% 0.53 / 0.51 / +4.8%
fineweb_q05/datafusion:parquet 80339412 / 80616398 / -0.3% 148788322 / 162946673 / -8.7% 0.54 / 0.49 / +9.1%
fineweb_q06/datafusion:parquet 76401856 / 74993748 / +1.9% 154451727 / 167327373 / -7.7% 0.49 / 0.45 / +10.4%
fineweb_q07/datafusion:parquet 74516034 / 74703466 / -0.3% 151878132 / 161875074 / -6.2% 0.49 / 0.46 / +6.3%
fineweb_q08/datafusion:parquet 73446796 / 73652338 / -0.3% 147567864 / 166993254 / -11.6% 🟢 0.50 / 0.44 / +12.8%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2095252 / 1992354 / +5.2% 7251745 / 7167288 / +1.2% 0.29 / 0.28 / +3.9%
fineweb_q01/duckdb:vortex-file-compressed 9565361 / 9302676 / +2.8% 34018918 / 33383961 / +1.9% 0.28 / 0.28 / +0.9%
fineweb_q02/duckdb:vortex-file-compressed 10638544 / 11086372 / -4.0% 37013875 / 32959285 / +12.3% 🔴 0.29 / 0.34 / -14.6%
fineweb_q03/duckdb:vortex-file-compressed 19200903 / 20108287 / -4.5% 101814214 / 93189312 / +9.3% 0.19 / 0.22 / -12.6%
fineweb_q04/duckdb:vortex-file-compressed 65814269 / 67281247 / -2.2% 112100879 / 109561330 / +2.3% 0.59 / 0.61 / -4.4%
fineweb_q05/duckdb:vortex-file-compressed 66210242 / 66431544 / -0.3% 113914926 / 106341165 / +7.1% 0.58 / 0.62 / -7.0%
fineweb_q06/duckdb:vortex-file-compressed 18496833 / 19036190 / -2.8% 102653693 / 93820093 / +9.4% 0.18 / 0.20 / -11.2%
fineweb_q07/duckdb:vortex-file-compressed 19234020 / 18786800 / +2.4% 98286962 / 90565938 / +8.5% 0.20 / 0.21 / -5.7%
fineweb_q08/duckdb:vortex-file-compressed 5409836 / 5376968 / +0.6% 13545163 / 13261327 / +2.1% 0.40 / 0.41 / -1.5%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23718476 / 23973552 / -1.1% 30399469 / 28107016 / +8.2% 0.78 / 0.85 / -8.5%
fineweb_q01/duckdb:parquet 56406594 / 56632112 / -0.4% 80045697 / 75490626 / +6.0% 0.70 / 0.75 / -6.1%
fineweb_q02/duckdb:parquet 61083859 / 61085010 / -0.0% 81985058 / 84868736 / -3.4% 0.75 / 0.72 / +3.5%
fineweb_q03/duckdb:parquet 119448910 / 119366500 / +0.1% 178008710 / 185364019 / -4.0% 0.67 / 0.64 / +4.2%
fineweb_q04/duckdb:parquet 162376206 / 161989686 / +0.2% 212999700 / 214789038 / -0.8% 0.76 / 0.75 / +1.1%
fineweb_q05/duckdb:parquet 160634188 / 160108938 / +0.3% 207020468 / 209160474 / -1.0% 0.78 / 0.77 / +1.4%
fineweb_q06/duckdb:parquet 88274445 / 87576319 / +0.8% 148857394 / 148207180 / +0.4% 0.59 / 0.59 / +0.4%
fineweb_q07/duckdb:parquet 91853848 / 92192530 / -0.4% 147272053 / 148218580 / -0.6% 0.62 / 0.62 / +0.3%
fineweb_q08/duckdb:parquet 28965690 / 30171232 / -4.0% 30874125 / 31697555 / -2.6% 0.94 / 0.95 / -1.4%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 7dcaf561 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.1%
Engines: DataFusion No clear signal (-3.7%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.981x ➖ · cold 1.015x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.009x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.965x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15213774 / 15244796 / -0.2% 41826565 / 43107623 / -3.0% 0.36 / 0.35 / +2.9%
tpch_q02/datafusion:vortex-file-compressed 16813447 / 16785369 / +0.2% 37899750 / 35606088 / +6.4% 0.44 / 0.47 / -5.9%
tpch_q03/datafusion:vortex-file-compressed 19420176 / 19704057 / -1.4% 48712905 / 46014863 / +5.9% 0.40 / 0.43 / -6.9%
tpch_q04/datafusion:vortex-file-compressed 9836366 / 10379829 / -5.2% 36279455 / 32939078 / +10.1% 🔴 0.27 / 0.32 / -14.0%
tpch_q05/datafusion:vortex-file-compressed 36763114 / 37109828 / -0.9% 69114356 / 66535663 / +3.9% 0.53 / 0.56 / -4.6%
tpch_q06/datafusion:vortex-file-compressed 4188604 / 5996442 / -30.1% 🟢 27301528 / 25090471 / +8.8% 0.15 / 0.24 / -35.8%
tpch_q07/datafusion:vortex-file-compressed 51824000 / 51590471 / +0.5% 81008088 / 75221258 / +7.7% 0.64 / 0.69 / -6.7%
tpch_q08/datafusion:vortex-file-compressed 51412241 / 51934499 / -1.0% 83793965 / 79965898 / +4.8% 0.61 / 0.65 / -5.5%
tpch_q09/datafusion:vortex-file-compressed 47752516 / 47546136 / +0.4% 80617791 / 79942083 / +0.8% 0.59 / 0.59 / -0.4%
tpch_q10/datafusion:vortex-file-compressed 17036815 / 17645205 / -3.4% 49851759 / 47530092 / +4.9% 0.34 / 0.37 / -7.9%
tpch_q11/datafusion:vortex-file-compressed 13923265 / 14039900 / -0.8% 33569839 / 33161470 / +1.2% 0.41 / 0.42 / -2.0%
tpch_q12/datafusion:vortex-file-compressed 18319193 / 18302956 / +0.1% 43938381 / 43729009 / +0.5% 0.42 / 0.42 / -0.4%
tpch_q13/datafusion:vortex-file-compressed 19675719 / 19620384 / +0.3% 39319211 / 41663145 / -5.6% 0.50 / 0.47 / +6.3%
tpch_q14/datafusion:vortex-file-compressed 14261584 / 14553341 / -2.0% 39867432 / 37184545 / +7.2% 0.36 / 0.39 / -8.6%
tpch_q15/datafusion:vortex-file-compressed 18355599 / 18610835 / -1.4% 44997295 / 43225258 / +4.1% 0.41 / 0.43 / -5.3%
tpch_q16/datafusion:vortex-file-compressed 18306959 / 18329773 / -0.1% 41741752 / 40570847 / +2.9% 0.44 / 0.45 / -2.9%
tpch_q17/datafusion:vortex-file-compressed 27785977 / 27783290 / +0.0% 59930395 / 58070075 / +3.2% 0.46 / 0.48 / -3.1%
tpch_q18/datafusion:vortex-file-compressed 35659792 / 36366608 / -1.9% 59075005 / 60484474 / -2.3% 0.60 / 0.60 / +0.4%
tpch_q19/datafusion:vortex-file-compressed 9928051 / 12404911 / -20.0% 🟢 39487430 / 37955343 / +4.0% 0.25 / 0.33 / -23.1%
tpch_q20/datafusion:vortex-file-compressed 20434260 / 20323772 / +0.5% 46280759 / 45113470 / +2.6% 0.44 / 0.45 / -2.0%
tpch_q21/datafusion:vortex-file-compressed 38679668 / 40850950 / -5.3% 69941205 / 69381261 / +0.8% 0.55 / 0.59 / -6.1%
tpch_q22/datafusion:vortex-file-compressed 10813994 / 10664079 / +1.4% 32333995 / 31422514 / +2.9% 0.33 / 0.34 / -1.5%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72275091 / 72197453 / +0.1% 89535103 / 88021582 / +1.7% 0.81 / 0.82 / -1.6%
tpch_q02/datafusion:parquet 76160611 / 76113619 / +0.1% 93384295 / 91783594 / +1.7% 0.82 / 0.83 / -1.7%
tpch_q03/datafusion:parquet 83814070 / 83587244 / +0.3% 105842798 / 104079904 / +1.7% 0.79 / 0.80 / -1.4%
tpch_q04/datafusion:parquet 40986575 / 41074548 / -0.2% 60142489 / 58708424 / +2.4% 0.68 / 0.70 / -2.6%
tpch_q05/datafusion:parquet 112296953 / 111873269 / +0.4% 142795271 / 138232292 / +3.3% 0.79 / 0.81 / -2.8%
tpch_q06/datafusion:parquet 32198046 / 32164141 / +0.1% 49147322 / 48132854 / +2.1% 0.66 / 0.67 / -2.0%
tpch_q07/datafusion:parquet 114707761 / 115287140 / -0.5% 143180400 / 138852302 / +3.1% 0.80 / 0.83 / -3.5%
tpch_q08/datafusion:parquet 120002293 / 119975551 / +0.0% 146303254 / 146061083 / +0.2% 0.82 / 0.82 / -0.1%
tpch_q09/datafusion:parquet 140246430 / 140206080 / +0.0% 169458723 / 167370100 / +1.2% 0.83 / 0.84 / -1.2%
tpch_q10/datafusion:parquet 107021282 / 106687730 / +0.3% 132007131 / 129115049 / +2.2% 0.81 / 0.83 / -1.9%
tpch_q11/datafusion:parquet 61138782 / 60132019 / +1.7% 81049129 / 80765575 / +0.4% 0.75 / 0.74 / +1.3%
tpch_q12/datafusion:parquet 65451161 / 65627851 / -0.3% 85925049 / 87684783 / -2.0% 0.76 / 0.75 / +1.8%
tpch_q13/datafusion:parquet 147248523 / 147425213 / -0.1% 166030667 / 165702279 / +0.2% 0.89 / 0.89 / -0.3%
tpch_q14/datafusion:parquet 47693797 / 47798012 / -0.2% 70419408 / 69229230 / +1.7% 0.68 / 0.69 / -1.9%
tpch_q15/datafusion:parquet 76057869 / 74426434 / +2.2% 95059187 / 92888867 / +2.3% 0.80 / 0.80 / -0.1%
tpch_q16/datafusion:parquet 43389574 / 43982597 / -1.3% 62467327 / 60662108 / +3.0% 0.69 / 0.73 / -4.2%
tpch_q17/datafusion:parquet 124269945 / 123982033 / +0.2% 149264216 / 146222630 / +2.1% 0.83 / 0.85 / -1.8%
tpch_q18/datafusion:parquet 124355681 / 123784690 / +0.5% 143033456 / 145985967 / -2.0% 0.87 / 0.85 / +2.5%
tpch_q19/datafusion:parquet 58686061 / 58291246 / +0.7% 83882987 / 82910665 / +1.2% 0.70 / 0.70 / -0.5%
tpch_q20/datafusion:parquet 78940550 / 78072120 / +1.1% 105404967 / 104292926 / +1.1% 0.75 / 0.75 / +0.0%
tpch_q21/datafusion:parquet 116771006 / 116406825 / +0.3% 142105507 / 140577249 / +1.1% 0.82 / 0.83 / -0.8%
tpch_q22/datafusion:parquet 51331069 / 51648092 / -0.6% 69598560 / 70957245 / -1.9% 0.74 / 0.73 / +1.3%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9855875 / 9331715 / +5.6% 20851042 / 22301445 / -6.5% 0.47 / 0.42 / +13.0%
tpch_q02/duckdb:vortex-file-compressed 15338057 / 15484601 / -0.9% 25718828 / 25552226 / +0.7% 0.60 / 0.61 / -1.6%
tpch_q03/duckdb:vortex-file-compressed 18924125 / 19032979 / -0.6% 36226135 / 34316634 / +5.6% 0.52 / 0.55 / -5.8%
tpch_q04/duckdb:vortex-file-compressed 12385431 / 12472751 / -0.7% 26548562 / 26219641 / +1.3% 0.47 / 0.48 / -1.9%
tpch_q05/duckdb:vortex-file-compressed 20395815 / 20655679 / -1.3% 36145010 / 36659669 / -1.4% 0.56 / 0.56 / +0.1%
tpch_q06/duckdb:vortex-file-compressed 4803745 / 4857931 / -1.1% 14046700 / 14308025 / -1.8% 0.34 / 0.34 / +0.7%
tpch_q07/duckdb:vortex-file-compressed 24413800 / 24022009 / +1.6% 41757363 / 42111704 / -0.8% 0.58 / 0.57 / +2.5%
tpch_q08/duckdb:vortex-file-compressed 21232071 / 20985996 / +1.2% 39485247 / 37397733 / +5.6% 0.54 / 0.56 / -4.2%
tpch_q09/duckdb:vortex-file-compressed 21506766 / 23200613 / -7.3% 38945660 / 39713549 / -1.9% 0.55 / 0.58 / -5.5%
tpch_q10/duckdb:vortex-file-compressed 22672505 / 22845856 / -0.8% 38607225 / 37304677 / +3.5% 0.59 / 0.61 / -4.1%
tpch_q11/duckdb:vortex-file-compressed 8205653 / 8326778 / -1.5% 17716918 / 17727782 / -0.1% 0.46 / 0.47 / -1.4%
tpch_q12/duckdb:vortex-file-compressed 14551001 / 14696796 / -1.0% 26077130 / 26761598 / -2.6% 0.56 / 0.55 / +1.6%
tpch_q13/duckdb:vortex-file-compressed 19703071 / 19458653 / +1.3% 32466373 / 31940922 / +1.6% 0.61 / 0.61 / -0.4%
tpch_q14/duckdb:vortex-file-compressed 11562709 / 11617118 / -0.5% 24908527 / 24005548 / +3.8% 0.46 / 0.48 / -4.1%
tpch_q15/duckdb:vortex-file-compressed 8981556 / 8531969 / +5.3% 20751341 / 19674383 / +5.5% 0.43 / 0.43 / -0.2%
tpch_q16/duckdb:vortex-file-compressed 16788972 / 16840450 / -0.3% 23309792 / 23631828 / -1.4% 0.72 / 0.71 / +1.1%
tpch_q17/duckdb:vortex-file-compressed 12353023 / 12519740 / -1.3% 27152857 / 28338798 / -4.2% 0.45 / 0.44 / +3.0%
tpch_q18/duckdb:vortex-file-compressed 24610788 / 24609179 / +0.0% 34654667 / 33693817 / +2.9% 0.71 / 0.73 / -2.8%
tpch_q19/duckdb:vortex-file-compressed 12087455 / 12334808 / -2.0% 25862240 / 30730234 / -15.8% 🟢 0.47 / 0.40 / +16.4%
tpch_q20/duckdb:vortex-file-compressed 14398573 / 14293355 / +0.7% 30952017 / 30174689 / +2.6% 0.47 / 0.47 / -1.8%
tpch_q21/duckdb:vortex-file-compressed 37496007 / 37652395 / -0.4% 57677641 / 58206800 / -0.9% 0.65 / 0.65 / +0.5%
tpch_q22/duckdb:vortex-file-compressed 16711722 / 16837835 / -0.7% 27610399 / 26922218 / +2.6% 0.61 / 0.63 / -3.2%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48455004 / 48307040 / +0.3% 55817204 / 54616876 / +2.2% 0.87 / 0.88 / -1.9%
tpch_q02/duckdb:parquet 48872210 / 48896101 / -0.0% 56318364 / 56077374 / +0.4% 0.87 / 0.87 / -0.5%
tpch_q03/duckdb:parquet 61040828 / 60904244 / +0.2% 69881692 / 68371951 / +2.2% 0.87 / 0.89 / -1.9%
tpch_q04/duckdb:parquet 35582217 / 35226993 / +1.0% 44300911 / 44130480 / +0.4% 0.80 / 0.80 / +0.6%
tpch_q05/duckdb:parquet 67999215 / 68007656 / -0.0% 79077341 / 77731599 / +1.7% 0.86 / 0.87 / -1.7%
tpch_q06/duckdb:parquet 22061600 / 21889190 / +0.8% 27599492 / 27655555 / -0.2% 0.80 / 0.79 / +1.0%
tpch_q07/duckdb:parquet 64548635 / 64584662 / -0.1% 74999285 / 73435438 / +2.1% 0.86 / 0.88 / -2.1%
tpch_q08/duckdb:parquet 76556796 / 76297906 / +0.3% 88202840 / 87034681 / +1.3% 0.87 / 0.88 / -1.0%
tpch_q09/duckdb:parquet 108774794 / 108722543 / +0.0% 121680087 / 120496821 / +1.0% 0.89 / 0.90 / -0.9%
tpch_q10/duckdb:parquet 106531897 / 106897948 / -0.3% 119803033 / 116850249 / +2.5% 0.89 / 0.91 / -2.8%
tpch_q11/duckdb:parquet 29874040 / 29838442 / +0.1% 35574761 / 35529130 / +0.1% 0.84 / 0.84 / -0.0%
tpch_q12/duckdb:parquet 38203863 / 38296481 / -0.2% 44807655 / 45197180 / -0.9% 0.85 / 0.85 / +0.6%
tpch_q13/duckdb:parquet 175972464 / 175842570 / +0.1% 182447634 / 182383123 / +0.0% 0.96 / 0.96 / +0.0%
tpch_q14/duckdb:parquet 43039276 / 43217986 / -0.4% 52682173 / 52537443 / +0.3% 0.82 / 0.82 / -0.7%
tpch_q15/duckdb:parquet 32997446 / 33055371 / -0.2% 42037931 / 41534637 / +1.2% 0.78 / 0.80 / -1.4%
tpch_q16/duckdb:parquet 48069462 / 48446976 / -0.8% 54010031 / 53452908 / +1.0% 0.89 / 0.91 / -1.8%
tpch_q17/duckdb:parquet 48600627 / 48382020 / +0.5% 59009206 / 57851431 / +2.0% 0.82 / 0.84 / -1.5%
tpch_q18/duckdb:parquet 75426284 / 75180930 / +0.3% 81801852 / 83106544 / -1.6% 0.92 / 0.90 / +1.9%
tpch_q19/duckdb:parquet 51426845 / 50581915 / +1.7% 56820263 / 60744521 / -6.5% 0.91 / 0.83 / +8.7%
tpch_q20/duckdb:parquet 64122063 / 64115182 / +0.0% 75883013 / 73707959 / +3.0% 0.85 / 0.87 / -2.9%
tpch_q21/duckdb:parquet 108374480 / 108525558 / -0.1% 118808788 / 116925506 / +1.6% 0.91 / 0.93 / -1.7%
tpch_q22/duckdb:parquet 51423533 / 51338913 / +0.2% 60078391 / 59925342 / +0.3% 0.86 / 0.86 / -0.1%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 7dcaf561 vs base 19dcd2f2
Vortex (geomean): hot 1.057x ➖ · cold 1.015x ➖


datafusion / vortex-file-compressed / ns (1.057x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44289148 / 44198107 / +0.2% 89740596 / 89439370 / +0.3% 0.49 / 0.49 / -0.1%
polarsignals_q01/datafusion:vortex-file-compressed 69155968 / 53423409 / +29.4% 🔴 117241796 / 135084640 / -13.2% 🟢 0.59 / 0.40 / +49.1%
polarsignals_q02/datafusion:vortex-file-compressed 14248427 / 11887196 / +19.9% 🔴 50788120 / 50980997 / -0.4% 0.28 / 0.23 / +20.3%
polarsignals_q03/datafusion:vortex-file-compressed 79883791 / 71391736 / +11.9% 🔴 119757283 / 117694461 / +1.8% 0.67 / 0.61 / +10.0%
polarsignals_q04/datafusion:vortex-file-compressed 9300203 / 9044253 / +2.8% 44860839 / 44519732 / +0.8% 0.21 / 0.20 / +2.0%
polarsignals_q05/datafusion:vortex-file-compressed 11747941 / 11570807 / +1.5% 49387459 / 46066653 / +7.2% 0.24 / 0.25 / -5.3%
polarsignals_q06/datafusion:vortex-file-compressed 23111344 / 23543970 / -1.8% 59468800 / 55935271 / +6.3% 0.39 / 0.42 / -7.7%
polarsignals_q07/datafusion:vortex-file-compressed 10939812 / 10790669 / +1.4% 45585457 / 43925484 / +3.8% 0.24 / 0.25 / -2.3%
polarsignals_q08/datafusion:vortex-file-compressed 98133892 / 104038217 / -5.7% 163002326 / 159248816 / +2.4% 0.60 / 0.65 / -7.8%
polarsignals_q09/datafusion:vortex-file-compressed 10057476 / 9853164 / +2.1% 43805499 / 40771950 / +7.4% 0.23 / 0.24 / -5.0%

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs
joseph-isaacs force-pushed the ji/codex/scan-v2-topk-feedback branch from 6cc6bb6 to 92b8101 Compare October 30, 2026 14:24
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs changed the title Improve Scan V2 TopK feedback and sparse payload retrieval Default DuckDB to Scan V2 and improve TopK and dense scans Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs changed the title Default DuckDB to Scan V2 and improve TopK and dense scans Default DuckDB to Scan V2 and optimize sparse and wide scans Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs force-pushed the ji/codex/scan-v2-topk-feedback branch from e0bc723 to e6afd4d Compare October 30, 2026 17:20
@joseph-isaacs joseph-isaacs reopened this Oct 30, 2026
@joseph-isaacs
joseph-isaacs force-pushed the ji/codex/scan-v2-topk-feedback branch from e6afd4d to 1f41995 Compare October 30, 2026 17:46
@joseph-isaacs joseph-isaacs removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
Emit small startup chunks per DuckDB worker, refresh dynamic pruning and
row filters when bounds change, and adapt predicate order using observed
cost and selectivity with occasional exploration.

Preserve exact file and row pairs during DuckDB V2 late materialization.
Retain the file-index hint for pre-open file pruning and gather sparse
dictionary selections before conversion when encoded take kernels apply.

Add benchmark controls, diagnostics, and regression coverage for startup,
dynamic thresholds, adaptive ordering, paired row lookup, and export.

Validation before develop integration: 301 DuckDB tests passed (2 S3 skips),
workspace all-target/all-feature Clippy, Rust/C++ formatting, and diff checks.
Q23 improved 37-41% across repeated 40-warm-sample local comparisons;
payload rows 70 -> 10 and payload arrays 49 -> 7.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Select sparse row lookup from positive input selections, schedule only selected regions, and preserve encoded take kernels at segment leaves and dictionary values. Keep zero-copy native slices and the dense scan path. Expose an access-mode override and diagnostics for mode selection and gather work.

Validation: 1,864 affected library tests passed (2 S3 skips), workspace all-target/all-feature Clippy, pinned formatting, layout doctests, and matched DuckDB/DataFusion benchmarks.
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Preserve selective predicate demand at scan leaves while retaining vectorized evaluation for dense scan masks. Memoize referenced string dictionary predicates and reuse packed whole results after bulk evaluation; keep numeric comparisons on their vectorized path.

Read dictionary codes before referenced value chunks for sparse random access, preserve duplicate/null code order, and keep partial reads out of whole-value caches. Fetch flat value segments alongside codes.

Validation: 1,890 affected library tests passed (2 S3 skips), workspace all-target/all-feature Clippy with warnings denied, pinned formatting, layout doctests, and five complete Q23 row comparisons against V1.
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs force-pushed the ji/codex/scan-v2-topk-feedback branch from 1f41995 to 7dcaf56 Compare October 30, 2026 18:29
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant