Build Arrow dictionaries for primitives without arrow_cast by mhk197 · Pull Request #11111 · vortex-data/vortex

mhk197 · 2026-11-02T19:57:57Z

Summary

A primitive column stored without a dictionary but requested as an Arrow dictionary is exported through arrow_cast. Its PrimitiveDictionaryBuilder hashes with SipHash and runs a get and then an insert for every new value. On PolarSignals that is most of the export: address is requested as Dictionary(UInt32, UInt64) and stored plain, because every value is distinct. On develop's files, line and function_start_line are stored plain too.

Changes

to_arrow_dictionary dictionary-encodes plain primitives whose type matches the requested values type with vortex-array's primitive dictionary encoder (FxHash) instead of arrow_cast.
New DictEncoder::reserve hint, a no-op by default. The primitive encoder sizes its table for it, and the export reserves the input length like Arrow's builder.
Nulls are exported as a null dictionary value rather than null keys, the shape dictionary-layout columns already export. Running out of keys fails when the codes are cast to the key type.
Strings, temporal types, decimals and mismatched value types still go through arrow_cast.

github-actions · 2026-11-02T20:11:05Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`1d18058`	vortex-queries	1	Explore Profiling Data
🟢 Done	`1d18058`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`1d18058`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`1d18058`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`1d18058`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`1d18058`	job-nvme	1	Explore Profiling Data
🟢 Done	`1d18058`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`1d18058`	fineweb	1	Explore Profiling Data
🟢 Done	`1d18058`	polarsignals	1	Explore Profiling Data
🟢 Done	`1d18058`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`1d18058`	statpopgen	1	Explore Profiling Data
🟢 Done	`1d18058`	appian-nvme	1	Explore Profiling Data
🟢 Done	`1d18058`	tpch-s3	1	Explore Profiling Data
🟢 Done	`1d18058`	tpcds-nvme	1	Explore Profiling Data

Previous Runs (28)

Status	Commit	Job	Attempt	Link
🟢 Done	`e30bd12`	vortex-queries	1	Explore Profiling Data
🟢 Done	`e30bd12`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`e30bd12`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`e30bd12`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`e30bd12`	fineweb	1	Explore Profiling Data
🟢 Done	`e30bd12`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`e30bd12`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`e30bd12`	job-nvme	1	Explore Profiling Data
🟢 Done	`e30bd12`	appian-nvme	1	Explore Profiling Data
🟢 Done	`e30bd12`	polarsignals	1	Explore Profiling Data
🟢 Done	`e30bd12`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`e30bd12`	tpch-s3	1	Explore Profiling Data
🟢 Done	`e30bd12`	statpopgen	1	Explore Profiling Data
🟢 Done	`e30bd12`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`7b65132`	vortex-queries	1	Explore Profiling Data
🟢 Done	`7b65132`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`7b65132`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`7b65132`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`7b65132`	job-nvme	1	Explore Profiling Data
🟢 Done	`7b65132`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`7b65132`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`7b65132`	fineweb	1	Explore Profiling Data
🟢 Done	`7b65132`	appian-nvme	1	Explore Profiling Data
🟢 Done	`7b65132`	polarsignals	1	Explore Profiling Data
🟢 Done	`7b65132`	tpch-s3	1	Explore Profiling Data
🟢 Done	`7b65132`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`7b65132`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`7b65132`	statpopgen	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-11-02T20:11:31Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR 1d180587 vs base d8e7467f
Vortex (geomean): hot 0.812x ✅ · cold 0.990x ➖

datafusion / vortex-file-compressed / ns (0.812x ✅, 5↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	17864776 / 44222698 / -59.6% 🟢	64608677 / 84562682 / -23.6% 🟢	0.28 / 0.52 / -47.1%
polarsignals_q01/datafusion:vortex-file-compressed	32471003 / 52984881 / -38.7% 🟢	94366979 / 107597608 / -12.3% 🟢	0.34 / 0.49 / -30.1%
polarsignals_q02/datafusion:vortex-file-compressed	10611620 / 12083532 / -12.2% 🟢	48547571 / 42102269 / +15.3% 🔴	0.22 / 0.29 / -23.8%
polarsignals_q03/datafusion:vortex-file-compressed	37994231 / 53742804 / -29.3% 🟢	95727706 / 113412423 / -15.6% 🟢	0.40 / 0.47 / -16.2%
polarsignals_q04/datafusion:vortex-file-compressed	9153544 / 9252012 / -1.1%	41258587 / 39670337 / +4.0%	0.22 / 0.23 / -4.9%
polarsignals_q05/datafusion:vortex-file-compressed	11683061 / 11447340 / +2.1%	46312642 / 41575920 / +11.4% 🔴	0.25 / 0.28 / -8.4%
polarsignals_q06/datafusion:vortex-file-compressed	23189158 / 22878022 / +1.4%	55711168 / 52236695 / +6.7%	0.42 / 0.44 / -5.0%
polarsignals_q07/datafusion:vortex-file-compressed	10646856 / 10491148 / +1.5%	45489581 / 41083072 / +10.7% 🔴	0.23 / 0.26 / -8.3%
polarsignals_q08/datafusion:vortex-file-compressed	75552922 / 96905530 / -22.0% 🟢	143833571 / 153793108 / -6.5%	0.53 / 0.63 / -16.6%
polarsignals_q09/datafusion:vortex-file-compressed	10077949 / 10027183 / +0.5%	40542552 / 37222297 / +8.9%	0.25 / 0.27 / -7.7%

github-actions · 2026-11-02T20:12:21Z

Benchmarks: FineWeb NVMe 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Engines: DataFusion No clear signal (-2.2%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.977x ➖
Parquet (geomean): hot 1.006x ➖ · cold 1.013x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.977x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	6071380 / 6043044 / +0.5%	20470898 / 19033861 / +7.5%	0.30 / 0.32 / -6.6%
fineweb_q01/datafusion:vortex-file-compressed	9144264 / 10022687 / -8.8%	39159576 / 40208620 / -2.6%	0.23 / 0.25 / -6.3%
fineweb_q02/datafusion:vortex-file-compressed	11581217 / 11002896 / +5.3%	38457776 / 43654276 / -11.9% 🟢	0.30 / 0.25 / +19.5%
fineweb_q03/datafusion:vortex-file-compressed	17224082 / 17095188 / +0.8%	105807010 / 104608927 / +1.1%	0.16 / 0.16 / -0.4%
fineweb_q04/datafusion:vortex-file-compressed	65491855 / 65550379 / -0.1%	145037062 / 142825616 / +1.5%	0.45 / 0.46 / -1.6%
fineweb_q05/datafusion:vortex-file-compressed	61558328 / 63751759 / -3.4%	140946208 / 139910808 / +0.7%	0.44 / 0.46 / -4.1%
fineweb_q06/datafusion:vortex-file-compressed	18088604 / 17596652 / +2.8%	104574801 / 108442994 / -3.6%	0.17 / 0.16 / +6.6%
fineweb_q07/datafusion:vortex-file-compressed	17832610 / 17199168 / +3.7%	102062840 / 103623154 / -1.5%	0.17 / 0.17 / +5.3%
fineweb_q08/datafusion:vortex-file-compressed	10608400 / 13071583 / -18.8% 🟢	29324775 / 28321664 / +3.5%	0.36 / 0.46 / -21.6%

datafusion / vortex-compact / ns (0.986x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	6151224 / 6110592 / +0.7%	20863666 / 19299660 / +8.1%	0.29 / 0.32 / -6.9%
fineweb_q01/datafusion:vortex-compact	102107838 / 102268002 / -0.2%	132285308 / 133812809 / -1.1%	0.77 / 0.76 / +1.0%
fineweb_q02/datafusion:vortex-compact	104207270 / 103437261 / +0.7%	133587694 / 138598994 / -3.6%	0.78 / 0.75 / +4.5%
fineweb_q03/datafusion:vortex-compact	185472199 / 178958682 / +3.6%	270835448 / 251177096 / +7.8%	0.68 / 0.71 / -3.9%
fineweb_q04/datafusion:vortex-compact	190597438 / 192813992 / -1.1%	266473094 / 264065394 / +0.9%	0.72 / 0.73 / -2.0%
fineweb_q05/datafusion:vortex-compact	186523169 / 180203242 / +3.5%	255663003 / 256243212 / -0.2%	0.73 / 0.70 / +3.7%
fineweb_q06/datafusion:vortex-compact	116804244 / 130208802 / -10.3% 🟢	195440741 / 226110751 / -13.6% 🟢	0.60 / 0.58 / +3.8%
fineweb_q07/datafusion:vortex-compact	130826968 / 133401274 / -1.9%	192128220 / 220448764 / -12.8% 🟢	0.68 / 0.61 / +12.5%
fineweb_q08/datafusion:vortex-compact	8778758 / 9401591 / -6.6%	27031132 / 23205386 / +16.5% 🔴	0.32 / 0.41 / -19.8%

datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9460302 / 9404294 / +0.6%	33741337 / 33670508 / +0.2%	0.28 / 0.28 / +0.4%
fineweb_q01/datafusion:parquet	74882678 / 76121940 / -1.6%	157978334 / 157004054 / +0.6%	0.47 / 0.48 / -2.2%
fineweb_q02/datafusion:parquet	75126802 / 74625111 / +0.7%	162579492 / 157945916 / +2.9%	0.46 / 0.47 / -2.2%
fineweb_q03/datafusion:parquet	74404531 / 74234566 / +0.2%	155317030 / 143608542 / +8.2%	0.48 / 0.52 / -7.3%
fineweb_q04/datafusion:parquet	83236582 / 82728146 / +0.6%	162333366 / 149506983 / +8.6%	0.51 / 0.55 / -7.3%
fineweb_q05/datafusion:parquet	80781736 / 80904748 / -0.2%	154398310 / 152636228 / +1.2%	0.52 / 0.53 / -1.3%
fineweb_q06/datafusion:parquet	75218478 / 75182242 / +0.0%	160438095 / 159672576 / +0.5%	0.47 / 0.47 / -0.4%
fineweb_q07/datafusion:parquet	75075981 / 73436770 / +2.2%	156810839 / 146702381 / +6.9%	0.48 / 0.50 / -4.4%
fineweb_q08/datafusion:parquet	73697006 / 73489728 / +0.3%	158787166 / 150273511 / +5.7%	0.46 / 0.49 / -5.1%

duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	2082574 / 2135544 / -2.5%	7209161 / 8171059 / -11.8% 🟢	0.29 / 0.26 / +10.5%
fineweb_q01/duckdb:vortex-file-compressed	7776486 / 7694537 / +1.1%	26191260 / 28499256 / -8.1%	0.30 / 0.27 / +10.0%
fineweb_q02/duckdb:vortex-file-compressed	9691512 / 9348370 / +3.7%	27137912 / 30667266 / -11.5% 🟢	0.36 / 0.30 / +17.2%
fineweb_q03/duckdb:vortex-file-compressed	18567863 / 19425882 / -4.4%	90657201 / 98277260 / -7.8%	0.20 / 0.20 / +3.6%
fineweb_q04/duckdb:vortex-file-compressed	65000859 / 65220328 / -0.3%	107317082 / 110685882 / -3.0%	0.61 / 0.59 / +2.8%
fineweb_q05/duckdb:vortex-file-compressed	65324620 / 65043407 / +0.4%	103893188 / 111085123 / -6.5%	0.63 / 0.59 / +7.4%
fineweb_q06/duckdb:vortex-file-compressed	18018806 / 18153757 / -0.7%	91624420 / 87586372 / +4.6%	0.20 / 0.21 / -5.1%
fineweb_q07/duckdb:vortex-file-compressed	17956555 / 18253440 / -1.6%	89940809 / 87562669 / +2.7%	0.20 / 0.21 / -4.2%
fineweb_q08/duckdb:vortex-file-compressed	4737589 / 4677950 / +1.3%	11960163 / 12326671 / -3.0%	0.40 / 0.38 / +4.4%

duckdb / vortex-compact / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	2330889 / 2288834 / +1.8%	7153553 / 8327715 / -14.1% 🟢	0.33 / 0.27 / +18.6%
fineweb_q01/duckdb:vortex-compact	38819102 / 38081568 / +1.9%	56443047 / 56784307 / -0.6%	0.69 / 0.67 / +2.6%
fineweb_q02/duckdb:vortex-compact	39183116 / 38835016 / +0.9%	56897919 / 57499739 / -1.0%	0.69 / 0.68 / +2.0%
fineweb_q03/duckdb:vortex-compact	150953658 / 157126902 / -3.9%	184323513 / 185289407 / -0.5%	0.82 / 0.85 / -3.4%
fineweb_q04/duckdb:vortex-compact	164891485 / 160840314 / +2.5%	195110558 / 191882882 / +1.7%	0.85 / 0.84 / +0.8%
fineweb_q05/duckdb:vortex-compact	151155430 / 149932888 / +0.8%	185253739 / 187599867 / -1.3%	0.82 / 0.80 / +2.1%
fineweb_q06/duckdb:vortex-compact	82220142 / 82296651 / -0.1%	124799185 / 124122782 / +0.5%	0.66 / 0.66 / -0.6%
fineweb_q07/duckdb:vortex-compact	86847940 / 85200826 / +1.9%	127541237 / 125191897 / +1.9%	0.68 / 0.68 / +0.1%
fineweb_q08/duckdb:vortex-compact	4388046 / 4452622 / -1.5%	9674849 / 11040843 / -12.4% 🟢	0.45 / 0.40 / +12.5%

duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	23946114 / 23646595 / +1.3%	28448289 / 28188796 / +0.9%	0.84 / 0.84 / +0.3%
fineweb_q01/duckdb:parquet	54293645 / 53921747 / +0.7%	73110779 / 76066779 / -3.9%	0.74 / 0.71 / +4.8%
fineweb_q02/duckdb:parquet	58329024 / 58008457 / +0.6%	75813664 / 77929773 / -2.7%	0.77 / 0.74 / +3.4%
fineweb_q03/duckdb:parquet	119350368 / 117699068 / +1.4%	182906201 / 180137228 / +1.5%	0.65 / 0.65 / -0.1%
fineweb_q04/duckdb:parquet	162770310 / 163497474 / -0.4%	199036662 / 202323953 / -1.6%	0.82 / 0.81 / +1.2%
fineweb_q05/duckdb:parquet	155242588 / 159811502 / -2.9%	196939553 / 200500390 / -1.8%	0.79 / 0.80 / -1.1%
fineweb_q06/duckdb:parquet	87463730 / 86640539 / +1.0%	146926852 / 148393110 / -1.0%	0.60 / 0.58 / +2.0%
fineweb_q07/duckdb:parquet	93008902 / 89022360 / +4.5%	144489781 / 145281126 / -0.5%	0.64 / 0.61 / +5.1%
fineweb_q08/duckdb:parquet	29344188 / 28720865 / +2.2%	30694244 / 30777699 / -0.3%	0.96 / 0.93 / +2.4%

github-actions · 2026-11-02T20:13:11Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.074x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	166348209 / 183588549 / -9.4%	577151421 / 600980052 / -4.0%	0.29 / 0.31 / -5.6%
clickbench-sorted_q24/datafusion:vortex-file-compressed	10271007 / 9941994 / +3.3%	54016931 / 51595159 / +4.7%	0.19 / 0.19 / -1.3%
clickbench-sorted_q26/datafusion:vortex-file-compressed	10483042 / 10615795 / -1.3%	56952861 / 55243662 / +3.1%	0.18 / 0.19 / -4.2%
clickbench-sorted_q36/datafusion:vortex-file-compressed	22980638 / 22813351 / +0.7%	75350607 / 70246897 / +7.3%	0.30 / 0.32 / -6.1%
clickbench-sorted_q37/datafusion:vortex-file-compressed	18266320 / 17886564 / +2.1%	64454273 / 55238816 / +16.7% 🔴	0.28 / 0.32 / -12.5%
clickbench-sorted_q38/datafusion:vortex-file-compressed	13086754 / 12624266 / +3.7%	66668436 / 61311814 / +8.7%	0.20 / 0.21 / -4.7%
clickbench-sorted_q39/datafusion:vortex-file-compressed	37979581 / 36948196 / +2.8%	99757023 / 92193826 / +8.2%	0.38 / 0.40 / -5.0%
clickbench-sorted_q40/datafusion:vortex-file-compressed	11027856 / 11512736 / -4.2%	46492799 / 39103576 / +18.9% 🔴	0.24 / 0.29 / -19.4%
clickbench-sorted_q41/datafusion:vortex-file-compressed	10681954 / 10728395 / -0.4%	45758452 / 38733159 / +18.1% 🔴	0.23 / 0.28 / -15.7%
clickbench-sorted_q42/datafusion:vortex-file-compressed	9569176 / 9275222 / +3.2%	38083190 / 34143360 / +11.5% 🔴	0.25 / 0.27 / -7.5%

datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	746075944 / 750584306 / -0.6%	969406385 / 962329653 / +0.7%	0.77 / 0.78 / -1.3%
clickbench-sorted_q24/datafusion:parquet	8969964 / 9026856 / -0.6%	75665003 / 71951853 / +5.2%	0.12 / 0.13 / -5.5%
clickbench-sorted_q26/datafusion:parquet	9277967 / 8983698 / +3.3%	73062981 / 72157233 / +1.3%	0.13 / 0.12 / +2.0%
clickbench-sorted_q36/datafusion:parquet	90425942 / 90164694 / +0.3%	166009657 / 159595310 / +4.0%	0.54 / 0.56 / -3.6%
clickbench-sorted_q37/datafusion:parquet	61260956 / 61267234 / -0.0%	132493901 / 126097942 / +5.1%	0.46 / 0.49 / -4.8%
clickbench-sorted_q38/datafusion:parquet	83608600 / 83728700 / -0.1%	162401302 / 150175948 / +8.1%	0.51 / 0.56 / -7.7%
clickbench-sorted_q39/datafusion:parquet	152688414 / 152920762 / -0.2%	231055786 / 223841655 / +3.2%	0.66 / 0.68 / -3.3%
clickbench-sorted_q40/datafusion:parquet	42012036 / 41737474 / +0.7%	115442551 / 106095404 / +8.8%	0.36 / 0.39 / -7.5%
clickbench-sorted_q41/datafusion:parquet	39176680 / 39543201 / -0.9%	108748201 / 105008245 / +3.6%	0.36 / 0.38 / -4.3%
clickbench-sorted_q42/datafusion:parquet	25072214 / 24919338 / +0.6%	86835022 / 86485810 / +0.4%	0.29 / 0.29 / +0.2%

duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	35881414 / 34954459 / +2.7%	72581011 / 70893616 / +2.4%	0.49 / 0.49 / +0.3%
clickbench-sorted_q24/duckdb:vortex-file-compressed	9160726 / 9123177 / +0.4%	28790940 / 27011726 / +6.6%	0.32 / 0.34 / -5.8%
clickbench-sorted_q26/duckdb:vortex-file-compressed	8977596 / 9081269 / -1.1%	31721410 / 29826543 / +6.4%	0.28 / 0.30 / -7.0%
clickbench-sorted_q36/duckdb:vortex-file-compressed	22101496 / 22537615 / -1.9%	49085898 / 48543623 / +1.1%	0.45 / 0.46 / -3.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed	17468574 / 17502942 / -0.2%	43938067 / 42132495 / +4.3%	0.40 / 0.42 / -4.3%
clickbench-sorted_q38/duckdb:vortex-file-compressed	18833908 / 18240950 / +3.3%	51114076 / 48387323 / +5.6%	0.37 / 0.38 / -2.3%
clickbench-sorted_q39/duckdb:vortex-file-compressed	42758520 / 42624334 / +0.3%	85591186 / 78669583 / +8.8%	0.50 / 0.54 / -7.8%
clickbench-sorted_q40/duckdb:vortex-file-compressed	10436268 / 10742756 / -2.9%	36253813 / 33371235 / +8.6%	0.29 / 0.32 / -10.6%
clickbench-sorted_q41/duckdb:vortex-file-compressed	11933370 / 11819956 / +1.0%	38278040 / 34073138 / +12.3% 🔴	0.31 / 0.35 / -10.1%
clickbench-sorted_q42/duckdb:vortex-file-compressed	9216274 / 8740240 / +5.4%	31861830 / 31402876 / +1.5%	0.29 / 0.28 / +3.9%

duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	140963372 / 141788893 / -0.6%	176204823 / 181531439 / -2.9%	0.80 / 0.78 / +2.4%
clickbench-sorted_q24/duckdb:parquet	15894196 / 15045850 / +5.6%	17953956 / 20895306 / -14.1% 🟢	0.89 / 0.72 / +22.9%
clickbench-sorted_q26/duckdb:parquet	15456592 / 15912479 / -2.9%	20362047 / 25022284 / -18.6% 🟢	0.76 / 0.64 / +19.4%
clickbench-sorted_q36/duckdb:parquet	45521472 / 46240870 / -1.6%	58849954 / 60407377 / -2.6%	0.77 / 0.77 / +1.0%
clickbench-sorted_q37/duckdb:parquet	37204652 / 35941899 / +3.5%	43434417 / 47334482 / -8.2%	0.86 / 0.76 / +12.8%
clickbench-sorted_q38/duckdb:parquet	42080396 / 41977624 / +0.2%	52660539 / 51124061 / +3.0%	0.80 / 0.82 / -2.7%
clickbench-sorted_q39/duckdb:parquet	73540498 / 74858620 / -1.8%	80257212 / 86048671 / -6.7%	0.92 / 0.87 / +5.3%
clickbench-sorted_q40/duckdb:parquet	21617328 / 21594382 / +0.1%	27873413 / 29352172 / -5.0%	0.78 / 0.74 / +5.4%
clickbench-sorted_q41/duckdb:parquet	23098721 / 22814058 / +1.2%	30584535 / 30074695 / +1.7%	0.76 / 0.76 / -0.4%
clickbench-sorted_q42/duckdb:parquet	17047915 / 17057460 / -0.1%	23403126 / 24143831 / -3.1%	0.73 / 0.71 / +3.1%

duckdb / duckdb / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb	67685968 / 68268000 / -0.9%	120754138 / 118426707 / +2.0%	0.56 / 0.58 / -2.8%
clickbench-sorted_q24/duckdb:duckdb	23140228 / 23642410 / -2.1%	29810823 / 28721012 / +3.8%	0.78 / 0.82 / -5.7%
clickbench-sorted_q26/duckdb:duckdb	23540510 / 23208638 / +1.4%	32061672 / 29867761 / +7.3%	0.73 / 0.78 / -5.5%
clickbench-sorted_q36/duckdb:duckdb	41568777 / 39885536 / +4.2%	72311911 / 69554288 / +4.0%	0.57 / 0.57 / +0.2%
clickbench-sorted_q37/duckdb:duckdb	37338492 / 38987562 / -4.2%	78439169 / 77526912 / +1.2%	0.48 / 0.50 / -5.3%
clickbench-sorted_q38/duckdb:duckdb	30432288 / 29999844 / +1.4%	66674369 / 63304192 / +5.3%	0.46 / 0.47 / -3.7%
clickbench-sorted_q39/duckdb:duckdb	52760461 / 55080868 / -4.2%	111958513 / 103047634 / +8.6%	0.47 / 0.53 / -11.8%
clickbench-sorted_q40/duckdb:duckdb	21806482 / 21524948 / +1.3%	47195773 / 43830452 / +7.7%	0.46 / 0.49 / -5.9%
clickbench-sorted_q41/duckdb:duckdb	20932899 / 20775501 / +0.8%	39457668 / 37259254 / +5.9%	0.53 / 0.56 / -4.9%
clickbench-sorted_q42/duckdb:duckdb	16893911 / 16921946 / -0.2%	28814418 / 27472676 / +4.9%	0.59 / 0.62 / -4.8%

github-actions · 2026-11-02T20:13:27Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.004x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.999x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.990x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	15951566 / 15661972 / +1.8%	42092119 / 42841947 / -1.8%	0.38 / 0.37 / +3.7%
tpch_q02/datafusion:vortex-file-compressed	16665133 / 16639869 / +0.2%	35397194 / 34458628 / +2.7%	0.47 / 0.48 / -2.5%
tpch_q03/datafusion:vortex-file-compressed	19473984 / 19330556 / +0.7%	48999149 / 46474905 / +5.4%	0.40 / 0.42 / -4.4%
tpch_q04/datafusion:vortex-file-compressed	10546038 / 11219123 / -6.0%	33643592 / 32673449 / +3.0%	0.31 / 0.34 / -8.7%
tpch_q05/datafusion:vortex-file-compressed	37392921 / 37153525 / +0.6%	63457460 / 65002639 / -2.4%	0.59 / 0.57 / +3.1%
tpch_q06/datafusion:vortex-file-compressed	4977563 / 6140371 / -18.9% 🟢	27809973 / 25819336 / +7.7%	0.18 / 0.24 / -24.7%
tpch_q07/datafusion:vortex-file-compressed	50751430 / 51870585 / -2.2%	79969828 / 77115574 / +3.7%	0.63 / 0.67 / -5.6%
tpch_q08/datafusion:vortex-file-compressed	51996723 / 52083957 / -0.2%	84142095 / 80363349 / +4.7%	0.62 / 0.65 / -4.7%
tpch_q09/datafusion:vortex-file-compressed	46865001 / 47409427 / -1.1%	79900882 / 77081113 / +3.7%	0.59 / 0.62 / -4.6%
tpch_q10/datafusion:vortex-file-compressed	16831802 / 17611044 / -4.4%	50724279 / 48988249 / +3.5%	0.33 / 0.36 / -7.7%
tpch_q11/datafusion:vortex-file-compressed	14205429 / 14067142 / +1.0%	33087781 / 33357597 / -0.8%	0.43 / 0.42 / +1.8%
tpch_q12/datafusion:vortex-file-compressed	18490393 / 18606586 / -0.6%	45051422 / 42551663 / +5.9%	0.41 / 0.44 / -6.1%
tpch_q13/datafusion:vortex-file-compressed	19384661 / 19146037 / +1.2%	40661457 / 37740367 / +7.7%	0.48 / 0.51 / -6.0%
tpch_q14/datafusion:vortex-file-compressed	14624302 / 14086999 / +3.8%	37060756 / 40404473 / -8.3%	0.39 / 0.35 / +13.2%
tpch_q15/datafusion:vortex-file-compressed	18719809 / 18930371 / -1.1%	42290207 / 42067933 / +0.5%	0.44 / 0.45 / -1.6%
tpch_q16/datafusion:vortex-file-compressed	18312177 / 18593962 / -1.5%	38662803 / 38075606 / +1.5%	0.47 / 0.49 / -3.0%
tpch_q17/datafusion:vortex-file-compressed	28070372 / 28012766 / +0.2%	58815684 / 62063476 / -5.2%	0.48 / 0.45 / +5.7%
tpch_q18/datafusion:vortex-file-compressed	35835542 / 35523861 / +0.9%	58584836 / 61102631 / -4.1%	0.61 / 0.58 / +5.2%
tpch_q19/datafusion:vortex-file-compressed	12135243 / 12032468 / +0.9%	40844495 / 40409167 / +1.1%	0.30 / 0.30 / -0.2%
tpch_q20/datafusion:vortex-file-compressed	20553638 / 20233461 / +1.6%	44647810 / 45504558 / -1.9%	0.46 / 0.44 / +3.5%
tpch_q21/datafusion:vortex-file-compressed	39703227 / 39004077 / +1.8%	72977179 / 68596288 / +6.4%	0.54 / 0.57 / -4.3%
tpch_q22/datafusion:vortex-file-compressed	10685556 / 10589702 / +0.9%	31547073 / 31254916 / +0.9%	0.34 / 0.34 / -0.0%

datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	16281867 / 16437199 / -0.9%	43283183 / 43763184 / -1.1%	0.38 / 0.38 / +0.2%
tpch_q02/datafusion:vortex-compact	18213398 / 18101280 / +0.6%	36911470 / 37213292 / -0.8%	0.49 / 0.49 / +1.4%
tpch_q03/datafusion:vortex-compact	20140209 / 20315660 / -0.9%	44916656 / 46304214 / -3.0%	0.45 / 0.44 / +2.2%
tpch_q04/datafusion:vortex-compact	11445781 / 11020708 / +3.9%	31877061 / 34079196 / -6.5%	0.36 / 0.32 / +11.0%
tpch_q05/datafusion:vortex-compact	37543057 / 37419515 / +0.3%	67420705 / 65422491 / +3.1%	0.56 / 0.57 / -2.6%
tpch_q06/datafusion:vortex-compact	6938291 / 6828702 / +1.6%	27387935 / 27420828 / -0.1%	0.25 / 0.25 / +1.7%
tpch_q07/datafusion:vortex-compact	52345805 / 52375990 / -0.1%	79168413 / 71832163 / +10.2% 🔴	0.66 / 0.73 / -9.3%
tpch_q08/datafusion:vortex-compact	52280729 / 51660724 / +1.2%	79164605 / 79957652 / -1.0%	0.66 / 0.65 / +2.2%
tpch_q09/datafusion:vortex-compact	47975737 / 47926458 / +0.1%	78143999 / 77871308 / +0.4%	0.61 / 0.62 / -0.2%
tpch_q10/datafusion:vortex-compact	18711902 / 18432720 / +1.5%	49927001 / 47307864 / +5.5%	0.37 / 0.39 / -3.8%
tpch_q11/datafusion:vortex-compact	14447007 / 14408402 / +0.3%	33308106 / 33927155 / -1.8%	0.43 / 0.42 / +2.1%
tpch_q12/datafusion:vortex-compact	19531208 / 19837576 / -1.5%	44873329 / 42104292 / +6.6%	0.44 / 0.47 / -7.6%
tpch_q13/datafusion:vortex-compact	20224622 / 21176106 / -4.5%	39798445 / 41740124 / -4.7%	0.51 / 0.51 / +0.2%
tpch_q14/datafusion:vortex-compact	15305092 / 15442703 / -0.9%	39457517 / 37349649 / +5.6%	0.39 / 0.41 / -6.2%
tpch_q15/datafusion:vortex-compact	20394948 / 20355984 / +0.2%	44556135 / 44366910 / +0.4%	0.46 / 0.46 / -0.2%
tpch_q16/datafusion:vortex-compact	18811031 / 18753433 / +0.3%	38962589 / 38451831 / +1.3%	0.48 / 0.49 / -1.0%
tpch_q17/datafusion:vortex-compact	29071178 / 28970126 / +0.3%	58480838 / 61873744 / -5.5%	0.50 / 0.47 / +6.2%
tpch_q18/datafusion:vortex-compact	35871204 / 35901717 / -0.1%	60280001 / 59735162 / +0.9%	0.60 / 0.60 / -1.0%
tpch_q19/datafusion:vortex-compact	13220881 / 13936760 / -5.1%	39926586 / 38473745 / +3.8%	0.33 / 0.36 / -8.6%
tpch_q20/datafusion:vortex-compact	21499505 / 21343887 / +0.7%	44845497 / 45620137 / -1.7%	0.48 / 0.47 / +2.5%
tpch_q21/datafusion:vortex-compact	41386820 / 40504373 / +2.2%	70148771 / 69914018 / +0.3%	0.59 / 0.58 / +1.8%
tpch_q22/datafusion:vortex-compact	11323715 / 10972595 / +3.2%	31282430 / 30686075 / +1.9%	0.36 / 0.36 / +1.2%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	71890414 / 71879149 / +0.0%	87771711 / 88674182 / -1.0%	0.82 / 0.81 / +1.0%
tpch_q02/datafusion:parquet	75802757 / 76212495 / -0.5%	93025306 / 91323921 / +1.9%	0.81 / 0.83 / -2.4%
tpch_q03/datafusion:parquet	82118253 / 81824349 / +0.4%	103009749 / 103263746 / -0.2%	0.80 / 0.79 / +0.6%
tpch_q04/datafusion:parquet	39204587 / 39635414 / -1.1%	59000939 / 57692186 / +2.3%	0.66 / 0.69 / -3.3%
tpch_q05/datafusion:parquet	110087731 / 110523930 / -0.4%	137924687 / 135954506 / +1.4%	0.80 / 0.81 / -1.8%
tpch_q06/datafusion:parquet	31415573 / 31335521 / +0.3%	47234125 / 47525730 / -0.6%	0.67 / 0.66 / +0.9%
tpch_q07/datafusion:parquet	112302990 / 112604549 / -0.3%	140404629 / 139824515 / +0.4%	0.80 / 0.81 / -0.7%
tpch_q08/datafusion:parquet	117386152 / 117260335 / +0.1%	143194666 / 144384044 / -0.8%	0.82 / 0.81 / +0.9%
tpch_q09/datafusion:parquet	137237708 / 137886600 / -0.5%	168579550 / 165138694 / +2.1%	0.81 / 0.83 / -2.5%
tpch_q10/datafusion:parquet	103461427 / 103448085 / +0.0%	127339155 / 130010786 / -2.1%	0.81 / 0.80 / +2.1%
tpch_q11/datafusion:parquet	62023984 / 62038743 / -0.0%	80731214 / 83120127 / -2.9%	0.77 / 0.75 / +2.9%
tpch_q12/datafusion:parquet	63976701 / 63317944 / +1.0%	86284121 / 84219126 / +2.5%	0.74 / 0.75 / -1.4%
tpch_q13/datafusion:parquet	143351891 / 143445157 / -0.1%	162945318 / 162548347 / +0.2%	0.88 / 0.88 / -0.3%
tpch_q14/datafusion:parquet	47238423 / 47405692 / -0.4%	69813943 / 68246362 / +2.3%	0.68 / 0.69 / -2.6%
tpch_q15/datafusion:parquet	75112701 / 74105852 / +1.4%	92214570 / 95831640 / -3.8%	0.81 / 0.77 / +5.3%
tpch_q16/datafusion:parquet	43421968 / 43711201 / -0.7%	61174800 / 61603025 / -0.7%	0.71 / 0.71 / +0.0%
tpch_q17/datafusion:parquet	123102348 / 122657598 / +0.4%	146192872 / 145403847 / +0.5%	0.84 / 0.84 / -0.2%
tpch_q18/datafusion:parquet	120194376 / 120793713 / -0.5%	144522890 / 139796318 / +3.4%	0.83 / 0.86 / -3.8%
tpch_q19/datafusion:parquet	56837572 / 57484659 / -1.1%	80695582 / 80887890 / -0.2%	0.70 / 0.71 / -0.9%
tpch_q20/datafusion:parquet	78091983 / 77616126 / +0.6%	102461663 / 101322956 / +1.1%	0.76 / 0.77 / -0.5%
tpch_q21/datafusion:parquet	113990203 / 113624163 / +0.3%	138825479 / 137455603 / +1.0%	0.82 / 0.83 / -0.7%
tpch_q22/datafusion:parquet	52250884 / 51779106 / +0.9%	68423750 / 68161336 / +0.4%	0.76 / 0.76 / +0.5%

duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	8839206 / 9436481 / -6.3%	20841591 / 21268010 / -2.0%	0.42 / 0.44 / -4.4%
tpch_q02/duckdb:vortex-file-compressed	15134704 / 15359987 / -1.5%	24367963 / 24718824 / -1.4%	0.62 / 0.62 / -0.0%
tpch_q03/duckdb:vortex-file-compressed	18986950 / 18820436 / +0.9%	36404118 / 34856541 / +4.4%	0.52 / 0.54 / -3.4%
tpch_q04/duckdb:vortex-file-compressed	12342311 / 12471946 / -1.0%	26694078 / 26605643 / +0.3%	0.46 / 0.47 / -1.4%
tpch_q05/duckdb:vortex-file-compressed	19808166 / 20241317 / -2.1%	38393350 / 36002915 / +6.6%	0.52 / 0.56 / -8.2%
tpch_q06/duckdb:vortex-file-compressed	4842306 / 4792497 / +1.0%	15159111 / 14693964 / +3.2%	0.32 / 0.33 / -2.1%
tpch_q07/duckdb:vortex-file-compressed	24315517 / 24310590 / +0.0%	39367773 / 40541328 / -2.9%	0.62 / 0.60 / +3.0%
tpch_q08/duckdb:vortex-file-compressed	20616926 / 20930255 / -1.5%	37049291 / 38302431 / -3.3%	0.56 / 0.55 / +1.8%
tpch_q09/duckdb:vortex-file-compressed	23051176 / 22613955 / +1.9%	37634434 / 38126892 / -1.3%	0.61 / 0.59 / +3.3%
tpch_q10/duckdb:vortex-file-compressed	23153555 / 22468574 / +3.0%	40241786 / 38996105 / +3.2%	0.58 / 0.58 / -0.1%
tpch_q11/duckdb:vortex-file-compressed	8283114 / 8030702 / +3.1%	17806716 / 17341125 / +2.7%	0.47 / 0.46 / +0.4%
tpch_q12/duckdb:vortex-file-compressed	14735400 / 14714414 / +0.1%	26609167 / 26763214 / -0.6%	0.55 / 0.55 / +0.7%
tpch_q13/duckdb:vortex-file-compressed	19628189 / 19535775 / +0.5%	32343788 / 31769946 / +1.8%	0.61 / 0.61 / -1.3%
tpch_q14/duckdb:vortex-file-compressed	11249656 / 11155722 / +0.8%	24273805 / 24000821 / +1.1%	0.46 / 0.46 / -0.3%
tpch_q15/duckdb:vortex-file-compressed	8562680 / 8680729 / -1.4%	20373555 / 21467889 / -5.1%	0.42 / 0.40 / +3.9%
tpch_q16/duckdb:vortex-file-compressed	16753007 / 16622560 / +0.8%	23456820 / 23016627 / +1.9%	0.71 / 0.72 / -1.1%
tpch_q17/duckdb:vortex-file-compressed	12533708 / 12749704 / -1.7%	28194960 / 27643362 / +2.0%	0.44 / 0.46 / -3.6%
tpch_q18/duckdb:vortex-file-compressed	24063676 / 24466358 / -1.6%	34916657 / 34426097 / +1.4%	0.69 / 0.71 / -3.0%
tpch_q19/duckdb:vortex-file-compressed	11827819 / 11753612 / +0.6%	28067745 / 28563007 / -1.7%	0.42 / 0.41 / +2.4%
tpch_q20/duckdb:vortex-file-compressed	14156591 / 14291466 / -0.9%	30687872 / 31095884 / -1.3%	0.46 / 0.46 / +0.4%
tpch_q21/duckdb:vortex-file-compressed	37418118 / 37282948 / +0.4%	57369569 / 56893288 / +0.8%	0.65 / 0.66 / -0.5%
tpch_q22/duckdb:vortex-file-compressed	16765610 / 16811961 / -0.3%	26574133 / 27198947 / -2.3%	0.63 / 0.62 / +2.1%

duckdb / vortex-compact / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	10711362 / 11012516 / -2.7%	19873816 / 21995910 / -9.6%	0.54 / 0.50 / +7.7%
tpch_q02/duckdb:vortex-compact	18555578 / 18281158 / +1.5%	26223192 / 26407241 / -0.7%	0.71 / 0.69 / +2.2%
tpch_q03/duckdb:vortex-compact	20023878 / 19995990 / +0.1%	36292744 / 35354215 / +2.7%	0.55 / 0.57 / -2.5%
tpch_q04/duckdb:vortex-compact	13186998 / 13413993 / -1.7%	26060918 / 27287181 / -4.5%	0.51 / 0.49 / +2.9%
tpch_q05/duckdb:vortex-compact	20969860 / 20956721 / +0.1%	36138346 / 37876028 / -4.6%	0.58 / 0.55 / +4.9%
tpch_q06/duckdb:vortex-compact	5424794 / 5348700 / +1.4%	15563259 / 15159843 / +2.7%	0.35 / 0.35 / -1.2%
tpch_q07/duckdb:vortex-compact	26091029 / 26264220 / -0.7%	41702751 / 42264972 / -1.3%	0.63 / 0.62 / +0.7%
tpch_q08/duckdb:vortex-compact	22366344 / 22046662 / +1.5%	36931566 / 38083989 / -3.0%	0.61 / 0.58 / +4.6%
tpch_q09/duckdb:vortex-compact	23359965 / 23801402 / -1.9%	39106012 / 37137738 / +5.3%	0.60 / 0.64 / -6.8%
tpch_q10/duckdb:vortex-compact	25989387 / 26616323 / -2.4%	40425688 / 40855973 / -1.1%	0.64 / 0.65 / -1.3%
tpch_q11/duckdb:vortex-compact	8598247 / 8600870 / -0.0%	17548397 / 17760777 / -1.2%	0.49 / 0.48 / +1.2%
tpch_q12/duckdb:vortex-compact	16289230 / 17540921 / -7.1%	28137322 / 27709034 / +1.5%	0.58 / 0.63 / -8.5%
tpch_q13/duckdb:vortex-compact	19892271 / 19490791 / +2.1%	30502165 / 31074922 / -1.8%	0.65 / 0.63 / +4.0%
tpch_q14/duckdb:vortex-compact	12273821 / 12309780 / -0.3%	26138390 / 26609984 / -1.8%	0.47 / 0.46 / +1.5%
tpch_q15/duckdb:vortex-compact	9821107 / 9694805 / +1.3%	21870510 / 23072219 / -5.2%	0.45 / 0.42 / +6.9%
tpch_q16/duckdb:vortex-compact	17216498 / 17310434 / -0.5%	23291526 / 22918865 / +1.6%	0.74 / 0.76 / -2.1%
tpch_q17/duckdb:vortex-compact	13280938 / 13731327 / -3.3%	29911959 / 28350295 / +5.5%	0.44 / 0.48 / -8.3%
tpch_q18/duckdb:vortex-compact	25108363 / 24912091 / +0.8%	33913796 / 34575726 / -1.9%	0.74 / 0.72 / +2.8%
tpch_q19/duckdb:vortex-compact	15158670 / 15044428 / +0.8%	30423785 / 29862782 / +1.9%	0.50 / 0.50 / -1.1%
tpch_q20/duckdb:vortex-compact	17004014 / 17264196 / -1.5%	32340683 / 32371430 / -0.1%	0.53 / 0.53 / -1.4%
tpch_q21/duckdb:vortex-compact	38406552 / 38659217 / -0.7%	54748313 / 56071800 / -2.4%	0.70 / 0.69 / +1.7%
tpch_q22/duckdb:vortex-compact	19494643 / 19641564 / -0.7%	29398956 / 29363430 / +0.1%	0.66 / 0.67 / -0.9%

duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	47711142 / 47754971 / -0.1%	53781086 / 54080389 / -0.6%	0.89 / 0.88 / +0.5%
tpch_q02/duckdb:parquet	48349875 / 48295851 / +0.1%	56198110 / 56153161 / +0.1%	0.86 / 0.86 / +0.0%
tpch_q03/duckdb:parquet	60184304 / 60305159 / -0.2%	69042285 / 68115746 / +1.4%	0.87 / 0.89 / -1.5%
tpch_q04/duckdb:parquet	34672252 / 34820162 / -0.4%	42975243 / 42780093 / +0.5%	0.81 / 0.81 / -0.9%
tpch_q05/duckdb:parquet	67025882 / 67167226 / -0.2%	77219752 / 76805532 / +0.5%	0.87 / 0.87 / -0.7%
tpch_q06/duckdb:parquet	21817963 / 21667354 / +0.7%	28628052 / 27009296 / +6.0%	0.76 / 0.80 / -5.0%
tpch_q07/duckdb:parquet	63835430 / 63687515 / +0.2%	72873818 / 73630561 / -1.0%	0.88 / 0.86 / +1.3%
tpch_q08/duckdb:parquet	75791159 / 75519986 / +0.4%	85980524 / 85618504 / +0.4%	0.88 / 0.88 / -0.1%
tpch_q09/duckdb:parquet	107647294 / 107770881 / -0.1%	119319846 / 119288344 / +0.0%	0.90 / 0.90 / -0.1%
tpch_q10/duckdb:parquet	105994666 / 105626536 / +0.3%	117575828 / 116704965 / +0.7%	0.90 / 0.91 / -0.4%
tpch_q11/duckdb:parquet	29380761 / 29442168 / -0.2%	34654950 / 34863217 / -0.6%	0.85 / 0.84 / +0.4%
tpch_q12/duckdb:parquet	37201924 / 37056974 / +0.4%	44017238 / 44780111 / -1.7%	0.85 / 0.83 / +2.1%
tpch_q13/duckdb:parquet	174745173 / 174821301 / -0.0%	183796014 / 182939856 / +0.5%	0.95 / 0.96 / -0.5%
tpch_q14/duckdb:parquet	42184350 / 42328624 / -0.3%	50584069 / 51058650 / -0.9%	0.83 / 0.83 / +0.6%
tpch_q15/duckdb:parquet	32662562 / 32467807 / +0.6%	40788073 / 40959078 / -0.4%	0.80 / 0.79 / +1.0%
tpch_q16/duckdb:parquet	47393152 / 46747530 / +1.4%	52073757 / 52027471 / +0.1%	0.91 / 0.90 / +1.3%
tpch_q17/duckdb:parquet	47776713 / 48083048 / -0.6%	56876968 / 57353570 / -0.8%	0.84 / 0.84 / +0.2%
tpch_q18/duckdb:parquet	74323365 / 73917270 / +0.5%	81308877 / 80751670 / +0.7%	0.91 / 0.92 / -0.1%
tpch_q19/duckdb:parquet	49248397 / 48160108 / +2.3%	52979654 / 59775076 / -11.4% 🟢	0.93 / 0.81 / +15.4%
tpch_q20/duckdb:parquet	63332368 / 63565952 / -0.4%	73489426 / 74327184 / -1.1%	0.86 / 0.86 / +0.8%
tpch_q21/duckdb:parquet	106747846 / 106707092 / +0.0%	115625390 / 116130732 / -0.4%	0.92 / 0.92 / +0.5%
tpch_q22/duckdb:parquet	50343982 / 50351895 / -0.0%	58161023 / 59359977 / -2.0%	0.87 / 0.85 / +2.0%

duckdb / duckdb / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb	6301268 / 6206977 / +1.5%	14276004 / 13962200 / +2.2%	0.44 / 0.44 / -0.7%
tpch_q02/duckdb:duckdb	8522373 / 8667407 / -1.7%	16484411 / 16666387 / -1.1%	0.52 / 0.52 / -0.6%
tpch_q03/duckdb:duckdb	15460477 / 15536929 / -0.5%	25526863 / 25970261 / -1.7%	0.61 / 0.60 / +1.2%
tpch_q04/duckdb:duckdb	11374631 / 11218462 / +1.4%	21958809 / 21956248 / +0.0%	0.52 / 0.51 / +1.4%
tpch_q05/duckdb:duckdb	15586738 / 15382138 / +1.3%	27627462 / 27173383 / +1.7%	0.56 / 0.57 / -0.3%
tpch_q06/duckdb:duckdb	3198020 / 3194867 / +0.1%	10209222 / 9420893 / +8.4%	0.31 / 0.34 / -7.6%
tpch_q07/duckdb:duckdb	18485712 / 18512175 / -0.1%	28947785 / 28455239 / +1.7%	0.64 / 0.65 / -1.8%
tpch_q08/duckdb:duckdb	17224731 / 17432451 / -1.2%	29764824 / 30210420 / -1.5%	0.58 / 0.58 / +0.3%
tpch_q09/duckdb:duckdb	23880769 / 23980637 / -0.4%	36321487 / 37228261 / -2.4%	0.66 / 0.64 / +2.1%
tpch_q10/duckdb:duckdb	29699843 / 28939848 / +2.6%	43717749 / 43457605 / +0.6%	0.68 / 0.67 / +2.0%
tpch_q11/duckdb:duckdb	5761862 / 5815788 / -0.9%	11972152 / 12019854 / -0.4%	0.48 / 0.48 / -0.5%
tpch_q12/duckdb:duckdb	10711199 / 10666455 / +0.4%	20772370 / 20783778 / -0.1%	0.52 / 0.51 / +0.5%
tpch_q13/duckdb:duckdb	31989076 / 32085339 / -0.3%	40465381 / 40839640 / -0.9%	0.79 / 0.79 / +0.6%
tpch_q14/duckdb:duckdb	12499988 / 12628062 / -1.0%	21597859 / 21325894 / +1.3%	0.58 / 0.59 / -2.3%
tpch_q15/duckdb:duckdb	6945595 / 6887880 / +0.8%	16285778 / 16572948 / -1.7%	0.43 / 0.42 / +2.6%
tpch_q16/duckdb:duckdb	18946769 / 18924834 / +0.1%	25135413 / 25620087 / -1.9%	0.75 / 0.74 / +2.0%
tpch_q17/duckdb:duckdb	8529297 / 8544456 / -0.2%	17639348 / 18098734 / -2.5%	0.48 / 0.47 / +2.4%
tpch_q18/duckdb:duckdb	18129948 / 18162571 / -0.2%	26127062 / 26129299 / -0.0%	0.69 / 0.70 / -0.2%
tpch_q19/duckdb:duckdb	12676687 / 12704321 / -0.2%	22697605 / 22003063 / +3.2%	0.56 / 0.58 / -3.3%
tpch_q20/duckdb:duckdb	14473636 / 14538672 / -0.4%	27520021 / 27480672 / +0.1%	0.53 / 0.53 / -0.6%
tpch_q21/duckdb:duckdb	21975413 / 21992931 / -0.1%	33117927 / 32959328 / +0.5%	0.66 / 0.67 / -0.6%
tpch_q22/duckdb:duckdb	23109802 / 23463046 / -1.5%	31397909 / 32083147 / -2.1%	0.74 / 0.73 / +0.6%

github-actions · 2026-11-02T20:14:13Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-1.2%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.012x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed	1800313 / 1786990 / +0.7%	7559302 / 6525029 / +15.9% 🔴	0.24 / 0.27 / -13.0%
statpopgen_q01/datafusion:vortex-file-compressed	3773044 / 3924966 / -3.9%	12491278 / 12052498 / +3.6%	0.30 / 0.33 / -7.2%
statpopgen_q02/datafusion:vortex-file-compressed	39732594 / 40522754 / -1.9%	65074299 / 63422291 / +2.6%	0.61 / 0.64 / -4.4%
statpopgen_q03/datafusion:vortex-file-compressed	116027678 / 117023688 / -0.9%	158659496 / 167541807 / -5.3%	0.73 / 0.70 / +4.7%
statpopgen_q04/datafusion:vortex-file-compressed	115478896 / 117348420 / -1.6%	155295244 / 153460061 / +1.2%	0.74 / 0.76 / -2.8%
statpopgen_q05/datafusion:vortex-file-compressed	70153030 / 69848306 / +0.4%	108221189 / 111952669 / -3.3%	0.65 / 0.62 / +3.9%
statpopgen_q06/datafusion:vortex-file-compressed	196088758 / 197538186 / -0.7%	230349771 / 230911962 / -0.2%	0.85 / 0.86 / -0.5%
statpopgen_q07/datafusion:vortex-file-compressed	277782840 / 278142722 / -0.1%	345715613 / 314190206 / +10.0% 🔴	0.80 / 0.89 / -9.2%
statpopgen_q08/datafusion:vortex-file-compressed	282501046 / 286587933 / -1.4%	317364092 / 319110335 / -0.5%	0.89 / 0.90 / -0.9%
statpopgen_q09/datafusion:vortex-file-compressed	97351332 / 97151824 / +0.2%	131956473 / 131441783 / +0.4%	0.74 / 0.74 / -0.2%
statpopgen_q10/datafusion:vortex-file-compressed	252945108 / 253561504 / -0.2%	300109014 / 297068460 / +1.0%	0.84 / 0.85 / -1.3%

datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact	1787780 / 1790284 / -0.1%	7653155 / 6490618 / +17.9% 🔴	0.23 / 0.28 / -15.3%
statpopgen_q01/datafusion:vortex-compact	3983478 / 3847938 / +3.5%	12251170 / 11777980 / +4.0%	0.33 / 0.33 / -0.5%
statpopgen_q02/datafusion:vortex-compact	42553485 / 42607028 / -0.1%	64066466 / 64072257 / -0.0%	0.66 / 0.66 / -0.1%
statpopgen_q03/datafusion:vortex-compact	121691444 / 127767266 / -4.8%	153456572 / 152801820 / +0.4%	0.79 / 0.84 / -5.2%
statpopgen_q04/datafusion:vortex-compact	120308236 / 120854292 / -0.5%	154646464 / 155363385 / -0.5%	0.78 / 0.78 / +0.0%
statpopgen_q05/datafusion:vortex-compact	73668468 / 75536345 / -2.5%	115782026 / 104019385 / +11.3% 🔴	0.64 / 0.73 / -12.4%
statpopgen_q06/datafusion:vortex-compact	201172112 / 195984942 / +2.6%	230951103 / 230391200 / +0.2%	0.87 / 0.85 / +2.4%
statpopgen_q07/datafusion:vortex-compact	350953651 / 352101054 / -0.3%	374001934 / 376981957 / -0.8%	0.94 / 0.93 / +0.5%
statpopgen_q08/datafusion:vortex-compact	356485568 / 356337092 / +0.0%	418206696 / 417943731 / +0.1%	0.85 / 0.85 / -0.0%
statpopgen_q09/datafusion:vortex-compact	100119336 / 100394786 / -0.3%	130570853 / 131241522 / -0.5%	0.77 / 0.76 / +0.2%
statpopgen_q10/datafusion:vortex-compact	255973896 / 256822300 / -0.3%	306134561 / 302470130 / +1.2%	0.84 / 0.85 / -1.5%

datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet	1924494 / 1939959 / -0.8%	90992053 / 88723746 / +2.6%	0.02 / 0.02 / -3.3%
statpopgen_q01/datafusion:parquet	163651977 / 163723141 / -0.0%	173267463 / 174351314 / -0.6%	0.94 / 0.94 / +0.6%
statpopgen_q02/datafusion:parquet	289162376 / 281183028 / +2.8%	423927771 / 435290869 / -2.6%	0.68 / 0.65 / +5.6%
statpopgen_q03/datafusion:parquet	385356795 / 393697801 / -2.1%	507781049 / 530241911 / -4.2%	0.76 / 0.74 / +2.2%
statpopgen_q04/datafusion:parquet	381498683 / 378208502 / +0.9%	504109679 / 511823732 / -1.5%	0.76 / 0.74 / +2.4%
statpopgen_q05/datafusion:parquet	331402876 / 305552658 / +8.5%	435354479 / 434520524 / +0.2%	0.76 / 0.70 / +8.3%
statpopgen_q06/datafusion:parquet	476022560 / 487307128 / -2.3%	653045604 / 637484901 / +2.4%	0.73 / 0.76 / -4.6%
statpopgen_q07/datafusion:parquet	420375748 / 421703442 / -0.3%	549546421 / 569540804 / -3.5%	0.76 / 0.74 / +3.3%
statpopgen_q08/datafusion:parquet	424138913 / 422151441 / +0.5%	548148364 / 561034350 / -2.3%	0.77 / 0.75 / +2.8%
statpopgen_q09/datafusion:parquet	360221964 / 358509414 / +0.5%	486979167 / 462703060 / +5.2%	0.74 / 0.77 / -4.5%
statpopgen_q10/datafusion:parquet	545504050 / 546708426 / -0.2%	700954197 / 676467452 / +3.6%	0.78 / 0.81 / -3.7%

duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	12890074 / 13290283 / -3.0%	14952974 / 15132573 / -1.2%	0.86 / 0.88 / -1.8%
statpopgen_q01/duckdb:vortex-file-compressed	13626465 / 14045338 / -3.0%	18048193 / 18420298 / -2.0%	0.76 / 0.76 / -1.0%
statpopgen_q02/duckdb:vortex-file-compressed	138596786 / 136719600 / +1.4%	155831626 / 156696327 / -0.6%	0.89 / 0.87 / +1.9%
statpopgen_q03/duckdb:vortex-file-compressed	318123035 / 319958942 / -0.6%	358483907 / 346565184 / +3.4%	0.89 / 0.92 / -3.9%
statpopgen_q04/duckdb:vortex-file-compressed	336330576 / 338178826 / -0.5%	355488024 / 363889590 / -2.3%	0.95 / 0.93 / +1.8%
statpopgen_q05/duckdb:vortex-file-compressed	97086687 / 98604936 / -1.5%	116997944 / 122345182 / -4.4%	0.83 / 0.81 / +3.0%
statpopgen_q06/duckdb:vortex-file-compressed	225685286 / 228218313 / -1.1%	248018292 / 251618322 / -1.4%	0.91 / 0.91 / +0.3%
statpopgen_q07/duckdb:vortex-file-compressed	139522692 / 141748746 / -1.6%	160835950 / 157341424 / +2.2%	0.87 / 0.90 / -3.7%
statpopgen_q08/duckdb:vortex-file-compressed	148563698 / 150411582 / -1.2%	167753048 / 172194861 / -2.6%	0.89 / 0.87 / +1.4%
statpopgen_q09/duckdb:vortex-file-compressed	284727922 / 307692676 / -7.5%	309454085 / 331277526 / -6.6%	0.92 / 0.93 / -0.9%
statpopgen_q10/duckdb:vortex-file-compressed	822071104 / 747554852 / +10.0%	839683098 / 755334542 / +11.2% 🔴	0.98 / 0.99 / -1.1%

duckdb / vortex-compact / ns (0.998x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact	12823774 / 13062718 / -1.8%	14932896 / 15187471 / -1.7%	0.86 / 0.86 / -0.2%
statpopgen_q01/duckdb:vortex-compact	13811053 / 14091910 / -2.0%	18378716 / 18474940 / -0.5%	0.75 / 0.76 / -1.5%
statpopgen_q02/duckdb:vortex-compact	124667662 / 125103806 / -0.3%	158551457 / 160655243 / -1.3%	0.79 / 0.78 / +1.0%
statpopgen_q03/duckdb:vortex-compact	357098602 / 318310463 / +12.2% 🔴	375536482 / 354693252 / +5.9%	0.95 / 0.90 / +6.0%
statpopgen_q04/duckdb:vortex-compact	336487838 / 320515142 / +5.0%	366125988 / 342369503 / +6.9%	0.92 / 0.94 / -1.8%
statpopgen_q05/duckdb:vortex-compact	102231182 / 101105094 / +1.1%	122639643 / 121717556 / +0.8%	0.83 / 0.83 / +0.4%
statpopgen_q06/duckdb:vortex-compact	230561517 / 231841218 / -0.6%	252683035 / 251725996 / +0.4%	0.91 / 0.92 / -0.9%
statpopgen_q07/duckdb:vortex-compact	199072052 / 200165738 / -0.5%	216080625 / 220472599 / -2.0%	0.92 / 0.91 / +1.5%
statpopgen_q08/duckdb:vortex-compact	216029230 / 213954644 / +1.0%	221049298 / 226575220 / -2.4%	0.98 / 0.94 / +3.5%
statpopgen_q09/duckdb:vortex-compact	285726796 / 295253806 / -3.2%	308524321 / 313891833 / -1.7%	0.93 / 0.94 / -1.5%
statpopgen_q10/duckdb:vortex-compact	720194784 / 809717448 / -11.1% 🟢	819070365 / 820778225 / -0.2%	0.88 / 0.99 / -10.9%

duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	243670202 / 250697500 / -2.8%	243542175 / 250083644 / -2.6%	1.00 / 1.00 / -0.2%
statpopgen_q01/duckdb:parquet	304293820 / 309968334 / -1.8%	303314210 / 310569398 / -2.3%	1.00 / 1.00 / +0.5%
statpopgen_q02/duckdb:parquet	577691970 / 594148779 / -2.8%	574221349 / 584960684 / -1.8%	1.01 / 1.02 / -1.0%
statpopgen_q03/duckdb:parquet	751423916 / 746581268 / +0.6%	798032081 / 815853714 / -2.2%	0.94 / 0.92 / +2.9%
statpopgen_q04/duckdb:parquet	720343704 / 765811118 / -5.9%	806475089 / 832254972 / -3.1%	0.89 / 0.92 / -2.9%
statpopgen_q05/duckdb:parquet	537370953 / 536294115 / +0.2%	575861954 / 579219980 / -0.6%	0.93 / 0.93 / +0.8%
statpopgen_q06/duckdb:parquet	657703706 / 636596122 / +3.3%	705583990 / 693493960 / +1.7%	0.93 / 0.92 / +1.5%
statpopgen_q07/duckdb:parquet	559128774 / 568047210 / -1.6%	563217278 / 564861044 / -0.3%	0.99 / 1.01 / -1.3%
statpopgen_q08/duckdb:parquet	564832014 / 572145233 / -1.3%	559203643 / 570963792 / -2.1%	1.01 / 1.00 / +0.8%
statpopgen_q09/duckdb:parquet	721139435 / 720286346 / +0.1%	785881477 / 786809437 / -0.1%	0.92 / 0.92 / +0.2%
statpopgen_q10/duckdb:parquet	1004585306 / 1017658846 / -1.3%	1074778303 / 1173557474 / -8.4%	0.93 / 0.87 / +7.8%

github-actions · 2026-11-02T20:15:20Z

Benchmarks: FineWeb S3 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.0%
Engines: DataFusion No clear signal (-16.7%, environment too noisy confidence) · DuckDB No clear signal (+12.9%, environment too noisy confidence)
Vortex (geomean): hot 0.966x ➖ · cold 0.965x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.048x ➖
Shifts: Parquet (control) -0.3% · Median polish -2.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.933x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	35124120 / 48239669 / -27.2%	117909816 / 213246901 / -44.7% 🟢	0.30 / 0.23 / +31.7%
fineweb_q01/datafusion:vortex-file-compressed	328202584 / 288069681 / +13.9%	619958071 / 437414978 / +41.7% 🔴	0.53 / 0.66 / -19.6%
fineweb_q02/datafusion:vortex-file-compressed	260178313 / 259757479 / +0.2%	308101228 / 407809381 / -24.4%	0.84 / 0.64 / +32.6%
fineweb_q03/datafusion:vortex-file-compressed	409888823 / 508212586 / -19.3%	495251134 / 595045335 / -16.8%	0.83 / 0.85 / -3.1%
fineweb_q04/datafusion:vortex-file-compressed	415925106 / 415416734 / +0.1%	436328886 / 457258505 / -4.6%	0.95 / 0.91 / +4.9%
fineweb_q05/datafusion:vortex-file-compressed	481464906 / 730824214 / -34.1% 🟢	516851724 / 706275842 / -26.8%	0.93 / 1.03 / -10.0%
fineweb_q06/datafusion:vortex-file-compressed	695458438 / 696884922 / -0.2%	848677232 / 825843514 / +2.8%	0.82 / 0.84 / -2.9%
fineweb_q07/datafusion:vortex-file-compressed	529128144 / 466141378 / +13.5%	622154714 / 474434483 / +31.1% 🔴	0.85 / 0.98 / -13.4%
fineweb_q08/datafusion:vortex-file-compressed	184878258 / 172038132 / +7.5%	196134584 / 188511224 / +4.0%	0.94 / 0.91 / +3.3%

datafusion / vortex-compact / ns (0.940x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	33670126 / 38202518 / -11.9%	131446714 / 111156343 / +18.3%	0.26 / 0.34 / -25.5%
fineweb_q01/datafusion:vortex-compact	343709944 / 358486699 / -4.1%	572971232 / 597271946 / -4.1%	0.60 / 0.60 / -0.1%
fineweb_q02/datafusion:vortex-compact	374058832 / 302195920 / +23.8%	442913588 / 438277819 / +1.1%	0.84 / 0.69 / +22.5%
fineweb_q03/datafusion:vortex-compact	532052916 / 705137512 / -24.5%	584385235 / 739630955 / -21.0%	0.91 / 0.95 / -4.5%
fineweb_q04/datafusion:vortex-compact	499815490 / 501409286 / -0.3%	609725968 / 526753727 / +15.8%	0.82 / 0.95 / -13.9%
fineweb_q05/datafusion:vortex-compact	530353170 / 546619040 / -3.0%	553449802 / 576789170 / -4.0%	0.96 / 0.95 / +1.1%
fineweb_q06/datafusion:vortex-compact	716631212 / 562857251 / +27.3%	801180852 / 581349564 / +37.8% 🔴	0.89 / 0.97 / -7.6%
fineweb_q07/datafusion:vortex-compact	514162365 / 509912224 / +0.8%	554447362 / 700594403 / -20.9%	0.93 / 0.73 / +27.4%
fineweb_q08/datafusion:vortex-compact	149649416 / 256005330 / -41.5% 🟢	149776904 / 278513231 / -46.2% 🟢	1.00 / 0.92 / +8.7%

datafusion / parquet / ns (1.125x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	709851620 / 383063250 / +85.3% 🔴	957200677 / 814923804 / +17.5%	0.74 / 0.47 / +57.8%
fineweb_q01/datafusion:parquet	941573125 / 739897609 / +27.3%	905334292 / 751428159 / +20.5%	1.04 / 0.98 / +5.6%
fineweb_q02/datafusion:parquet	1308925484 / 750212498 / +74.5% 🔴	3160007641 / 676475042 / +367.1% 🔴	0.41 / 1.11 / -62.6%
fineweb_q03/datafusion:parquet	798525458 / 735895957 / +8.5%	846037641 / 712524033 / +18.7%	0.94 / 1.03 / -8.6%
fineweb_q04/datafusion:parquet	747874198 / 685394162 / +9.1%	831081217 / 883379196 / -5.9%	0.90 / 0.78 / +16.0%
fineweb_q05/datafusion:parquet	750823864 / 854911060 / -12.2%	690858373 / 826517105 / -16.4%	1.09 / 1.03 / +5.1%
fineweb_q06/datafusion:parquet	764201637 / 785414761 / -2.7%	680353585 / 792591513 / -14.2%	1.12 / 0.99 / +13.4%
fineweb_q07/datafusion:parquet	743984940 / 811607217 / -8.3%	779272141 / 724548821 / +7.6%	0.95 / 1.12 / -14.8%
fineweb_q08/datafusion:parquet	665920758 / 881457006 / -24.5%	778548247 / 880650885 / -11.6%	0.86 / 1.00 / -14.5%

duckdb / vortex-file-compressed / ns (0.989x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	79259522 / 68861578 / +15.1%	86454631 / 85435025 / +1.2%	0.92 / 0.81 / +13.7%
fineweb_q01/duckdb:vortex-file-compressed	296861906 / 268266337 / +10.7%	325507906 / 335008965 / -2.8%	0.91 / 0.80 / +13.9%
fineweb_q02/duckdb:vortex-file-compressed	412608665 / 388901102 / +6.1%	361139842 / 327288945 / +10.3%	1.14 / 1.19 / -3.8%
fineweb_q03/duckdb:vortex-file-compressed	930806068 / 820082708 / +13.5%	1022341191 / 925293089 / +10.5%	0.91 / 0.89 / +2.7%
fineweb_q04/duckdb:vortex-file-compressed	915460990 / 942414012 / -2.9%	1011579413 / 975833326 / +3.7%	0.90 / 0.97 / -6.3%
fineweb_q05/duckdb:vortex-file-compressed	858702498 / 898273650 / -4.4%	954500957 / 967869540 / -1.4%	0.90 / 0.93 / -3.1%
fineweb_q06/duckdb:vortex-file-compressed	944998124 / 894595712 / +5.6%	1070443107 / 955222429 / +12.1%	0.88 / 0.94 / -5.7%
fineweb_q07/duckdb:vortex-file-compressed	886655582 / 870696724 / +1.8%	977947530 / 903021215 / +8.3%	0.91 / 0.96 / -6.0%
fineweb_q08/duckdb:vortex-file-compressed	193401038 / 326247913 / -40.7% 🟢	225187139 / 310764368 / -27.5%	0.86 / 1.05 / -18.2%

duckdb / vortex-compact / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	67783196 / 71429004 / -5.1%	98975012 / 116616686 / -15.1%	0.68 / 0.61 / +11.8%
fineweb_q01/duckdb:vortex-compact	329251566 / 300795396 / +9.5%	353002726 / 321426963 / +9.8%	0.93 / 0.94 / -0.3%
fineweb_q02/duckdb:vortex-compact	359953842 / 344256558 / +4.6%	461929750 / 347463231 / +32.9% 🔴	0.78 / 0.99 / -21.4%
fineweb_q03/duckdb:vortex-compact	967143905 / 826953692 / +17.0%	975524530 / 879941358 / +10.9%	0.99 / 0.94 / +5.5%
fineweb_q04/duckdb:vortex-compact	867995979 / 1005722118 / -13.7%	970214822 / 1006781266 / -3.6%	0.89 / 1.00 / -10.4%
fineweb_q05/duckdb:vortex-compact	848973748 / 840565438 / +1.0%	861103031 / 1057000864 / -18.5%	0.99 / 0.80 / +24.0%
fineweb_q06/duckdb:vortex-compact	881369840 / 858212369 / +2.7%	918423102 / 1091213193 / -15.8%	0.96 / 0.79 / +22.0%
fineweb_q07/duckdb:vortex-compact	831311066 / 825034270 / +0.8%	907573047 / 922356363 / -1.6%	0.92 / 0.89 / +2.4%
fineweb_q08/duckdb:vortex-compact	196190786 / 216920455 / -9.6%	256399993 / 253764810 / +1.0%	0.77 / 0.85 / -10.5%

duckdb / parquet / ns (0.883x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	333358759 / 472635278 / -29.5%	403722054 / 549581117 / -26.5%	0.83 / 0.86 / -4.0%
fineweb_q01/duckdb:parquet	414762968 / 559716294 / -25.9%	438149160 / 584442549 / -25.0%	0.95 / 0.96 / -1.2%
fineweb_q02/duckdb:parquet	509520752 / 533326897 / -4.5%	572303489 / 591837435 / -3.3%	0.89 / 0.90 / -1.2%
fineweb_q03/duckdb:parquet	663853931 / 745613106 / -11.0%	856335537 / 874624795 / -2.1%	0.78 / 0.85 / -9.1%
fineweb_q04/duckdb:parquet	654653278 / 810994768 / -19.3%	808692529 / 863559654 / -6.4%	0.81 / 0.94 / -13.8%
fineweb_q05/duckdb:parquet	766411251 / 870677710 / -12.0%	978588208 / 842031781 / +16.2%	0.78 / 1.03 / -24.3%
fineweb_q06/duckdb:parquet	790432666 / 721481892 / +9.6%	879858332 / 822958798 / +6.9%	0.90 / 0.88 / +2.5%
fineweb_q07/duckdb:parquet	717138567 / 747729269 / -4.1%	724169867 / 808193231 / -10.4%	0.99 / 0.93 / +7.0%
fineweb_q08/duckdb:parquet	298240340 / 303434658 / -1.7%	346198861 / 404486296 / -14.4%	0.86 / 0.75 / +14.8%

github-actions · 2026-11-02T20:15:49Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.003x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.011x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	93034979 / 92908552 / +0.1%	154975884 / 159373044 / -2.8%	0.60 / 0.58 / +3.0%
tpch_q02/datafusion:vortex-file-compressed	64999636 / 64160771 / +1.3%	96528357 / 97878107 / -1.4%	0.67 / 0.66 / +2.7%
tpch_q03/datafusion:vortex-file-compressed	63333139 / 63641474 / -0.5%	112668075 / 125843574 / -10.5% 🟢	0.56 / 0.51 / +11.2%
tpch_q04/datafusion:vortex-file-compressed	34145586 / 33889539 / +0.8%	74927160 / 73479619 / +2.0%	0.46 / 0.46 / -1.2%
tpch_q05/datafusion:vortex-file-compressed	118290777 / 117409591 / +0.8%	176779912 / 169718292 / +4.2%	0.67 / 0.69 / -3.3%
tpch_q06/datafusion:vortex-file-compressed	10654689 / 10890114 / -2.2%	58170307 / 57227742 / +1.6%	0.18 / 0.19 / -3.7%
tpch_q07/datafusion:vortex-file-compressed	134593626 / 132193114 / +1.8%	197587890 / 205427364 / -3.8%	0.68 / 0.64 / +5.9%
tpch_q08/datafusion:vortex-file-compressed	144082268 / 141739927 / +1.7%	214214039 / 218208609 / -1.8%	0.67 / 0.65 / +3.5%
tpch_q09/datafusion:vortex-file-compressed	185617943 / 182616256 / +1.6%	267268389 / 256599328 / +4.2%	0.69 / 0.71 / -2.4%
tpch_q10/datafusion:vortex-file-compressed	69779570 / 70000523 / -0.3%	138203372 / 134770293 / +2.5%	0.50 / 0.52 / -2.8%
tpch_q11/datafusion:vortex-file-compressed	42813637 / 43393805 / -1.3%	69380084 / 67804287 / +2.3%	0.62 / 0.64 / -3.6%
tpch_q12/datafusion:vortex-file-compressed	35137422 / 35177432 / -0.1%	81874617 / 77286493 / +5.9%	0.43 / 0.46 / -5.7%
tpch_q13/datafusion:vortex-file-compressed	47901824 / 46485276 / +3.0%	81971743 / 79306360 / +3.4%	0.58 / 0.59 / -0.3%
tpch_q14/datafusion:vortex-file-compressed	21694473 / 21460543 / +1.1%	87852374 / 86466970 / +1.6%	0.25 / 0.25 / -0.5%
tpch_q15/datafusion:vortex-file-compressed	33886767 / 34214663 / -1.0%	92005230 / 86138557 / +6.8%	0.37 / 0.40 / -7.3%
tpch_q16/datafusion:vortex-file-compressed	37138397 / 36983594 / +0.4%	66500562 / 65846677 / +1.0%	0.56 / 0.56 / -0.6%
tpch_q17/datafusion:vortex-file-compressed	179906599 / 177342554 / +1.4%	224576440 / 245213968 / -8.4%	0.80 / 0.72 / +10.8%
tpch_q18/datafusion:vortex-file-compressed	205068076 / 204275794 / +0.4%	271506498 / 269844489 / +0.6%	0.76 / 0.76 / -0.2%
tpch_q19/datafusion:vortex-file-compressed	29436864 / 29724791 / -1.0%	88446742 / 83200929 / +6.3%	0.33 / 0.36 / -6.8%
tpch_q20/datafusion:vortex-file-compressed	60867537 / 60679370 / +0.3%	119932744 / 115962700 / +3.4%	0.51 / 0.52 / -3.0%
tpch_q21/datafusion:vortex-file-compressed	177307664 / 177728345 / -0.2%	237822809 / 244566303 / -2.8%	0.75 / 0.73 / +2.6%
tpch_q22/datafusion:vortex-file-compressed	25068419 / 25347137 / -1.1%	52950950 / 52603339 / +0.7%	0.47 / 0.48 / -1.7%

datafusion / vortex-compact / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	101570532 / 102091180 / -0.5%	151280409 / 154455020 / -2.1%	0.67 / 0.66 / +1.6%
tpch_q02/datafusion:vortex-compact	64603642 / 65916353 / -2.0%	91849262 / 96077867 / -4.4%	0.70 / 0.69 / +2.5%
tpch_q03/datafusion:vortex-compact	67689360 / 67980682 / -0.4%	113687688 / 113495664 / +0.2%	0.60 / 0.60 / -0.6%
tpch_q04/datafusion:vortex-compact	38016294 / 37999990 / +0.0%	68417162 / 66587384 / +2.7%	0.56 / 0.57 / -2.6%
tpch_q05/datafusion:vortex-compact	119434742 / 117600361 / +1.6%	173466797 / 172844625 / +0.4%	0.69 / 0.68 / +1.2%
tpch_q06/datafusion:vortex-compact	15541125 / 15318754 / +1.5%	48252276 / 48644095 / -0.8%	0.32 / 0.31 / +2.3%
tpch_q07/datafusion:vortex-compact	141115718 / 139796158 / +0.9%	203079675 / 195338369 / +4.0%	0.69 / 0.72 / -2.9%
tpch_q08/datafusion:vortex-compact	144661637 / 143856686 / +0.6%	213920021 / 211207159 / +1.3%	0.68 / 0.68 / -0.7%
tpch_q09/datafusion:vortex-compact	187083613 / 186690208 / +0.2%	262712485 / 251897250 / +4.3%	0.71 / 0.74 / -3.9%
tpch_q10/datafusion:vortex-compact	78511218 / 78593994 / -0.1%	125059884 / 128717936 / -2.8%	0.63 / 0.61 / +2.8%
tpch_q11/datafusion:vortex-compact	43468692 / 43943290 / -1.1%	66139730 / 70647308 / -6.4%	0.66 / 0.62 / +5.7%
tpch_q12/datafusion:vortex-compact	47336657 / 47907349 / -1.2%	77046351 / 77791822 / -1.0%	0.61 / 0.62 / -0.2%
tpch_q13/datafusion:vortex-compact	56385336 / 56816306 / -0.8%	91238791 / 85416985 / +6.8%	0.62 / 0.67 / -7.1%
tpch_q14/datafusion:vortex-compact	25367855 / 25174923 / +0.8%	86839751 / 91118278 / -4.7%	0.29 / 0.28 / +5.7%
tpch_q15/datafusion:vortex-compact	46534490 / 46790556 / -0.5%	98075343 / 102740551 / -4.5%	0.47 / 0.46 / +4.2%
tpch_q16/datafusion:vortex-compact	38495940 / 38553683 / -0.1%	69252405 / 68607062 / +0.9%	0.56 / 0.56 / -1.1%
tpch_q17/datafusion:vortex-compact	178528352 / 178890640 / -0.2%	226859609 / 222423789 / +2.0%	0.79 / 0.80 / -2.2%
tpch_q18/datafusion:vortex-compact	202701501 / 202391604 / +0.2%	259815634 / 261163102 / -0.5%	0.78 / 0.77 / +0.7%
tpch_q19/datafusion:vortex-compact	35102165 / 35774518 / -1.9%	83338590 / 80438653 / +3.6%	0.42 / 0.44 / -5.3%
tpch_q20/datafusion:vortex-compact	65603263 / 65089646 / +0.8%	117769219 / 119027421 / -1.1%	0.56 / 0.55 / +1.9%
tpch_q21/datafusion:vortex-compact	188073415 / 186027171 / +1.1%	236666653 / 244043154 / -3.0%	0.79 / 0.76 / +4.3%
tpch_q22/datafusion:vortex-compact	26310694 / 26576501 / -1.0%	54332892 / 55825312 / -2.7%	0.48 / 0.48 / +1.7%

datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	87199900 / 87550577 / -0.4%	127965939 / 128204946 / -0.2%	0.68 / 0.68 / -0.2%
tpch_q02/datafusion:parquet	173088403 / 173147265 / -0.0%	198003881 / 196404699 / +0.8%	0.87 / 0.88 / -0.8%
tpch_q03/datafusion:parquet	135183769 / 134856023 / +0.2%	186407729 / 181748961 / +2.6%	0.73 / 0.74 / -2.3%
tpch_q04/datafusion:parquet	57642681 / 57800665 / -0.3%	97542057 / 90958015 / +7.2%	0.59 / 0.64 / -7.0%
tpch_q05/datafusion:parquet	167676404 / 167295214 / +0.2%	228234530 / 224125516 / +1.8%	0.73 / 0.75 / -1.6%
tpch_q06/datafusion:parquet	36329786 / 36532211 / -0.6%	78551724 / 76485165 / +2.7%	0.46 / 0.48 / -3.2%
tpch_q07/datafusion:parquet	215974893 / 214927599 / +0.5%	270611240 / 277940762 / -2.6%	0.80 / 0.77 / +3.2%
tpch_q08/datafusion:parquet	218307333 / 217309569 / +0.5%	288493048 / 283416772 / +1.8%	0.76 / 0.77 / -1.3%
tpch_q09/datafusion:parquet	309079219 / 309086704 / -0.0%	380013990 / 388770992 / -2.3%	0.81 / 0.80 / +2.3%
tpch_q10/datafusion:parquet	309916470 / 312396491 / -0.8%	374692896 / 375617512 / -0.2%	0.83 / 0.83 / -0.5%
tpch_q11/datafusion:parquet	128233970 / 127382432 / +0.7%	153203235 / 150278571 / +1.9%	0.84 / 0.85 / -1.3%
tpch_q12/datafusion:parquet	82735325 / 82565703 / +0.2%	121629147 / 123280816 / -1.3%	0.68 / 0.67 / +1.6%
tpch_q13/datafusion:parquet	210484197 / 209874808 / +0.3%	241985442 / 242324507 / -0.1%	0.87 / 0.87 / +0.4%
tpch_q14/datafusion:parquet	86623274 / 86829863 / -0.2%	192412717 / 191263049 / +0.6%	0.45 / 0.45 / -0.8%
tpch_q15/datafusion:parquet	107595963 / 104983772 / +2.5%	160404108 / 156414034 / +2.6%	0.67 / 0.67 / -0.1%
tpch_q16/datafusion:parquet	96392030 / 95106194 / +1.4%	124300612 / 121945435 / +1.9%	0.78 / 0.78 / -0.6%
tpch_q17/datafusion:parquet	217351440 / 215231793 / +1.0%	275257095 / 264688785 / +4.0%	0.79 / 0.81 / -2.9%
tpch_q18/datafusion:parquet	270108537 / 270387275 / -0.1%	318402464 / 314998364 / +1.1%	0.85 / 0.86 / -1.2%
tpch_q19/datafusion:parquet	108203067 / 107919095 / +0.3%	168807684 / 172540281 / -2.2%	0.64 / 0.63 / +2.5%
tpch_q20/datafusion:parquet	185966676 / 186424401 / -0.2%	245638428 / 252984825 / -2.9%	0.76 / 0.74 / +2.7%
tpch_q21/datafusion:parquet	245521206 / 243655727 / +0.8%	304779429 / 306501729 / -0.6%	0.81 / 0.79 / +1.3%
tpch_q22/datafusion:parquet	150137281 / 149772782 / +0.2%	177136548 / 174983536 / +1.2%	0.85 / 0.86 / -1.0%

duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	33283867 / 32851926 / +1.3%	72329704 / 66818123 / +8.2%	0.46 / 0.49 / -6.4%
tpch_q02/duckdb:vortex-file-compressed	28906869 / 28474545 / +1.5%	42007479 / 42412369 / -1.0%	0.69 / 0.67 / +2.5%
tpch_q03/duckdb:vortex-file-compressed	53153912 / 53202682 / -0.1%	105325333 / 103155056 / +2.1%	0.50 / 0.52 / -2.2%
tpch_q04/duckdb:vortex-file-compressed	51562791 / 51734558 / -0.3%	91819911 / 90458558 / +1.5%	0.56 / 0.57 / -1.8%
tpch_q05/duckdb:vortex-file-compressed	68474746 / 68936838 / -0.7%	112500215 / 112027367 / +0.4%	0.61 / 0.62 / -1.1%
tpch_q06/duckdb:vortex-file-compressed	15754948 / 15589669 / +1.1%	51721221 / 53989315 / -4.2%	0.30 / 0.29 / +5.5%
tpch_q07/duckdb:vortex-file-compressed	55502281 / 55495414 / +0.0%	111182409 / 108878927 / +2.1%	0.50 / 0.51 / -2.1%
tpch_q08/duckdb:vortex-file-compressed	88450165 / 87419095 / +1.2%	134041560 / 135012239 / -0.7%	0.66 / 0.65 / +1.9%
tpch_q09/duckdb:vortex-file-compressed	103612893 / 103268438 / +0.3%	159742346 / 158763897 / +0.6%	0.65 / 0.65 / -0.3%
tpch_q10/duckdb:vortex-file-compressed	96206459 / 96347781 / -0.1%	148647194 / 150090886 / -1.0%	0.65 / 0.64 / +0.8%
tpch_q11/duckdb:vortex-file-compressed	13877741 / 13111481 / +5.8%	28855433 / 27049703 / +6.7%	0.48 / 0.48 / -0.8%
tpch_q12/duckdb:vortex-file-compressed	45170922 / 45371353 / -0.4%	83793798 / 81143885 / +3.3%	0.54 / 0.56 / -3.6%
tpch_q13/duckdb:vortex-file-compressed	72842308 / 72192432 / +0.9%	99979303 / 103606255 / -3.5%	0.73 / 0.70 / +4.6%
tpch_q14/duckdb:vortex-file-compressed	28378148 / 28183824 / +0.7%	73978560 / 73675264 / +0.4%	0.38 / 0.38 / +0.3%
tpch_q15/duckdb:vortex-file-compressed	25072479 / 24897614 / +0.7%	65323460 / 63865343 / +2.3%	0.38 / 0.39 / -1.5%
tpch_q16/duckdb:vortex-file-compressed	48363909 / 49495672 / -2.3%	59753474 / 57072012 / +4.7%	0.81 / 0.87 / -6.7%
tpch_q17/duckdb:vortex-file-compressed	34913663 / 34715954 / +0.6%	69957136 / 66729986 / +4.8%	0.50 / 0.52 / -4.1%
tpch_q18/duckdb:vortex-file-compressed	108758136 / 106533395 / +2.1%	126475365 / 122985738 / +2.8%	0.86 / 0.87 / -0.7%
tpch_q19/duckdb:vortex-file-compressed	27750806 / 28178225 / -1.5%	77008708 / 76011113 / +1.3%	0.36 / 0.37 / -2.8%
tpch_q20/duckdb:vortex-file-compressed	41934621 / 41776089 / +0.4%	92796008 / 94945604 / -2.3%	0.45 / 0.44 / +2.7%
tpch_q21/duckdb:vortex-file-compressed	96627807 / 95831255 / +0.8%	149650428 / 150764301 / -0.7%	0.65 / 0.64 / +1.6%
tpch_q22/duckdb:vortex-file-compressed	33430928 / 33321430 / +0.3%	50078163 / 48885014 / +2.4%	0.67 / 0.68 / -2.1%

duckdb / vortex-compact / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	45946695 / 47109764 / -2.5%	75003614 / 74185842 / +1.1%	0.61 / 0.64 / -3.5%
tpch_q02/duckdb:vortex-compact	31771829 / 31287201 / +1.5%	44725875 / 46090533 / -3.0%	0.71 / 0.68 / +4.6%
tpch_q03/duckdb:vortex-compact	58555808 / 58593081 / -0.1%	101296523 / 98213098 / +3.1%	0.58 / 0.60 / -3.1%
tpch_q04/duckdb:vortex-compact	54386486 / 54431280 / -0.1%	83876139 / 80353361 / +4.4%	0.65 / 0.68 / -4.3%
tpch_q05/duckdb:vortex-compact	71567983 / 70837841 / +1.0%	108189257 / 106811643 / +1.3%	0.66 / 0.66 / -0.3%
tpch_q06/duckdb:vortex-compact	19796949 / 20113037 / -1.6%	50358098 / 51226245 / -1.7%	0.39 / 0.39 / +0.1%
tpch_q07/duckdb:vortex-compact	64053113 / 63867570 / +0.3%	108863238 / 107251662 / +1.5%	0.59 / 0.60 / -1.2%
tpch_q08/duckdb:vortex-compact	89205307 / 91766582 / -2.8%	128153652 / 126515468 / +1.3%	0.70 / 0.73 / -4.0%
tpch_q09/duckdb:vortex-compact	109516654 / 109295950 / +0.2%	153949915 / 157810860 / -2.4%	0.71 / 0.69 / +2.7%
tpch_q10/duckdb:vortex-compact	105088571 / 104385190 / +0.7%	141647127 / 145669284 / -2.8%	0.74 / 0.72 / +3.5%
tpch_q11/duckdb:vortex-compact	14290959 / 13806812 / +3.5%	28884501 / 29516603 / -2.1%	0.49 / 0.47 / +5.8%
tpch_q12/duckdb:vortex-compact	60160666 / 59679269 / +0.8%	82290027 / 81094287 / +1.5%	0.73 / 0.74 / -0.7%
tpch_q13/duckdb:vortex-compact	77894670 / 76574763 / +1.7%	101484410 / 100701601 / +0.8%	0.77 / 0.76 / +0.9%
tpch_q14/duckdb:vortex-compact	33162712 / 33275897 / -0.3%	73478904 / 72264765 / +1.7%	0.45 / 0.46 / -2.0%
tpch_q15/duckdb:vortex-compact	31410159 / 31394581 / +0.0%	65926329 / 65532445 / +0.6%	0.48 / 0.48 / -0.5%
tpch_q16/duckdb:vortex-compact	51064659 / 50161807 / +1.8%	59819840 / 61115087 / -2.1%	0.85 / 0.82 / +4.0%
tpch_q17/duckdb:vortex-compact	37010898 / 36562470 / +1.2%	66940968 / 67376377 / -0.6%	0.55 / 0.54 / +1.9%
tpch_q18/duckdb:vortex-compact	110975470 / 108751386 / +2.0%	119046404 / 122477386 / -2.8%	0.93 / 0.89 / +5.0%
tpch_q19/duckdb:vortex-compact	34394313 / 34831460 / -1.3%	76691379 / 79039720 / -3.0%	0.45 / 0.44 / +1.8%
tpch_q20/duckdb:vortex-compact	52891401 / 51981753 / +1.7%	94997370 / 94426160 / +0.6%	0.56 / 0.55 / +1.1%
tpch_q21/duckdb:vortex-compact	104612558 / 106696793 / -2.0%	147136453 / 148749955 / -1.1%	0.71 / 0.72 / -0.9%
tpch_q22/duckdb:vortex-compact	35163533 / 35153236 / +0.0%	50891573 / 52204017 / -2.5%	0.69 / 0.67 / +2.6%

duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	67485574 / 67724439 / -0.4%	90112994 / 88364939 / +2.0%	0.75 / 0.77 / -2.3%
tpch_q02/duckdb:parquet	87199041 / 87256179 / -0.1%	98513475 / 96896877 / +1.7%	0.89 / 0.90 / -1.7%
tpch_q03/duckdb:parquet	109953032 / 110709525 / -0.7%	146631532 / 143346690 / +2.3%	0.75 / 0.77 / -2.9%
tpch_q04/duckdb:parquet	76749150 / 76711850 / +0.0%	98936934 / 96258106 / +2.8%	0.78 / 0.80 / -2.7%
tpch_q05/duckdb:parquet	122952532 / 122070224 / +0.7%	155499986 / 157286801 / -1.1%	0.79 / 0.78 / +1.9%
tpch_q06/duckdb:parquet	35586199 / 35726006 / -0.4%	61244361 / 58235423 / +5.2%	0.58 / 0.61 / -5.3%
tpch_q07/duckdb:parquet	116595740 / 116962996 / -0.3%	157163689 / 153894252 / +2.1%	0.74 / 0.76 / -2.4%
tpch_q08/duckdb:parquet	147221411 / 147483589 / -0.2%	189550757 / 190848623 / -0.7%	0.78 / 0.77 / +0.5%
tpch_q09/duckdb:parquet	237228472 / 236450460 / +0.3%	279189720 / 275436157 / +1.4%	0.85 / 0.86 / -1.0%
tpch_q10/duckdb:parquet	313713206 / 312484158 / +0.4%	342620007 / 339631218 / +0.9%	0.92 / 0.92 / -0.5%
tpch_q11/duckdb:parquet	43577635 / 43491597 / +0.2%	50612227 / 50164201 / +0.9%	0.86 / 0.87 / -0.7%
tpch_q12/duckdb:parquet	70525271 / 70085856 / +0.6%	92486514 / 90951564 / +1.7%	0.76 / 0.77 / -1.0%
tpch_q13/duckdb:parquet	292805217 / 293177210 / -0.1%	309346813 / 312414576 / -1.0%	0.95 / 0.94 / +0.9%
tpch_q14/duckdb:parquet	101785467 / 101323373 / +0.5%	138902995 / 139021558 / -0.1%	0.73 / 0.73 / +0.5%
tpch_q15/duckdb:parquet	57751787 / 58426124 / -1.2%	85684387 / 85787126 / -0.1%	0.67 / 0.68 / -1.0%
tpch_q16/duckdb:parquet	100676903 / 99974660 / +0.7%	107949455 / 106890891 / +1.0%	0.93 / 0.94 / -0.3%
tpch_q17/duckdb:parquet	81651475 / 81029422 / +0.8%	117464478 / 112900268 / +4.0%	0.70 / 0.72 / -3.1%
tpch_q18/duckdb:parquet	154403134 / 155452778 / -0.7%	179060603 / 175087217 / +2.3%	0.86 / 0.89 / -2.9%
tpch_q19/duckdb:parquet	97260194 / 98955670 / -1.7%	136233570 / 129517035 / +5.2%	0.71 / 0.76 / -6.6%
tpch_q20/duckdb:parquet	147204053 / 147123845 / +0.1%	185962568 / 184285390 / +0.9%	0.79 / 0.80 / -0.8%
tpch_q21/duckdb:parquet	254507000 / 251472596 / +1.2%	276595989 / 271550543 / +1.9%	0.92 / 0.93 / -0.6%
tpch_q22/duckdb:parquet	168025815 / 168386550 / -0.2%	180547600 / 180008277 / +0.3%	0.93 / 0.94 / -0.5%

duckdb / duckdb / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb	23735318 / 23527383 / +0.9%	54429469 / 55596344 / -2.1%	0.44 / 0.42 / +3.0%
tpch_q02/duckdb:duckdb	20319844 / 20392450 / -0.4%	33905106 / 33323993 / +1.7%	0.60 / 0.61 / -2.1%
tpch_q03/duckdb:duckdb	46181656 / 45073278 / +2.5%	78574745 / 77975104 / +0.8%	0.59 / 0.58 / +1.7%
tpch_q04/duckdb:duckdb	55944119 / 55891573 / +0.1%	80712181 / 81133421 / -0.5%	0.69 / 0.69 / +0.6%
tpch_q05/duckdb:duckdb	59608771 / 59331836 / +0.5%	91196754 / 94021025 / -3.0%	0.65 / 0.63 / +3.6%
tpch_q06/duckdb:duckdb	14760674 / 14585307 / +1.2%	44512642 / 41665243 / +6.8%	0.33 / 0.35 / -5.3%
tpch_q07/duckdb:duckdb	43201817 / 43534231 / -0.8%	78490489 / 80791549 / -2.8%	0.55 / 0.54 / +2.1%
tpch_q08/duckdb:duckdb	65645434 / 66839706 / -1.8%	106432637 / 106570391 / -0.1%	0.62 / 0.63 / -1.7%
tpch_q09/duckdb:duckdb	77430237 / 76704487 / +0.9%	114878627 / 114834792 / +0.0%	0.67 / 0.67 / +0.9%
tpch_q10/duckdb:duckdb	92599884 / 91811512 / +0.9%	125593929 / 125386928 / +0.2%	0.74 / 0.73 / +0.7%
tpch_q11/duckdb:duckdb	9934281 / 9731742 / +2.1%	18140868 / 18001626 / +0.8%	0.55 / 0.54 / +1.3%
tpch_q12/duckdb:duckdb	40247100 / 39748812 / +1.3%	68939361 / 69198076 / -0.4%	0.58 / 0.57 / +1.6%
tpch_q13/duckdb:duckdb	99835953 / 101354513 / -1.5%	113544273 / 115866726 / -2.0%	0.88 / 0.87 / +0.5%
tpch_q14/duckdb:duckdb	32244568 / 32472479 / -0.7%	68395394 / 69664059 / -1.8%	0.47 / 0.47 / +1.1%
tpch_q15/duckdb:duckdb	25329021 / 24677978 / +2.6%	57438280 / 56404850 / +1.8%	0.44 / 0.44 / +0.8%
tpch_q16/duckdb:duckdb	45212730 / 44752159 / +1.0%	51654075 / 50926078 / +1.4%	0.88 / 0.88 / -0.4%
tpch_q17/duckdb:duckdb	26214231 / 26418310 / -0.8%	59050017 / 60425657 / -2.3%	0.44 / 0.44 / +1.5%
tpch_q18/duckdb:duckdb	70932179 / 70462647 / +0.7%	92523034 / 92444904 / +0.1%	0.77 / 0.76 / +0.6%
tpch_q19/duckdb:duckdb	29535758 / 29264826 / +0.9%	66881109 / 65583490 / +2.0%	0.44 / 0.45 / -1.0%
tpch_q20/duckdb:duckdb	37661517 / 37714964 / -0.1%	81438183 / 80494031 / +1.2%	0.46 / 0.47 / -1.3%
tpch_q21/duckdb:duckdb	64119683 / 63425463 / +1.1%	94083754 / 91886667 / +2.4%	0.68 / 0.69 / -1.3%
tpch_q22/duckdb:duckdb	35928055 / 35539185 / +1.1%	46947334 / 46224955 / +1.6%	0.77 / 0.77 / -0.5%

github-actions · 2026-11-02T20:16:43Z

Benchmarks: Appian on NVME 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.002x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-file-compressed	52125187 / 52173937 / -0.1%	73593011 / 78090064 / -5.8%	0.71 / 0.67 / +6.0%
appian_q02/datafusion:vortex-file-compressed	228323705 / 224852956 / +1.5%	267710970 / 267523090 / +0.1%	0.85 / 0.84 / +1.5%
appian_q03/datafusion:vortex-file-compressed	141259494 / 142289848 / -0.7%	190663055 / 183959908 / +3.6%	0.74 / 0.77 / -4.2%
appian_q04/datafusion:vortex-file-compressed	9619990182 / 9615279204 / +0.0%	9642663408 / 9729095106 / -0.9%	1.00 / 0.99 / +0.9%
appian_q05/datafusion:vortex-file-compressed	133808585 / 132140811 / +1.3%	174758767 / 175455534 / -0.4%	0.77 / 0.75 / +1.7%
appian_q06/datafusion:vortex-file-compressed	138396847 / 137143158 / +0.9%	174832518 / 166716363 / +4.9%	0.79 / 0.82 / -3.8%
appian_q07/datafusion:vortex-file-compressed	156394374 / 155333648 / +0.7%	193865905 / 191161097 / +1.4%	0.81 / 0.81 / -0.7%
appian_q08/datafusion:vortex-file-compressed	521947770 / 523595300 / -0.3%	578487770 / 575033022 / +0.6%	0.90 / 0.91 / -0.9%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet	71867125 / 71257435 / +0.9%	89792767 / 90929780 / -1.3%	0.80 / 0.78 / +2.1%
appian_q02/datafusion:parquet	287144347 / 287695140 / -0.2%	333092224 / 329688255 / +1.0%	0.86 / 0.87 / -1.2%
appian_q03/datafusion:parquet	184047337 / 183841258 / +0.1%	224901216 / 225724269 / -0.4%	0.82 / 0.81 / +0.5%
appian_q04/datafusion:parquet	9648678388 / 9667366210 / -0.2%	9746875257 / 9684624046 / +0.6%	0.99 / 1.00 / -0.8%
appian_q05/datafusion:parquet	192599298 / 192247095 / +0.2%	225924982 / 218248040 / +3.5%	0.85 / 0.88 / -3.2%
appian_q06/datafusion:parquet	165372012 / 165815353 / -0.3%	191837150 / 195574358 / -1.9%	0.86 / 0.85 / +1.7%
appian_q07/datafusion:parquet	204036531 / 203269702 / +0.4%	236460342 / 233129107 / +1.4%	0.86 / 0.87 / -1.0%
appian_q08/datafusion:parquet	624770967 / 628177855 / -0.5%	699290705 / 686913629 / +1.8%	0.89 / 0.91 / -2.3%

duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-file-compressed	84512520 / 83749753 / +0.9%	98554151 / 94848671 / +3.9%	0.86 / 0.88 / -2.9%
appian_q02/duckdb:vortex-file-compressed	237090710 / 233095868 / +1.7%	254851654 / 258458060 / -1.4%	0.93 / 0.90 / +3.2%
appian_q03/duckdb:vortex-file-compressed	111951453 / 114050044 / -1.8%	130327030 / 130991508 / -0.5%	0.86 / 0.87 / -1.3%
appian_q04/duckdb:vortex-file-compressed	606864082 / 616359303 / -1.5%	589346520 / 610085831 / -3.4%	1.03 / 1.01 / +1.9%
appian_q05/duckdb:vortex-file-compressed	118793746 / 118834024 / -0.0%	128906471 / 130785910 / -1.4%	0.92 / 0.91 / +1.4%
appian_q06/duckdb:vortex-file-compressed	194950127 / 200664611 / -2.8%	208494594 / 201596829 / +3.4%	0.94 / 1.00 / -6.1%
appian_q07/duckdb:vortex-file-compressed	117038798 / 117409993 / -0.3%	132557292 / 129745607 / +2.2%	0.88 / 0.90 / -2.4%
appian_q08/duckdb:vortex-file-compressed	336930954 / 340643320 / -1.1%	344354004 / 355795695 / -3.2%	0.98 / 0.96 / +2.2%

duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet	93885393 / 92545002 / +1.4%	100910132 / 103418715 / -2.4%	0.93 / 0.89 / +4.0%
appian_q02/duckdb:parquet	240109926 / 241428627 / -0.5%	254070963 / 244688497 / +3.8%	0.95 / 0.99 / -4.2%
appian_q03/duckdb:parquet	129849162 / 130525026 / -0.5%	133454702 / 138110521 / -3.4%	0.97 / 0.95 / +3.0%
appian_q04/duckdb:parquet	483017588 / 495880488 / -2.6%	489271938 / 487793397 / +0.3%	0.99 / 1.02 / -2.9%
appian_q05/duckdb:parquet	132182035 / 132816838 / -0.5%	138952043 / 133508452 / +4.1%	0.95 / 0.99 / -4.4%
appian_q06/duckdb:parquet	115365683 / 115349058 / +0.0%	119178596 / 119329031 / -0.1%	0.97 / 0.97 / +0.1%
appian_q07/duckdb:parquet	106674318 / 108466671 / -1.7%	121983137 / 122972279 / -0.8%	0.87 / 0.88 / -0.9%
appian_q08/duckdb:parquet	359078331 / 358956384 / +0.0%	346058693 / 344099419 / +0.6%	1.04 / 1.04 / -0.5%

duckdb / duckdb / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:duckdb	78272608 / 78169269 / +0.1%	90606868 / 88733089 / +2.1%	0.86 / 0.88 / -1.9%
appian_q02/duckdb:duckdb	212807985 / 213717106 / -0.4%	224096757 / 218415736 / +2.6%	0.95 / 0.98 / -2.9%
appian_q03/duckdb:duckdb	84292720 / 83782272 / +0.6%	92796068 / 91765773 / +1.1%	0.91 / 0.91 / -0.5%
appian_q04/duckdb:duckdb	557586409 / 538287521 / +3.6%	545943236 / 539845839 / +1.1%	1.02 / 1.00 / +2.4%
appian_q05/duckdb:duckdb	107028677 / 107124280 / -0.1%	120483897 / 118655885 / +1.5%	0.89 / 0.90 / -1.6%
appian_q06/duckdb:duckdb	185139776 / 192533765 / -3.8%	198293071 / 191239971 / +3.7%	0.93 / 1.01 / -7.3%
appian_q07/duckdb:duckdb	87915380 / 88159069 / -0.3%	99447654 / 98666914 / +0.8%	0.88 / 0.89 / -1.1%
appian_q08/duckdb:duckdb	313270119 / 311559215 / +0.5%	325033969 / 324961270 / +0.0%	0.96 / 0.96 / +0.5%

github-actions · 2026-11-02T20:17:27Z

Benchmarks: JOB on NVME 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.049x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.015x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
job_q01/duckdb:vortex-file-compressed	14875306 / 14835270 / +0.3%	31592710 / 27283848 / +15.8% 🔴	0.47 / 0.54 / -13.4%
job_q02/duckdb:vortex-file-compressed	25056260 / 25483052 / -1.7%	38126764 / 37526192 / +1.6%	0.66 / 0.68 / -3.2%
job_q03/duckdb:vortex-file-compressed	15914887 / 15964426 / -0.3%	29766279 / 29549138 / +0.7%	0.53 / 0.54 / -1.0%
job_q04/duckdb:vortex-file-compressed	27436554 / 27684749 / -0.9%	41793128 / 41089647 / +1.7%	0.66 / 0.67 / -2.6%
job_q05/duckdb:vortex-file-compressed	19589180 / 19302472 / +1.5%	37490230 / 35489460 / +5.6%	0.52 / 0.54 / -3.9%
job_q06/duckdb:vortex-file-compressed	16340768 / 16581540 / -1.5%	33429561 / 32174937 / +3.9%	0.49 / 0.52 / -5.2%
job_q07/duckdb:vortex-file-compressed	9640241 / 9957738 / -3.2%	26295730 / 23910836 / +10.0%	0.37 / 0.42 / -12.0%
job_q08/duckdb:vortex-file-compressed	22039589 / 21447116 / +2.8%	38586954 / 35843722 / +7.7%	0.57 / 0.60 / -4.5%
job_q09/duckdb:vortex-file-compressed	27737020 / 27075531 / +2.4%	64474394 / 59609375 / +8.2%	0.43 / 0.45 / -5.3%
job_q10/duckdb:vortex-file-compressed	25795470 / 26013010 / -0.8%	59675726 / 59082467 / +1.0%	0.43 / 0.44 / -1.8%
job_q100/duckdb:vortex-file-compressed	42459701 / 41620042 / +2.0%	79686921 / 76514899 / +4.1%	0.53 / 0.54 / -2.0%
job_q101/duckdb:vortex-file-compressed	40684984 / 39690535 / +2.5%	79494691 / 75294337 / +5.6%	0.51 / 0.53 / -2.9%
job_q102/duckdb:vortex-file-compressed	72385470 / 72275661 / +0.2%	115087852 / 110718710 / +3.9%	0.63 / 0.65 / -3.7%
job_q103/duckdb:vortex-file-compressed	50566137 / 50561788 / +0.0%	88886285 / 82745087 / +7.4%	0.57 / 0.61 / -6.9%
job_q104/duckdb:vortex-file-compressed	39162975 / 39137688 / +0.1%	76566144 / 70940342 / +7.9%	0.51 / 0.55 / -7.3%
job_q105/duckdb:vortex-file-compressed	70273068 / 70149275 / +0.2%	107974559 / 101238743 / +6.7%	0.65 / 0.69 / -6.1%
job_q106/duckdb:vortex-file-compressed	47374669 / 47383282 / -0.0%	81529157 / 76646873 / +6.4%	0.58 / 0.62 / -6.0%
job_q107/duckdb:vortex-file-compressed	44344022 / 44453012 / -0.2%	82764211 / 76932435 / +7.6%	0.54 / 0.58 / -7.3%
job_q108/duckdb:vortex-file-compressed	48114391 / 47810252 / +0.6%	88301328 / 84185978 / +4.9%	0.54 / 0.57 / -4.1%
job_q109/duckdb:vortex-file-compressed	11316874 / 11220592 / +0.9%	23835451 / 22699838 / +5.0%	0.47 / 0.49 / -3.9%
job_q11/duckdb:vortex-file-compressed	29280835 / 29262228 / +0.1%	62024735 / 61857446 / +0.3%	0.47 / 0.47 / -0.2%
job_q110/duckdb:vortex-file-compressed	17683942 / 17852335 / -0.9%	31257630 / 30861359 / +1.3%	0.57 / 0.58 / -2.2%
job_q111/duckdb:vortex-file-compressed	28377348 / 28549555 / -0.6%	46868899 / 45262691 / +3.5%	0.61 / 0.63 / -4.0%
job_q112/duckdb:vortex-file-compressed	27960290 / 28187076 / -0.8%	46407292 / 42910942 / +8.1%	0.60 / 0.66 / -8.3%
job_q113/duckdb:vortex-file-compressed	32192194 / 32733952 / -1.7%	53727266 / 50319780 / +6.8%	0.60 / 0.65 / -7.9%
job_q12/duckdb:vortex-file-compressed	43482442 / 43407478 / +0.2%	60105638 / 59966445 / +0.2%	0.72 / 0.72 / -0.1%
job_q13/duckdb:vortex-file-compressed	15835074 / 16349986 / -3.1%	31851030 / 31170725 / +2.2%	0.50 / 0.52 / -5.2%
job_q14/duckdb:vortex-file-compressed	58315478 / 58706836 / -0.7%	75503234 / 72677725 / +3.9%	0.77 / 0.81 / -4.4%
job_q15/duckdb:vortex-file-compressed	25116572 / 25329164 / -0.8%	56796316 / 55398482 / +2.5%	0.44 / 0.46 / -3.3%
job_q16/duckdb:vortex-file-compressed	24075080 / 24149566 / -0.3%	56518469 / 53348397 / +5.9%	0.43 / 0.45 / -5.9%
job_q17/duckdb:vortex-file-compressed	34735854 / 35046147 / -0.9%	66875567 / 63953599 / +4.6%	0.52 / 0.55 / -5.2%
job_q18/duckdb:vortex-file-compressed	38672224 / 38864490 / -0.5%	55147468 / 51100839 / +7.9%	0.70 / 0.76 / -7.8%
job_q19/duckdb:vortex-file-compressed	17854217 / 18412044 / -3.0%	42169833 / 40881801 / +3.2%	0.42 / 0.45 / -6.0%
job_q20/duckdb:vortex-file-compressed	19055163 / 18839170 / +1.1%	41473913 / 36855157 / +12.5% 🔴	0.46 / 0.51 / -10.1%
job_q21/duckdb:vortex-file-compressed	33875100 / 34450608 / -1.7%	61353674 / 55603084 / +10.3% 🔴	0.55 / 0.62 / -10.9%
job_q22/duckdb:vortex-file-compressed	26533470 / 26132914 / +1.5%	55615369 / 47298544 / +17.6% 🔴	0.48 / 0.55 / -13.7%
job_q23/duckdb:vortex-file-compressed	63336502 / 62307738 / +1.7%	90707859 / 89128856 / +1.8%	0.70 / 0.70 / -0.1%
job_q24/duckdb:vortex-file-compressed	41044830 / 40912210 / +0.3%	73373021 / 64806171 / +13.2% 🔴	0.56 / 0.63 / -11.4%
job_q25/duckdb:vortex-file-compressed	34718584 / 34398091 / +0.9%	64543667 / 60033650 / +7.5%	0.54 / 0.57 / -6.1%
job_q26/duckdb:vortex-file-compressed	85836101 / 87257324 / -1.6%	121422055 / 119041670 / +2.0%	0.71 / 0.73 / -3.6%
job_q27/duckdb:vortex-file-compressed	28173890 / 28185076 / -0.0%	54197404 / 53212841 / +1.9%	0.52 / 0.53 / -1.9%
job_q28/duckdb:vortex-file-compressed	23343168 / 23403126 / -0.3%	49845735 / 49252585 / +1.2%	0.47 / 0.48 / -1.4%
job_q29/duckdb:vortex-file-compressed	85189455 / 84497938 / +0.8%	104485337 / 101092360 / +3.4%	0.82 / 0.84 / -2.5%
job_q30/duckdb:vortex-file-compressed	68336346 / 67702876 / +0.9%	84764924 / 83367107 / +1.7%	0.81 / 0.81 / -0.7%
job_q31/duckdb:vortex-file-compressed	60503699 / 60554140 / -0.1%	95571598 / 91748147 / +4.2%	0.63 / 0.66 / -4.1%
job_q32/duckdb:vortex-file-compressed	48193644 / 47200633 / +2.1%	83822629 / 77605322 / +8.0%	0.57 / 0.61 / -5.5%
job_q33/duckdb:vortex-file-compressed	61821690 / 61584891 / +0.4%	86719611 / 88930251 / -2.5%	0.71 / 0.69 / +2.9%
job_q34/duckdb:vortex-file-compressed	126468754 / 126912910 / -0.3%	155553119 / 151809541 / +2.5%	0.81 / 0.84 / -2.7%
job_q35/duckdb:vortex-file-compressed	26755655 / 26761553 / -0.0%	54272717 / 49059960 / +10.6% 🔴	0.49 / 0.55 / -9.6%
job_q36/duckdb:vortex-file-compressed	20518301 / 20674901 / -0.8%	48698803 / 43539491 / +11.8% 🔴	0.42 / 0.47 / -11.3%
job_q37/duckdb:vortex-file-compressed	50382462 / 51260050 / -1.7%	81687137 / 77322733 / +5.6%	0.62 / 0.66 / -7.0%
job_q38/duckdb:vortex-file-compressed	18673197 / 18718092 / -0.2%	35883181 / 34212170 / +4.9%	0.52 / 0.55 / -4.9%
job_q39/duckdb:vortex-file-compressed	15746721 / 15543822 / +1.3%	31631296 / 30618790 / +3.3%	0.50 / 0.51 / -1.9%
job_q40/duckdb:vortex-file-compressed	94681282 / 91887174 / +3.0%	114348665 / 112670683 / +1.5%	0.83 / 0.82 / +1.5%
job_q41/duckdb:vortex-file-compressed	267365707 / 263628238 / +1.4%	284708932 / 278135679 / +2.4%	0.94 / 0.95 / -0.9%
job_q42/duckdb:vortex-file-compressed	33139098 / 32324915 / +2.5%	53089984 / 49247440 / +7.8%	0.62 / 0.66 / -4.9%
job_q43/duckdb:vortex-file-compressed	21343280 / 21548834 / -1.0%	39597083 / 36977017 / +7.1%	0.54 / 0.58 / -7.5%
job_q44/duckdb:vortex-file-compressed	45499383 / 46026166 / -1.1%	66021748 / 61220488 / +7.8%	0.69 / 0.75 / -8.3%
job_q45/duckdb:vortex-file-compressed	69086554 / 69569668 / -0.7%	92862288 / 89273801 / +4.0%	0.74 / 0.78 / -4.5%
job_q46/duckdb:vortex-file-compressed	25566060 / 25056494 / +2.0%	43509524 / 40706040 / +6.9%	0.59 / 0.62 / -4.5%
job_q47/duckdb:vortex-file-compressed	22546936 / 21686962 / +4.0%	40311620 / 38078239 / +5.9%	0.56 / 0.57 / -1.8%
job_q48/duckdb:vortex-file-compressed	73067738 / 73738582 / -0.9%	92023652 / 90816257 / +1.3%	0.79 / 0.81 / -2.2%
job_q49/duckdb:vortex-file-compressed	42300154 / 42791298 / -1.1%	60881408 / 59380344 / +2.5%	0.69 / 0.72 / -3.6%
job_q50/duckdb:vortex-file-compressed	36973780 / 36866368 / +0.3%	55445235 / 53016758 / +4.6%	0.67 / 0.70 / -4.1%
job_q51/duckdb:vortex-file-compressed	63786606 / 63738918 / +0.1%	84411956 / 81733564 / +3.3%	0.76 / 0.78 / -3.1%
job_q52/duckdb:vortex-file-compressed	47058654 / 46951844 / +0.2%	71792482 / 69608576 / +3.1%	0.66 / 0.67 / -2.8%
job_q53/duckdb:vortex-file-compressed	44562908 / 44617737 / -0.1%	68381171 / 67054138 / +2.0%	0.65 / 0.67 / -2.1%
job_q54/duckdb:vortex-file-compressed	57756909 / 57354050 / +0.7%	80012605 / 77738057 / +2.9%	0.72 / 0.74 / -2.2%
job_q55/duckdb:vortex-file-compressed	56032857 / 57094693 / -1.9%	78702785 / 76429977 / +3.0%	0.71 / 0.75 / -4.7%
job_q56/duckdb:vortex-file-compressed	36838097 / 36888720 / -0.1%	65313570 / 60591988 / +7.8%	0.56 / 0.61 / -7.4%
job_q57/duckdb:vortex-file-compressed	84830292 / 83718289 / +1.3%	106079178 / 100859192 / +5.2%	0.80 / 0.83 / -3.7%
job_q58/duckdb:vortex-file-compressed	65825927 / 66023044 / -0.3%	92546886 / 91593304 / +1.0%	0.71 / 0.72 / -1.3%
job_q59/duckdb:vortex-file-compressed	61341724 / 62027302 / -1.1%	91374109 / 87693531 / +4.2%	0.67 / 0.71 / -5.1%
job_q60/duckdb:vortex-file-compressed	41619134 / 41414739 / +0.5%	66374907 / 61526380 / +7.9%	0.63 / 0.67 / -6.8%
job_q61/duckdb:vortex-file-compressed	32961441 / 32476662 / +1.5%	60690394 / 58335792 / +4.0%	0.54 / 0.56 / -2.4%
job_q62/duckdb:vortex-file-compressed	31468505 / 31161336 / +1.0%	58246200 / 55501148 / +4.9%	0.54 / 0.56 / -3.8%
job_q63/duckdb:vortex-file-compressed	34924147 / 34286217 / +1.9%	62883751 / 58248693 / +8.0%	0.56 / 0.59 / -5.6%
job_q64/duckdb:vortex-file-compressed	58140223 / 56555971 / +2.8%	87213697 / 80556751 / +8.3%	0.67 / 0.70 / -5.0%
job_q65/duckdb:vortex-file-compressed	49565207 / 49999332 / -0.9%	77852800 / 72260037 / +7.7%	0.64 / 0.69 / -8.0%
job_q66/duckdb:vortex-file-compressed	35913838 / 35454877 / +1.3%	65898406 / 65259579 / +1.0%	0.54 / 0.54 / +0.3%
job_q67/duckdb:vortex-file-compressed	39147968 / 38941370 / +0.5%	71339032 / 67086189 / +6.3%	0.55 / 0.58 / -5.5%
job_q68/duckdb:vortex-file-compressed	47410353 / 46897290 / +1.1%	76809023 / 73175877 / +5.0%	0.62 / 0.64 / -3.7%
job_q69/duckdb:vortex-file-compressed	74182918 / 73499946 / +0.9%	107504866 / 104924645 / +2.5%	0.69 / 0.70 / -1.5%
job_q70/duckdb:vortex-file-compressed	43220146 / 43817660 / -1.4%	75826969 / 70581536 / +7.4%	0.57 / 0.62 / -8.2%
job_q71/duckdb:vortex-file-compressed	65344901 / 65636040 / -0.4%	98202189 / 96693895 / +1.6%	0.67 / 0.68 / -2.0%
job_q72/duckdb:vortex-file-compressed	139439894 / 140329036 / -0.6%	168628313 / 165402439 / +2.0%	0.83 / 0.85 / -2.5%
job_q73/duckdb:vortex-file-compressed	80249516 / 83201658 / -3.5%	120025370 / 113767454 / +5.5%	0.67 / 0.73 / -8.6%
job_q74/duckdb:vortex-file-compressed	72349618 / 72011926 / +0.5%	111832264 / 108108631 / +3.4%	0.65 / 0.67 / -2.9%
job_q75/duckdb:vortex-file-compressed	65058672 / 66129348 / -1.6%	105943408 / 102396779 / +3.5%	0.61 / 0.65 / -4.9%
job_q76/duckdb:vortex-file-compressed	25921793 / 25935496 / -0.1%	50163597 / 48513545 / +3.4%	0.52 / 0.53 / -3.3%
job_q77/duckdb:vortex-file-compressed	25331594 / 25590170 / -1.0%	49744899 / 48544851 / +2.5%	0.51 / 0.53 / -3.4%
job_q78/duckdb:vortex-file-compressed	27063176 / 28096290 / -3.7%	54000521 / 49475206 / +9.1%	0.50 / 0.57 / -11.7%
job_q79/duckdb:vortex-file-compressed	74943983 / 74747277 / +0.3%	99299068 / 94941054 / +4.6%	0.75 / 0.79 / -4.1%
job_q80/duckdb:vortex-file-compressed	51189490 / 51153400 / +0.1%	76549785 / 71281005 / +7.4%	0.67 / 0.72 / -6.8%
job_q81/duckdb:vortex-file-compressed	161618198 / 161118126 / +0.3%	185102399 / 184862679 / +0.1%	0.87 / 0.87 / +0.2%
job_q82/duckdb:vortex-file-compressed	305032140 / 305001780 / +0.0%	326547888 / 327748393 / -0.4%	0.93 / 0.93 / +0.4%
job_q83/duckdb:vortex-file-compressed	39788184 / 39897497 / -0.3%	64258536 / 59146185 / +8.6%	0.62 / 0.67 / -8.2%
job_q84/duckdb:vortex-file-compressed	38044435 / 38835986 / -2.0%	61120468 / 59666645 / +2.4%	0.62 / 0.65 / -4.4%
job_q85/duckdb:vortex-file-compressed	45381671 / 45156260 / +0.5%	69115674 / 65930048 / +4.8%	0.66 / 0.68 / -4.1%
job_q86/duckdb:vortex-file-compressed	64513709 / 63713809 / +1.3%	101635322 / 96850203 / +4.9%	0.63 / 0.66 / -3.5%
job_q87/duckdb:vortex-file-compressed	60039006 / 59193424 / +1.4%	95838198 / 93980260 / +2.0%	0.63 / 0.63 / -0.5%
job_q88/duckdb:vortex-file-compressed	46702422 / 46764086 / -0.1%	81646717 / 80035090 / +2.0%	0.57 / 0.58 / -2.1%
job_q89/duckdb:vortex-file-compressed	28745636 / 29664345 / -3.1%	64065032 / 58491350 / +9.5%	0.45 / 0.51 / -11.5%
job_q90/duckdb:vortex-file-compressed	68858630 / 68529590 / +0.5%	104502477 / 101321468 / +3.1%	0.66 / 0.68 / -2.6%
job_q91/duckdb:vortex-file-compressed	61035033 / 61907999 / -1.4%	103865458 / 95758718 / +8.5%	0.59 / 0.65 / -9.1%
job_q92/duckdb:vortex-file-compressed	44452694 / 43648496 / +1.8%	80638469 / 76123587 / +5.9%	0.55 / 0.57 / -3.9%
job_q93/duckdb:vortex-file-compressed	69816602 / 69098309 / +1.0%	111946664 / 103115657 / +8.6%	0.62 / 0.67 / -6.9%
job_q94/duckdb:vortex-file-compressed	26187105 / 26553088 / -1.4%	49124108 / 47322707 / +3.8%	0.53 / 0.56 / -5.0%
job_q95/duckdb:vortex-file-compressed	24542879 / 24415588 / +0.5%	46660629 / 45681396 / +2.1%	0.53 / 0.53 / -1.6%
job_q96/duckdb:vortex-file-compressed	27011928 / 27239944 / -0.8%	50783900 / 48505242 / +4.7%	0.53 / 0.56 / -5.3%
job_q97/duckdb:vortex-file-compressed	93413802 / 93933879 / -0.6%	136499827 / 129656320 / +5.3%	0.68 / 0.72 / -5.5%
job_q98/duckdb:vortex-file-compressed	57455470 / 57311692 / +0.3%	97422831 / 95555198 / +2.0%	0.59 / 0.60 / -1.7%
job_q99/duckdb:vortex-file-compressed	85743202 / 85490262 / +0.3%	127657062 / 123308495 / +3.5%	0.67 / 0.69 / -3.1%

duckdb / parquet / ns (0.995x ➖, 5↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
job_q01/duckdb:parquet	60337616 / 59438413 / +1.5%	69879933 / 66606138 / +4.9%	0.86 / 0.89 / -3.2%
job_q02/duckdb:parquet	154285343 / 153285044 / +0.7%	166301079 / 162496790 / +2.3%	0.93 / 0.94 / -1.6%
job_q03/duckdb:parquet	90138885 / 89926298 / +0.2%	100574415 / 97802842 / +2.8%	0.90 / 0.92 / -2.5%
job_q04/duckdb:parquet	169596332 / 169154554 / +0.3%	180057866 / 179326122 / +0.4%	0.94 / 0.94 / -0.1%
job_q05/duckdb:parquet	77422694 / 77032468 / +0.5%	88558337 / 85768956 / +3.3%	0.87 / 0.90 / -2.7%
job_q06/duckdb:parquet	73554594 / 73222228 / +0.5%	83978112 / 82792387 / +1.4%	0.88 / 0.88 / -1.0%
job_q07/duckdb:parquet	31347878 / 31439402 / -0.3%	43013812 / 39916122 / +7.8%	0.73 / 0.79 / -7.5%
job_q08/duckdb:parquet	93530000 / 93435512 / +0.1%	104554713 / 102629774 / +1.9%	0.89 / 0.91 / -1.7%
job_q09/duckdb:parquet	293445880 / 295936651 / -0.8%	311824754 / 315007481 / -1.0%	0.94 / 0.94 / +0.2%
job_q10/duckdb:parquet	241832924 / 235920998 / +2.5%	257106170 / 253502033 / +1.4%	0.94 / 0.93 / +1.1%
job_q100/duckdb:parquet	225711611 / 236393316 / -4.5%	256907854 / 253170086 / +1.5%	0.88 / 0.93 / -5.9%
job_q101/duckdb:parquet	219628750 / 227186410 / -3.3%	247049360 / 249253212 / -0.9%	0.89 / 0.91 / -2.5%
job_q102/duckdb:parquet	258797161 / 267796404 / -3.4%	307062364 / 274223119 / +12.0% 🔴	0.84 / 0.98 / -13.7%
job_q103/duckdb:parquet	227046772 / 193425100 / +17.4% 🔴	242750241 / 256226554 / -5.3%	0.94 / 0.75 / +23.9%
job_q104/duckdb:parquet	167242883 / 157489622 / +6.2%	197115475 / 183546835 / +7.4%	0.85 / 0.86 / -1.1%
job_q105/duckdb:parquet	209264278 / 200851368 / +4.2%	342934389 / 221645284 / +54.7% 🔴	0.61 / 0.91 / -32.7%
job_q106/duckdb:parquet	220627873 / 216690773 / +1.8%	260872846 / 257839070 / +1.2%	0.85 / 0.84 / +0.6%
job_q107/duckdb:parquet	191481614 / 214440736 / -10.7% 🟢	213799024 / 242764570 / -11.9% 🟢	0.90 / 0.88 / +1.4%
job_q108/duckdb:parquet	221119003 / 234817229 / -5.8%	259519471 / 251083561 / +3.4%	0.85 / 0.94 / -8.9%
job_q109/duckdb:parquet	30225252 / 30053117 / +0.6%	37162778 / 35907190 / +3.5%	0.81 / 0.84 / -2.8%
job_q11/duckdb:parquet	334065054 / 324670444 / +2.9%	340908184 / 342690162 / -0.5%	0.98 / 0.95 / +3.4%
job_q110/duckdb:parquet	78497074 / 78970420 / -0.6%	86172781 / 85424991 / +0.9%	0.91 / 0.92 / -1.5%
job_q111/duckdb:parquet	109431952 / 109629186 / -0.2%	118270926 / 118420300 / -0.1%	0.93 / 0.93 / -0.1%
job_q112/duckdb:parquet	106083319 / 106817516 / -0.7%	117400308 / 116895818 / +0.4%	0.90 / 0.91 / -1.1%
job_q113/duckdb:parquet	117922310 / 118291084 / -0.3%	129445564 / 127953409 / +1.2%	0.91 / 0.92 / -1.5%
job_q12/duckdb:parquet	107227382 / 107783954 / -0.5%	117079249 / 115258510 / +1.6%	0.92 / 0.94 / -2.1%
job_q13/duckdb:parquet	60230040 / 59999285 / +0.4%	70404198 / 66928305 / +5.2%	0.86 / 0.90 / -4.6%
job_q14/duckdb:parquet	126086124 / 125154574 / +0.7%	135736959 / 132171661 / +2.7%	0.93 / 0.95 / -1.9%
job_q15/duckdb:parquet	362257223 / 363657221 / -0.4%	383769956 / 380790447 / +0.8%	0.94 / 0.96 / -1.2%
job_q16/duckdb:parquet	315223572 / 254656191 / +23.8% 🔴	208622496 / 202649648 / +2.9%	1.51 / 1.26 / +20.2%
job_q17/duckdb:parquet	322990748 / 359598755 / -10.2% 🟢	325303581 / 382103623 / -14.9% 🟢	0.99 / 0.94 / +5.5%
job_q18/duckdb:parquet	85906862 / 85499886 / +0.5%	98616261 / 99095981 / -0.5%	0.87 / 0.86 / +1.0%
job_q19/duckdb:parquet	72739638 / 72089684 / +0.9%	85063445 / 84449732 / +0.7%	0.86 / 0.85 / +0.2%
job_q20/duckdb:parquet	72561470 / 72391286 / +0.2%	82177267 / 83044647 / -1.0%	0.88 / 0.87 / +1.3%
job_q21/duckdb:parquet	116424916 / 115425576 / +0.9%	132636687 / 131585815 / +0.8%	0.88 / 0.88 / +0.1%
job_q22/duckdb:parquet	110952108 / 111173290 / -0.2%	127574934 / 124980050 / +2.1%	0.87 / 0.89 / -2.2%
job_q23/duckdb:parquet	198762571 / 198490533 / +0.1%	222776618 / 220074888 / +1.2%	0.89 / 0.90 / -1.1%
job_q24/duckdb:parquet	164785849 / 165347883 / -0.3%	186435796 / 186194358 / +0.1%	0.88 / 0.89 / -0.5%
job_q25/duckdb:parquet	132899370 / 132244328 / +0.5%	155072083 / 152606449 / +1.6%	0.86 / 0.87 / -1.1%
job_q26/duckdb:parquet	322720672 / 323404344 / -0.2%	348505151 / 348501241 / +0.0%	0.93 / 0.93 / -0.2%
job_q27/duckdb:parquet	131832663 / 132960474 / -0.8%	154333262 / 145464271 / +6.1%	0.85 / 0.91 / -6.5%
job_q28/duckdb:parquet	143955218 / 142816612 / +0.8%	161348506 / 157121322 / +2.7%	0.89 / 0.91 / -1.8%
job_q29/duckdb:parquet	390641402 / 391370498 / -0.2%	403826314 / 409410814 / -1.4%	0.97 / 0.96 / +1.2%
job_q30/duckdb:parquet	205621800 / 205822782 / -0.1%	216704625 / 219113358 / -1.1%	0.95 / 0.94 / +1.0%
job_q31/duckdb:parquet	309745920 / 313683582 / -1.3%	336766625 / 328644520 / +2.5%	0.92 / 0.95 / -3.6%
job_q32/duckdb:parquet	272973824 / 272495350 / +0.2%	295501465 / 291076223 / +1.5%	0.92 / 0.94 / -1.3%
job_q33/duckdb:parquet	261431382 / 264960456 / -1.3%	279351164 / 277734928 / +0.6%	0.94 / 0.95 / -1.9%
job_q34/duckdb:parquet	417165225 / 417172754 / -0.0%	441696846 / 437199506 / +1.0%	0.94 / 0.95 / -1.0%
job_q35/duckdb:parquet	142810644 / 142590344 / +0.2%	161135519 / 155684176 / +3.5%	0.89 / 0.92 / -3.2%
job_q36/duckdb:parquet	86241016 / 85478697 / +0.9%	101201193 / 102223032 / -1.0%	0.85 / 0.84 / +1.9%
job_q37/duckdb:parquet	247993801 / 248005520 / -0.0%	271803546 / 269362138 / +0.9%	0.91 / 0.92 / -0.9%
job_q38/duckdb:parquet	67439271 / 66595873 / +1.3%	76628959 / 76873384 / -0.3%	0.88 / 0.87 / +1.6%
job_q39/duckdb:parquet	63014673 / 61576820 / +2.3%	69188458 / 71513328 / -3.3%	0.91 / 0.86 / +5.8%
job_q40/duckdb:parquet	81022008 / 81515284 / -0.6%	91551269 / 91160889 / +0.4%	0.88 / 0.89 / -1.0%
job_q41/duckdb:parquet	91822414 / 93051751 / -1.3%	102914718 / 101523899 / +1.4%	0.89 / 0.92 / -2.7%
job_q42/duckdb:parquet	140788812 / 143695148 / -2.0%	280184946 / 153409217 / +82.6% 🔴	0.50 / 0.94 / -46.4%
job_q43/duckdb:parquet	55860550 / 56754834 / -1.6%	69477468 / 65758093 / +5.7%	0.80 / 0.86 / -6.8%
job_q44/duckdb:parquet	174394692 / 217236172 / -19.7% 🟢	269798313 / 369954338 / -27.1% 🟢	0.65 / 0.59 / +10.1%
job_q45/duckdb:parquet	176987730 / 176683968 / +0.2%	191737620 / 189587459 / +1.1%	0.92 / 0.93 / -1.0%
job_q46/duckdb:parquet	111786856 / 113357133 / -1.4%	128210248 / 124593636 / +2.9%	0.87 / 0.91 / -4.2%
job_q47/duckdb:parquet	91450997 / 91804939 / -0.4%	104913199 / 101854534 / +3.0%	0.87 / 0.90 / -3.3%
job_q48/duckdb:parquet	172279651 / 171859581 / +0.2%	186417369 / 184350996 / +1.1%	0.92 / 0.93 / -0.9%
job_q49/duckdb:parquet	167140932 / 167414168 / -0.2%	185432280 / 166785124 / +11.2% 🔴	0.90 / 1.00 / -10.2%
job_q50/duckdb:parquet	135942264 / 141399997 / -3.9%	159147352 / 142238141 / +11.9% 🔴	0.85 / 0.99 / -14.1%
job_q51/duckdb:parquet	210338586 / 195298419 / +7.7%	202129030 / 208388094 / -3.0%	1.04 / 0.94 / +11.0%
job_q52/duckdb:parquet	180845514 / 180395505 / +0.2%	212756765 / 195028038 / +9.1%	0.85 / 0.92 / -8.1%
job_q53/duckdb:parquet	180995268 / 173267062 / +4.5%	192484710 / 192384878 / +0.1%	0.94 / 0.90 / +4.4%
job_q54/duckdb:parquet	172546004 / 180125390 / -4.2%	185979490 / 189696314 / -2.0%	0.93 / 0.95 / -2.3%
job_q55/duckdb:parquet	174905434 / 173552482 / +0.8%	188203462 / 187795570 / +0.2%	0.93 / 0.92 / +0.6%
job_q56/duckdb:parquet	155990954 / 155429118 / +0.4%	181676751 / 178527786 / +1.8%	0.86 / 0.87 / -1.4%
job_q57/duckdb:parquet	206396546 / 205955296 / +0.2%	229840691 / 228553780 / +0.6%	0.90 / 0.90 / -0.3%
job_q58/duckdb:parquet	236498578 / 238375872 / -0.8%	265378541 / 263441158 / +0.7%	0.89 / 0.90 / -1.5%
job_q59/duckdb:parquet	227205521 / 225054863 / +1.0%	252467345 / 251020809 / +0.6%	0.90 / 0.90 / +0.4%
job_q60/duckdb:parquet	93791152 / 94480320 / -0.7%	112703583 / 108890741 / +3.5%	0.83 / 0.87 / -4.1%
job_q61/duckdb:parquet	77124788 / 75918283 / +1.6%	93801125 / 91581543 / +2.4%	0.82 / 0.83 / -0.8%
job_q62/duckdb:parquet	73288062 / 73181515 / +0.1%	89353481 / 89882287 / -0.6%	0.82 / 0.81 / +0.7%
job_q63/duckdb:parquet	90302066 / 90122444 / +0.2%	108988689 / 108438067 / +0.5%	0.83 / 0.83 / -0.3%
job_q64/duckdb:parquet	160453787 / 160610260 / -0.1%	179622778 / 181847852 / -1.2%	0.89 / 0.88 / +1.1%
job_q65/duckdb:parquet	111771232 / 111478673 / +0.3%	127655792 / 126446896 / +1.0%	0.88 / 0.88 / -0.7%
job_q66/duckdb:parquet	188874204 / 186451568 / +1.3%	211479495 / 214600153 / -1.5%	0.89 / 0.87 / +2.8%
job_q67/duckdb:parquet	151523594 / 175258540 / -13.5% 🟢	182905909 / 234842607 / -22.1% 🟢	0.83 / 0.75 / +11.0%
job_q68/duckdb:parquet	197784114 / 188735348 / +4.8%	220658097 / 323309208 / -31.8% 🟢	0.90 / 0.58 / +53.5%
job_q69/duckdb:parquet	305291358 / 322539935 / -5.3%	322670285 / 343848184 / -6.2%	0.95 / 0.94 / +0.9%
job_q70/duckdb:parquet	236773369 / 229972507 / +3.0%	269496442 / 271915163 / -0.9%	0.88 / 0.85 / +3.9%
job_q71/duckdb:parquet	201512296 / 201417141 / +0.0%	241335676 / 221963091 / +8.7%	0.83 / 0.91 / -8.0%
job_q72/duckdb:parquet	288005148 / 289944726 / -0.7%	302348600 / 304259350 / -0.6%	0.95 / 0.95 / -0.0%
job_q73/duckdb:parquet	195920957 / 197010964 / -0.6%	220066398 / 220131018 / -0.0%	0.89 / 0.89 / -0.5%
job_q74/duckdb:parquet	195195670 / 194875504 / +0.2%	223401879 / 220509064 / +1.3%	0.87 / 0.88 / -1.1%
job_q75/duckdb:parquet	225582110 / 226518980 / -0.4%	254177689 / 250096209 / +1.6%	0.89 / 0.91 / -2.0%
job_q76/duckdb:parquet	133756988 / 133313400 / +0.3%	160047480 / 161011105 / -0.6%	0.84 / 0.83 / +0.9%
job_q77/duckdb:parquet	124293723 / 126115471 / -1.4%	156870727 / 138641066 / +13.1% 🔴	0.79 / 0.91 / -12.9%
job_q78/duckdb:parquet	135397993 / 129933959 / +4.2%	156081089 / 143629625 / +8.7%	0.87 / 0.90 / -4.1%
job_q79/duckdb:parquet	254222552 / 271292947 / -6.3%	291737169 / 260860394 / +11.8% 🔴	0.87 / 1.04 / -16.2%
job_q80/duckdb:parquet	238676342 / 272111052 / -12.3% 🟢	256592328 / 259466176 / -1.1%	0.93 / 1.05 / -11.3%
job_q81/duckdb:parquet	380246994 / 366598557 / +3.7%	418091992 / 383931044 / +8.9%	0.91 / 0.95 / -4.8%
job_q82/duckdb:parquet	288186852 / 280267608 / +2.8%	314238698 / 306871689 / +2.4%	0.92 / 0.91 / +0.4%
job_q83/duckdb:parquet	124897518 / 122407607 / +2.0%	144830432 / 142860590 / +1.4%	0.86 / 0.86 / +0.6%
job_q84/duckdb:parquet	122868547 / 125736588 / -2.3%	144195423 / 143198062 / +0.7%	0.85 / 0.88 / -3.0%
job_q85/duckdb:parquet	136412662 / 143764054 / -5.1%	162244889 / 148941962 / +8.9%	0.84 / 0.97 / -12.9%
job_q86/duckdb:parquet	224770530 / 224632504 / +0.1%	244949490 / 267569612 / -8.5%	0.92 / 0.84 / +9.3%
job_q87/duckdb:parquet	197108182 / 201026717 / -1.9%	231752944 / 243807004 / -4.9%	0.85 / 0.82 / +3.2%
job_q88/duckdb:parquet	194029306 / 197798846 / -1.9%	234891145 / 226816127 / +3.6%	0.83 / 0.87 / -5.3%
job_q89/duckdb:parquet	167758605 / 167676762 / +0.0%	212371902 / 214159502 / -0.8%	0.79 / 0.78 / +0.9%
job_q90/duckdb:parquet	235503990 / 229613269 / +2.6%	253039371 / 257609798 / -1.8%	0.93 / 0.89 / +4.4%
job_q91/duckdb:parquet	257920426 / 255833576 / +0.8%	286707254 / 283201768 / +1.2%	0.90 / 0.90 / -0.4%
job_q92/duckdb:parquet	199483313 / 200673274 / -0.6%	226123236 / 228770935 / -1.2%	0.88 / 0.88 / +0.6%
job_q93/duckdb:parquet	241793795 / 242445626 / -0.3%	268885734 / 269358815 / -0.2%	0.90 / 0.90 / -0.1%
job_q94/duckdb:parquet	137082833 / 141381243 / -3.0%	163766978 / 165767296 / -1.2%	0.84 / 0.85 / -1.9%
job_q95/duckdb:parquet	129531373 / 126208660 / +2.6%	172091113 / 151419152 / +13.7% 🔴	0.75 / 0.83 / -9.7%
job_q96/duckdb:parquet	137635783 / 139985043 / -1.7%	154630743 / 160969602 / -3.9%	0.89 / 0.87 / +2.4%
job_q97/duckdb:parquet	252138938 / 262114118 / -3.8%	294639138 / 302732880 / -2.7%	0.86 / 0.87 / -1.2%
job_q98/duckdb:parquet	200552838 / 219063376 / -8.4%	228281705 / 213949137 / +6.7%	0.88 / 1.02 / -14.2%
job_q99/duckdb:parquet	242150620 / 258594684 / -6.4%	276581399 / 256096686 / +8.0%	0.88 / 1.01 / -13.3%

duckdb / duckdb / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
job_q01/duckdb:duckdb	7646510 / 7900175 / -3.2%	17129750 / 16200819 / +5.7%	0.45 / 0.49 / -8.5%
job_q02/duckdb:duckdb	6111876 / 5926532 / +3.1%	13309596 / 12447808 / +6.9%	0.46 / 0.48 / -3.6%
job_q03/duckdb:duckdb	6440700 / 6318504 / +1.9%	14336638 / 13500894 / +6.2%	0.45 / 0.47 / -4.0%
job_q04/duckdb:duckdb	5901304 / 5722260 / +3.1%	13554667 / 12809869 / +5.8%	0.44 / 0.45 / -2.5%
job_q05/duckdb:duckdb	14397732 / 14687922 / -2.0%	25901818 / 24225495 / +6.9%	0.56 / 0.61 / -8.3%
job_q06/duckdb:duckdb	14156842 / 14439660 / -2.0%	24953912 / 23532616 / +6.0%	0.57 / 0.61 / -7.5%
job_q07/duckdb:duckdb	10981168 / 10915342 / +0.6%	20991193 / 18781969 / +11.8% 🔴	0.52 / 0.58 / -10.0%
job_q08/duckdb:duckdb	16373416 / 16731016 / -2.1%	27737259 / 26920333 / +3.0%	0.59 / 0.62 / -5.0%
job_q09/duckdb:duckdb	63527751 / 63037406 / +0.8%	88403406 / 86329741 / +2.4%	0.72 / 0.73 / -1.6%
job_q10/duckdb:duckdb	41647804 / 41470006 / +0.4%	73631482 / 69334464 / +6.2%	0.57 / 0.60 / -5.4%
job_q100/duckdb:duckdb	24353676 / 24324188 / +0.1%	44344931 / 39756925 / +11.5% 🔴	0.55 / 0.61 / -10.2%
job_q101/duckdb:duckdb	24865298 / 25668166 / -3.1%	52424129 / 44753516 / +17.1% 🔴	0.47 / 0.57 / -17.3%
job_q102/duckdb:duckdb	44911362 / 46294429 / -3.0%	70958108 / 63666344 / +11.5% 🔴	0.63 / 0.73 / -13.0%
job_q103/duckdb:duckdb	53770269 / 54207532 / -0.8%	85487978 / 79965903 / +6.9%	0.63 / 0.68 / -7.2%
job_q104/duckdb:duckdb	46269758 / 45926387 / +0.7%	71485729 / 68361366 / +4.6%	0.65 / 0.67 / -3.7%
job_q105/duckdb:duckdb	75128168 / 74681520 / +0.6%	107401185 / 100730969 / +6.6%	0.70 / 0.74 / -5.6%
job_q106/duckdb:duckdb	64798504 / 64168131 / +1.0%	95112728 / 92217560 / +3.1%	0.68 / 0.70 / -2.1%
job_q107/duckdb:duckdb	58643048 / 58862140 / -0.4%	86691711 / 84681371 / +2.4%	0.68 / 0.70 / -2.7%
job_q108/duckdb:duckdb	74956666 / 75544482 / -0.8%	107857284 / 101712210 / +6.0%	0.69 / 0.74 / -6.4%
job_q109/duckdb:duckdb	7100666 / 7078172 / +0.3%	15717721 / 14785570 / +6.3%	0.45 / 0.48 / -5.6%
job_q11/duckdb:duckdb	47875402 / 48022249 / -0.3%	86628835 / 77810013 / +11.3% 🔴	0.55 / 0.62 / -10.5%
job_q110/duckdb:duckdb	13689678 / 14078544 / -2.8%	24684384 / 22608175 / +9.2%	0.55 / 0.62 / -10.9%
job_q111/duckdb:duckdb	16526950 / 16412170 / +0.7%	28385043 / 26022131 / +9.1%	0.58 / 0.63 / -7.7%
job_q112/duckdb:duckdb	22312436 / 22299391 / +0.1%	34974394 / 32751908 / +6.8%	0.64 / 0.68 / -6.3%
job_q113/duckdb:duckdb	18392668 / 18317509 / +0.4%	30728344 / 29319173 / +4.8%	0.60 / 0.62 / -4.2%
job_q12/duckdb:duckdb	27469223 / 27462670 / +0.0%	37938455 / 36209836 / +4.8%	0.72 / 0.76 / -4.5%
job_q13/duckdb:duckdb	10054986 / 10029530 / +0.3%	18834433 / 18624365 / +1.1%	0.53 / 0.54 / -0.9%
job_q14/duckdb:duckdb	35107890 / 35382774 / -0.8%	46274321 / 44654384 / +3.6%	0.76 / 0.79 / -4.3%
job_q15/duckdb:duckdb	55570299 / 55735888 / -0.3%	88905582 / 84459619 / +5.3%	0.63 / 0.66 / -5.3%
job_q16/duckdb:duckdb	46566868 / 46980512 / -0.9%	74554833 / 74998567 / -0.6%	0.62 / 0.63 / -0.3%
job_q17/duckdb:duckdb	54898906 / 55384470 / -0.9%	84215486 / 80624255 / +4.5%	0.65 / 0.69 / -5.1%
job_q18/duckdb:duckdb	21360622 / 21379902 / -0.1%	42784841 / 39378523 / +8.7%	0.50 / 0.54 / -8.0%
job_q19/duckdb:duckdb	12155628 / 12196624 / -0.3%	22544415 / 19622456 / +14.9% 🔴	0.54 / 0.62 / -13.3%
job_q20/duckdb:duckdb	15509466 / 15343330 / +1.1%	32556273 / 30674562 / +6.1%	0.48 / 0.50 / -4.8%
job_q21/duckdb:duckdb	22235130 / 22326278 / -0.4%	33674669 / 32024971 / +5.2%	0.66 / 0.70 / -5.3%
job_q22/duckdb:duckdb	22011917 / 21938288 / +0.3%	41820787 / 40185163 / +4.1%	0.53 / 0.55 / -3.6%
job_q23/duckdb:duckdb	40192988 / 39680634 / +1.3%	57013995 / 54382787 / +4.8%	0.70 / 0.73 / -3.4%
job_q24/duckdb:duckdb	16882160 / 17348291 / -2.7%	32137296 / 31587373 / +1.7%	0.53 / 0.55 / -4.4%
job_q25/duckdb:duckdb	15570729 / 15873694 / -1.9%	29413379 / 27282014 / +7.8%	0.53 / 0.58 / -9.0%
job_q26/duckdb:duckdb	78345136 / 78768718 / -0.5%	127948414 / 113398111 / +12.8% 🔴	0.61 / 0.69 / -11.8%
job_q27/duckdb:duckdb	26196192 / 26033206 / +0.6%	41483390 / 40091236 / +3.5%	0.63 / 0.65 / -2.8%
job_q28/duckdb:duckdb	25144630 / 25434644 / -1.1%	40210134 / 37675262 / +6.7%	0.63 / 0.68 / -7.4%
job_q29/duckdb:duckdb	87212356 / 86798534 / +0.5%	99022189 / 96642448 / +2.5%	0.88 / 0.90 / -1.9%
job_q30/duckdb:duckdb	56896656 / 56772565 / +0.2%	69983593 / 68920005 / +1.5%	0.81 / 0.82 / -1.3%
job_q31/duckdb:duckdb	68031048 / 67429534 / +0.9%	88888390 / 86529037 / +2.7%	0.77 / 0.78 / -1.8%
job_q32/duckdb:duckdb	46473143 / 48223290 / -3.6%	71259492 / 66328937 / +7.4%	0.65 / 0.73 / -10.3%
job_q33/duckdb:duckdb	57307250 / 57235275 / +0.1%	78779552 / 75582221 / +4.2%	0.73 / 0.76 / -3.9%
job_q34/duckdb:duckdb	94745500 / 93251206 / +1.6%	113990016 / 109720310 / +3.9%	0.83 / 0.85 / -2.2%
job_q35/duckdb:duckdb	22057684 / 22210270 / -0.7%	40730192 / 37167522 / +9.6%	0.54 / 0.60 / -9.4%
job_q36/duckdb:duckdb	15974056 / 15994057 / -0.1%	31202849 / 29267942 / +6.6%	0.51 / 0.55 / -6.3%
job_q37/duckdb:duckdb	50860886 / 51812574 / -1.8%	72746691 / 71015428 / +2.4%	0.70 / 0.73 / -4.2%
job_q38/duckdb:duckdb	18384684 / 18205730 / +1.0%	34280540 / 29832637 / +14.9% 🔴	0.54 / 0.61 / -12.1%
job_q39/duckdb:duckdb	14482358 / 13774706 / +5.1%	26653218 / 24543644 / +8.6%	0.54 / 0.56 / -3.2%
job_q40/duckdb:duckdb	25963178 / 25844306 / +0.5%	38138052 / 36519909 / +4.4%	0.68 / 0.71 / -3.8%
job_q41/duckdb:duckdb	40860050 / 39668098 / +3.0%	51512307 / 49670573 / +3.7%	0.79 / 0.80 / -0.7%
job_q42/duckdb:duckdb	20453224 / 20969846 / -2.5%	31887200 / 29839451 / +6.9%	0.64 / 0.70 / -8.7%
job_q43/duckdb:duckdb	24468026 / 23876510 / +2.5%	36751366 / 34571373 / +6.3%	0.67 / 0.69 / -3.6%
job_q44/duckdb:duckdb	29532187 / 29668080 / -0.5%	39963703 / 38251195 / +4.5%	0.74 / 0.78 / -4.7%
job_q45/duckdb:duckdb	22605294 / 21860074 / +3.4%	35702051 / 32751099 / +9.0%	0.63 / 0.67 / -5.1%
job_q46/duckdb:duckdb	34880224 / 34613086 / +0.8%	47939199 / 44323416 / +8.2%	0.73 / 0.78 / -6.8%
job_q47/duckdb:duckdb	32461154 / 32228285 / +0.7%	45070543 / 42728679 / +5.5%	0.72 / 0.75 / -4.5%
job_q48/duckdb:duckdb	58790901 / 59149102 / -0.6%	71733938 / 69239686 / +3.6%	0.82 / 0.85 / -4.1%
job_q49/duckdb:duckdb	52530131 / 53607649 / -2.0%	69511428 / 64827374 / +7.2%	0.76 / 0.83 / -8.6%
job_q50/duckdb:duckdb	27424784 / 27314472 / +0.4%	38975786 / 36885131 / +5.7%	0.70 / 0.74 / -5.0%
job_q51/duckdb:duckdb	39531192 / 39402015 / +0.3%	51494849 / 49638865 / +3.7%	0.77 / 0.79 / -3.3%
job_q52/duckdb:duckdb	34862345 / 35253508 / -1.1%	50672104 / 47641018 / +6.4%	0.69 / 0.74 / -7.0%
job_q53/duckdb:duckdb	22128812 / 22138166 / -0.0%	36905526 / 35079682 / +5.2%	0.60 / 0.63 / -5.0%
job_q54/duckdb:duckdb	59603147 / 59393272 / +0.4%	74347083 / 71562720 / +3.9%	0.80 / 0.83 / -3.4%
job_q55/duckdb:duckdb	67199080 / 66778030 / +0.6%	83443766 / 80018961 / +4.3%	0.81 / 0.83 / -3.5%
job_q56/duckdb:duckdb	24942732 / 24800345 / +0.6%	48746053 / 43705729 / +11.5% 🔴	0.51 / 0.57 / -9.8%
job_q57/duckdb:duckdb	112326730 / 111775314 / +0.5%	134692612 / 130099550 / +3.5%	0.83 / 0.86 / -2.9%
job_q58/duckdb:duckdb	45519997 / 45247680 / +0.6%	67834028 / 65114311 / +4.2%	0.67 / 0.69 / -3.4%
job_q59/duckdb:duckdb	42179762 / 41804474 / +0.9%	63889900 / 61588027 / +3.7%	0.66 / 0.68 / -2.7%
job_q60/duckdb:duckdb	47109630 / 47266416 / -0.3%	67373248 / 63840398 / +5.5%	0.70 / 0.74 / -5.6%
job_q61/duckdb:duckdb	55218445 / 53903387 / +2.4%	71787419 / 68663725 / +4.5%	0.77 / 0.79 / -2.0%
job_q62/duckdb:duckdb	52082922 / 53175617 / -2.1%	70352681 / 67469998 / +4.3%	0.74 / 0.79 / -6.1%
job_q63/duckdb:duckdb	59415618 / 59184570 / +0.4%	77541959 / 74868906 / +3.6%	0.77 / 0.79 / -3.1%
job_q64/duckdb:duckdb	46231678 / 46455076 / -0.5%	66745627 / 63329942 / +5.4%	0.69 / 0.73 / -5.6%
job_q65/duckdb:duckdb	75026460 / 74858616 / +0.2%	90452347 / 89457394 / +1.1%	0.83 / 0.84 / -0.9%
job_q66/duckdb:duckdb	53749500 / 54316815 / -1.0%	82296221 / 79589435 / +3.4%	0.65 / 0.68 / -4.3%
job_q67/duckdb:duckdb	24337582 / 24484255 / -0.6%	49088766 / 47160046 / +4.1%	0.50 / 0.52 / -4.5%
job_q68/duckdb:duckdb	53377668 / 53440146 / -0.1%	78927077 / 75360347 / +4.7%	0.68 / 0.71 / -4.6%
job_q69/duckdb:duckdb	78225620 / 76362442 / +2.4%	98451062 / 95457881 / +3.1%	0.79 / 0.80 / -0.7%
job_q70/duckdb:duckdb	46435028 / 46045723 / +0.8%	65168937 / 66854995 / -2.5%	0.71 / 0.69 / +3.5%
job_q71/duckdb:duckdb	81145065 / 79847928 / +1.6%	100504377 / 97984147 / +2.6%	0.81 / 0.81 / -0.9%
job_q72/duckdb:duckdb	109993770 / 109898792 / +0.1%	130277100 / 126415277 / +3.1%	0.84 / 0.87 / -2.9%
job_q73/duckdb:duckdb	64587804 / 64992020 / -0.6%	88814535 / 84788632 / +4.7%	0.73 / 0.77 / -5.1%
job_q74/duckdb:duckdb	61795272 / 62209156 / -0.7%	87724423 / 82992834 / +5.7%	0.70 / 0.75 / -6.0%
job_q75/duckdb:duckdb	54212976 / 55235602 / -1.9%	79264087 / 74599050 / +6.3%	0.68 / 0.74 / -7.6%
job_q76/duckdb:duckdb	24166495 / 24167201 / -0.0%	43172332 / 40429804 / +6.8%	0.56 / 0.60 / -6.4%
job_q77/duckdb:duckdb	22148718 / 22389186 / -1.1%	37647226 / 34276117 / +9.8%	0.59 / 0.65 / -9.9%
job_q78/duckdb:duckdb	25144168 / 23795928 / +5.7%	42873099 / 40513143 / +5.8%	0.59 / 0.59 / -0.2%
job_q79/duckdb:duckdb	62772702 / 62970100 / -0.3%	80130712 / 78259685 / +2.4%	0.78 / 0.80 / -2.6%
job_q80/duckdb:duckdb	46570956 / 46960658 / -0.8%	63960466 / 61237439 / +4.4%	0.73 / 0.77 / -5.1%
job_q81/duckdb:duckdb	101883867 / 102193986 / -0.3%	119753853 / 118608737 / +1.0%	0.85 / 0.86 / -1.3%
job_q82/duckdb:duckdb	143626383 / 143193716 / +0.3%	158721800 / 158960649 / -0.2%	0.90 / 0.90 / +0.5%
job_q83/duckdb:duckdb	48683287 / 48577050 / +0.2%	65268761 / 60821433 / +7.3%	0.75 / 0.80 / -6.6%
job_q84/duckdb:duckdb	26547012 / 26425077 / +0.5%	42542429 / 39078274 / +8.9%	0.62 / 0.68 / -7.7%
job_q85/duckdb:duckdb	50858592 / 50470789 / +0.8%	66895060 / 61846841 / +8.2%	0.76 / 0.82 / -6.8%
job_q86/duckdb:duckdb	55435250 / 54897892 / +1.0%	80580058 / 75529649 / +6.7%	0.69 / 0.73 / -5.4%
job_q87/duckdb:duckdb	32543656 / 33267856 / -2.2%	59166777 / 49281610 / +20.1% 🔴	0.55 / 0.68 / -18.5%
job_q88/duckdb:duckdb	48218866 / 48829102 / -1.2%	77697160 / 73406906 / +5.8%	0.62 / 0.67 / -6.7%
job_q89/duckdb:duckdb	25426898 / 25496352 / -0.3%	48744581 / 45366552 / +7.4%	0.52 / 0.56 / -7.2%
job_q90/duckdb:duckdb	58830434 / 59321922 / -0.8%	85307109 / 83615746 / +2.0%	0.69 / 0.71 / -2.8%
job_q91/duckdb:duckdb	54611377 / 54811014 / -0.4%	85395578 / 80300656 / +6.3%	0.64 / 0.68 / -6.3%
job_q92/duckdb:duckdb	34627948 / 34305136 / +0.9%	61129037 / 58015161 / +5.4%	0.57 / 0.59 / -4.2%
job_q93/duckdb:duckdb	78584962 / 80630770 / -2.5%	109553118 / 106248951 / +3.1%	0.72 / 0.76 / -5.5%
job_q94/duckdb:duckdb	22265604 / 22560875 / -1.3%	39707485 / 35905319 / +10.6% 🔴	0.56 / 0.63 / -10.8%
job_q95/duckdb:duckdb	21501066 / 20561066 / +4.6%	35770511 / 35620690 / +0.4%	0.60 / 0.58 / +4.1%
job_q96/duckdb:duckdb	23141578 / 22849408 / +1.3%	40352376 / 38533360 / +4.7%	0.57 / 0.59 / -3.3%
job_q97/duckdb:duckdb	85784996 / 85846096 / -0.1%	103644570 / 100303439 / +3.3%	0.83 / 0.86 / -3.3%
job_q98/duckdb:duckdb	45469480 / 45847628 / -0.8%	63038874 / 61452234 / +2.6%	0.72 / 0.75 / -3.3%
job_q99/duckdb:duckdb	77867830 / 78248322 / -0.5%	95729743 / 91828492 / +4.2%	0.81 / 0.85 / -4.5%

github-actions · 2026-11-02T20:18:23Z

Benchmarks: Clickbench on NVME 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1233924 / 1260098 / -2.1%	23993186 / 22908139 / +4.7%	0.05 / 0.06 / -6.5%
clickbench_q01/datafusion:vortex-file-compressed	5945740 / 6332382 / -6.1%	33535941 / 29084459 / +15.3% 🔴	0.18 / 0.22 / -18.6%
clickbench_q02/datafusion:vortex-file-compressed	10829839 / 10575444 / +2.4%	44953952 / 39949060 / +12.5% 🔴	0.24 / 0.26 / -9.0%
clickbench_q03/datafusion:vortex-file-compressed	13365546 / 13536726 / -1.3%	55781636 / 58335860 / -4.4%	0.24 / 0.23 / +3.3%
clickbench_q04/datafusion:vortex-file-compressed	58597926 / 58685990 / -0.2%	103755541 / 101685663 / +2.0%	0.56 / 0.58 / -2.1%
clickbench_q05/datafusion:vortex-file-compressed	77670796 / 77387092 / +0.4%	124146340 / 128310993 / -3.2%	0.63 / 0.60 / +3.7%
clickbench_q06/datafusion:vortex-file-compressed	1264607 / 1235261 / +2.4%	22448261 / 22164689 / +1.3%	0.06 / 0.06 / +1.1%
clickbench_q07/datafusion:vortex-file-compressed	9974154 / 9485795 / +5.1%	33859080 / 32645891 / +3.7%	0.29 / 0.29 / +1.4%
clickbench_q08/datafusion:vortex-file-compressed	80517996 / 79518901 / +1.3%	128851703 / 126603776 / +1.8%	0.62 / 0.63 / -0.5%
clickbench_q09/datafusion:vortex-file-compressed	174979772 / 170423720 / +2.7%	215769639 / 227082585 / -5.0%	0.81 / 0.75 / +8.1%
clickbench_q10/datafusion:vortex-file-compressed	23892420 / 24012363 / -0.5%	71535304 / 69441097 / +3.0%	0.33 / 0.35 / -3.4%
clickbench_q11/datafusion:vortex-file-compressed	26443373 / 24639724 / +7.3%	72924384 / 70198052 / +3.9%	0.36 / 0.35 / +3.3%
clickbench_q12/datafusion:vortex-file-compressed	72684252 / 72424778 / +0.4%	127843756 / 124962586 / +2.3%	0.57 / 0.58 / -1.9%
clickbench_q13/datafusion:vortex-file-compressed	118553685 / 117166638 / +1.2%	185462418 / 184012965 / +0.8%	0.64 / 0.64 / +0.4%
clickbench_q14/datafusion:vortex-file-compressed	75161797 / 76517138 / -1.8%	127927461 / 126917261 / +0.8%	0.59 / 0.60 / -2.5%
clickbench_q15/datafusion:vortex-file-compressed	63990920 / 63633009 / +0.6%	101199802 / 100925234 / +0.3%	0.63 / 0.63 / +0.3%
clickbench_q16/datafusion:vortex-file-compressed	155215144 / 155330378 / -0.1%	217234798 / 216757899 / +0.2%	0.71 / 0.72 / -0.3%
clickbench_q17/datafusion:vortex-file-compressed	151544844 / 153608332 / -1.3%	233837860 / 221550587 / +5.5%	0.65 / 0.69 / -6.5%
clickbench_q18/datafusion:vortex-file-compressed	296959266 / 290137434 / +2.4%	378946590 / 376770703 / +0.6%	0.78 / 0.77 / +1.8%
clickbench_q19/datafusion:vortex-file-compressed	8011631 / 8637864 / -7.2%	48952300 / 50046140 / -2.2%	0.16 / 0.17 / -5.2%
clickbench_q20/datafusion:vortex-file-compressed	68950482 / 68617686 / +0.5%	252324361 / 247484378 / +2.0%	0.27 / 0.28 / -1.4%
clickbench_q21/datafusion:vortex-file-compressed	78599158 / 82771067 / -5.0%	291381439 / 286814848 / +1.6%	0.27 / 0.29 / -6.5%
clickbench_q22/datafusion:vortex-file-compressed	91217157 / 92330963 / -1.2%	390498235 / 392990836 / -0.6%	0.23 / 0.23 / -0.6%
clickbench_q23/datafusion:vortex-file-compressed	187760156 / 193115051 / -2.8%	550829357 / 551883305 / -0.2%	0.34 / 0.35 / -2.6%
clickbench_q24/datafusion:vortex-file-compressed	15136549 / 15537910 / -2.6%	73377344 / 73005090 / +0.5%	0.21 / 0.21 / -3.1%
clickbench_q25/datafusion:vortex-file-compressed	19313514 / 19439042 / -0.6%	65171167 / 63439367 / +2.7%	0.30 / 0.31 / -3.3%
clickbench_q26/datafusion:vortex-file-compressed	17672013 / 16420556 / +7.6%	70040255 / 75719382 / -7.5%	0.25 / 0.22 / +16.3%
clickbench_q27/datafusion:vortex-file-compressed	103927556 / 101642702 / +2.2%	259066197 / 255672828 / +1.3%	0.40 / 0.40 / +0.9%
clickbench_q28/datafusion:vortex-file-compressed	558734744 / 562863338 / -0.7%	655878866 / 668951839 / -2.0%	0.85 / 0.84 / +1.2%
clickbench_q29/datafusion:vortex-file-compressed	24244264 / 24011852 / +1.0%	57552625 / 52983842 / +8.6%	0.42 / 0.45 / -7.0%
clickbench_q30/datafusion:vortex-file-compressed	56584478 / 56821774 / -0.4%	109724403 / 116752986 / -6.0%	0.52 / 0.49 / +6.0%
clickbench_q31/datafusion:vortex-file-compressed	65766735 / 68041014 / -3.3%	159152434 / 163581204 / -2.7%	0.41 / 0.42 / -0.7%
clickbench_q32/datafusion:vortex-file-compressed	288145667 / 291771342 / -1.2%	389806884 / 393872027 / -1.0%	0.74 / 0.74 / -0.2%
clickbench_q33/datafusion:vortex-file-compressed	322791980 / 321143264 / +0.5%	435317825 / 432592241 / +0.6%	0.74 / 0.74 / -0.1%
clickbench_q34/datafusion:vortex-file-compressed	326195158 / 320412695 / +1.8%	436348099 / 434897994 / +0.3%	0.75 / 0.74 / +1.5%
clickbench_q35/datafusion:vortex-file-compressed	56839684 / 57926576 / -1.9%	92232910 / 92873961 / -0.7%	0.62 / 0.62 / -1.2%
clickbench_q36/datafusion:vortex-file-compressed	37556765 / 37456232 / +0.3%	67604360 / 68297060 / -1.0%	0.56 / 0.55 / +1.3%
clickbench_q37/datafusion:vortex-file-compressed	21359371 / 21396608 / -0.2%	48194940 / 47916747 / +0.6%	0.44 / 0.45 / -0.8%
clickbench_q38/datafusion:vortex-file-compressed	13605418 / 13214945 / +3.0%	43284857 / 41173916 / +5.1%	0.31 / 0.32 / -2.1%
clickbench_q39/datafusion:vortex-file-compressed	79459308 / 79497390 / -0.0%	113074860 / 112388079 / +0.6%	0.70 / 0.71 / -0.7%
clickbench_q40/datafusion:vortex-file-compressed	10680682 / 10675746 / +0.0%	35988785 / 36359606 / -1.0%	0.30 / 0.29 / +1.1%
clickbench_q41/datafusion:vortex-file-compressed	9906750 / 10098838 / -1.9%	34506039 / 34470776 / +0.1%	0.29 / 0.29 / -2.0%
clickbench_q42/datafusion:vortex-file-compressed	10530244 / 10193024 / +3.3%	35160681 / 36033838 / -2.4%	0.30 / 0.28 / +5.9%

datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1269759 / 1242539 / +2.2%	51229332 / 50911941 / +0.6%	0.02 / 0.02 / +1.6%
clickbench_q01/datafusion:parquet	15784108 / 15947766 / -1.0%	66170551 / 66802218 / -0.9%	0.24 / 0.24 / -0.1%
clickbench_q02/datafusion:parquet	18569419 / 19579552 / -5.2%	81184389 / 82505995 / -1.6%	0.23 / 0.24 / -3.6%
clickbench_q03/datafusion:parquet	16918276 / 16734486 / +1.1%	81296040 / 80224248 / +1.3%	0.21 / 0.21 / -0.2%
clickbench_q04/datafusion:parquet	62554968 / 64494127 / -3.0%	127774992 / 127266686 / +0.4%	0.49 / 0.51 / -3.4%
clickbench_q05/datafusion:parquet	88531969 / 88635325 / -0.1%	157200356 / 157233232 / -0.0%	0.56 / 0.56 / -0.1%
clickbench_q06/datafusion:parquet	1269180 / 1254502 / +1.2%	50155277 / 50629107 / -0.9%	0.03 / 0.02 / +2.1%
clickbench_q07/datafusion:parquet	16757292 / 17073932 / -1.9%	68271464 / 69917932 / -2.4%	0.25 / 0.24 / +0.5%
clickbench_q08/datafusion:parquet	84216253 / 87140709 / -3.4%	160285385 / 161859485 / -1.0%	0.53 / 0.54 / -2.4%
clickbench_q09/datafusion:parquet	185140961 / 188175487 / -1.6%	274457493 / 263415684 / +4.2%	0.67 / 0.71 / -5.6%
clickbench_q10/datafusion:parquet	35773320 / 36638313 / -2.4%	104078662 / 101389789 / +2.7%	0.34 / 0.36 / -4.9%
clickbench_q11/datafusion:parquet	42998566 / 43461207 / -1.1%	113251575 / 110290274 / +2.7%	0.38 / 0.39 / -3.7%
clickbench_q12/datafusion:parquet	97120364 / 97564720 / -0.5%	164695559 / 162706513 / +1.2%	0.59 / 0.60 / -1.7%
clickbench_q13/datafusion:parquet	147657024 / 146528482 / +0.8%	226801099 / 235016513 / -3.5%	0.65 / 0.62 / +4.4%
clickbench_q14/datafusion:parquet	101598764 / 102607652 / -1.0%	175988047 / 175350021 / +0.4%	0.58 / 0.59 / -1.3%
clickbench_q15/datafusion:parquet	71513852 / 72849352 / -1.8%	131067876 / 132634627 / -1.2%	0.55 / 0.55 / -0.7%
clickbench_q16/datafusion:parquet	157110912 / 157182754 / -0.0%	239606499 / 235842917 / +1.6%	0.66 / 0.67 / -1.6%
clickbench_q17/datafusion:parquet	156019064 / 157443502 / -0.9%	237435083 / 235621773 / +0.8%	0.66 / 0.67 / -1.7%
clickbench_q18/datafusion:parquet	314064893 / 310485054 / +1.2%	417508905 / 427025926 / -2.2%	0.75 / 0.73 / +3.5%
clickbench_q19/datafusion:parquet	19086786 / 18999759 / +0.5%	78381640 / 77670124 / +0.9%	0.24 / 0.24 / -0.5%
clickbench_q20/datafusion:parquet	179570981 / 179730994 / -0.1%	298556323 / 297254228 / +0.4%	0.60 / 0.60 / -0.5%
clickbench_q21/datafusion:parquet	175478680 / 173966657 / +0.9%	316669651 / 311527956 / +1.7%	0.55 / 0.56 / -0.8%
clickbench_q22/datafusion:parquet	262465314 / 260160663 / +0.9%	459580539 / 459190004 / +0.1%	0.57 / 0.57 / +0.8%
clickbench_q23/datafusion:parquet	1002006203 / 1014842362 / -1.3%	1188132681 / 1198081163 / -0.8%	0.84 / 0.85 / -0.4%
clickbench_q24/datafusion:parquet	30524579 / 30758662 / -0.8%	91436445 / 91161165 / +0.3%	0.33 / 0.34 / -1.1%
clickbench_q25/datafusion:parquet	38070908 / 37547486 / +1.4%	105980583 / 104907639 / +1.0%	0.36 / 0.36 / +0.4%
clickbench_q26/datafusion:parquet	30699264 / 30614614 / +0.3%	90885070 / 90630763 / +0.3%	0.34 / 0.34 / -0.0%
clickbench_q27/datafusion:parquet	194487274 / 194431478 / +0.0%	307473351 / 307804639 / -0.1%	0.63 / 0.63 / +0.1%
clickbench_q28/datafusion:parquet	622078288 / 618983312 / +0.5%	716610868 / 710020080 / +0.9%	0.87 / 0.87 / -0.4%
clickbench_q29/datafusion:parquet	29194652 / 28737160 / +1.6%	90059766 / 91615853 / -1.7%	0.32 / 0.31 / +3.3%
clickbench_q30/datafusion:parquet	90174469 / 89219614 / +1.1%	175464824 / 173873803 / +0.9%	0.51 / 0.51 / +0.2%
clickbench_q31/datafusion:parquet	102925416 / 102329996 / +0.6%	199714606 / 201655695 / -1.0%	0.52 / 0.51 / +1.6%
clickbench_q32/datafusion:parquet	311826808 / 308823612 / +1.0%	424528877 / 430701861 / -1.4%	0.73 / 0.72 / +2.4%
clickbench_q33/datafusion:parquet	377467542 / 378277496 / -0.2%	477710842 / 479752437 / -0.4%	0.79 / 0.79 / +0.2%
clickbench_q34/datafusion:parquet	379884672 / 376878607 / +0.8%	482192505 / 477960173 / +0.9%	0.79 / 0.79 / -0.1%
clickbench_q35/datafusion:parquet	64967466 / 63475718 / +2.4%	124742114 / 128347968 / -2.8%	0.52 / 0.49 / +5.3%
clickbench_q36/datafusion:parquet	73813992 / 73909641 / -0.1%	136289198 / 136421876 / -0.1%	0.54 / 0.54 / -0.0%
clickbench_q37/datafusion:parquet	35613330 / 35677822 / -0.2%	92262362 / 92129837 / +0.1%	0.39 / 0.39 / -0.3%
clickbench_q38/datafusion:parquet	47927596 / 48067644 / -0.3%	108240358 / 109391380 / -1.1%	0.44 / 0.44 / +0.8%
clickbench_q39/datafusion:parquet	144810550 / 143928980 / +0.6%	211407241 / 209302743 / +1.0%	0.68 / 0.69 / -0.4%
clickbench_q40/datafusion:parquet	19897212 / 20330023 / -2.1%	79062064 / 77938801 / +1.4%	0.25 / 0.26 / -3.5%
clickbench_q41/datafusion:parquet	18862418 / 18953340 / -0.5%	76070463 / 74767571 / +1.7%	0.25 / 0.25 / -2.2%
clickbench_q42/datafusion:parquet	19187048 / 19109388 / +0.4%	74041587 / 73920154 / +0.2%	0.26 / 0.26 / +0.2%

duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	2214606 / 2200642 / +0.6%	24883747 / 24976667 / -0.4%	0.09 / 0.09 / +1.0%
clickbench_q01/duckdb:vortex-file-compressed	7331438 / 7737814 / -5.3%	28009146 / 28143070 / -0.5%	0.26 / 0.27 / -4.8%
clickbench_q02/duckdb:vortex-file-compressed	9255276 / 8960388 / +3.3%	37311780 / 37435557 / -0.3%	0.25 / 0.24 / +3.6%
clickbench_q03/duckdb:vortex-file-compressed	14085202 / 14151435 / -0.5%	51418464 / 51161346 / +0.5%	0.27 / 0.28 / -1.0%
clickbench_q04/duckdb:vortex-file-compressed	56181656 / 58898656 / -4.6%	92396772 / 92482495 / -0.1%	0.61 / 0.64 / -4.5%
clickbench_q05/duckdb:vortex-file-compressed	64166654 / 63940714 / +0.4%	96638609 / 93699825 / +3.1%	0.66 / 0.68 / -2.7%
clickbench_q06/duckdb:vortex-file-compressed	2639306 / 2633962 / +0.2%	30206539 / 30354635 / -0.5%	0.09 / 0.09 / +0.7%
clickbench_q07/duckdb:vortex-file-compressed	9444457 / 9490308 / -0.5%	30639346 / 31380454 / -2.4%	0.31 / 0.30 / +1.9%
clickbench_q08/duckdb:vortex-file-compressed	69353802 / 70714752 / -1.9%	105231344 / 105693334 / -0.4%	0.66 / 0.67 / -1.5%
clickbench_q09/duckdb:vortex-file-compressed	93466499 / 91938529 / +1.7%	130164670 / 128758466 / +1.1%	0.72 / 0.71 / +0.6%
clickbench_q10/duckdb:vortex-file-compressed	27444640 / 28325980 / -3.1%	71493795 / 74056187 / -3.5%	0.38 / 0.38 / +0.4%
clickbench_q11/duckdb:vortex-file-compressed	30857178 / 30807464 / +0.2%	73777157 / 74492318 / -1.0%	0.42 / 0.41 / +1.1%
clickbench_q12/duckdb:vortex-file-compressed	70861677 / 69508186 / +1.9%	103177620 / 100013836 / +3.2%	0.69 / 0.69 / -1.2%
clickbench_q13/duckdb:vortex-file-compressed	122607280 / 126495698 / -3.1%	170029908 / 168817617 / +0.7%	0.72 / 0.75 / -3.8%
clickbench_q14/duckdb:vortex-file-compressed	74796747 / 73936514 / +1.2%	106229945 / 103117154 / +3.0%	0.70 / 0.72 / -1.8%
clickbench_q15/duckdb:vortex-file-compressed	77630201 / 77057811 / +0.7%	115089735 / 109484599 / +5.1%	0.67 / 0.70 / -4.2%
clickbench_q16/duckdb:vortex-file-compressed	135919584 / 134284258 / +1.2%	172635136 / 172999824 / -0.2%	0.79 / 0.78 / +1.4%
clickbench_q17/duckdb:vortex-file-compressed	138913352 / 140719837 / -1.3%	174131524 / 178851423 / -2.6%	0.80 / 0.79 / +1.4%
clickbench_q18/duckdb:vortex-file-compressed	256926719 / 262253665 / -2.0%	306900486 / 307694056 / -0.3%	0.84 / 0.85 / -1.8%
clickbench_q19/duckdb:vortex-file-compressed	9415794 / 9342374 / +0.8%	38963912 / 35235507 / +10.6% 🔴	0.24 / 0.27 / -8.9%
clickbench_q20/duckdb:vortex-file-compressed	66671186 / 69614295 / -4.2%	172428450 / 167368939 / +3.0%	0.39 / 0.42 / -7.0%
clickbench_q21/duckdb:vortex-file-compressed	85018884 / 86581134 / -1.8%	195080670 / 190208928 / +2.6%	0.44 / 0.46 / -4.3%
clickbench_q22/duckdb:vortex-file-compressed	173607538 / 174126300 / -0.3%	351147768 / 348678031 / +0.7%	0.49 / 0.50 / -1.0%
clickbench_q23/duckdb:vortex-file-compressed	41638998 / 40686224 / +2.3%	82435842 / 86029361 / -4.2%	0.51 / 0.47 / +6.8%
clickbench_q24/duckdb:vortex-file-compressed	13995744 / 14361734 / -2.5%	37495799 / 38559779 / -2.8%	0.37 / 0.37 / +0.2%
clickbench_q25/duckdb:vortex-file-compressed	19526326 / 19155672 / +1.9%	54422819 / 54378852 / +0.1%	0.36 / 0.35 / +1.9%
clickbench_q26/duckdb:vortex-file-compressed	11220878 / 11412425 / -1.7%	35787791 / 37970900 / -5.7%	0.31 / 0.30 / +4.3%
clickbench_q27/duckdb:vortex-file-compressed	53395680 / 54022135 / -1.2%	178273363 / 173285690 / +2.9%	0.30 / 0.31 / -3.9%
clickbench_q28/duckdb:vortex-file-compressed	510401536 / 511557668 / -0.2%	557566231 / 571814749 / -2.5%	0.92 / 0.89 / +2.3%
clickbench_q29/duckdb:vortex-file-compressed	17141944 / 17520892 / -2.2%	43803401 / 43587133 / +0.5%	0.39 / 0.40 / -2.6%
clickbench_q30/duckdb:vortex-file-compressed	60816058 / 60976030 / -0.3%	111404536 / 113940824 / -2.2%	0.55 / 0.54 / +2.0%
clickbench_q31/duckdb:vortex-file-compressed	109730114 / 101068268 / +8.6%	177214290 / 198370976 / -10.7% 🟢	0.62 / 0.51 / +21.5%
clickbench_q32/duckdb:vortex-file-compressed	357051629 / 370697102 / -3.7%	394230213 / 401783913 / -1.9%	0.91 / 0.92 / -1.8%
clickbench_q33/duckdb:vortex-file-compressed	344685380 / 349610681 / -1.4%	401870718 / 408399924 / -1.6%	0.86 / 0.86 / +0.2%
clickbench_q34/duckdb:vortex-file-compressed	355877656 / 354158988 / +0.5%	428250281 / 414407427 / +3.3%	0.83 / 0.85 / -2.8%
clickbench_q35/duckdb:vortex-file-compressed	58215748 / 56732256 / +2.6%	88442283 / 87104391 / +1.5%	0.66 / 0.65 / +1.1%
clickbench_q36/duckdb:vortex-file-compressed	11815360 / 11669470 / +1.3%	33730732 / 33657853 / +0.2%	0.35 / 0.35 / +1.0%
clickbench_q37/duckdb:vortex-file-compressed	8139862 / 8116686 / +0.3%	28032223 / 27875290 / +0.6%	0.29 / 0.29 / -0.3%
clickbench_q38/duckdb:vortex-file-compressed	9160880 / 8837116 / +3.7%	30229670 / 27677664 / +9.2%	0.30 / 0.32 / -5.1%
clickbench_q39/duckdb:vortex-file-compressed	18693748 / 18880741 / -1.0%	40077822 / 39742262 / +0.8%	0.47 / 0.48 / -1.8%
clickbench_q40/duckdb:vortex-file-compressed	7350437 / 7392110 / -0.6%	26734642 / 28741110 / -7.0%	0.27 / 0.26 / +6.9%
clickbench_q41/duckdb:vortex-file-compressed	8539818 / 8264720 / +3.3%	29185416 / 31662194 / -7.8%	0.29 / 0.26 / +12.1%
clickbench_q42/duckdb:vortex-file-compressed	7324443 / 7432544 / -1.5%	27456082 / 27739402 / -1.0%	0.27 / 0.27 / -0.4%

duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	8896534 / 9361102 / -5.0%	14982510 / 15075952 / -0.6%	0.59 / 0.62 / -4.4%
clickbench_q01/duckdb:parquet	15063944 / 15774604 / -4.5%	20345381 / 21046017 / -3.3%	0.74 / 0.75 / -1.2%
clickbench_q02/duckdb:parquet	22641046 / 22317563 / +1.4%	30852497 / 30806067 / +0.2%	0.73 / 0.72 / +1.3%
clickbench_q03/duckdb:parquet	23151553 / 22943628 / +0.9%	35848450 / 37479420 / -4.4%	0.65 / 0.61 / +5.5%
clickbench_q04/duckdb:parquet	62368070 / 61317524 / +1.7%	72873318 / 75574425 / -3.6%	0.86 / 0.81 / +5.5%
clickbench_q05/duckdb:parquet	84164868 / 86888976 / -3.1%	95148139 / 98836094 / -3.7%	0.88 / 0.88 / +0.6%
clickbench_q06/duckdb:parquet	20092322 / 20929992 / -4.0%	28886460 / 28134809 / +2.7%	0.70 / 0.74 / -6.5%
clickbench_q07/duckdb:parquet	16956660 / 17086650 / -0.8%	22311339 / 22489529 / -0.8%	0.76 / 0.76 / +0.0%
clickbench_q08/duckdb:parquet	73792203 / 75265840 / -2.0%	87818660 / 90009729 / -2.4%	0.84 / 0.84 / +0.5%
clickbench_q09/duckdb:parquet	102599230 / 104194938 / -1.5%	119146465 / 118673052 / +0.4%	0.86 / 0.88 / -1.9%
clickbench_q10/duckdb:parquet	41503555 / 41806220 / -0.7%	54590456 / 52675102 / +3.6%	0.76 / 0.79 / -4.2%
clickbench_q11/duckdb:parquet	47280357 / 46565877 / +1.5%	62075639 / 61054383 / +1.7%	0.76 / 0.76 / -0.1%
clickbench_q12/duckdb:parquet	94410858 / 91347154 / +3.4%	107958716 / 108479764 / -0.5%	0.87 / 0.84 / +3.9%
clickbench_q13/duckdb:parquet	150197534 / 149572704 / +0.4%	169967196 / 171301094 / -0.8%	0.88 / 0.87 / +1.2%
clickbench_q14/duckdb:parquet	101248952 / 101231902 / +0.0%	117952720 / 118945091 / -0.8%	0.86 / 0.85 / +0.9%
clickbench_q15/duckdb:parquet	86362064 / 86568590 / -0.2%	106137643 / 103957530 / +2.1%	0.81 / 0.83 / -2.3%
clickbench_q16/duckdb:parquet	165238942 / 158584000 / +4.2%	179210583 / 181250774 / -1.1%	0.92 / 0.87 / +5.4%
clickbench_q17/duckdb:parquet	166415050 / 162156573 / +2.6%	180146841 / 180403311 / -0.1%	0.92 / 0.90 / +2.8%
clickbench_q18/duckdb:parquet	291476842 / 292942743 / -0.5%	314967469 / 319557317 / -1.4%	0.93 / 0.92 / +0.9%
clickbench_q19/duckdb:parquet	19708249 / 19773721 / -0.3%	29467127 / 27220312 / +8.3%	0.67 / 0.73 / -7.9%
clickbench_q20/duckdb:parquet	180516348 / 175266402 / +3.0%	235280764 / 227681956 / +3.3%	0.77 / 0.77 / -0.3%
clickbench_q21/duckdb:parquet	219318720 / 218561544 / +0.3%	261771047 / 265119248 / -1.3%	0.84 / 0.82 / +1.6%
clickbench_q22/duckdb:parquet	301377708 / 315358774 / -4.4%	345565934 / 375796687 / -8.0%	0.87 / 0.84 / +3.9%
clickbench_q23/duckdb:parquet	160144910 / 174813308 / -8.4%	246273234 / 249133969 / -1.1%	0.65 / 0.70 / -7.3%
clickbench_q24/duckdb:parquet	30453078 / 30487496 / -0.1%	45040070 / 45676970 / -1.4%	0.68 / 0.67 / +1.3%
clickbench_q25/duckdb:parquet	43021867 / 44276928 / -2.8%	56247270 / 56912467 / -1.2%	0.76 / 0.78 / -1.7%
clickbench_q26/duckdb:parquet	31065172 / 31943645 / -2.8%	46170035 / 45510510 / +1.4%	0.67 / 0.70 / -4.1%
clickbench_q27/duckdb:parquet	186485919 / 191441747 / -2.6%	229801739 / 230172443 / -0.2%	0.81 / 0.83 / -2.4%
clickbench_q28/duckdb:parquet	973260003 / 971836026 / +0.1%	938386917 / 943334917 / -0.5%	1.04 / 1.03 / +0.7%
clickbench_q29/duckdb:parquet	23290247 / 23810722 / -2.2%	29974143 / 30549669 / -1.9%	0.78 / 0.78 / -0.3%
clickbench_q30/duckdb:parquet	106181178 / 105562880 / +0.6%	125532724 / 126214734 / -0.5%	0.85 / 0.84 / +1.1%
clickbench_q31/duckdb:parquet	158827144 / 160062956 / -0.8%	174239409 / 199342228 / -12.6% 🟢	0.91 / 0.80 / +13.5%
clickbench_q32/duckdb:parquet	394496209 / 388018280 / +1.7%	411818615 / 410857334 / +0.2%	0.96 / 0.94 / +1.4%
clickbench_q33/duckdb:parquet	479394697 / 465737018 / +2.9%	470296438 / 449721630 / +4.6%	1.02 / 1.04 / -1.6%
clickbench_q34/duckdb:parquet	472031614 / 469984428 / +0.4%	480028359 / 455772803 / +5.3%	0.98 / 1.03 / -4.6%
clickbench_q35/duckdb:parquet	61324925 / 61370894 / -0.1%	75077392 / 74067469 / +1.4%	0.82 / 0.83 / -1.4%
clickbench_q36/duckdb:parquet	29488661 / 30378482 / -2.9%	36381340 / 35716470 / +1.9%	0.81 / 0.85 / -4.7%
clickbench_q37/duckdb:parquet	23452803 / 23503715 / -0.2%	29501923 / 30188421 / -2.3%	0.79 / 0.78 / +2.1%
clickbench_q38/duckdb:parquet	23737339 / 23843658 / -0.4%	29699415 / 30227350 / -1.7%	0.80 / 0.79 / +1.3%
clickbench_q39/duckdb:parquet	53421754 / 52688912 / +1.4%	59281888 / 60773835 / -2.5%	0.90 / 0.87 / +3.9%
clickbench_q40/duckdb:parquet	14696210 / 14649648 / +0.3%	20947692 / 19774693 / +5.9%	0.70 / 0.74 / -5.3%
clickbench_q41/duckdb:parquet	15302540 / 15917880 / -3.9%	20650561 / 21025400 / -1.8%	0.74 / 0.76 / -2.1%
clickbench_q42/duckdb:parquet	14611387 / 13982776 / +4.5%	21121753 / 20415969 / +3.5%	0.69 / 0.68 / +1.0%

duckdb / duckdb / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:duckdb	11136648 / 11032538 / +0.9%	13811558 / 13627056 / +1.4%	0.81 / 0.81 / -0.4%
clickbench_q01/duckdb:duckdb	26344004 / 26223028 / +0.5%	43599277 / 43557472 / +0.1%	0.60 / 0.60 / +0.4%
clickbench_q02/duckdb:duckdb	22562838 / 22216808 / +1.6%	45699399 / 48469142 / -5.7%	0.49 / 0.46 / +7.7%
clickbench_q03/duckdb:duckdb	21083856 / 21200974 / -0.6%	45564666 / 43511062 / +4.7%	0.46 / 0.49 / -5.0%
clickbench_q04/duckdb:duckdb	75514857 / 74416960 / +1.5%	100574856 / 97810286 / +2.8%	0.75 / 0.76 / -1.3%
clickbench_q05/duckdb:duckdb	78975242 / 80168418 / -1.5%	99136056 / 102874460 / -3.6%	0.80 / 0.78 / +2.2%
clickbench_q06/duckdb:duckdb	21530201 / 21444090 / +0.4%	28677003 / 29376068 / -2.4%	0.75 / 0.73 / +2.8%
clickbench_q07/duckdb:duckdb	17208494 / 17585124 / -2.1%	33366666 / 37208160 / -10.3% 🟢	0.52 / 0.47 / +9.1%
clickbench_q08/duckdb:duckdb	88315694 / 87009516 / +1.5%	117401633 / 115821355 / +1.4%	0.75 / 0.75 / +0.1%
clickbench_q09/duckdb:duckdb	97286412 / 97920431 / -0.6%	138526656 / 136541122 / +1.5%	0.70 / 0.72 / -2.1%
clickbench_q10/duckdb:duckdb	52534874 / 52042898 / +0.9%	89966397 / 88184602 / +2.0%	0.58 / 0.59 / -1.1%
clickbench_q11/duckdb:duckdb	55678762 / 55501412 / +0.3%	99544555 / 98884820 / +0.7%	0.56 / 0.56 / -0.3%
clickbench_q12/duckdb:duckdb	83455400 / 81770823 / +2.1%	105471172 / 102202620 / +3.2%	0.79 / 0.80 / -1.1%
clickbench_q13/duckdb:duckdb	144855230 / 144969936 / -0.1%	178741560 / 180628409 / -1.0%	0.81 / 0.80 / +1.0%
clickbench_q14/duckdb:duckdb	91710935 / 89987734 / +1.9%	113541975 / 112795098 / +0.7%	0.81 / 0.80 / +1.2%
clickbench_q15/duckdb:duckdb	83762445 / 82348812 / +1.7%	106149759 / 104860411 / +1.2%	0.79 / 0.79 / +0.5%
clickbench_q16/duckdb:duckdb	164419140 / 168829126 / -2.6%	191990648 / 185199431 / +3.7%	0.86 / 0.91 / -6.1%
clickbench_q17/duckdb:duckdb	153397797 / 152771300 / +0.4%	186830812 / 186714711 / +0.1%	0.82 / 0.82 / +0.3%
clickbench_q18/duckdb:duckdb	300555542 / 304364621 / -1.3%	347483620 / 353444961 / -1.7%	0.86 / 0.86 / +0.4%
clickbench_q19/duckdb:duckdb	17561260 / 17694986 / -0.8%	32105692 / 32842286 / -2.2%	0.55 / 0.54 / +1.5%
clickbench_q20/duckdb:duckdb	183972353 / 194354396 / -5.3%	470990928 / 464754475 / +1.3%	0.39 / 0.42 / -6.6%
clickbench_q21/duckdb:duckdb	171789666 / 176710904 / -2.8%	458706061 / 457955623 / +0.2%	0.37 / 0.39 / -2.9%
clickbench_q22/duckdb:duckdb	188280124 / 205724600 / -8.5%	527574157 / 446426451 / +18.2% 🔴	0.36 / 0.46 / -22.6%
clickbench_q23/duckdb:duckdb	70760648 / 71262763 / -0.7%	147058961 / 146982469 / +0.1%	0.48 / 0.48 / -0.8%
clickbench_q24/duckdb:duckdb	30435355 / 31007024 / -1.8%	46008111 / 46374361 / -0.8%	0.66 / 0.67 / -1.1%
clickbench_q25/duckdb:duckdb	41311086 / 41157418 / +0.4%	75934998 / 76378534 / -0.6%	0.54 / 0.54 / +1.0%
clickbench_q26/duckdb:duckdb	30636974 / 30794885 / -0.5%	48341851 / 48417719 / -0.2%	0.63 / 0.64 / -0.4%
clickbench_q27/duckdb:duckdb	153753994 / 161444793 / -4.8%	416532723 / 432868750 / -3.8%	0.37 / 0.37 / -1.0%
clickbench_q28/duckdb:duckdb	842917775 / 843904871 / -0.1%	896078915 / 897456997 / -0.2%	0.94 / 0.94 / +0.0%
clickbench_q29/duckdb:duckdb	27237970 / 27124808 / +0.4%	44027513 / 45214740 / -2.6%	0.62 / 0.60 / +3.1%
clickbench_q30/duckdb:duckdb	101036711 / 101678434 / -0.6%	167991219 / 160232791 / +4.8%	0.60 / 0.63 / -5.2%
clickbench_q31/duckdb:duckdb	171355338 / 170958661 / +0.2%	241496930 / 238613841 / +1.2%	0.71 / 0.72 / -1.0%
clickbench_q32/duckdb:duckdb	484325580 / 474415423 / +2.1%	490209966 / 479034449 / +2.3%	0.99 / 0.99 / -0.2%
clickbench_q33/duckdb:duckdb	475909761 / 449343983 / +5.9%	604221744 / 609919598 / -0.9%	0.79 / 0.74 / +6.9%
clickbench_q34/duckdb:duckdb	447077574 / 454571073 / -1.6%	615636543 / 609259703 / +1.0%	0.73 / 0.75 / -2.7%
clickbench_q35/duckdb:duckdb	76908729 / 74126798 / +3.8%	96038209 / 94586215 / +1.5%	0.80 / 0.78 / +2.2%
clickbench_q36/duckdb:duckdb	32445840 / 31672593 / +2.4%	47008295 / 45802526 / +2.6%	0.69 / 0.69 / -0.2%
clickbench_q37/duckdb:duckdb	17053582 / 16867191 / +1.1%	26294914 / 25603465 / +2.7%	0.65 / 0.66 / -1.6%
clickbench_q38/duckdb:duckdb	18591295 / 18745879 / -0.8%	33785135 / 34192583 / -1.2%	0.55 / 0.55 / +0.4%
clickbench_q39/duckdb:duckdb	55629161 / 55746973 / -0.2%	80813310 / 78994913 / +2.3%	0.69 / 0.71 / -2.5%
clickbench_q40/duckdb:duckdb	16202094 / 16292624 / -0.6%	28503189 / 29285066 / -2.7%	0.57 / 0.56 / +2.2%
clickbench_q41/duckdb:duckdb	15561148 / 15826634 / -1.7%	23941087 / 25661891 / -6.7%	0.65 / 0.62 / +5.4%
clickbench_q42/duckdb:duckdb	15875994 / 15957513 / -0.5%	25012152 / 27471530 / -9.0%	0.63 / 0.58 / +9.3%

github-actions · 2026-11-02T20:18:53Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.017x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.014x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	21040086 / 21027114 / +0.1%	37700461 / 36819573 / +2.4%	0.56 / 0.57 / -2.3%
tpcds_q02/datafusion:vortex-file-compressed	44050646 / 44215389 / -0.4%	64727260 / 61999541 / +4.4%	0.68 / 0.71 / -4.6%
tpcds_q03/datafusion:vortex-file-compressed	11040160 / 11182433 / -1.3%	26533598 / 25753378 / +3.0%	0.42 / 0.43 / -4.2%
tpcds_q04/datafusion:vortex-file-compressed	87647707 / 86397418 / +1.4%	117589281 / 119545290 / -1.6%	0.75 / 0.72 / +3.1%
tpcds_q05/datafusion:vortex-file-compressed	56148762 / 56328583 / -0.3%	84028219 / 75208178 / +11.7% 🔴	0.67 / 0.75 / -10.8%
tpcds_q06/datafusion:vortex-file-compressed	22231996 / 22620072 / -1.7%	42159349 / 40379730 / +4.4%	0.53 / 0.56 / -5.9%
tpcds_q07/datafusion:vortex-file-compressed	28977577 / 28734358 / +0.8%	51731326 / 51439171 / +0.6%	0.56 / 0.56 / +0.3%
tpcds_q08/datafusion:vortex-file-compressed	24577310 / 24689598 / -0.5%	43480120 / 41749676 / +4.1%	0.57 / 0.59 / -4.4%
tpcds_q09/datafusion:vortex-file-compressed	21625826 / 20777426 / +4.1%	40123814 / 37921447 / +5.8%	0.54 / 0.55 / -1.6%
tpcds_q10/datafusion:vortex-file-compressed	26718052 / 26946234 / -0.8%	49268829 / 46731784 / +5.4%	0.54 / 0.58 / -6.0%
tpcds_q11/datafusion:vortex-file-compressed	53385422 / 53051691 / +0.6%	84160579 / 79892431 / +5.3%	0.63 / 0.66 / -4.5%
tpcds_q12/datafusion:vortex-file-compressed	14907202 / 14848202 / +0.4%	31960370 / 32760800 / -2.4%	0.47 / 0.45 / +2.9%
tpcds_q13/datafusion:vortex-file-compressed	31256229 / 31116748 / +0.4%	57851049 / 52680712 / +9.8%	0.54 / 0.59 / -8.5%
tpcds_q14/datafusion:vortex-file-compressed	486189110 / 485531669 / +0.1%	545246812 / 540253364 / +0.9%	0.89 / 0.90 / -0.8%
tpcds_q15/datafusion:vortex-file-compressed	12478078 / 12532810 / -0.4%	33217937 / 31118523 / +6.7%	0.38 / 0.40 / -6.7%
tpcds_q16/datafusion:vortex-file-compressed	18336956 / 18270295 / +0.4%	38096718 / 37428356 / +1.8%	0.48 / 0.49 / -1.4%
tpcds_q17/datafusion:vortex-file-compressed	50291325 / 54969444 / -8.5%	77383522 / 66251946 / +16.8% 🔴	0.65 / 0.83 / -21.7%
tpcds_q18/datafusion:vortex-file-compressed	63290556 / 63415868 / -0.2%	85284171 / 82749094 / +3.1%	0.74 / 0.77 / -3.2%
tpcds_q19/datafusion:vortex-file-compressed	16515112 / 16617180 / -0.6%	38400533 / 36764265 / +4.5%	0.43 / 0.45 / -4.8%
tpcds_q20/datafusion:vortex-file-compressed	15954838 / 15760030 / +1.2%	33623322 / 33993969 / -1.1%	0.47 / 0.46 / +2.4%
tpcds_q21/datafusion:vortex-file-compressed	16404588 / 15783530 / +3.9%	37454153 / 39043556 / -4.1%	0.44 / 0.40 / +8.3%
tpcds_q22/datafusion:vortex-file-compressed	49298876 / 49319929 / -0.0%	70562743 / 70060150 / +0.7%	0.70 / 0.70 / -0.8%
tpcds_q23/datafusion:vortex-file-compressed	69980034 / 70584340 / -0.9%	95133854 / 95548998 / -0.4%	0.74 / 0.74 / -0.4%
tpcds_q24/datafusion:vortex-file-compressed	65155396 / 64407675 / +1.2%	85962961 / 87419156 / -1.7%	0.76 / 0.74 / +2.9%
tpcds_q25/datafusion:vortex-file-compressed	47596848 / 47391381 / +0.4%	78504441 / 64611086 / +21.5% 🔴	0.61 / 0.73 / -17.3%
tpcds_q26/datafusion:vortex-file-compressed	25911846 / 25838222 / +0.3%	45871683 / 47052373 / -2.5%	0.56 / 0.55 / +2.9%
tpcds_q27/datafusion:vortex-file-compressed	58942347 / 59687518 / -1.2%	79394528 / 87082737 / -8.8%	0.74 / 0.69 / +8.3%
tpcds_q28/datafusion:vortex-file-compressed	24640367 / 24009766 / +2.6%	44165495 / 37956325 / +16.4% 🔴	0.56 / 0.63 / -11.8%
tpcds_q29/datafusion:vortex-file-compressed	52943470 / 49923743 / +6.0%	67548592 / 65506358 / +3.1%	0.78 / 0.76 / +2.8%
tpcds_q30/datafusion:vortex-file-compressed	25891633 / 25699094 / +0.7%	43193670 / 42833767 / +0.8%	0.60 / 0.60 / -0.1%
tpcds_q31/datafusion:vortex-file-compressed	58284866 / 58353996 / -0.1%	84338393 / 81868701 / +3.0%	0.69 / 0.71 / -3.0%
tpcds_q32/datafusion:vortex-file-compressed	12332317 / 12335598 / -0.0%	29368677 / 27725859 / +5.9%	0.42 / 0.44 / -5.6%
tpcds_q33/datafusion:vortex-file-compressed	26936168 / 27246207 / -1.1%	51068970 / 47820165 / +6.8%	0.53 / 0.57 / -7.4%
tpcds_q34/datafusion:vortex-file-compressed	17567132 / 17544736 / +0.1%	36070031 / 34831721 / +3.6%	0.49 / 0.50 / -3.3%
tpcds_q35/datafusion:vortex-file-compressed	30534856 / 30006676 / +1.8%	52878049 / 50778983 / +4.1%	0.58 / 0.59 / -2.3%
tpcds_q36/datafusion:vortex-file-compressed	46379271 / 47091562 / -1.5%	67335163 / 67578631 / -0.4%	0.69 / 0.70 / -1.2%
tpcds_q37/datafusion:vortex-file-compressed	12647014 / 12055110 / +4.9%	33747384 / 31365754 / +7.6%	0.37 / 0.38 / -2.5%
tpcds_q38/datafusion:vortex-file-compressed	25443498 / 25435372 / +0.0%	48506821 / 45422259 / +6.8%	0.52 / 0.56 / -6.3%
tpcds_q39/datafusion:vortex-file-compressed	63677010 / 65064391 / -2.1%	91551677 / 90094129 / +1.6%	0.70 / 0.72 / -3.7%
tpcds_q40/datafusion:vortex-file-compressed	23593023 / 23278306 / +1.4%	42282012 / 42109239 / +0.4%	0.56 / 0.55 / +0.9%
tpcds_q41/datafusion:vortex-file-compressed	20512404 / 20514086 / -0.0%	32687377 / 32483516 / +0.6%	0.63 / 0.63 / -0.6%
tpcds_q42/datafusion:vortex-file-compressed	11028908 / 11027975 / +0.0%	26757173 / 25435557 / +5.2%	0.41 / 0.43 / -4.9%
tpcds_q43/datafusion:vortex-file-compressed	12409584 / 12620464 / -1.7%	32569091 / 31492936 / +3.4%	0.38 / 0.40 / -4.9%
tpcds_q44/datafusion:vortex-file-compressed	29258778 / 28586260 / +2.4%	52388164 / 50618225 / +3.5%	0.56 / 0.56 / -1.1%
tpcds_q45/datafusion:vortex-file-compressed	15920380 / 15953515 / -0.2%	32797191 / 31813852 / +3.1%	0.49 / 0.50 / -3.2%
tpcds_q46/datafusion:vortex-file-compressed	22897410 / 23095812 / -0.9%	46509300 / 44704110 / +4.0%	0.49 / 0.52 / -4.7%
tpcds_q47/datafusion:vortex-file-compressed	74717672 / 74853104 / -0.2%	104571038 / 101669602 / +2.9%	0.71 / 0.74 / -3.0%
tpcds_q48/datafusion:vortex-file-compressed	28990852 / 28499040 / +1.7%	51399935 / 50243028 / +2.3%	0.56 / 0.57 / -0.6%
tpcds_q49/datafusion:vortex-file-compressed	55418678 / 57737578 / -4.0%	81146558 / 79616339 / +1.9%	0.68 / 0.73 / -5.8%
tpcds_q50/datafusion:vortex-file-compressed	30068946 / 29922484 / +0.5%	53062459 / 49024384 / +8.2%	0.57 / 0.61 / -7.2%
tpcds_q51/datafusion:vortex-file-compressed	65856336 / 65544828 / +0.5%	88033067 / 85928961 / +2.4%	0.75 / 0.76 / -1.9%
tpcds_q52/datafusion:vortex-file-compressed	11466456 / 11459616 / +0.1%	27089110 / 25206513 / +7.5%	0.42 / 0.45 / -6.9%
tpcds_q53/datafusion:vortex-file-compressed	17473866 / 17834540 / -2.0%	40133617 / 37089499 / +8.2%	0.44 / 0.48 / -9.5%
tpcds_q54/datafusion:vortex-file-compressed	31533522 / 31189791 / +1.1%	55365257 / 51909126 / +6.7%	0.57 / 0.60 / -5.2%
tpcds_q55/datafusion:vortex-file-compressed	10891686 / 10863388 / +0.3%	26049377 / 25502592 / +2.1%	0.42 / 0.43 / -1.8%
tpcds_q56/datafusion:vortex-file-compressed	26410210 / 26419355 / -0.0%	46176858 / 46736359 / -1.2%	0.57 / 0.57 / +1.2%
tpcds_q57/datafusion:vortex-file-compressed	62249876 / 61825261 / +0.7%	87895890 / 88367410 / -0.5%	0.71 / 0.70 / +1.2%
tpcds_q58/datafusion:vortex-file-compressed	38123720 / 38363042 / -0.6%	62550128 / 61746711 / +1.3%	0.61 / 0.62 / -1.9%
tpcds_q59/datafusion:vortex-file-compressed	29451599 / 29701422 / -0.8%	54256538 / 53285855 / +1.8%	0.54 / 0.56 / -2.6%
tpcds_q60/datafusion:vortex-file-compressed	25331606 / 26282063 / -3.6%	45777992 / 45633109 / +0.3%	0.55 / 0.58 / -3.9%
tpcds_q61/datafusion:vortex-file-compressed	21131496 / 21913476 / -3.6%	42684662 / 42733667 / -0.1%	0.50 / 0.51 / -3.5%
tpcds_q62/datafusion:vortex-file-compressed	16487047 / 16598858 / -0.7%	33729646 / 32575012 / +3.5%	0.49 / 0.51 / -4.1%
tpcds_q63/datafusion:vortex-file-compressed	17635980 / 17456781 / +1.0%	36943085 / 36270895 / +1.9%	0.48 / 0.48 / -0.8%
tpcds_q64/datafusion:vortex-file-compressed	209344068 / 211108528 / -0.8%	242837695 / 247126462 / -1.7%	0.86 / 0.85 / +0.9%
tpcds_q65/datafusion:vortex-file-compressed	72505002 / 73467510 / -1.3%	92345987 / 92386662 / -0.0%	0.79 / 0.80 / -1.3%
tpcds_q66/datafusion:vortex-file-compressed	50148186 / 50129552 / +0.0%	72560473 / 71868161 / +1.0%	0.69 / 0.70 / -0.9%
tpcds_q67/datafusion:vortex-file-compressed	50308438 / 51005909 / -1.4%	83399328 / 81740944 / +2.0%	0.60 / 0.62 / -3.3%
tpcds_q68/datafusion:vortex-file-compressed	22544890 / 22988587 / -1.9%	45490909 / 42706305 / +6.5%	0.50 / 0.54 / -7.9%
tpcds_q69/datafusion:vortex-file-compressed	25976773 / 25435557 / +2.1%	47581004 / 45013856 / +5.7%	0.55 / 0.57 / -3.4%
tpcds_q70/datafusion:vortex-file-compressed	71001357 / 71396555 / -0.6%	91907274 / 90870027 / +1.1%	0.77 / 0.79 / -1.7%
tpcds_q71/datafusion:vortex-file-compressed	18714010 / 19080460 / -1.9%	39369401 / 38770917 / +1.5%	0.48 / 0.49 / -3.4%
tpcds_q72/datafusion:vortex-file-compressed	338834258 / 361685162 / -6.3%	388452991 / 388921596 / -0.1%	0.87 / 0.93 / -6.2%
tpcds_q73/datafusion:vortex-file-compressed	16217078 / 16142460 / +0.5%	34047716 / 34577046 / -1.5%	0.48 / 0.47 / +2.0%
tpcds_q74/datafusion:vortex-file-compressed	39636440 / 40424504 / -1.9%	66689298 / 66909922 / -0.3%	0.59 / 0.60 / -1.6%
tpcds_q75/datafusion:vortex-file-compressed	134117226 / 133935386 / +0.1%	158383289 / 152244835 / +4.0%	0.85 / 0.88 / -3.7%
tpcds_q76/datafusion:vortex-file-compressed	29367681 / 29210542 / +0.5%	45290024 / 47409320 / -4.5%	0.65 / 0.62 / +5.2%
tpcds_q77/datafusion:vortex-file-compressed	44624593 / 44708545 / -0.2%	67084903 / 64873474 / +3.4%	0.67 / 0.69 / -3.5%
tpcds_q78/datafusion:vortex-file-compressed	63884616 / 64273674 / -0.6%	94259630 / 90612138 / +4.0%	0.68 / 0.71 / -4.5%
tpcds_q79/datafusion:vortex-file-compressed	19492518 / 19438164 / +0.3%	41150358 / 40067657 / +2.7%	0.47 / 0.49 / -2.4%
tpcds_q80/datafusion:vortex-file-compressed	73136836 / 73124612 / +0.0%	102329141 / 104556641 / -2.1%	0.71 / 0.70 / +2.2%
tpcds_q81/datafusion:vortex-file-compressed	26779280 / 26351952 / +1.6%	44114396 / 42404392 / +4.0%	0.61 / 0.62 / -2.3%
tpcds_q82/datafusion:vortex-file-compressed	12037100 / 11602290 / +3.7%	33006156 / 31497198 / +4.8%	0.36 / 0.37 / -1.0%
tpcds_q83/datafusion:vortex-file-compressed	32998472 / 32819222 / +0.5%	51021089 / 51605269 / -1.1%	0.65 / 0.64 / +1.7%
tpcds_q84/datafusion:vortex-file-compressed	10278694 / 10263767 / +0.1%	24768641 / 24389733 / +1.6%	0.41 / 0.42 / -1.4%
tpcds_q85/datafusion:vortex-file-compressed	53113920 / 53015156 / +0.2%	78420702 / 77971191 / +0.6%	0.68 / 0.68 / -0.4%
tpcds_q86/datafusion:vortex-file-compressed	15980850 / 15598310 / +2.5%	33934022 / 31387036 / +8.1%	0.47 / 0.50 / -5.2%
tpcds_q87/datafusion:vortex-file-compressed	25891292 / 25862882 / +0.1%	47724822 / 46646085 / +2.3%	0.54 / 0.55 / -2.2%
tpcds_q88/datafusion:vortex-file-compressed	31785836 / 31772906 / +0.0%	50410419 / 48275694 / +4.4%	0.63 / 0.66 / -4.2%
tpcds_q89/datafusion:vortex-file-compressed	20821346 / 21067572 / -1.2%	41870251 / 40155782 / +4.3%	0.50 / 0.52 / -5.2%
tpcds_q90/datafusion:vortex-file-compressed	9876792 / 9953964 / -0.8%	24345463 / 23928329 / +1.7%	0.41 / 0.42 / -2.5%
tpcds_q91/datafusion:vortex-file-compressed	16451492 / 16656854 / -1.2%	36194658 / 34211087 / +5.8%	0.45 / 0.49 / -6.6%
tpcds_q92/datafusion:vortex-file-compressed	13140178 / 12874770 / +2.1%	27937263 / 26415164 / +5.8%	0.47 / 0.49 / -3.5%
tpcds_q93/datafusion:vortex-file-compressed	20313932 / 20502904 / -0.9%	40377450 / 41753615 / -3.3%	0.50 / 0.49 / +2.5%
tpcds_q94/datafusion:vortex-file-compressed	18209330 / 17764678 / +2.5%	36868464 / 35816503 / +2.9%	0.49 / 0.50 / -0.4%
tpcds_q95/datafusion:vortex-file-compressed	41995160 / 42041432 / -0.1%	62005849 / 60528683 / +2.4%	0.68 / 0.69 / -2.5%
tpcds_q96/datafusion:vortex-file-compressed	7278010 / 7619796 / -4.5%	25655123 / 23676876 / +8.4%	0.28 / 0.32 / -11.9%
tpcds_q97/datafusion:vortex-file-compressed	16954826 / 16784934 / +1.0%	37475501 / 36021555 / +4.0%	0.45 / 0.47 / -2.9%
tpcds_q98/datafusion:vortex-file-compressed	16608820 / 16374104 / +1.4%	36092203 / 37218916 / -3.0%	0.46 / 0.44 / +4.6%
tpcds_q99/datafusion:vortex-file-compressed	15825526 / 16043736 / -1.4%	35171707 / 32755772 / +7.4%	0.45 / 0.49 / -8.1%

datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact	20789090 / 21180386 / -1.8%	39174655 / 38763548 / +1.1%	0.53 / 0.55 / -2.9%
tpcds_q02/datafusion:vortex-compact	43997446 / 44344840 / -0.8%	65906595 / 66144557 / -0.4%	0.67 / 0.67 / -0.4%
tpcds_q03/datafusion:vortex-compact	11635976 / 11681267 / -0.4%	31203701 / 29798601 / +4.7%	0.37 / 0.39 / -4.9%
tpcds_q04/datafusion:vortex-compact	93281033 / 93105008 / +0.2%	118410544 / 126838125 / -6.6%	0.79 / 0.73 / +7.3%
tpcds_q05/datafusion:vortex-compact	56087314 / 57717529 / -2.8%	80192440 / 77055037 / +4.1%	0.70 / 0.75 / -6.6%
tpcds_q06/datafusion:vortex-compact	23764538 / 23187366 / +2.5%	44301327 / 45582119 / -2.8%	0.54 / 0.51 / +5.5%
tpcds_q07/datafusion:vortex-compact	31493508 / 31181301 / +1.0%	52637606 / 50720526 / +3.8%	0.60 / 0.61 / -2.7%
tpcds_q08/datafusion:vortex-compact	27276085 / 26972332 / +1.1%	47418894 / 48005753 / -1.2%	0.58 / 0.56 / +2.4%
tpcds_q09/datafusion:vortex-compact	23602112 / 24621402 / -4.1%	42593957 / 41794097 / +1.9%	0.55 / 0.59 / -5.9%
tpcds_q10/datafusion:vortex-compact	30454744 / 29162926 / +4.4%	51024408 / 50186308 / +1.7%	0.60 / 0.58 / +2.7%
tpcds_q11/datafusion:vortex-compact	57160627 / 56597644 / +1.0%	84589705 / 83916951 / +0.8%	0.68 / 0.67 / +0.2%
tpcds_q12/datafusion:vortex-compact	18713298 / 18430218 / +1.5%	37403633 / 34819775 / +7.4%	0.50 / 0.53 / -5.5%
tpcds_q13/datafusion:vortex-compact	47190624 / 47479480 / -0.6%	68120029 / 67905896 / +0.3%	0.69 / 0.70 / -0.9%
tpcds_q14/datafusion:vortex-compact	633566106 / 632221914 / +0.2%	692580101 / 692973293 / -0.1%	0.91 / 0.91 / +0.3%
tpcds_q15/datafusion:vortex-compact	13905642 / 14117404 / -1.5%	34774169 / 33300609 / +4.4%	0.40 / 0.42 / -5.7%
tpcds_q16/datafusion:vortex-compact	19484900 / 19148870 / +1.8%	39492812 / 38277118 / +3.2%	0.49 / 0.50 / -1.4%
tpcds_q17/datafusion:vortex-compact	58255753 / 56120201 / +3.8%	79830624 / 72906082 / +9.5%	0.73 / 0.77 / -5.2%
tpcds_q18/datafusion:vortex-compact	60834933 / 60314076 / +0.9%	80623883 / 78721456 / +2.4%	0.75 / 0.77 / -1.5%
tpcds_q19/datafusion:vortex-compact	19037114 / 18639982 / +2.1%	41087577 / 39766918 / +3.3%	0.46 / 0.47 / -1.2%
tpcds_q20/datafusion:vortex-compact	20127452 / 20314062 / -0.9%	40404999 / 39550321 / +2.2%	0.50 / 0.51 / -3.0%
tpcds_q21/datafusion:vortex-compact	17763604 / 17473506 / +1.7%	42694117 / 39862198 / +7.1%	0.42 / 0.44 / -5.1%
tpcds_q22/datafusion:vortex-compact	49944602 / 49146304 / +1.6%	74912160 / 72356829 / +3.5%	0.67 / 0.68 / -1.8%
tpcds_q23/datafusion:vortex-compact	72512385 / 73815630 / -1.8%	95734250 / 94051113 / +1.8%	0.76 / 0.78 / -3.5%
tpcds_q24/datafusion:vortex-compact	71293394 / 71050592 / +0.3%	93574734 / 96712835 / -3.2%	0.76 / 0.73 / +3.7%
tpcds_q25/datafusion:vortex-compact	52103613 / 51884863 / +0.4%	82930208 / 71427863 / +16.1% 🔴	0.63 / 0.73 / -13.5%
tpcds_q26/datafusion:vortex-compact	28181453 / 27780448 / +1.4%	47575614 / 46264558 / +2.8%	0.59 / 0.60 / -1.4%
tpcds_q27/datafusion:vortex-compact	61154530 / 59718118 / +2.4%	77504635 / 77449074 / +0.1%	0.79 / 0.77 / +2.3%
tpcds_q28/datafusion:vortex-compact	29517495 / 28389210 / +4.0%	45878896 / 45909598 / -0.1%	0.64 / 0.62 / +4.0%
tpcds_q29/datafusion:vortex-compact	56575172 / 57248192 / -1.2%	77699507 / 76921689 / +1.0%	0.73 / 0.74 / -2.2%
tpcds_q30/datafusion:vortex-compact	27416610 / 27726066 / -1.1%	46330182 / 43531122 / +6.4%	0.59 / 0.64 / -7.1%
tpcds_q31/datafusion:vortex-compact	61366846 / 61903022 / -0.9%	87485130 / 85892888 / +1.9%	0.70 / 0.72 / -2.7%
tpcds_q32/datafusion:vortex-compact	13547252 / 13617510 / -0.5%	33194058 / 30973796 / +7.2%	0.41 / 0.44 / -7.2%
tpcds_q33/datafusion:vortex-compact	27726377 / 27821768 / -0.3%	52661753 / 50105257 / +5.1%	0.53 / 0.56 / -5.2%
tpcds_q34/datafusion:vortex-compact	18688850 / 19000622 / -1.6%	37042137 / 35937807 / +3.1%	0.50 / 0.53 / -4.6%
tpcds_q35/datafusion:vortex-compact	33453279 / 33392851 / +0.2%	55609260 / 55555127 / +0.1%	0.60 / 0.60 / +0.1%
tpcds_q36/datafusion:vortex-compact	48905912 / 48569566 / +0.7%	73080609 / 73201329 / -0.2%	0.67 / 0.66 / +0.9%
tpcds_q37/datafusion:vortex-compact	14246274 / 14455485 / -1.4%	37276907 / 37482865 / -0.5%	0.38 / 0.39 / -0.9%
tpcds_q38/datafusion:vortex-compact	26157206 / 25936094 / +0.9%	47962498 / 46111197 / +4.0%	0.55 / 0.56 / -3.0%
tpcds_q39/datafusion:vortex-compact	65918174 / 65272091 / +1.0%	88130427 / 88633674 / -0.6%	0.75 / 0.74 / +1.6%
tpcds_q40/datafusion:vortex-compact	24224278 / 24109358 / +0.5%	48780544 / 45179410 / +8.0%	0.50 / 0.53 / -6.9%
tpcds_q41/datafusion:vortex-compact	20727212 / 20914552 / -0.9%	35883794 / 35044466 / +2.4%	0.58 / 0.60 / -3.2%
tpcds_q42/datafusion:vortex-compact	11101854 / 11420453 / -2.8%	30388746 / 29126431 / +4.3%	0.37 / 0.39 / -6.8%
tpcds_q43/datafusion:vortex-compact	13113218 / 13008314 / +0.8%	31101324 / 31555258 / -1.4%	0.42 / 0.41 / +2.3%
tpcds_q44/datafusion:vortex-compact	29261374 / 29841046 / -1.9%	51121205 / 48857548 / +4.6%	0.57 / 0.61 / -6.3%
tpcds_q45/datafusion:vortex-compact	17620244 / 17809181 / -1.1%	36852660 / 35182136 / +4.7%	0.48 / 0.51 / -5.5%
tpcds_q46/datafusion:vortex-compact	24794988 / 24554100 / +1.0%	45970073 / 44249230 / +3.9%	0.54 / 0.55 / -2.8%
tpcds_q47/datafusion:vortex-compact	78688464 / 79321111 / -0.8%	110790085 / 110265088 / +0.5%	0.71 / 0.72 / -1.3%
tpcds_q48/datafusion:vortex-compact	43746634 / 43948122 / -0.5%	63507004 / 60502110 / +5.0%	0.69 / 0.73 / -5.2%
tpcds_q49/datafusion:vortex-compact	59583248 / 58880806 / +1.2%	81724144 / 85454482 / -4.4%	0.73 / 0.69 / +5.8%
tpcds_q50/datafusion:vortex-compact	30717124 / 31409196 / -2.2%	49540475 / 50483044 / -1.9%	0.62 / 0.62 / -0.3%
tpcds_q51/datafusion:vortex-compact	66410194 / 66736280 / -0.5%	85645633 / 85277260 / +0.4%	0.78 / 0.78 / -0.9%
tpcds_q52/datafusion:vortex-compact	11261822 / 11650013 / -3.3%	30039703 / 29128805 / +3.1%	0.37 / 0.40 / -6.3%
tpcds_q53/datafusion:vortex-compact	20549176 / 20722063 / -0.8%	43204317 / 40987711 / +5.4%	0.48 / 0.51 / -5.9%
tpcds_q54/datafusion:vortex-compact	33947600 / 33753951 / +0.6%	59862250 / 58224293 / +2.8%	0.57 / 0.58 / -2.2%
tpcds_q55/datafusion:vortex-compact	10755632 / 11517474 / -6.6%	29870563 / 29280334 / +2.0%	0.36 / 0.39 / -8.5%
tpcds_q56/datafusion:vortex-compact	25801552 / 26108142 / -1.2%	47903289 / 48898425 / -2.0%	0.54 / 0.53 / +0.9%
tpcds_q57/datafusion:vortex-compact	65299726 / 65289606 / +0.0%	92512825 / 94265826 / -1.9%	0.71 / 0.69 / +1.9%
tpcds_q58/datafusion:vortex-compact	41719358 / 41652312 / +0.2%	67607187 / 65925500 / +2.6%	0.62 / 0.63 / -2.3%
tpcds_q59/datafusion:vortex-compact	31695028 / 31914041 / -0.7%	55574996 / 55417089 / +0.3%	0.57 / 0.58 / -1.0%
tpcds_q60/datafusion:vortex-compact	26094702 / 26137294 / -0.2%	49173850 / 48417594 / +1.6%	0.53 / 0.54 / -1.7%
tpcds_q61/datafusion:vortex-compact	23478558 / 22814673 / +2.9%	42499091 / 42120338 / +0.9%	0.55 / 0.54 / +2.0%
tpcds_q62/datafusion:vortex-compact	16758619 / 16527752 / +1.4%	34130434 / 33062950 / +3.2%	0.49 / 0.50 / -1.8%
tpcds_q63/datafusion:vortex-compact	20648248 / 20498058 / +0.7%	42328070 / 43855192 / -3.5%	0.49 / 0.47 / +4.4%
tpcds_q64/datafusion:vortex-compact	300538142 / 301044093 / -0.2%	336398838 / 332623938 / +1.1%	0.89 / 0.91 / -1.3%
tpcds_q65/datafusion:vortex-compact	76907943 / 75380365 / +2.0%	99311361 / 98495094 / +0.8%	0.77 / 0.77 / +1.2%
tpcds_q66/datafusion:vortex-compact	50770972 / 50018788 / +1.5%	71823904 / 72071918 / -0.3%	0.71 / 0.69 / +1.9%
tpcds_q67/datafusion:vortex-compact	51561350 / 52242380 / -1.3%	83981620 / 82887646 / +1.3%	0.61 / 0.63 / -2.6%
tpcds_q68/datafusion:vortex-compact	24738182 / 24257696 / +2.0%	48501803 / 46453258 / +4.4%	0.51 / 0.52 / -2.3%
tpcds_q69/datafusion:vortex-compact	29995275 / 28915512 / +3.7%	51445049 / 48998315 / +5.0%	0.58 / 0.59 / -1.2%
tpcds_q70/datafusion:vortex-compact	71823334 / 72954570 / -1.6%	96769649 / 92663467 / +4.4%	0.74 / 0.79 / -5.7%
tpcds_q71/datafusion:vortex-compact	20220236 / 18758766 / +7.8%	38791065 / 39100049 / -0.8%	0.52 / 0.48 / +8.6%
tpcds_q72/datafusion:vortex-compact	362193307 / 371535444 / -2.5%	395516386 / 401296223 / -1.4%	0.92 / 0.93 / -1.1%
tpcds_q73/datafusion:vortex-compact	17613560 / 17187395 / +2.5%	38722778 / 37263787 / +3.9%	0.45 / 0.46 / -1.4%
tpcds_q74/datafusion:vortex-compact	41574036 / 41256876 / +0.8%	68911843 / 68409083 / +0.7%	0.60 / 0.60 / +0.0%
tpcds_q75/datafusion:vortex-compact	141740896 / 142077462 / -0.2%	160898991 / 172365176 / -6.7%	0.88 / 0.82 / +6.9%
tpcds_q76/datafusion:vortex-compact	29635426 / 29715802 / -0.3%	48305934 / 48362410 / -0.1%	0.61 / 0.61 / -0.2%
tpcds_q77/datafusion:vortex-compact	45428096 / 45244880 / +0.4%	68168509 / 66529541 / +2.5%	0.67 / 0.68 / -2.0%
tpcds_q78/datafusion:vortex-compact	65437594 / 66068760 / -1.0%	93995688 / 91130529 / +3.1%	0.70 / 0.72 / -4.0%
tpcds_q79/datafusion:vortex-compact	21443614 / 22339754 / -4.0%	43054288 / 39573825 / +8.8%	0.50 / 0.56 / -11.8%
tpcds_q80/datafusion:vortex-compact	74747681 / 74011092 / +1.0%	103322015 / 102671896 / +0.6%	0.72 / 0.72 / +0.4%
tpcds_q81/datafusion:vortex-compact	26803870 / 26919720 / -0.4%	44479714 / 43027997 / +3.4%	0.60 / 0.63 / -3.7%
tpcds_q82/datafusion:vortex-compact	14240534 / 13691677 / +4.0%	36633764 / 34506285 / +6.2%	0.39 / 0.40 / -2.0%
tpcds_q83/datafusion:vortex-compact	33354180 / 32745180 / +1.9%	52886416 / 53084858 / -0.4%	0.63 / 0.62 / +2.2%
tpcds_q84/datafusion:vortex-compact	11091938 / 11296564 / -1.8%	26354307 / 24339019 / +8.3%	0.42 / 0.46 / -9.3%
tpcds_q85/datafusion:vortex-compact	95295912 / 95165565 / +0.1%	119554723 / 119152980 / +0.3%	0.80 / 0.80 / -0.2%
tpcds_q86/datafusion:vortex-compact	15565182 / 15557951 / +0.0%	34100749 / 33238893 / +2.6%	0.46 / 0.47 / -2.5%
tpcds_q87/datafusion:vortex-compact	26350119 / 26239124 / +0.4%	49720987 / 46636141 / +6.6%	0.53 / 0.56 / -5.8%
tpcds_q88/datafusion:vortex-compact	36435038 / 35456404 / +2.8%	56311961 / 57982771 / -2.9%	0.65 / 0.61 / +5.8%
tpcds_q89/datafusion:vortex-compact	22695456 / 22642961 / +0.2%	43808663 / 43584638 / +0.5%	0.52 / 0.52 / -0.3%
tpcds_q90/datafusion:vortex-compact	10559185 / 10386939 / +1.7%	24959055 / 23768745 / +5.0%	0.42 / 0.44 / -3.2%
tpcds_q91/datafusion:vortex-compact	24384479 / 24669588 / -1.2%	43059829 / 42491997 / +1.3%	0.57 / 0.58 / -2.5%
tpcds_q92/datafusion:vortex-compact	14009454 / 13666070 / +2.5%	29666122 / 29207700 / +1.6%	0.47 / 0.47 / +0.9%
tpcds_q93/datafusion:vortex-compact	20765261 / 20467370 / +1.5%	38940954 / 39236665 / -0.8%	0.53 / 0.52 / +2.2%
tpcds_q94/datafusion:vortex-compact	19320915 / 18988432 / +1.8%	37450864 / 36227965 / +3.4%	0.52 / 0.52 / -1.6%
tpcds_q95/datafusion:vortex-compact	43252133 / 42640781 / +1.4%	63291112 / 62507496 / +1.3%	0.68 / 0.68 / +0.2%
tpcds_q96/datafusion:vortex-compact	8560776 / 8496808 / +0.8%	24871504 / 25017562 / -0.6%	0.34 / 0.34 / +1.3%
tpcds_q97/datafusion:vortex-compact	16928470 / 17432819 / -2.9%	36552730 / 35869002 / +1.9%	0.46 / 0.49 / -4.7%
tpcds_q98/datafusion:vortex-compact	20602715 / 20713363 / -0.5%	39903327 / 40506478 / -1.5%	0.52 / 0.51 / +1.0%
tpcds_q99/datafusion:vortex-compact	16461492 / 16766650 / -1.8%	34962697 / 33513219 / +4.3%	0.47 / 0.50 / -5.9%

datafusion / parquet / ns (0.999x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	41001747 / 43465080 / -5.7%	61057220 / 59761794 / +2.2%	0.67 / 0.73 / -7.7%
tpcds_q02/datafusion:parquet	53792462 / 54362306 / -1.0%	70565315 / 68582746 / +2.9%	0.76 / 0.79 / -3.8%
tpcds_q03/datafusion:parquet	19064500 / 18873836 / +1.0%	31493839 / 29218971 / +7.8%	0.61 / 0.65 / -6.3%
tpcds_q04/datafusion:parquet	177783048 / 178052113 / -0.2%	199025216 / 202081673 / -1.5%	0.89 / 0.88 / +1.4%
tpcds_q05/datafusion:parquet	68575018 / 66182042 / +3.6%	89445477 / 86792761 / +3.1%	0.77 / 0.76 / +0.5%
tpcds_q06/datafusion:parquet	33711360 / 33789838 / -0.2%	49313857 / 47355608 / +4.1%	0.68 / 0.71 / -4.2%
tpcds_q07/datafusion:parquet	46445135 / 46590460 / -0.3%	65864076 / 63856175 / +3.1%	0.71 / 0.73 / -3.4%
tpcds_q08/datafusion:parquet	32088170 / 31200588 / +2.8%	47479149 / 46342471 / +2.5%	0.68 / 0.67 / +0.4%
tpcds_q09/datafusion:parquet	32081160 / 35718348 / -10.2% 🟢	42684245 / 37247416 / +14.6% 🔴	0.75 / 0.96 / -21.6%
tpcds_q10/datafusion:parquet	44256245 / 43778640 / +1.1%	56901338 / 56583476 / +0.6%	0.78 / 0.77 / +0.5%
tpcds_q11/datafusion:parquet	95262912 / 96040500 / -0.8%	121925296 / 113689901 / +7.2%	0.78 / 0.84 / -7.5%
tpcds_q12/datafusion:parquet	23504394 / 23379970 / +0.5%	35871593 / 34662651 / +3.5%	0.66 / 0.67 / -2.9%
tpcds_q13/datafusion:parquet	46392576 / 46845458 / -1.0%	65596109 / 66456362 / -1.3%	0.71 / 0.70 / +0.3%
tpcds_q14/datafusion:parquet	534730014 / 534565292 / +0.0%	581329254 / 582078565 / -0.1%	0.92 / 0.92 / +0.2%
tpcds_q15/datafusion:parquet	23759366 / 23882926 / -0.5%	38108217 / 38901527 / -2.0%	0.62 / 0.61 / +1.6%
tpcds_q16/datafusion:parquet	37039890 / 36843790 / +0.5%	51120038 / 50269095 / +1.7%	0.72 / 0.73 / -1.1%
tpcds_q17/datafusion:parquet	74873484 / 73018666 / +2.5%	95862154 / 95061154 / +0.8%	0.78 / 0.77 / +1.7%
tpcds_q18/datafusion:parquet	69219778 / 69425817 / -0.3%	87202797 / 85756903 / +1.7%	0.79 / 0.81 / -1.9%
tpcds_q19/datafusion:parquet	29227882 / 30090019 / -2.9%	42325524 / 42115818 / +0.5%	0.69 / 0.71 / -3.3%
tpcds_q20/datafusion:parquet	24756696 / 25103004 / -1.4%	39025871 / 36470939 / +7.0%	0.63 / 0.69 / -7.8%
tpcds_q21/datafusion:parquet	20060307 / 20188595 / -0.6%	31371666 / 31933698 / -1.8%	0.64 / 0.63 / +1.1%
tpcds_q22/datafusion:parquet	77523430 / 76639612 / +1.2%	88532788 / 87159061 / +1.6%	0.88 / 0.88 / -0.4%
tpcds_q23/datafusion:parquet	90718432 / 92029296 / -1.4%	114397676 / 111367436 / +2.7%	0.79 / 0.83 / -4.0%
tpcds_q24/datafusion:parquet	90987989 / 89887661 / +1.2%	113938747 / 112907428 / +0.9%	0.80 / 0.80 / +0.3%
tpcds_q25/datafusion:parquet	81362178 / 79415162 / +2.5%	98016016 / 102071377 / -4.0%	0.83 / 0.78 / +6.7%
tpcds_q26/datafusion:parquet	43171650 / 43151834 / +0.0%	58528713 / 58511573 / +0.0%	0.74 / 0.74 / +0.0%
tpcds_q27/datafusion:parquet	75820391 / 75764812 / +0.1%	96836063 / 98106611 / -1.3%	0.78 / 0.77 / +1.4%
tpcds_q28/datafusion:parquet	28323696 / 28676454 / -1.2%	42987320 / 40978821 / +4.9%	0.66 / 0.70 / -5.8%
tpcds_q29/datafusion:parquet	75600364 / 75503772 / +0.1%	97518180 / 93863457 / +3.9%	0.78 / 0.80 / -3.6%
tpcds_q30/datafusion:parquet	45610536 / 45505476 / +0.2%	59703023 / 54942748 / +8.7%	0.76 / 0.83 / -7.8%
tpcds_q31/datafusion:parquet	80419558 / 80224792 / +0.2%	98708116 / 93359691 / +5.7%	0.81 / 0.86 / -5.2%
tpcds_q32/datafusion:parquet	26974367 / 26840202 / +0.5%	39642182 / 38425661 / +3.2%	0.68 / 0.70 / -2.6%
tpcds_q33/datafusion:parquet	37571912 / 37316687 / +0.7%	52643987 / 50136316 / +5.0%	0.71 / 0.74 / -4.1%
tpcds_q34/datafusion:parquet	24061308 / 24185800 / -0.5%	36187821 / 34893534 / +3.7%	0.66 / 0.69 / -4.1%
tpcds_q35/datafusion:parquet	50685754 / 50449880 / +0.5%	63218444 / 62623565 / +0.9%	0.80 / 0.81 / -0.5%
tpcds_q36/datafusion:parquet	52090223 / 52292494 / -0.4%	71332052 / 72011730 / -0.9%	0.73 / 0.73 / +0.6%
tpcds_q37/datafusion:parquet	21321759 / 20981073 / +1.6%	33113924 / 32758939 / +1.1%	0.64 / 0.64 / +0.5%
tpcds_q38/datafusion:parquet	44324108 / 45246216 / -2.0%	64368707 / 63233454 / +1.8%	0.69 / 0.72 / -3.8%
tpcds_q39/datafusion:parquet	68795598 / 67833624 / +1.4%	85236724 / 83684798 / +1.9%	0.81 / 0.81 / -0.4%
tpcds_q40/datafusion:parquet	30150435 / 30953084 / -2.6%	51458616 / 48613902 / +5.9%	0.59 / 0.64 / -8.0%
tpcds_q41/datafusion:parquet	20094815 / 20207454 / -0.6%	32086033 / 31180913 / +2.9%	0.63 / 0.65 / -3.4%
tpcds_q42/datafusion:parquet	18114340 / 18246800 / -0.7%	33505317 / 29233692 / +14.6% 🔴	0.54 / 0.62 / -13.4%
tpcds_q43/datafusion:parquet	19320678 / 19452823 / -0.7%	32103573 / 31048016 / +3.4%	0.60 / 0.63 / -3.9%
tpcds_q44/datafusion:parquet	36616874 / 35241090 / +3.9%	50703082 / 47998948 / +5.6%	0.72 / 0.73 / -1.6%
tpcds_q45/datafusion:parquet	27754482 / 27930196 / -0.6%	41688251 / 38033363 / +9.6%	0.67 / 0.73 / -9.3%
tpcds_q46/datafusion:parquet	28634652 / 28844240 / -0.7%	44716027 / 44307582 / +0.9%	0.64 / 0.65 / -1.6%
tpcds_q47/datafusion:parquet	96444226 / 98440736 / -2.0%	120756092 / 117731943 / +2.6%	0.80 / 0.84 / -4.5%
tpcds_q48/datafusion:parquet	41542713 / 41614122 / -0.2%	58520329 / 56448239 / +3.7%	0.71 / 0.74 / -3.7%
tpcds_q49/datafusion:parquet	71131449 / 74896526 / -5.0%	96078201 / 92244921 / +4.2%	0.74 / 0.81 / -8.8%
tpcds_q50/datafusion:parquet	47692101 / 47173568 / +1.1%	65995507 / 67326612 / -2.0%	0.72 / 0.70 / +3.1%
tpcds_q51/datafusion:parquet	75281208 / 75065429 / +0.3%	93921279 / 92201582 / +1.9%	0.80 / 0.81 / -1.5%
tpcds_q52/datafusion:parquet	18194246 / 18552751 / -1.9%	29134054 / 28293505 / +3.0%	0.62 / 0.66 / -4.8%
tpcds_q53/datafusion:parquet	22300462 / 22053820 / +1.1%	38659599 / 36867945 / +4.9%	0.58 / 0.60 / -3.6%
tpcds_q54/datafusion:parquet	55249949 / 53415969 / +3.4%	64676922 / 65450389 / -1.2%	0.85 / 0.82 / +4.7%
tpcds_q55/datafusion:parquet	18114332 / 18012589 / +0.6%	28715807 / 29636175 / -3.1%	0.63 / 0.61 / +3.8%
tpcds_q56/datafusion:parquet	41176103 / 40429020 / +1.8%	54141822 / 55503110 / -2.5%	0.76 / 0.73 / +4.4%
tpcds_q57/datafusion:parquet	99609799 / 100455858 / -0.8%	120641860 / 118017359 / +2.2%	0.83 / 0.85 / -3.0%
tpcds_q58/datafusion:parquet	64993828 / 66553173 / -2.3%	84235025 / 81529183 / +3.3%	0.77 / 0.82 / -5.5%
tpcds_q59/datafusion:parquet	47282816 / 47673206 / -0.8%	62686521 / 63575775 / -1.4%	0.75 / 0.75 / +0.6%
tpcds_q60/datafusion:parquet	41574740 / 42908302 / -3.1%	52472185 / 50410036 / +4.1%	0.79 / 0.85 / -6.9%
tpcds_q61/datafusion:parquet	35537446 / 36442311 / -2.5%	50030817 / 49888931 / +0.3%	0.71 / 0.73 / -2.8%
tpcds_q62/datafusion:parquet	25225042 / 25190782 / +0.1%	36866384 / 37081527 / -0.6%	0.68 / 0.68 / +0.7%
tpcds_q63/datafusion:parquet	22127168 / 22207873 / -0.4%	37224151 / 37064362 / +0.4%	0.59 / 0.60 / -0.8%
tpcds_q64/datafusion:parquet	285718451 / 286403956 / -0.2%	326437657 / 325848938 / +0.2%	0.88 / 0.88 / -0.4%
tpcds_q65/datafusion:parquet	119941978 / 120423525 / -0.4%	141284810 / 142112611 / -0.6%	0.85 / 0.85 / +0.2%
tpcds_q66/datafusion:parquet	60731294 / 60581132 / +0.2%	74839911 / 75901042 / -1.4%	0.81 / 0.80 / +1.7%
tpcds_q67/datafusion:parquet	68304338 / 69387666 / -1.6%	92675966 / 90860419 / +2.0%	0.74 / 0.76 / -3.5%
tpcds_q68/datafusion:parquet	29310902 / 28596312 / +2.5%	47577838 / 46404726 / +2.5%	0.62 / 0.62 / -0.0%
tpcds_q69/datafusion:parquet	42881840 / 43172336 / -0.7%	58802199 / 54542237 / +7.8%	0.73 / 0.79 / -7.9%
tpcds_q70/datafusion:parquet	80147472 / 79836016 / +0.4%	97758010 / 96978344 / +0.8%	0.82 / 0.82 / -0.4%
tpcds_q71/datafusion:parquet	26511802 / 24926108 / +6.4%	38208474 / 37797206 / +1.1%	0.69 / 0.66 / +5.2%
tpcds_q72/datafusion:parquet	529198756 / 520477550 / +1.7%	546334824 / 557824745 / -2.1%	0.97 / 0.93 / +3.8%
tpcds_q73/datafusion:parquet	23663966 / 23950882 / -1.2%	35428410 / 34854281 / +1.6%	0.67 / 0.69 / -2.8%
tpcds_q74/datafusion:parquet	72510043 / 69147286 / +4.9%	89533324 / 88904336 / +0.7%	0.81 / 0.78 / +4.1%
tpcds_q75/datafusion:parquet	156609320 / 149843262 / +4.5%	176828378 / 175219038 / +0.9%	0.89 / 0.86 / +3.6%
tpcds_q76/datafusion:parquet	33763243 / 33450098 / +0.9%	48428257 / 47035639 / +3.0%	0.70 / 0.71 / -2.0%
tpcds_q77/datafusion:parquet	58232675 / 56004656 / +4.0%	76909710 / 73950207 / +4.0%	0.76 / 0.76 / -0.0%
tpcds_q78/datafusion:parquet	85088712 / 85994544 / -1.1%	119012010 / 114101137 / +4.3%	0.71 / 0.75 / -5.1%
tpcds_q79/datafusion:parquet	26540916 / 26999772 / -1.7%	40989693 / 40097238 / +2.2%	0.65 / 0.67 / -3.8%
tpcds_q80/datafusion:parquet	80936678 / 80985722 / -0.1%	110014204 / 108028018 / +1.8%	0.74 / 0.75 / -1.9%
tpcds_q81/datafusion:parquet	37180674 / 36957965 / +0.6%	53342684 / 49524247 / +7.7%	0.70 / 0.75 / -6.6%
tpcds_q82/datafusion:parquet	22326286 / 22130296 / +0.9%	35360221 / 34628780 / +2.1%	0.63 / 0.64 / -1.2%
tpcds_q83/datafusion:parquet	57868843 / 58871268 / -1.7%	73473542 / 74037385 / -0.8%	0.79 / 0.80 / -0.9%
tpcds_q84/datafusion:parquet	25892840 / 26631094 / -2.8%	38847875 / 40285633 / -3.6%	0.67 / 0.66 / +0.8%
tpcds_q85/datafusion:parquet	80286761 / 81308886 / -1.3%	102796038 / 102168967 / +0.6%	0.78 / 0.80 / -1.9%
tpcds_q86/datafusion:parquet	20348390 / 20703460 / -1.7%	32912730 / 31754227 / +3.6%	0.62 / 0.65 / -5.2%
tpcds_q87/datafusion:parquet	45089992 / 43965123 / +2.6%	57518327 / 60526699 / -5.0%	0.78 / 0.73 / +7.9%
tpcds_q88/datafusion:parquet	37304568 / 36908124 / +1.1%	52653000 / 48745754 / +8.0%	0.71 / 0.76 / -6.4%
tpcds_q89/datafusion:parquet	26445339 / 25490202 / +3.7%	41322485 / 40394899 / +2.3%	0.64 / 0.63 / +1.4%
tpcds_q90/datafusion:parquet	15680428 / 15684436 / -0.0%	26619442 / 25958020 / +2.5%	0.59 / 0.60 / -2.5%
tpcds_q91/datafusion:parquet	32172456 / 32140608 / +0.1%	45933587 / 45968323 / -0.1%	0.70 / 0.70 / +0.2%
tpcds_q92/datafusion:parquet	27406774 / 26923382 / +1.8%	37125857 / 38158201 / -2.7%	0.74 / 0.71 / +4.6%
tpcds_q93/datafusion:parquet	26926592 / 27650742 / -2.6%	46605128 / 45573798 / +2.3%	0.58 / 0.61 / -4.8%
tpcds_q94/datafusion:parquet	35107472 / 35199560 / -0.3%	47871625 / 48253802 / -0.8%	0.73 / 0.73 / +0.5%
tpcds_q95/datafusion:parquet	64669508 / 63833456 / +1.3%	79050744 / 79535005 / -0.6%	0.82 / 0.80 / +1.9%
tpcds_q96/datafusion:parquet	12604546 / 12780000 / -1.4%	23653964 / 23885657 / -1.0%	0.53 / 0.54 / -0.4%
tpcds_q97/datafusion:parquet	34899972 / 35577866 / -1.9%	51189566 / 49997771 / +2.4%	0.68 / 0.71 / -4.2%
tpcds_q98/datafusion:parquet	24603818 / 24606390 / -0.0%	38735055 / 38115589 / +1.6%	0.64 / 0.65 / -1.6%
tpcds_q99/datafusion:parquet	29940868 / 29820496 / +0.4%	41516472 / 41464555 / +0.1%	0.72 / 0.72 / +0.3%

duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	16124804 / 16077346 / +0.3%	24659142 / 25188991 / -2.1%	0.65 / 0.64 / +2.5%
tpcds_q02/duckdb:vortex-file-compressed	16729402 / 17283506 / -3.2%	22536156 / 21605419 / +4.3%	0.74 / 0.80 / -7.2%
tpcds_q03/duckdb:vortex-file-compressed	6972378 / 7378640 / -5.5%	15676497 / 15189705 / +3.2%	0.44 / 0.49 / -8.4%
tpcds_q04/duckdb:vortex-file-compressed	46045583 / 45850934 / +0.4%	57432061 / 57192457 / +0.4%	0.80 / 0.80 / +0.0%
tpcds_q05/duckdb:vortex-file-compressed	23002080 / 23297214 / -1.3%	32567200 / 32697280 / -0.4%	0.71 / 0.71 / -0.9%
tpcds_q06/duckdb:vortex-file-compressed	24527306 / 24664392 / -0.6%	38051300 / 38378361 / -0.9%	0.64 / 0.64 / +0.3%
tpcds_q07/duckdb:vortex-file-compressed	13318388 / 13625730 / -2.3%	24721473 / 24653898 / +0.3%	0.54 / 0.55 / -2.5%
tpcds_q08/duckdb:vortex-file-compressed	17259385 / 17445289 / -1.1%	25529889 / 24891256 / +2.6%	0.68 / 0.70 / -3.5%
tpcds_q09/duckdb:vortex-file-compressed	19374346 / 19312845 / +0.3%	30353268 / 28853304 / +5.2%	0.64 / 0.67 / -4.6%
tpcds_q10/duckdb:vortex-file-compressed	28207674 / 28073528 / +0.5%	39795079 / 41134987 / -3.3%	0.71 / 0.68 / +3.9%
tpcds_q11/duckdb:vortex-file-compressed	37045461 / 36957883 / +0.2%	45736607 / 46059495 / -0.7%	0.81 / 0.80 / +0.9%
tpcds_q12/duckdb:vortex-file-compressed	10113365 / 10225020 / -1.1%	17193688 / 16616150 / +3.5%	0.59 / 0.62 / -4.4%
tpcds_q13/duckdb:vortex-file-compressed	20856540 / 21397350 / -2.5%	33586242 / 33303811 / +0.8%	0.62 / 0.64 / -3.3%
tpcds_q14/duckdb:vortex-file-compressed	55974935 / 56523044 / -1.0%	68808599 / 65544237 / +5.0%	0.81 / 0.86 / -5.7%
tpcds_q15/duckdb:vortex-file-compressed	10970659 / 11252500 / -2.5%	18357045 / 17973758 / +2.1%	0.60 / 0.63 / -4.5%
tpcds_q16/duckdb:vortex-file-compressed	24451635 / 24240442 / +0.9%	34470291 / 34768199 / -0.9%	0.71 / 0.70 / +1.7%
tpcds_q17/duckdb:vortex-file-compressed	24420932 / 24558930 / -0.6%	36897436 / 35403074 / +4.2%	0.66 / 0.69 / -4.6%
tpcds_q18/duckdb:vortex-file-compressed	31674224 / 31873512 / -0.6%	41832587 / 43129329 / -3.0%	0.76 / 0.74 / +2.5%
tpcds_q19/duckdb:vortex-file-compressed	78566054 / 77441536 / +1.5%	89100489 / 89026957 / +0.1%	0.88 / 0.87 / +1.4%
tpcds_q20/duckdb:vortex-file-compressed	10917562 / 11075520 / -1.4%	18069042 / 17809241 / +1.5%	0.60 / 0.62 / -2.8%
tpcds_q21/duckdb:vortex-file-compressed	10085584 / 9511646 / +6.0%	21249525 / 21018110 / +1.1%	0.47 / 0.45 / +4.9%
tpcds_q22/duckdb:vortex-file-compressed	18050254 / 17688850 / +2.0%	29490789 / 28577987 / +3.2%	0.61 / 0.62 / -1.1%
tpcds_q23/duckdb:vortex-file-compressed	38505240 / 38678242 / -0.4%	49997287 / 50330019 / -0.7%	0.77 / 0.77 / +0.2%
tpcds_q24/duckdb:vortex-file-compressed	25924351 / 26380085 / -1.7%	36513404 / 35713106 / +2.2%	0.71 / 0.74 / -3.9%
tpcds_q25/duckdb:vortex-file-compressed	23304151 / 23526928 / -0.9%	34701733 / 34876701 / -0.5%	0.67 / 0.67 / -0.4%
tpcds_q26/duckdb:vortex-file-compressed	12984788 / 13280332 / -2.2%	21965467 / 20561216 / +6.8%	0.59 / 0.65 / -8.5%
tpcds_q27/duckdb:vortex-file-compressed	16006575 / 16047878 / -0.3%	25928887 / 24713668 / +4.9%	0.62 / 0.65 / -4.9%
tpcds_q28/duckdb:vortex-file-compressed	15241517 / 15410258 / -1.1%	25712587 / 25883013 / -0.7%	0.59 / 0.60 / -0.4%
tpcds_q29/duckdb:vortex-file-compressed	22880130 / 22733620 / +0.6%	34401127 / 33849576 / +1.6%	0.67 / 0.67 / -1.0%
tpcds_q30/duckdb:vortex-file-compressed	16317130 / 16353124 / -0.2%	24542685 / 24609573 / -0.3%	0.66 / 0.66 / +0.1%
tpcds_q31/duckdb:vortex-file-compressed	17955913 / 17852596 / +0.6%	26571202 / 25812987 / +2.9%	0.68 / 0.69 / -2.3%
tpcds_q32/duckdb:vortex-file-compressed	11983288 / 11842142 / +1.2%	20660024 / 20914421 / -1.2%	0.58 / 0.57 / +2.4%
tpcds_q33/duckdb:vortex-file-compressed	18895264 / 19669417 / -3.9%	28688551 / 28847325 / -0.6%	0.66 / 0.68 / -3.4%
tpcds_q34/duckdb:vortex-file-compressed	13248764 / 13127661 / +0.9%	22576217 / 22091590 / +2.2%	0.59 / 0.59 / -1.2%
tpcds_q35/duckdb:vortex-file-compressed	27886126 / 28082074 / -0.7%	39749400 / 38588820 / +3.0%	0.70 / 0.73 / -3.6%
tpcds_q36/duckdb:vortex-file-compressed	14520668 / 14135667 / +2.7%	23909948 / 23399838 / +2.2%	0.61 / 0.60 / +0.5%
tpcds_q37/duckdb:vortex-file-compressed	9325702 / 9482134 / -1.6%	23157314 / 23347981 / -0.8%	0.40 / 0.41 / -0.8%
tpcds_q38/duckdb:vortex-file-compressed	24483570 / 24549050 / -0.3%	32854573 / 32240322 / +1.9%	0.75 / 0.76 / -2.1%
tpcds_q39/duckdb:vortex-file-compressed	18939537 / 19184558 / -1.3%	31943760 / 31510476 / +1.4%	0.59 / 0.61 / -2.6%
tpcds_q40/duckdb:vortex-file-compressed	14275198 / 13954936 / +2.3%	20429435 / 21621682 / -5.5%	0.70 / 0.65 / +8.3%
tpcds_q41/duckdb:vortex-file-compressed	18773823 / 18767839 / +0.0%	25345963 / 26071055 / -2.8%	0.74 / 0.72 / +2.9%
tpcds_q42/duckdb:vortex-file-compressed	7128963 / 7021487 / +1.5%	15714858 / 15284466 / +2.8%	0.45 / 0.46 / -1.3%
tpcds_q43/duckdb:vortex-file-compressed	10002500 / 9778127 / +2.3%	19695682 / 18126006 / +8.7%	0.51 / 0.54 / -5.9%
tpcds_q44/duckdb:vortex-file-compressed	12637099 / 12641515 / -0.0%	23764153 / 23970459 / -0.9%	0.53 / 0.53 / +0.8%
tpcds_q45/duckdb:vortex-file-compressed	23416096 / 23628760 / -0.9%	30902035 / 29990582 / +3.0%	0.76 / 0.79 / -3.8%
tpcds_q46/duckdb:vortex-file-compressed	19137182 / 19354693 / -1.1%	27933012 / 27947272 / -0.1%	0.69 / 0.69 / -1.1%
tpcds_q47/duckdb:vortex-file-compressed	34520114 / 34376904 / +0.4%	44906956 / 44627635 / +0.6%	0.77 / 0.77 / -0.2%
tpcds_q48/duckdb:vortex-file-compressed	23634358 / 23652373 / -0.1%	36932171 / 35917055 / +2.8%	0.64 / 0.66 / -2.8%
tpcds_q49/duckdb:vortex-file-compressed	19522917 / 19050742 / +2.5%	31191908 / 29905240 / +4.3%	0.63 / 0.64 / -1.7%
tpcds_q50/duckdb:vortex-file-compressed	16756042 / 17025518 / -1.6%	27869821 / 26666688 / +4.5%	0.60 / 0.64 / -5.8%
tpcds_q51/duckdb:vortex-file-compressed	49109294 / 48586502 / +1.1%	77481810 / 57955937 / +33.7% 🔴	0.63 / 0.84 / -24.4%
tpcds_q52/duckdb:vortex-file-compressed	7197014 / 7272568 / -1.0%	16119174 / 15540797 / +3.7%	0.45 / 0.47 / -4.6%
tpcds_q53/duckdb:vortex-file-compressed	11470196 / 11498469 / -0.2%	20443123 / 21004527 / -2.7%	0.56 / 0.55 / +2.5%
tpcds_q54/duckdb:vortex-file-compressed	20543332 / 20671933 / -0.6%	31078241 / 30900143 / +0.6%	0.66 / 0.67 / -1.2%
tpcds_q55/duckdb:vortex-file-compressed	6918214 / 7012993 / -1.4%	15784529 / 15030564 / +5.0%	0.44 / 0.47 / -6.1%
tpcds_q56/duckdb:vortex-file-compressed	18055184 / 18424232 / -2.0%	29444959 / 28681860 / +2.7%	0.61 / 0.64 / -4.5%
tpcds_q57/duckdb:vortex-file-compressed	26055152 / 26052274 / +0.0%	34195534 / 34183339 / +0.0%	0.76 / 0.76 / -0.0%
tpcds_q58/duckdb:vortex-file-compressed	20202260 / 20481394 / -1.4%	30985791 / 30174441 / +2.7%	0.65 / 0.68 / -3.9%
tpcds_q59/duckdb:vortex-file-compressed	19574727 / 19484756 / +0.5%	26337869 / 26535149 / -0.7%	0.74 / 0.73 / +1.2%
tpcds_q60/duckdb:vortex-file-compressed	18769413 / 18933901 / -0.9%	28925660 / 28798814 / +0.4%	0.65 / 0.66 / -1.3%
tpcds_q61/duckdb:vortex-file-compressed	25639884 / 25465774 / +0.7%	33750798 / 33744675 / +0.0%	0.76 / 0.75 / +0.7%
tpcds_q62/duckdb:vortex-file-compressed	11552203 / 11792328 / -2.0%	18654798 / 17726885 / +5.2%	0.62 / 0.67 / -6.9%
tpcds_q63/duckdb:vortex-file-compressed	11084746 / 10956724 / +1.2%	20328773 / 19474991 / +4.4%	0.55 / 0.56 / -3.1%
tpcds_q64/duckdb:vortex-file-compressed	49238714 / 49743086 / -1.0%	64342385 / 63859777 / +0.8%	0.77 / 0.78 / -1.8%
tpcds_q65/duckdb:vortex-file-compressed	13015844 / 13275328 / -2.0%	23264607 / 22874777 / +1.7%	0.56 / 0.58 / -3.6%
tpcds_q66/duckdb:vortex-file-compressed	29617659 / 29797564 / -0.6%	35782755 / 34996240 / +2.2%	0.83 / 0.85 / -2.8%
tpcds_q67/duckdb:vortex-file-compressed	60726656 / 59409166 / +2.2%	68951228 / 66941986 / +3.0%	0.88 / 0.89 / -0.8%
tpcds_q68/duckdb:vortex-file-compressed	19121266 / 19328682 / -1.1%	27770520 / 27038341 / +2.7%	0.69 / 0.71 / -3.7%
tpcds_q69/duckdb:vortex-file-compressed	23007176 / 22863525 / +0.6%	37443866 / 37020495 / +1.1%	0.61 / 0.62 / -0.5%
tpcds_q70/duckdb:vortex-file-compressed	15938064 / 15822539 / +0.7%	27568428 / 27699960 / -0.5%	0.58 / 0.57 / +1.2%
tpcds_q71/duckdb:vortex-file-compressed	12887604 / 12937822 / -0.4%	23140158 / 23224312 / -0.4%	0.56 / 0.56 / -0.0%
tpcds_q72/duckdb:vortex-file-compressed	52548528 / 52185872 / +0.7%	65513986 / 62576311 / +4.7%	0.80 / 0.83 / -3.8%
tpcds_q73/duckdb:vortex-file-compressed	12122111 / 12041080 / +0.7%	20586852 / 20549025 / +0.2%	0.59 / 0.59 / +0.5%
tpcds_q74/duckdb:vortex-file-compressed	26017382 / 26582898 / -2.1%	34543637 / 33463551 / +3.2%	0.75 / 0.79 / -5.2%
tpcds_q75/duckdb:vortex-file-compressed	27820054 / 28022000 / -0.7%	38742573 / 37920006 / +2.2%	0.72 / 0.74 / -2.8%
tpcds_q76/duckdb:vortex-file-compressed	12655314 / 13053422 / -3.0%	23406527 / 22415254 / +4.4%	0.54 / 0.58 / -7.2%
tpcds_q77/duckdb:vortex-file-compressed	20573954 / 20937940 / -1.7%	31061367 / 31205935 / -0.5%	0.66 / 0.67 / -1.3%
tpcds_q78/duckdb:vortex-file-compressed	42622080 / 42872648 / -0.6%	53054766 / 52733381 / +0.6%	0.80 / 0.81 / -1.2%
tpcds_q79/duckdb:vortex-file-compressed	13267505 / 13060134 / +1.6%	20917782 / 21067428 / -0.7%	0.63 / 0.62 / +2.3%
tpcds_q80/duckdb:vortex-file-compressed	37344394 / 37277892 / +0.2%	48842902 / 48490643 / +0.7%	0.76 / 0.77 / -0.5%
tpcds_q81/duckdb:vortex-file-compressed	21344725 / 21533282 / -0.9%	29677504 / 28788618 / +3.1%	0.72 / 0.75 / -3.8%
tpcds_q82/duckdb:vortex-file-compressed	9591631 / 9737208 / -1.5%	24453050 / 23479630 / +4.1%	0.39 / 0.41 / -5.4%
tpcds_q83/duckdb:vortex-file-compressed	17667931 / 17630199 / +0.2%	24935528 / 25020179 / -0.3%	0.71 / 0.70 / +0.6%
tpcds_q84/duckdb:vortex-file-compressed	15580470 / 15264067 / +2.1%	23369173 / 22922948 / +1.9%	0.67 / 0.67 / +0.1%
tpcds_q85/duckdb:vortex-file-compressed	24732790 / 24537969 / +0.8%	36700581 / 35342475 / +3.8%	0.67 / 0.69 / -2.9%
tpcds_q86/duckdb:vortex-file-compressed	9842220 / 9664048 / +1.8%	16741805 / 16149934 / +3.7%	0.59 / 0.60 / -1.8%
tpcds_q87/duckdb:vortex-file-compressed	25849435 / 26254028 / -1.5%	34572841 / 33684227 / +2.6%	0.75 / 0.78 / -4.1%
tpcds_q88/duckdb:vortex-file-compressed	30351149 / 30985972 / -2.0%	37795161 / 37838409 / -0.1%	0.80 / 0.82 / -1.9%
tpcds_q89/duckdb:vortex-file-compressed	12218205 / 12465762 / -2.0%	21887874 / 21125167 / +3.6%	0.56 / 0.59 / -5.4%
tpcds_q90/duckdb:vortex-file-compressed	8100738 / 8446244 / -4.1%	15301423 / 15374332 / -0.5%	0.53 / 0.55 / -3.6%
tpcds_q91/duckdb:vortex-file-compressed	14591426 / 14502276 / +0.6%	22127500 / 22227594 / -0.5%	0.66 / 0.65 / +1.1%
tpcds_q92/duckdb:vortex-file-compressed	12105324 / 12233464 / -1.0%	20610485 / 20543329 / +0.3%	0.59 / 0.60 / -1.4%
tpcds_q93/duckdb:vortex-file-compressed	10470878 / 10551251 / -0.8%	22589299 / 22086382 / +2.3%	0.46 / 0.48 / -3.0%
tpcds_q94/duckdb:vortex-file-compressed	22681798 / 22166111 / +2.3%	32147151 / 32415558 / -0.8%	0.71 / 0.68 / +3.2%
tpcds_q95/duckdb:vortex-file-compressed	62860452 / 62782268 / +0.1%	71608282 / 71780444 / -0.2%	0.88 / 0.87 / +0.4%
tpcds_q96/duckdb:vortex-file-compressed	6908428 / 7045894 / -2.0%	15488969 / 14961219 / +3.5%	0.45 / 0.47 / -5.3%
tpcds_q97/duckdb:vortex-file-compressed	23486316 / 23272766 / +0.9%	31796403 / 31760750 / +0.1%	0.74 / 0.73 / +0.8%
tpcds_q98/duckdb:vortex-file-compressed	11357612 / 11341540 / +0.1%	19949909 / 19521278 / +2.2%	0.57 / 0.58 / -2.0%
tpcds_q99/duckdb:vortex-file-compressed	14589463 / 14623504 / -0.2%	22561944 / 22285245 / +1.2%	0.65 / 0.66 / -1.5%

duckdb / vortex-compact / ns (1.001x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact	17653286 / 17648572 / +0.0%	25976767 / 25993555 / -0.1%	0.68 / 0.68 / +0.1%
tpcds_q02/duckdb:vortex-compact	19906676 / 18297542 / +8.8%	23848698 / 23330653 / +2.2%	0.83 / 0.78 / +6.4%
tpcds_q03/duckdb:vortex-compact	8238130 / 8227193 / +0.1%	17385385 / 17006373 / +2.2%	0.47 / 0.48 / -2.1%
tpcds_q04/duckdb:vortex-compact	47285907 / 47181305 / +0.2%	59419022 / 58841283 / +1.0%	0.80 / 0.80 / -0.8%
tpcds_q05/duckdb:vortex-compact	24966564 / 25177214 / -0.8%	34480786 / 34342306 / +0.4%	0.72 / 0.73 / -1.2%
tpcds_q06/duckdb:vortex-compact	26141970 / 26144327 / -0.0%	40041390 / 39601700 / +1.1%	0.65 / 0.66 / -1.1%
tpcds_q07/duckdb:vortex-compact	18164227 / 18675426 / -2.7%	27663525 / 27923129 / -0.9%	0.66 / 0.67 / -1.8%
tpcds_q08/duckdb:vortex-compact	22431537 / 22243078 / +0.8%	29515323 / 29251175 / +0.9%	0.76 / 0.76 / -0.1%
tpcds_q09/duckdb:vortex-compact	22161484 / 22108136 / +0.2%	31435731 / 31091073 / +1.1%	0.70 / 0.71 / -0.9%
tpcds_q10/duckdb:vortex-compact	32264538 / 32319923 / -0.2%	45002508 / 43877815 / +2.6%	0.72 / 0.74 / -2.7%
tpcds_q11/duckdb:vortex-compact	38653428 / 38262248 / +1.0%	47737309 / 47895428 / -0.3%	0.81 / 0.80 / +1.4%
tpcds_q12/duckdb:vortex-compact	12931730 / 12832167 / +0.8%	18874810 / 19030988 / -0.8%	0.69 / 0.67 / +1.6%
tpcds_q13/duckdb:vortex-compact	36994566 / 36872344 / +0.3%	47939680 / 48025203 / -0.2%	0.77 / 0.77 / +0.5%
tpcds_q14/duckdb:vortex-compact	62975004 / 61851752 / +1.8%	70459050 / 69515118 / +1.4%	0.89 / 0.89 / +0.5%
tpcds_q15/duckdb:vortex-compact	14966835 / 14979368 / -0.1%	22086424 / 22072999 / +0.1%	0.68 / 0.68 / -0.1%
tpcds_q16/duckdb:vortex-compact	26263781 / 27708462 / -5.2%	35360495 / 35810746 / -1.3%	0.74 / 0.77 / -4.0%
tpcds_q17/duckdb:vortex-compact	28222719 / 28722880 / -1.7%	38913519 / 39837165 / -2.3%	0.73 / 0.72 / +0.6%
tpcds_q18/duckdb:vortex-compact	36273236 / 37358632 / -2.9%	45120991 / 44901140 / +0.5%	0.80 / 0.83 / -3.4%
tpcds_q19/duckdb:vortex-compact	82825884 / 82336616 / +0.6%	94179649 / 92858135 / +1.4%	0.88 / 0.89 / -0.8%
tpcds_q20/duckdb:vortex-compact	13532306 / 13511395 / +0.2%	20026660 / 20225105 / -1.0%	0.68 / 0.67 / +1.1%
tpcds_q21/duckdb:vortex-compact	12365404 / 12369472 / -0.0%	23287414 / 23061294 / +1.0%	0.53 / 0.54 / -1.0%
tpcds_q22/duckdb:vortex-compact	19907214 / 19828916 / +0.4%	32283404 / 32250150 / +0.1%	0.62 / 0.61 / +0.3%
tpcds_q23/duckdb:vortex-compact	41859762 / 43385060 / -3.5%	53578398 / 53606991 / -0.1%	0.78 / 0.81 / -3.5%
tpcds_q24/duckdb:vortex-compact	28395823 / 28633057 / -0.8%	37566586 / 36247545 / +3.6%	0.76 / 0.79 / -4.3%
tpcds_q25/duckdb:vortex-compact	27452932 / 27049844 / +1.5%	40172946 / 38293011 / +4.9%	0.68 / 0.71 / -3.3%
tpcds_q26/duckdb:vortex-compact	21885202 / 17980930 / +21.7% 🔴	25247087 / 24674095 / +2.3%	0.87 / 0.73 / +19.0%
tpcds_q27/duckdb:vortex-compact	21042396 / 20917513 / +0.6%	29964966 / 29351497 / +2.1%	0.70 / 0.71 / -1.5%
tpcds_q28/duckdb:vortex-compact	21598397 / 22523148 / -4.1%	31994991 / 31330990 / +2.1%	0.68 / 0.72 / -6.1%
tpcds_q29/duckdb:vortex-compact	27159944 / 27249466 / -0.3%	38724160 / 38503180 / +0.6%	0.70 / 0.71 / -0.9%
tpcds_q30/duckdb:vortex-compact	18490830 / 18182418 / +1.7%	26911229 / 26333371 / +2.2%	0.69 / 0.69 / -0.5%
tpcds_q31/duckdb:vortex-compact	21287622 / 21745161 / -2.1%	27816750 / 28484894 / -2.3%	0.77 / 0.76 / +0.2%
tpcds_q32/duckdb:vortex-compact	13654158 / 13483250 / +1.3%	22495588 / 23106718 / -2.6%	0.61 / 0.58 / +4.0%
tpcds_q33/duckdb:vortex-compact	22231110 / 21610328 / +2.9%	30797577 / 30474467 / +1.1%	0.72 / 0.71 / +1.8%
tpcds_q34/duckdb:vortex-compact	14497279 / 14481334 / +0.1%	24603316 / 24108189 / +2.1%	0.59 / 0.60 / -1.9%
tpcds_q35/duckdb:vortex-compact	31713913 / 31739310 / -0.1%	42672210 / 43206233 / -1.2%	0.74 / 0.73 / +1.2%
tpcds_q36/duckdb:vortex-compact	15877204 / 15828600 / +0.3%	26117961 / 25005378 / +4.4%	0.61 / 0.63 / -4.0%
tpcds_q37/duckdb:vortex-compact	14070467 / 13639008 / +3.2%	26880461 / 26186787 / +2.6%	0.52 / 0.52 / +0.5%
tpcds_q38/duckdb:vortex-compact	25224685 / 25600080 / -1.5%	32731357 / 33924295 / -3.5%	0.77 / 0.75 / +2.1%
tpcds_q39/duckdb:vortex-compact	20434148 / 22345172 / -8.6%	31626331 / 33164268 / -4.6%	0.65 / 0.67 / -4.1%
tpcds_q40/duckdb:vortex-compact	16043020 / 16572967 / -3.2%	21487194 / 21400867 / +0.4%	0.75 / 0.77 / -3.6%
tpcds_q41/duckdb:vortex-compact	20590096 / 20626772 / -0.2%	27661248 / 27995018 / -1.2%	0.74 / 0.74 / +1.0%
tpcds_q42/duckdb:vortex-compact	8374474 / 8128929 / +3.0%	17217164 / 16759038 / +2.7%	0.49 / 0.49 / +0.3%
tpcds_q43/duckdb:vortex-compact	10898572 / 11214268 / -2.8%	20732097 / 20361032 / +1.8%	0.53 / 0.55 / -4.6%
tpcds_q44/duckdb:vortex-compact	14733238 / 15388278 / -4.3%	26696909 / 26736014 / -0.1%	0.55 / 0.58 / -4.1%
tpcds_q45/duckdb:vortex-compact	26672219 / 26533254 / +0.5%	32845726 / 33060162 / -0.6%	0.81 / 0.80 / +1.2%
tpcds_q46/duckdb:vortex-compact	20130200 / 20545886 / -2.0%	28458314 / 29115410 / -2.3%	0.71 / 0.71 / +0.2%
tpcds_q47/duckdb:vortex-compact	39442550 / 37651194 / +4.8%	47054793 / 45316679 / +3.8%	0.84 / 0.83 / +0.9%
tpcds_q48/duckdb:vortex-compact	38346604 / 38250710 / +0.3%	49510550 / 49183475 / +0.7%	0.77 / 0.78 / -0.4%
tpcds_q49/duckdb:vortex-compact	21995478 / 22440406 / -2.0%	33997532 / 31978477 / +6.3%	0.65 / 0.70 / -7.8%
tpcds_q50/duckdb:vortex-compact	18562989 / 18673686 / -0.6%	26802154 / 27554857 / -2.7%	0.69 / 0.68 / +2.2%
tpcds_q51/duckdb:vortex-compact	49852942 / 49862481 / -0.0%	59930309 / 78231136 / -23.4% 🟢	0.83 / 0.64 / +30.5%
tpcds_q52/duckdb:vortex-compact	8518880 / 8407366 / +1.3%	17252328 / 16483278 / +4.7%	0.49 / 0.51 / -3.2%
tpcds_q53/duckdb:vortex-compact	13650401 / 13709174 / -0.4%	23214477 / 23480899 / -1.1%	0.59 / 0.58 / +0.7%
tpcds_q54/duckdb:vortex-compact	22041843 / 22159956 / -0.5%	32172141 / 31526018 / +2.0%	0.69 / 0.70 / -2.5%
tpcds_q55/duckdb:vortex-compact	8208778 / 8362632 / -1.8%	16808160 / 16237631 / +3.5%	0.49 / 0.52 / -5.2%
tpcds_q56/duckdb:vortex-compact	21058550 / 21342171 / -1.3%	29902847 / 30565142 / -2.2%	0.70 / 0.70 / +0.9%
tpcds_q57/duckdb:vortex-compact	27311955 / 27023302 / +1.1%	36302194 / 35264386 / +2.9%	0.75 / 0.77 / -1.8%
tpcds_q58/duckdb:vortex-compact	23189559 / 22137216 / +4.8%	31397215 / 32469558 / -3.3%	0.74 / 0.68 / +8.3%
tpcds_q59/duckdb:vortex-compact	20826134 / 22351997 / -6.8%	28185454 / 28104336 / +0.3%	0.74 / 0.80 / -7.1%
tpcds_q60/duckdb:vortex-compact	20599542 / 22728862 / -9.4%	30521570 / 30617665 / -0.3%	0.67 / 0.74 / -9.1%
tpcds_q61/duckdb:vortex-compact	26845688 / 26874316 / -0.1%	36009102 / 36547936 / -1.5%	0.75 / 0.74 / +1.4%
tpcds_q62/duckdb:vortex-compact	12948322 / 13001398 / -0.4%	20078572 / 19574093 / +2.6%	0.64 / 0.66 / -2.9%
tpcds_q63/duckdb:vortex-compact	13241920 / 13300033 / -0.4%	22099834 / 22572213 / -2.1%	0.60 / 0.59 / +1.7%
tpcds_q64/duckdb:vortex-compact	56955168 / 57461906 / -0.9%	70315239 / 71352182 / -1.5%	0.81 / 0.81 / +0.6%
tpcds_q65/duckdb:vortex-compact	14539053 / 14608224 / -0.5%	24197740 / 23883736 / +1.3%	0.60 / 0.61 / -1.8%
tpcds_q66/duckdb:vortex-compact	34925212 / 33449007 / +4.4%	36857145 / 37109212 / -0.7%	0.95 / 0.90 / +5.1%
tpcds_q67/duckdb:vortex-compact	67397908 / 60913183 / +10.6% 🔴	70493123 / 70093687 / +0.6%	0.96 / 0.87 / +10.0%
tpcds_q68/duckdb:vortex-compact	19962252 / 19903500 / +0.3%	28678090 / 29387043 / -2.4%	0.70 / 0.68 / +2.8%
tpcds_q69/duckdb:vortex-compact	28651524 / 28809193 / -0.5%	42561672 / 43448351 / -2.0%	0.67 / 0.66 / +1.5%
tpcds_q70/duckdb:vortex-compact	18930022 / 18781102 / +0.8%	29396359 / 29109371 / +1.0%	0.64 / 0.65 / -0.2%
tpcds_q71/duckdb:vortex-compact	15577640 / 16052839 / -3.0%	25056646 / 25527932 / -1.8%	0.62 / 0.63 / -1.1%
tpcds_q72/duckdb:vortex-compact	56261668 / 57025351 / -1.3%	66605517 / 67257045 / -1.0%	0.84 / 0.85 / -0.4%
tpcds_q73/duckdb:vortex-compact	13240906 / 13372138 / -1.0%	23051388 / 22824900 / +1.0%	0.57 / 0.59 / -2.0%
tpcds_q74/duckdb:vortex-compact	26790220 / 27169652 / -1.4%	34988918 / 34799548 / +0.5%	0.77 / 0.78 / -1.9%
tpcds_q75/duckdb:vortex-compact	30056760 / 30130197 / -0.2%	40174814 / 39303125 / +2.2%	0.75 / 0.77 / -2.4%
tpcds_q76/duckdb:vortex-compact	14033786 / 14088814 / -0.4%	22616524 / 22563662 / +0.2%	0.62 / 0.62 / -0.6%
tpcds_q77/duckdb:vortex-compact	24465946 / 24282834 / +0.8%	32778318 / 33534229 / -2.3%	0.75 / 0.72 / +3.1%
tpcds_q78/duckdb:vortex-compact	47617144 / 45247816 / +5.2%	55392823 / 53734216 / +3.1%	0.86 / 0.84 / +2.1%
tpcds_q79/duckdb:vortex-compact	16544796 / 13624765 / +21.4% 🔴	21765375 / 21719559 / +0.2%	0.76 / 0.63 / +21.2%
tpcds_q80/duckdb:vortex-compact	41091370 / 40799646 / +0.7%	51437306 / 51178556 / +0.5%	0.80 / 0.80 / +0.2%
tpcds_q81/duckdb:vortex-compact	24139610 / 24468813 / -1.3%	31515227 / 31766713 / -0.8%	0.77 / 0.77 / -0.6%
tpcds_q82/duckdb:vortex-compact	12534372 / 12653568 / -0.9%	25927872 / 25647546 / +1.1%	0.48 / 0.49 / -2.0%
tpcds_q83/duckdb:vortex-compact	18857677 / 18991844 / -0.7%	25788557 / 25508157 / +1.1%	0.73 / 0.74 / -1.8%
tpcds_q84/duckdb:vortex-compact	17878888 / 17546371 / +1.9%	24212411 / 23199413 / +4.4%	0.74 / 0.76 / -2.4%
tpcds_q85/duckdb:vortex-compact	38577158 / 39121466 / -1.4%	51336850 / 50886999 / +0.9%	0.75 / 0.77 / -2.3%
tpcds_q86/duckdb:vortex-compact	10947314 / 11052106 / -0.9%	17587024 / 17377837 / +1.2%	0.62 / 0.64 / -2.1%
tpcds_q87/duckdb:vortex-compact	27096458 / 27001023 / +0.4%	35821042 / 34784132 / +3.0%	0.76 / 0.78 / -2.6%
tpcds_q88/duckdb:vortex-compact	32373451 / 32610436 / -0.7%	38912781 / 39766500 / -2.1%	0.83 / 0.82 / +1.5%
tpcds_q89/duckdb:vortex-compact	14330982 / 15421736 / -7.1%	23581252 / 22720207 / +3.8%	0.61 / 0.68 / -10.5%
tpcds_q90/duckdb:vortex-compact	8760908 / 8720468 / +0.5%	15662806 / 16400299 / -4.5%	0.56 / 0.53 / +5.2%
tpcds_q91/duckdb:vortex-compact	23631212 / 23615967 / +0.1%	31418136 / 31882882 / -1.5%	0.75 / 0.74 / +1.5%
tpcds_q92/duckdb:vortex-compact	14328980 / 14246230 / +0.6%	22842227 / 22826865 / +0.1%	0.63 / 0.62 / +0.5%
tpcds_q93/duckdb:vortex-compact	12668916 / 12640914 / +0.2%	25626189 / 24531021 / +4.5%	0.49 / 0.52 / -4.1%
tpcds_q94/duckdb:vortex-compact	24185610 / 23988612 / +0.8%	33092495 / 33430075 / -1.0%	0.73 / 0.72 / +1.8%
tpcds_q95/duckdb:vortex-compact	64977644 / 64578745 / +0.6%	73942922 / 74089424 / -0.2%	0.88 / 0.87 / +0.8%
tpcds_q96/duckdb:vortex-compact	8749982 / 8702284 / +0.5%	16730774 / 16633471 / +0.6%	0.52 / 0.52 / -0.0%
tpcds_q97/duckdb:vortex-compact	24008120 / 23924263 / +0.4%	34068641 / 32186806 / +5.8%	0.70 / 0.74 / -5.2%
tpcds_q98/duckdb:vortex-compact	14216044 / 14278516 / -0.4%	22364872 / 23322191 / -4.1%	0.64 / 0.61 / +3.8%
tpcds_q99/duckdb:vortex-compact	15607225 / 15907858 / -1.9%	23052183 / 23528908 / -2.0%	0.68 / 0.68 / +0.1%

duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	24124038 / 23954671 / +0.7%	31130310 / 30620202 / +1.7%	0.77 / 0.78 / -0.9%
tpcds_q02/duckdb:parquet	17905056 / 17912996 / -0.0%	25069368 / 23908123 / +4.9%	0.71 / 0.75 / -4.7%
tpcds_q03/duckdb:parquet	9779802 / 9775515 / +0.0%	15600450 / 15700388 / -0.6%	0.63 / 0.62 / +0.7%
tpcds_q04/duckdb:parquet	118098596 / 117460478 / +0.5%	126488325 / 126426763 / +0.0%	0.93 / 0.93 / +0.5%
tpcds_q05/duckdb:parquet	28335956 / 28328998 / +0.0%	32990305 / 32718509 / +0.8%	0.86 / 0.87 / -0.8%
tpcds_q06/duckdb:parquet	26542070 / 26336096 / +0.8%	36179497 / 35363403 / +2.3%	0.73 / 0.74 / -1.5%
tpcds_q07/duckdb:parquet	30943986 / 31997443 / -3.3%	38503750 / 38550096 / -0.1%	0.80 / 0.83 / -3.2%
tpcds_q08/duckdb:parquet	19782240 / 19773132 / +0.0%	24805264 / 26656308 / -6.9%	0.80 / 0.74 / +7.5%
tpcds_q09/duckdb:parquet	27430722 / 27001265 / +1.6%	29888753 / 30034352 / -0.5%	0.92 / 0.90 / +2.1%
tpcds_q10/duckdb:parquet	32712622 / 32339904 / +1.2%	40283886 / 39534455 / +1.9%	0.81 / 0.82 / -0.7%
tpcds_q11/duckdb:parquet	68466260 / 68850570 / -0.6%	76147727 / 75026849 / +1.5%	0.90 / 0.92 / -2.0%
tpcds_q12/duckdb:parquet	13905089 / 14056214 / -1.1%	19295077 / 19104358 / +1.0%	0.72 / 0.74 / -2.1%
tpcds_q13/duckdb:parquet	32360456 / 31700576 / +2.1%	39233934 / 38651938 / +1.5%	0.82 / 0.82 / +0.6%
tpcds_q14/duckdb:parquet	65648773 / 63579183 / +3.3%	68007098 / 69095701 / -1.6%	0.97 / 0.92 / +4.9%
tpcds_q15/duckdb:parquet	16454472 / 16451588 / +0.0%	22432939 / 22546728 / -0.5%	0.73 / 0.73 / +0.5%
tpcds_q16/duckdb:parquet	30409520 / 30023486 / +1.3%	37125189 / 37535453 / -1.1%	0.82 / 0.80 / +2.4%
tpcds_q17/duckdb:parquet	34515330 / 34069810 / +1.3%	40014758 / 40112111 / -0.2%	0.86 / 0.85 / +1.6%
tpcds_q18/duckdb:parquet	47274038 / 47105222 / +0.4%	54479156 / 54270560 / +0.4%	0.87 / 0.87 / -0.0%
tpcds_q19/duckdb:parquet	19495788 / 19839204 / -1.7%	25502414 / 25525985 / -0.1%	0.76 / 0.78 / -1.6%
tpcds_q20/duckdb:parquet	14907240 / 14843369 / +0.4%	19771369 / 19136923 / +3.3%	0.75 / 0.78 / -2.8%
tpcds_q21/duckdb:parquet	10622023 / 10606462 / +0.1%	17002505 / 16727680 / +1.6%	0.62 / 0.63 / -1.5%
tpcds_q22/duckdb:parquet	20696460 / 20726117 / -0.1%	26539486 / 26470510 / +0.3%	0.78 / 0.78 / -0.4%
tpcds_q23/duckdb:parquet	42039570 / 43161656 / -2.6%	47336233 / 47024635 / +0.7%	0.89 / 0.92 / -3.2%
tpcds_q24/duckdb:parquet	30147910 / 31734848 / -5.0%	36575424 / 37128449 / -1.5%	0.82 / 0.85 / -3.6%
tpcds_q25/duckdb:parquet	30287436 / 30101720 / +0.6%	37054675 / 36982401 / +0.2%	0.82 / 0.81 / +0.4%
tpcds_q26/duckdb:parquet	28981012 / 28956573 / +0.1%	35365813 / 35051669 / +0.9%	0.82 / 0.83 / -0.8%
tpcds_q27/duckdb:parquet	35476236 / 34088410 / +4.1%	41860042 / 40952327 / +2.2%	0.85 / 0.83 / +1.8%
tpcds_q28/duckdb:parquet	25819867 / 26718435 / -3.4%	34506692 / 34044461 / +1.4%	0.75 / 0.78 / -4.7%
tpcds_q29/duckdb:parquet	32072785 / 32161458 / -0.3%	39422158 / 39202371 / +0.6%	0.81 / 0.82 / -0.8%
tpcds_q30/duckdb:parquet	35549942 / 35480326 / +0.2%	44971245 / 43705799 / +2.9%	0.79 / 0.81 / -2.6%
tpcds_q31/duckdb:parquet	36231526 / 35386878 / +2.4%	42492084 / 42832119 / -0.8%	0.85 / 0.83 / +3.2%
tpcds_q32/duckdb:parquet	14129938 / 14150931 / -0.1%	21223003 / 20429761 / +3.9%	0.67 / 0.69 / -3.9%
tpcds_q33/duckdb:parquet	24380630 / 25406566 / -4.0%	29556923 / 29058831 / +1.7%	0.82 / 0.87 / -5.7%
tpcds_q34/duckdb:parquet	16895354 / 17221546 / -1.9%	24209123 / 24016735 / +0.8%	0.70 / 0.72 / -2.7%
tpcds_q35/duckdb:parquet	34625862 / 34904092 / -0.8%	43853861 / 43684382 / +0.4%	0.79 / 0.80 / -1.2%
tpcds_q36/duckdb:parquet	39659146 / 39600848 / +0.1%	48202021 / 46987479 / +2.6%	0.82 / 0.84 / -2.4%
tpcds_q37/duckdb:parquet	12602576 / 12727656 / -1.0%	19727617 / 19280363 / +2.3%	0.64 / 0.66 / -3.2%
tpcds_q38/duckdb:parquet	29708266 / 29890353 / -0.6%	33736465 / 33639446 / +0.3%	0.88 / 0.89 / -0.9%
tpcds_q39/duckdb:parquet	23268164 / 23424154 / -0.7%	30016900 / 29495699 / +1.8%	0.78 / 0.79 / -2.4%
tpcds_q40/duckdb:parquet	16007886 / 15808344 / +1.3%	21615205 / 20897159 / +3.4%	0.74 / 0.76 / -2.1%
tpcds_q41/duckdb:parquet	11932546 / 11903102 / +0.2%	17755225 / 18063883 / -1.7%	0.67 / 0.66 / +2.0%
tpcds_q42/duckdb:parquet	9553302 / 9511781 / +0.4%	15380733 / 15563591 / -1.2%	0.62 / 0.61 / +1.6%
tpcds_q43/duckdb:parquet	11995454 / 12156028 / -1.3%	18013814 / 18312723 / -1.6%	0.67 / 0.66 / +0.3%
tpcds_q44/duckdb:parquet	20974568 / 20903923 / +0.3%	27048717 / 26655166 / +1.5%	0.78 / 0.78 / -1.1%
tpcds_q45/duckdb:parquet	21051810 / 21042442 / +0.0%	27870537 / 27488657 / +1.4%	0.76 / 0.77 / -1.3%
tpcds_q46/duckdb:parquet	36057450 / 36022036 / +0.1%	43992292 / 43248013 / +1.7%	0.82 / 0.83 / -1.6%
tpcds_q47/duckdb:parquet	34632122 / 34457084 / +0.5%	41559034 / 40956296 / +1.5%	0.83 / 0.84 / -0.9%
tpcds_q48/duckdb:parquet	31448885 / 29913192 / +5.1%	36674969 / 36437042 / +0.7%	0.86 / 0.82 / +4.5%
tpcds_q49/duckdb:parquet	28890218 / 28723680 / +0.6%	35970733 / 35966655 / +0.0%	0.80 / 0.80 / +0.6%
tpcds_q50/duckdb:parquet	19600378 / 19221938 / +2.0%	25550215 / 25616897 / -0.3%	0.77 / 0.75 / +2.2%
tpcds_q51/duckdb:parquet	52257173 / 52348473 / -0.2%	78376908 / 60320326 / +29.9% 🔴	0.67 / 0.87 / -23.2%
tpcds_q52/duckdb:parquet	9721104 / 9645489 / +0.8%	15340874 / 15393961 / -0.3%	0.63 / 0.63 / +1.1%
tpcds_q53/duckdb:parquet	14212737 / 13857736 / +2.6%	20928287 / 20848298 / +0.4%	0.68 / 0.66 / +2.2%
tpcds_q54/duckdb:parquet	24875382 / 25093769 / -0.9%	31751972 / 31613611 / +0.4%	0.78 / 0.79 / -1.3%
tpcds_q55/duckdb:parquet	9555640 / 9434984 / +1.3%	15205473 / 15053564 / +1.0%	0.63 / 0.63 / +0.3%
tpcds_q56/duckdb:parquet	27145427 / 26931688 / +0.8%	29983184 / 30212127 / -0.8%	0.91 / 0.89 / +1.6%
tpcds_q57/duckdb:parquet	30855668 / 30456394 / +1.3%	36487620 / 36125095 / +1.0%	0.85 / 0.84 / +0.3%
tpcds_q58/duckdb:parquet	24648845 / 23886156 / +3.2%	29864761 / 29508333 / +1.2%	0.83 / 0.81 / +2.0%
tpcds_q59/duckdb:parquet	22645820 / 22502620 / +0.6%	28814113 / 28834519 / -0.1%	0.79 / 0.78 / +0.7%
tpcds_q60/duckdb:parquet	26005944 / 27826874 / -6.5%	32493550 / 31936525 / +1.7%	0.80 / 0.87 / -8.1%
tpcds_q61/duckdb:parquet	24823197 / 25277440 / -1.8%	29425001 / 29207418 / +0.7%	0.84 / 0.87 / -2.5%
tpcds_q62/duckdb:parquet	12746346 / 12637950 / +0.9%	17971766 / 18099512 / -0.7%	0.71 / 0.70 / +1.6%
tpcds_q63/duckdb:parquet	13669390 / 13320856 / +2.6%	19926570 / 20120255 / -1.0%	0.69 / 0.66 / +3.6%
tpcds_q64/duckdb:parquet	70548686 / 71222442 / -0.9%	80485346 / 79366289 / +1.4%	0.88 / 0.90 / -2.3%
tpcds_q65/duckdb:parquet	18517072 / 18742227 / -1.2%	25793627 / 25617565 / +0.7%	0.72 / 0.73 / -1.9%
tpcds_q66/duckdb:parquet	33072162 / 33480546 / -1.2%	38107488 / 37974766 / +0.3%	0.87 / 0.88 / -1.6%
tpcds_q67/duckdb:parquet	61970790 / 60678232 / +2.1%	66821765 / 67858556 / -1.5%	0.93 / 0.89 / +3.7%
tpcds_q68/duckdb:parquet	30599932 / 28123679 / +8.8%	36185488 / 35774099 / +1.1%	0.85 / 0.79 / +7.6%
tpcds_q69/duckdb:parquet	25879370 / 25730346 / +0.6%	33985025 / 33990664 / -0.0%	0.76 / 0.76 / +0.6%
tpcds_q70/duckdb:parquet	19321338 / 19218640 / +0.5%	26987616 / 26720717 / +1.0%	0.72 / 0.72 / -0.5%
tpcds_q71/duckdb:parquet	17722608 / 16866668 / +5.1%	24103385 / 23732287 / +1.6%	0.74 / 0.71 / +3.5%
tpcds_q72/duckdb:parquet	52742646 / 53114634 / -0.7%	60302037 / 59470579 / +1.4%	0.87 / 0.89 / -2.1%
tpcds_q73/duckdb:parquet	14560412 / 14915961 / -2.4%	21262361 / 21244584 / +0.1%	0.68 / 0.70 / -2.5%
tpcds_q74/duckdb:parquet	84262258 / 84589438 / -0.4%	91753530 / 89233979 / +2.8%	0.92 / 0.95 / -3.1%
tpcds_q75/duckdb:parquet	43086314 / 42491541 / +1.4%	49807730 / 50339824 / -1.1%	0.87 / 0.84 / +2.5%
tpcds_q76/duckdb:parquet	18089246 / 18419306 / -1.8%	23196893 / 23031385 / +0.7%	0.78 / 0.80 / -2.5%
tpcds_q77/duckdb:parquet	25766438 / 26994638 / -4.5%	30498697 / 31561509 / -3.4%	0.84 / 0.86 / -1.2%
tpcds_q78/duckdb:parquet	78150740 / 77654156 / +0.6%	84980520 / 85363914 / -0.4%	0.92 / 0.91 / +1.1%
tpcds_q79/duckdb:parquet	24096638 / 22780256 / +5.8%	28504435 / 28287063 / +0.8%	0.85 / 0.81 / +5.0%
tpcds_q80/duckdb:parquet	36058896 / 36732492 / -1.8%	43590321 / 43707965 / -0.3%	0.83 / 0.84 / -1.6%
tpcds_q81/duckdb:parquet	36401916 / 36393651 / +0.0%	45266855 / 44477733 / +1.8%	0.80 / 0.82 / -1.7%
tpcds_q82/duckdb:parquet	13492491 / 13437382 / +0.4%	20268214 / 20504128 / -1.2%	0.67 / 0.66 / +1.6%
tpcds_q83/duckdb:parquet	20109818 / 20321165 / -1.0%	24975130 / 25238175 / -1.0%	0.81 / 0.81 / +0.0%
tpcds_q84/duckdb:parquet	22817254 / 23066902 / -1.1%	29275442 / 28407279 / +3.1%	0.78 / 0.81 / -4.0%
tpcds_q85/duckdb:parquet	32414629 / 32450117 / -0.1%	39854053 / 38971425 / +2.3%	0.81 / 0.83 / -2.3%
tpcds_q86/duckdb:parquet	11861601 / 11835100 / +0.2%	17079452 / 16717899 / +2.2%	0.69 / 0.71 / -1.9%
tpcds_q87/duckdb:parquet	31023110 / 31048573 / -0.1%	36292700 / 35508796 / +2.2%	0.85 / 0.87 / -2.2%
tpcds_q88/duckdb:parquet	38483096 / 38005012 / +1.3%	43597021 / 43409922 / +0.4%	0.88 / 0.88 / +0.8%
tpcds_q89/duckdb:parquet	14188201 / 15620060 / -9.2%	21086140 / 21515380 / -2.0%	0.67 / 0.73 / -7.3%
tpcds_q90/duckdb:parquet	9914277 / 10006328 / -0.9%	15183925 / 15606215 / -2.7%	0.65 / 0.64 / +1.8%
tpcds_q91/duckdb:parquet	20974079 / 21019750 / -0.2%	28878981 / 28034970 / +3.0%	0.73 / 0.75 / -3.1%
tpcds_q92/duckdb:parquet	15592790 / 15476858 / +0.7%	22070573 / 22232205 / -0.7%	0.71 / 0.70 / +1.5%
tpcds_q93/duckdb:parquet	14266056 / 14203517 / +0.4%	20216519 / 20223013 / -0.0%	0.71 / 0.70 / +0.5%
tpcds_q94/duckdb:parquet	25334771 / 25501778 / -0.7%	32740564 / 32732491 / +0.0%	0.77 / 0.78 / -0.7%
tpcds_q95/duckdb:parquet	43870202 / 44138988 / -0.6%	49450094 / 50245520 / -1.6%	0.89 / 0.88 / +1.0%
tpcds_q96/duckdb:parquet	8117341 / 8252334 / -1.6%	13630338 / 14005560 / -2.7%	0.60 / 0.59 / +1.1%
tpcds_q97/duckdb:parquet	27600434 / 27617159 / -0.1%	34379301 / 33643900 / +2.2%	0.80 / 0.82 / -2.2%
tpcds_q98/duckdb:parquet	16426122 / 16491309 / -0.4%	23062611 / 22888018 / +0.8%	0.71 / 0.72 / -1.1%
tpcds_q99/duckdb:parquet	18907216 / 18709854 / +1.1%	24888913 / 24379935 / +2.1%	0.76 / 0.77 / -1.0%

duckdb / duckdb / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:duckdb	15674542 / 15657218 / +0.1%	25284479 / 24892780 / +1.6%	0.62 / 0.63 / -1.4%
tpcds_q02/duckdb:duckdb	12281851 / 12279462 / +0.0%	19340819 / 18418121 / +5.0%	0.64 / 0.67 / -4.8%
tpcds_q03/duckdb:duckdb	4956902 / 4941847 / +0.3%	12101068 / 11200263 / +8.0%	0.41 / 0.44 / -7.2%
tpcds_q04/duckdb:duckdb	48683406 / 48663260 / +0.0%	56059514 / 55182676 / +1.6%	0.87 / 0.88 / -1.5%
tpcds_q05/duckdb:duckdb	15360646 / 15704182 / -2.2%	21534128 / 20939485 / +2.8%	0.71 / 0.75 / -4.9%
tpcds_q06/duckdb:duckdb	18059196 / 17740150 / +1.8%	29496849 / 28448294 / +3.7%	0.61 / 0.62 / -1.8%
tpcds_q07/duckdb:duckdb	21397686 / 21095759 / +1.4%	31143266 / 30558880 / +1.9%	0.69 / 0.69 / -0.5%
tpcds_q08/duckdb:duckdb	18121012 / 18306950 / -1.0%	28863382 / 27543091 / +4.8%	0.63 / 0.66 / -5.5%
tpcds_q09/duckdb:duckdb	8648600 / 8514343 / +1.6%	13408637 / 13122380 / +2.2%	0.65 / 0.65 / -0.6%
tpcds_q10/duckdb:duckdb	18128116 / 17954266 / +1.0%	28713146 / 27092007 / +6.0%	0.63 / 0.66 / -4.7%
tpcds_q11/duckdb:duckdb	41846996 / 42163559 / -0.8%	49574340 / 49204163 / +0.8%	0.84 / 0.86 / -1.5%
tpcds_q12/duckdb:duckdb	9095186 / 9191658 / -1.0%	17109478 / 16175606 / +5.8%	0.53 / 0.57 / -6.5%
tpcds_q13/duckdb:duckdb	20182242 / 20307336 / -0.6%	33379300 / 31045121 / +7.5%	0.60 / 0.65 / -7.6%
tpcds_q14/duckdb:duckdb	39823253 / 39743730 / +0.2%	44956571 / 44597171 / +0.8%	0.89 / 0.89 / -0.6%
tpcds_q15/duckdb:duckdb	7845248 / 7932852 / -1.1%	14034472 / 13605808 / +3.2%	0.56 / 0.58 / -4.1%
tpcds_q16/duckdb:duckdb	12383049 / 12231322 / +1.2%	22142197 / 21086184 / +5.0%	0.56 / 0.58 / -3.6%
tpcds_q17/duckdb:duckdb	17645110 / 17694456 / -0.3%	29474530 / 28306559 / +4.1%	0.60 / 0.63 / -4.2%
tpcds_q18/duckdb:duckdb	32119991 / 32568895 / -1.4%	45561641 / 45123997 / +1.0%	0.70 / 0.72 / -2.3%
tpcds_q19/duckdb:duckdb	10625532 / 10289326 / +3.3%	20670229 / 18953381 / +9.1%	0.51 / 0.54 / -5.3%
tpcds_q20/duckdb:duckdb	9691162 / 9558883 / +1.4%	17105369 / 16982948 / +0.7%	0.57 / 0.56 / +0.7%
tpcds_q21/duckdb:duckdb	6093400 / 6106942 / -0.2%	11521654 / 11076221 / +4.0%	0.53 / 0.55 / -4.1%
tpcds_q22/duckdb:duckdb	17486368 / 17416428 / +0.4%	22966330 / 22744558 / +1.0%	0.76 / 0.77 / -0.6%
tpcds_q23/duckdb:duckdb	26744792 / 26599501 / +0.5%	35735624 / 33598764 / +6.4%	0.75 / 0.79 / -5.5%
tpcds_q24/duckdb:duckdb	15396670 / 15284048 / +0.7%	30601464 / 28585060 / +7.1%	0.50 / 0.53 / -5.9%
tpcds_q25/duckdb:duckdb	13752810 / 13935312 / -1.3%	26756904 / 24929147 / +7.3%	0.51 / 0.56 / -8.1%
tpcds_q26/duckdb:duckdb	18345419 / 18174158 / +0.9%	28145729 / 26640037 / +5.7%	0.65 / 0.68 / -4.5%
tpcds_q27/duckdb:duckdb	23323554 / 23403024 / -0.3%	35364333 / 34020678 / +3.9%	0.66 / 0.69 / -4.1%
tpcds_q28/duckdb:duckdb	12002810 / 11954616 / +0.4%	20582191 / 18726381 / +9.9%	0.58 / 0.64 / -8.6%
tpcds_q29/duckdb:duckdb	14018936 / 13903964 / +0.8%	26294262 / 24645356 / +6.7%	0.53 / 0.56 / -5.5%
tpcds_q30/duckdb:duckdb	17697577 / 17447007 / +1.4%	29848338 / 28763796 / +3.8%	0.59 / 0.61 / -2.2%
tpcds_q31/duckdb:duckdb	29996276 / 29876454 / +0.4%	39214885 / 37733155 / +3.9%	0.76 / 0.79 / -3.4%
tpcds_q32/duckdb:duckdb	5353814 / 5325323 / +0.5%	12851217 / 12356075 / +4.0%	0.42 / 0.43 / -3.3%
tpcds_q33/duckdb:duckdb	8934710 / 8896462 / +0.4%	16585055 / 15604381 / +6.3%	0.54 / 0.57 / -5.5%
tpcds_q34/duckdb:duckdb	10498524 / 10471570 / +0.3%	19855297 / 18914440 / +5.0%	0.53 / 0.55 / -4.5%
tpcds_q35/duckdb:duckdb	24165588 / 24213280 / -0.2%	34106548 / 33789525 / +0.9%	0.71 / 0.72 / -1.1%
tpcds_q36/duckdb:duckdb	12920064 / 12800411 / +0.9%	23145674 / 21635008 / +7.0%	0.56 / 0.59 / -5.7%
tpcds_q37/duckdb:duckdb	5226193 / 5239118 / -0.2%	13761862 / 13143858 / +4.7%	0.38 / 0.40 / -4.7%
tpcds_q38/duckdb:duckdb	23018645 / 22871704 / +0.6%	28831106 / 28586800 / +0.9%	0.80 / 0.80 / -0.2%
tpcds_q39/duckdb:duckdb	19360518 / 19106644 / +1.3%	25119956 / 24657703 / +1.9%	0.77 / 0.77 / -0.5%
tpcds_q40/duckdb:duckdb	8357504 / 8345522 / +0.1%	16416841 / 15376096 / +6.8%	0.51 / 0.54 / -6.2%
tpcds_q41/duckdb:duckdb	10039657 / 10311401 / -2.6%	16867393 / 17190992 / -1.9%	0.60 / 0.60 / -0.8%
tpcds_q42/duckdb:duckdb	4760509 / 4703648 / +1.2%	11491653 / 10968928 / +4.8%	0.41 / 0.43 / -3.4%
tpcds_q43/duckdb:duckdb	7507062 / 7474740 / +0.4%	15496955 / 15063342 / +2.9%	0.48 / 0.50 / -2.4%
tpcds_q44/duckdb:duckdb	9298934 / 9226984 / +0.8%	18841230 / 17859255 / +5.5%	0.49 / 0.52 / -4.5%
tpcds_q45/duckdb:duckdb	13606617 / 13435865 / +1.3%	22846430 / 21564761 / +5.9%	0.60 / 0.62 / -4.4%
tpcds_q46/duckdb:duckdb	25245150 / 24921975 / +1.3%	37589137 / 33995157 / +10.6% 🔴	0.67 / 0.73 / -8.4%
tpcds_q47/duckdb:duckdb	33562008 / 33178636 / +1.2%	42412359 / 40063879 / +5.9%	0.79 / 0.83 / -4.4%
tpcds_q48/duckdb:duckdb	27084446 / 27372152 / -1.1%	36560886 / 36048493 / +1.4%	0.74 / 0.76 / -2.4%
tpcds_q49/duckdb:duckdb	14510191 / 14566096 / -0.4%	24925135 / 23755317 / +4.9%	0.58 / 0.61 / -5.1%
tpcds_q50/duckdb:duckdb	10005645 / 9845710 / +1.6%	18674152 / 16898080 / +10.5% 🔴	0.54 / 0.58 / -8.0%
tpcds_q51/duckdb:duckdb	46563517 / 46199394 / +0.8%	69514717 / 72060238 / -3.5%	0.67 / 0.64 / +4.5%
tpcds_q52/duckdb:duckdb	4918896 / 4901698 / +0.4%	11454022 / 11084276 / +3.3%	0.43 / 0.44 / -2.9%
tpcds_q53/duckdb:duckdb	9377200 / 9291971 / +0.9%	17815276 / 16513432 / +7.9%	0.53 / 0.56 / -6.5%
tpcds_q54/duckdb:duckdb	11792520 / 11790444 / +0.0%	22078092 / 21440835 / +3.0%	0.53 / 0.55 / -2.9%
tpcds_q55/duckdb:duckdb	4839926 / 4728634 / +2.4%	11122767 / 10771129 / +3.3%	0.44 / 0.44 / -0.9%
tpcds_q56/duckdb:duckdb	10300544 / 10210723 / +0.9%	18115771 / 17103503 / +5.9%	0.57 / 0.60 / -4.8%
tpcds_q57/duckdb:duckdb	27771410 / 27535901 / +0.9%	35104890 / 34305449 / +2.3%	0.79 / 0.80 / -1.4%
tpcds_q58/duckdb:duckdb	10698143 / 10872236 / -1.6%	18269860 / 17349605 / +5.3%	0.59 / 0.63 / -6.6%
tpcds_q59/duckdb:duckdb	16736368 / 16787882 / -0.3%	24299553 / 23381972 / +3.9%	0.69 / 0.72 / -4.1%
tpcds_q60/duckdb:duckdb	10997752 / 11119322 / -1.1%	18411232 / 17285496 / +6.5%	0.60 / 0.64 / -7.1%
tpcds_q61/duckdb:duckdb	10078885 / 10021466 / +0.6%	18703160 / 18332940 / +2.0%	0.54 / 0.55 / -1.4%
tpcds_q62/duckdb:duckdb	8361168 / 8314466 / +0.6%	15214769 / 14619450 / +4.1%	0.55 / 0.57 / -3.4%
tpcds_q63/duckdb:duckdb	8887464 / 8802395 / +1.0%	18037501 / 15727305 / +14.7% 🔴	0.49 / 0.56 / -12.0%
tpcds_q64/duckdb:duckdb	38306145 / 38136667 / +0.4%	56908732 / 53210574 / +7.0%	0.67 / 0.72 / -6.1%
tpcds_q65/duckdb:duckdb	9822234 / 9748496 / +0.8%	19231740 / 18165520 / +5.9%	0.51 / 0.54 / -4.8%
tpcds_q66/duckdb:duckdb	24540735 / 24505846 / +0.1%	32027972 / 31228073 / +2.6%	0.77 / 0.78 / -2.4%
tpcds_q67/duckdb:duckdb	55305557 / 55083714 / +0.4%	65258598 / 63995062 / +2.0%	0.85 / 0.86 / -1.5%
tpcds_q68/duckdb:duckdb	15662064 / 15643589 / +0.1%	27622660 / 25966260 / +6.4%	0.57 / 0.60 / -5.9%
tpcds_q69/duckdb:duckdb	15269940 / 15194591 / +0.5%	24711861 / 24084373 / +2.6%	0.62 / 0.63 / -2.1%
tpcds_q70/duckdb:duckdb	10060814 / 10123466 / -0.6%	21160048 / 19208472 / +10.2% 🔴	0.48 / 0.53 / -9.8%
tpcds_q71/duckdb:duckdb	7967972 / 7801115 / +2.1%	15678962 / 14962919 / +4.8%	0.51 / 0.52 / -2.5%
tpcds_q72/duckdb:duckdb	36101566 / 36351737 / -0.7%	48114292 / 46016615 / +4.6%	0.75 / 0.79 / -5.0%
tpcds_q73/duckdb:duckdb	7997358 / 7898498 / +1.3%	17066554 / 15655093 / +9.0%	0.47 / 0.50 / -7.1%
tpcds_q74/duckdb:duckdb	36333476 / 35643420 / +1.9%	45044700 / 43477994 / +3.6%	0.81 / 0.82 / -1.6%
tpcds_q75/duckdb:duckdb	30006094 / 29839978 / +0.6%	40881704 / 39780912 / +2.8%	0.73 / 0.75 / -2.2%
tpcds_q76/duckdb:duckdb	8201790 / 8070169 / +1.6%	16400085 / 15730530 / +4.3%	0.50 / 0.51 / -2.5%
tpcds_q77/duckdb:duckdb	10527869 / 10663882 / -1.3%	19962550 / 20028828 / -0.3%	0.53 / 0.53 / -0.9%
tpcds_q78/duckdb:duckdb	64421594 / 65112888 / -1.1%	75098540 / 74176859 / +1.2%	0.86 / 0.88 / -2.3%
tpcds_q79/duckdb:duckdb	12162416 / 12102198 / +0.5%	22092505 / 21308821 / +3.7%	0.55 / 0.57 / -3.1%
tpcds_q80/duckdb:duckdb	17015682 / 16811242 / +1.2%	29760180 / 28251530 / +5.3%	0.57 / 0.60 / -3.9%
tpcds_q81/duckdb:duckdb	25334495 / 25259258 / +0.3%	38651984 / 37549873 / +2.9%	0.66 / 0.67 / -2.6%
tpcds_q82/duckdb:duckdb	5819334 / 5650114 / +3.0%	14822474 / 13741258 / +7.9%	0.39 / 0.41 / -4.5%
tpcds_q83/duckdb:duckdb	8996502 / 8995372 / +0.0%	14872477 / 14754493 / +0.8%	0.60 / 0.61 / -0.8%
tpcds_q84/duckdb:duckdb	9322071 / 9143568 / +2.0%	18502604 / 17315418 / +6.9%	0.50 / 0.53 / -4.6%
tpcds_q85/duckdb:duckdb	21245488 / 21245658 / -0.0%	35719736 / 34217308 / +4.4%	0.59 / 0.62 / -4.2%
tpcds_q86/duckdb:duckdb	8546202 / 8560470 / -0.2%	15380837 / 14956440 / +2.8%	0.56 / 0.57 / -2.9%
tpcds_q87/duckdb:duckdb	24771524 / 24875306 / -0.4%	31529329 / 32049598 / -1.6%	0.79 / 0.78 / +1.2%
tpcds_q88/duckdb:duckdb	18733638 / 18581534 / +0.8%	25322692 / 24536164 / +3.2%	0.74 / 0.76 / -2.3%
tpcds_q89/duckdb:duckdb	10319060 / 10230590 / +0.9%	19955162 / 17715249 / +12.6% 🔴	0.52 / 0.58 / -10.5%
tpcds_q90/duckdb:duckdb	4905858 / 4799128 / +2.2%	10581066 / 10204381 / +3.7%	0.46 / 0.47 / -1.4%
tpcds_q91/duckdb:duckdb	8899022 / 8626110 / +3.2%	18737839 / 17483152 / +7.2%	0.47 / 0.49 / -3.7%
tpcds_q92/duckdb:duckdb	6798336 / 6740122 / +0.9%	14672869 / 14138006 / +3.8%	0.46 / 0.48 / -2.8%
tpcds_q93/duckdb:duckdb	6921910 / 6884984 / +0.5%	14773415 / 13892270 / +6.3%	0.47 / 0.50 / -5.5%
tpcds_q94/duckdb:duckdb	11774919 / 11665031 / +0.9%	22971447 / 21257459 / +8.1%	0.51 / 0.55 / -6.6%
tpcds_q95/duckdb:duckdb	35291714 / 35309367 / -0.0%	44660971 / 43658117 / +2.3%	0.79 / 0.81 / -2.3%
tpcds_q96/duckdb:duckdb	3786280 / 3809419 / -0.6%	9516085 / 9072294 / +4.9%	0.40 / 0.42 / -5.2%
tpcds_q97/duckdb:duckdb	21520113 / 21560100 / -0.2%	27472612 / 26919004 / +2.1%	0.78 / 0.80 / -2.2%
tpcds_q98/duckdb:duckdb	10656515 / 10637099 / +0.2%	19905034 / 18729090 / +6.3%	0.54 / 0.57 / -5.7%
tpcds_q99/duckdb:duckdb	13006550 / 13020235 / -0.1%	19760490 / 19376058 / +2.0%	0.66 / 0.67 / -2.0%

github-actions · 2026-11-02T20:21:06Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (+1.2%, environment too noisy confidence) · DuckDB No clear signal (-4.4%, environment too noisy confidence)
Vortex (geomean): hot 1.041x ➖ · cold 0.967x ➖
Parquet (geomean): hot 1.058x ➖ · cold 1.075x ➖
Shifts: Parquet (control) +5.8% · Median polish +2.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.016x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	222799001 / 245993335 / -9.4%	730881562 / 910537073 / -19.7%	0.30 / 0.27 / +12.8%
tpch_q02/datafusion:vortex-file-compressed	334120108 / 333592816 / +0.2%	723379619 / 644829940 / +12.2%	0.46 / 0.52 / -10.7%
tpch_q03/datafusion:vortex-file-compressed	377762853 / 353633800 / +6.8%	906104031 / 960623178 / -5.7%	0.42 / 0.37 / +13.3%
tpch_q04/datafusion:vortex-file-compressed	192263306 / 199500751 / -3.6%	461889158 / 403738570 / +14.4%	0.42 / 0.49 / -15.8%
tpch_q05/datafusion:vortex-file-compressed	554921196 / 444080268 / +25.0%	640708971 / 636474937 / +0.7%	0.87 / 0.70 / +24.1%
tpch_q06/datafusion:vortex-file-compressed	144856086 / 154973215 / -6.5%	299564557 / 327720472 / -8.6%	0.48 / 0.47 / +2.3%
tpch_q07/datafusion:vortex-file-compressed	399557412 / 375517487 / +6.4%	699058000 / 610809400 / +14.4%	0.57 / 0.61 / -7.0%
tpch_q08/datafusion:vortex-file-compressed	457112396 / 455055417 / +0.5%	645290531 / 606504673 / +6.4%	0.71 / 0.75 / -5.6%
tpch_q09/datafusion:vortex-file-compressed	426913591 / 318152284 / +34.2% 🔴	673743491 / 982080409 / -31.4% 🟢	0.63 / 0.32 / +95.6%
tpch_q10/datafusion:vortex-file-compressed	385114674 / 347523803 / +10.8%	486259129 / 499766060 / -2.7%	0.79 / 0.70 / +13.9%
tpch_q11/datafusion:vortex-file-compressed	272754307 / 295059031 / -7.6%	430203267 / 417647128 / +3.0%	0.63 / 0.71 / -10.3%
tpch_q12/datafusion:vortex-file-compressed	220033509 / 206901658 / +6.3%	402840418 / 460803162 / -12.6%	0.55 / 0.45 / +21.6%
tpch_q13/datafusion:vortex-file-compressed	138645226 / 136796590 / +1.4%	370384831 / 334101599 / +10.9%	0.37 / 0.41 / -8.6%
tpch_q14/datafusion:vortex-file-compressed	174303794 / 202732316 / -14.0%	423561073 / 364508570 / +16.2%	0.41 / 0.56 / -26.0%
tpch_q15/datafusion:vortex-file-compressed	329025568 / 301980784 / +9.0%	571772864 / 528565230 / +8.2%	0.58 / 0.57 / +0.7%
tpch_q16/datafusion:vortex-file-compressed	131782948 / 133162469 / -1.0%	285719688 / 279952079 / +2.1%	0.46 / 0.48 / -3.0%
tpch_q17/datafusion:vortex-file-compressed	239091787 / 338599807 / -29.4%	403550090 / 698242054 / -42.2% 🟢	0.59 / 0.48 / +22.2%
tpch_q18/datafusion:vortex-file-compressed	233594703 / 251478873 / -7.1%	487125227 / 462427132 / +5.3%	0.48 / 0.54 / -11.8%
tpch_q19/datafusion:vortex-file-compressed	265757984 / 219484622 / +21.1%	403219748 / 356363469 / +13.1%	0.66 / 0.62 / +7.0%
tpch_q20/datafusion:vortex-file-compressed	267189169 / 267390889 / -0.1%	455572482 / 471834065 / -3.4%	0.59 / 0.57 / +3.5%
tpch_q21/datafusion:vortex-file-compressed	425445017 / 450729835 / -5.6%	690666101 / 701080826 / -1.5%	0.62 / 0.64 / -4.2%
tpch_q22/datafusion:vortex-file-compressed	169765843 / 144461434 / +17.5%	377869284 / 383098740 / -1.4%	0.45 / 0.38 / +19.1%

datafusion / vortex-compact / ns (1.057x ➖, 1↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	228919664 / 230645285 / -0.7%	581541959 / 727340825 / -20.0%	0.39 / 0.32 / +24.1%
tpch_q02/datafusion:vortex-compact	308002223 / 302577979 / +1.8%	589479017 / 581668872 / +1.3%	0.52 / 0.52 / +0.4%
tpch_q03/datafusion:vortex-compact	322918802 / 324111444 / -0.4%	636126560 / 629468101 / +1.1%	0.51 / 0.51 / -1.4%
tpch_q04/datafusion:vortex-compact	155363190 / 143627680 / +8.2%	344085459 / 365772728 / -5.9%	0.45 / 0.39 / +15.0%
tpch_q05/datafusion:vortex-compact	365352655 / 423271170 / -13.7%	560941215 / 745035732 / -24.7%	0.65 / 0.57 / +14.6%
tpch_q06/datafusion:vortex-compact	181366219 / 140457330 / +29.1%	301032494 / 308179041 / -2.3%	0.60 / 0.46 / +32.2%
tpch_q07/datafusion:vortex-compact	512904362 / 398058829 / +28.9%	568899245 / 544942137 / +4.4%	0.90 / 0.73 / +23.4%
tpch_q08/datafusion:vortex-compact	383928466 / 616616396 / -37.7% 🟢	613646678 / 671271265 / -8.6%	0.63 / 0.92 / -31.9%
tpch_q09/datafusion:vortex-compact	248775875 / 329230412 / -24.4%	489724693 / 585413192 / -16.3%	0.51 / 0.56 / -9.7%
tpch_q10/datafusion:vortex-compact	320072706 / 298625832 / +7.2%	457681903 / 484970796 / -5.6%	0.70 / 0.62 / +13.6%
tpch_q11/datafusion:vortex-compact	273192864 / 261990929 / +4.3%	457367936 / 431312299 / +6.0%	0.60 / 0.61 / -1.7%
tpch_q12/datafusion:vortex-compact	176532410 / 184049349 / -4.1%	357817411 / 380662008 / -6.0%	0.49 / 0.48 / +2.0%
tpch_q13/datafusion:vortex-compact	206418821 / 101823595 / +102.7% 🔴	311326336 / 299586997 / +3.9%	0.66 / 0.34 / +95.1%
tpch_q14/datafusion:vortex-compact	241397784 / 172878036 / +39.6% 🔴	500944452 / 385137169 / +30.1% 🔴	0.48 / 0.45 / +7.4%
tpch_q15/datafusion:vortex-compact	290772903 / 303136055 / -4.1%	493565015 / 513772953 / -3.9%	0.59 / 0.59 / -0.2%
tpch_q16/datafusion:vortex-compact	129310774 / 131438145 / -1.6%	262301785 / 294802265 / -11.0%	0.49 / 0.45 / +10.6%
tpch_q17/datafusion:vortex-compact	240952617 / 235856743 / +2.2%	596934124 / 420791235 / +41.9% 🔴	0.40 / 0.56 / -28.0%
tpch_q18/datafusion:vortex-compact	242203029 / 215459034 / +12.4%	449275004 / 470332869 / -4.5%	0.54 / 0.46 / +17.7%
tpch_q19/datafusion:vortex-compact	252804400 / 243055938 / +4.0%	399728274 / 347395248 / +15.1%	0.63 / 0.70 / -9.6%
tpch_q20/datafusion:vortex-compact	525803244 / 339717042 / +54.8% 🔴	486273750 / 549447850 / -11.5%	1.08 / 0.62 / +74.9%
tpch_q21/datafusion:vortex-compact	413819000 / 437973106 / -5.5%	602056744 / 688846241 / -12.6%	0.69 / 0.64 / +8.1%
tpch_q22/datafusion:vortex-compact	153087104 / 166595078 / -8.1%	431383581 / 351156204 / +22.8%	0.35 / 0.47 / -25.2%

datafusion / parquet / ns (1.024x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	151484338 / 182724258 / -17.1%	595928950 / 546709588 / +9.0%	0.25 / 0.33 / -23.9%
tpch_q02/datafusion:parquet	282188692 / 280345036 / +0.7%	521983257 / 494900441 / +5.5%	0.54 / 0.57 / -4.6%
tpch_q03/datafusion:parquet	223091815 / 234804739 / -5.0%	627112462 / 708564789 / -11.5%	0.36 / 0.33 / +7.4%
tpch_q04/datafusion:parquet	125447129 / 127863074 / -1.9%	306880600 / 333074833 / -7.9%	0.41 / 0.38 / +6.5%
tpch_q05/datafusion:parquet	336688578 / 360011040 / -6.5%	508273251 / 487198721 / +4.3%	0.66 / 0.74 / -10.4%
tpch_q06/datafusion:parquet	112863850 / 103439407 / +9.1%	289655000 / 234001276 / +23.8%	0.39 / 0.44 / -11.9%
tpch_q07/datafusion:parquet	326337467 / 348537955 / -6.4%	476377384 / 439836847 / +8.3%	0.69 / 0.79 / -13.6%
tpch_q08/datafusion:parquet	497032980 / 407374846 / +22.0%	785121181 / 568203964 / +38.2% 🔴	0.63 / 0.72 / -11.7%
tpch_q09/datafusion:parquet	371305681 / 384914193 / -3.5%	528620258 / 538662237 / -1.9%	0.70 / 0.71 / -1.7%
tpch_q10/datafusion:parquet	321074305 / 320973477 / +0.0%	499030462 / 459941189 / +8.5%	0.64 / 0.70 / -7.8%
tpch_q11/datafusion:parquet	259927121 / 300984157 / -13.6%	396120286 / 446088592 / -11.2%	0.66 / 0.67 / -2.7%
tpch_q12/datafusion:parquet	388329677 / 168587410 / +130.3% 🔴	492340614 / 310448926 / +58.6% 🔴	0.79 / 0.54 / +45.2%
tpch_q13/datafusion:parquet	273943017 / 276290550 / -0.8%	468182350 / 441101158 / +6.1%	0.59 / 0.63 / -6.6%
tpch_q14/datafusion:parquet	162023754 / 157323053 / +3.0%	307245660 / 263507670 / +16.6%	0.53 / 0.60 / -11.7%
tpch_q15/datafusion:parquet	311762488 / 300228614 / +3.8%	509791741 / 467117052 / +9.1%	0.61 / 0.64 / -4.9%
tpch_q16/datafusion:parquet	98181648 / 104021157 / -5.6%	195288090 / 193667244 / +0.8%	0.50 / 0.54 / -6.4%
tpch_q17/datafusion:parquet	289324309 / 273634241 / +5.7%	440365929 / 436319530 / +0.9%	0.66 / 0.63 / +4.8%
tpch_q18/datafusion:parquet	319307878 / 357046730 / -10.6%	846029245 / 706692668 / +19.7%	0.38 / 0.51 / -25.3%
tpch_q19/datafusion:parquet	166548030 / 162935006 / +2.2%	272271460 / 343465507 / -20.7%	0.61 / 0.47 / +28.9%
tpch_q20/datafusion:parquet	254606775 / 256844823 / -0.9%	345296572 / 365148572 / -5.4%	0.74 / 0.70 / +4.8%
tpch_q21/datafusion:parquet	329855008 / 338339069 / -2.5%	584647061 / 469511973 / +24.5%	0.56 / 0.72 / -21.7%
tpch_q22/datafusion:parquet	157413186 / 152287823 / +3.4%	356669019 / 336554910 / +6.0%	0.44 / 0.45 / -2.5%

duckdb / vortex-file-compressed / ns (1.038x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	253724038 / 261291193 / -2.9%	233084835 / 278110766 / -16.2%	1.09 / 0.94 / +15.9%
tpch_q02/duckdb:vortex-file-compressed	460318253 / 402265191 / +14.4%	495863578 / 465849393 / +6.4%	0.93 / 0.86 / +7.5%
tpch_q03/duckdb:vortex-file-compressed	455447885 / 409748201 / +11.2%	516021029 / 554425991 / -6.9%	0.88 / 0.74 / +19.4%
tpch_q04/duckdb:vortex-file-compressed	518904789 / 256629075 / +102.2% 🔴	313554593 / 306922380 / +2.2%	1.65 / 0.84 / +97.9%
tpch_q05/duckdb:vortex-file-compressed	549776329 / 523038533 / +5.1%	605180251 / 683599537 / -11.5%	0.91 / 0.77 / +18.7%
tpch_q06/duckdb:vortex-file-compressed	176968996 / 163475519 / +8.3%	203189588 / 216946864 / -6.3%	0.87 / 0.75 / +15.6%
tpch_q07/duckdb:vortex-file-compressed	443900155 / 462644916 / -4.1%	479653960 / 427583379 / +12.2%	0.93 / 1.08 / -14.5%
tpch_q08/duckdb:vortex-file-compressed	613373698 / 562199133 / +9.1%	646717325 / 646753789 / -0.0%	0.95 / 0.87 / +9.1%
tpch_q09/duckdb:vortex-file-compressed	411371643 / 383597237 / +7.2%	501199246 / 450542014 / +11.2%	0.82 / 0.85 / -3.6%
tpch_q10/duckdb:vortex-file-compressed	532535938 / 526446506 / +1.2%	568170202 / 552031697 / +2.9%	0.94 / 0.95 / -1.7%
tpch_q11/duckdb:vortex-file-compressed	291571878 / 354252073 / -17.7%	294284504 / 292875433 / +0.5%	0.99 / 1.21 / -18.1%
tpch_q12/duckdb:vortex-file-compressed	226749131 / 239275361 / -5.2%	294214687 / 322989416 / -8.9%	0.77 / 0.74 / +4.0%
tpch_q13/duckdb:vortex-file-compressed	223206376 / 246112562 / -9.3%	304004878 / 251205136 / +21.0%	0.73 / 0.98 / -25.1%
tpch_q14/duckdb:vortex-file-compressed	241065412 / 243326581 / -0.9%	296264300 / 308130046 / -3.9%	0.81 / 0.79 / +3.0%
tpch_q15/duckdb:vortex-file-compressed	243652149 / 262739966 / -7.3%	255942199 / 305517770 / -16.2%	0.95 / 0.86 / +10.7%
tpch_q16/duckdb:vortex-file-compressed	199752327 / 210857471 / -5.3%	214006912 / 252270717 / -15.2%	0.93 / 0.84 / +11.7%
tpch_q17/duckdb:vortex-file-compressed	374591095 / 312501002 / +19.9%	363726697 / 546371771 / -33.4% 🟢	1.03 / 0.57 / +80.1%
tpch_q18/duckdb:vortex-file-compressed	395341535 / 356294315 / +11.0%	455126504 / 404867677 / +12.4%	0.87 / 0.88 / -1.3%
tpch_q19/duckdb:vortex-file-compressed	303195316 / 337506807 / -10.2%	341607920 / 336075111 / +1.6%	0.89 / 1.00 / -11.6%
tpch_q20/duckdb:vortex-file-compressed	352539696 / 347020802 / +1.6%	429017203 / 429983932 / -0.2%	0.82 / 0.81 / +1.8%
tpch_q21/duckdb:vortex-file-compressed	657404197 / 759791657 / -13.5%	729419334 / 925914844 / -21.2%	0.90 / 0.82 / +9.8%
tpch_q22/duckdb:vortex-file-compressed	250057505 / 229015955 / +9.2%	295081823 / 373945909 / -21.1%	0.85 / 0.61 / +38.4%

duckdb / vortex-compact / ns (1.053x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	251206024 / 276602371 / -9.2%	262447302 / 389712733 / -32.7% 🟢	0.96 / 0.71 / +34.9%
tpch_q02/duckdb:vortex-compact	435156028 / 402417783 / +8.1%	468911014 / 429126071 / +9.3%	0.93 / 0.94 / -1.0%
tpch_q03/duckdb:vortex-compact	383308177 / 373288323 / +2.7%	427615400 / 389776837 / +9.7%	0.90 / 0.96 / -6.4%
tpch_q04/duckdb:vortex-compact	371110820 / 221029648 / +67.9% 🔴	341824707 / 255400023 / +33.8% 🔴	1.09 / 0.87 / +25.4%
tpch_q05/duckdb:vortex-compact	494491147 / 517262357 / -4.4%	552458422 / 741671092 / -25.5%	0.90 / 0.70 / +28.3%
tpch_q06/duckdb:vortex-compact	219463334 / 173821627 / +26.3%	221844392 / 207812990 / +6.8%	0.99 / 0.84 / +18.3%
tpch_q07/duckdb:vortex-compact	514813648 / 403360508 / +27.6%	620439907 / 487990448 / +27.1%	0.83 / 0.83 / +0.4%
tpch_q08/duckdb:vortex-compact	566776308 / 592596261 / -4.4%	720639268 / 760984180 / -5.3%	0.79 / 0.78 / +1.0%
tpch_q09/duckdb:vortex-compact	403642926 / 416493539 / -3.1%	459419503 / 502149396 / -8.5%	0.88 / 0.83 / +5.9%
tpch_q10/duckdb:vortex-compact	499521437 / 472072234 / +5.8%	718705300 / 443455430 / +62.1% 🔴	0.70 / 1.06 / -34.7%
tpch_q11/duckdb:vortex-compact	350522162 / 271011388 / +29.3%	317144329 / 334567212 / -5.2%	1.11 / 0.81 / +36.4%
tpch_q12/duckdb:vortex-compact	227370750 / 323457376 / -29.7%	291400945 / 514572005 / -43.4% 🟢	0.78 / 0.63 / +24.1%
tpch_q13/duckdb:vortex-compact	206057292 / 199334634 / +3.4%	305431129 / 292561272 / +4.4%	0.67 / 0.68 / -1.0%
tpch_q14/duckdb:vortex-compact	244118606 / 219231044 / +11.4%	265451196 / 292794495 / -9.3%	0.92 / 0.75 / +22.8%
tpch_q15/duckdb:vortex-compact	244433999 / 252212965 / -3.1%	257291766 / 320553591 / -19.7%	0.95 / 0.79 / +20.7%
tpch_q16/duckdb:vortex-compact	195036663 / 193711184 / +0.7%	205452609 / 231271252 / -11.2%	0.95 / 0.84 / +13.3%
tpch_q17/duckdb:vortex-compact	331703599 / 305268751 / +8.7%	356363578 / 370591967 / -3.8%	0.93 / 0.82 / +13.0%
tpch_q18/duckdb:vortex-compact	307529208 / 321922518 / -4.5%	318400224 / 333704003 / -4.6%	0.97 / 0.96 / +0.1%
tpch_q19/duckdb:vortex-compact	291018742 / 293123878 / -0.7%	341075877 / 325718126 / +4.7%	0.85 / 0.90 / -5.2%
tpch_q20/duckdb:vortex-compact	373676894 / 329290921 / +13.5%	424185071 / 446779090 / -5.1%	0.88 / 0.74 / +19.5%
tpch_q21/duckdb:vortex-compact	591181163 / 632290249 / -6.5%	611681754 / 795665930 / -23.1%	0.97 / 0.79 / +21.6%
tpch_q22/duckdb:vortex-compact	256168640 / 233090480 / +9.9%	293724815 / 307951805 / -4.6%	0.87 / 0.76 / +15.2%

duckdb / parquet / ns (1.093x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	195209296 / 155141817 / +25.8%	288493516 / 172388044 / +67.4% 🔴	0.68 / 0.90 / -24.8%
tpch_q02/duckdb:parquet	452063888 / 394841707 / +14.5%	466269194 / 403969101 / +15.4%	0.97 / 0.98 / -0.8%
tpch_q03/duckdb:parquet	448180449 / 405756331 / +10.5%	443003315 / 451438469 / -1.9%	1.01 / 0.90 / +12.6%
tpch_q04/duckdb:parquet	241098950 / 266322631 / -9.5%	399625290 / 379350411 / +5.3%	0.60 / 0.70 / -14.1%
tpch_q05/duckdb:parquet	541515916 / 585227714 / -7.5%	492387906 / 557420533 / -11.7%	1.10 / 1.05 / +4.8%
tpch_q06/duckdb:parquet	145316575 / 166668090 / -12.8%	203077793 / 198410501 / +2.4%	0.72 / 0.84 / -14.8%
tpch_q07/duckdb:parquet	445365527 / 437881868 / +1.7%	465055832 / 474587877 / -2.0%	0.96 / 0.92 / +3.8%
tpch_q08/duckdb:parquet	654688577 / 646557741 / +1.3%	692934416 / 753109790 / -8.0%	0.94 / 0.86 / +10.1%
tpch_q09/duckdb:parquet	601081182 / 597329360 / +0.6%	759910694 / 653280360 / +16.3%	0.79 / 0.91 / -13.5%
tpch_q10/duckdb:parquet	654734059 / 519585881 / +26.0%	634680457 / 660605230 / -3.9%	1.03 / 0.79 / +31.2%
tpch_q11/duckdb:parquet	308137967 / 319914594 / -3.7%	325867515 / 294291919 / +10.7%	0.95 / 1.09 / -13.0%
tpch_q12/duckdb:parquet	317432289 / 238604868 / +33.0% 🔴	375921787 / 276146357 / +36.1% 🔴	0.84 / 0.86 / -2.3%
tpch_q13/duckdb:parquet	384419704 / 386485026 / -0.5%	519133369 / 515476238 / +0.7%	0.74 / 0.75 / -1.2%
tpch_q14/duckdb:parquet	444635317 / 271598994 / +63.7% 🔴	784468198 / 353074718 / +122.2% 🔴	0.57 / 0.77 / -26.3%
tpch_q15/duckdb:parquet	319691270 / 233904415 / +36.7% 🔴	452922461 / 318848729 / +42.0% 🔴	0.71 / 0.73 / -3.8%
tpch_q16/duckdb:parquet	305627578 / 289522511 / +5.6%	269692535 / 294696205 / -8.5%	1.13 / 0.98 / +15.3%
tpch_q17/duckdb:parquet	295722132 / 355173238 / -16.7%	328053684 / 408728868 / -19.7%	0.90 / 0.87 / +3.7%
tpch_q18/duckdb:parquet	399900370 / 399316826 / +0.1%	424245713 / 521893395 / -18.7%	0.94 / 0.77 / +23.2%
tpch_q19/duckdb:parquet	288116788 / 232736768 / +23.8%	311644475 / 349748205 / -10.9%	0.92 / 0.67 / +38.9%
tpch_q20/duckdb:parquet	500905975 / 510278041 / -1.8%	659248439 / 669340476 / -1.5%	0.76 / 0.76 / -0.3%
tpch_q21/duckdb:parquet	522261831 / 433777331 / +20.4%	612164644 / 534350522 / +14.6%	0.85 / 0.81 / +5.1%
tpch_q22/duckdb:parquet	326318555 / 254889403 / +28.0%	320993119 / 310238273 / +3.5%	1.02 / 0.82 / +23.7%

github-actions · 2026-11-02T20:24:47Z

Benchmarks: Vortex queries 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 0.987x ➖
Parquet (geomean): hot 1.017x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +1.7% · Median polish +1.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
vortex_q00/datafusion:vortex-file-compressed	131576499 / 130833472 / +0.6%	510696792 / 506663088 / +0.8%	0.26 / 0.26 / -0.2%
vortex_q01/datafusion:vortex-file-compressed	124126926 / 121442388 / +2.2%	295837155 / 279846572 / +5.7%	0.42 / 0.43 / -3.3%
vortex_q02/datafusion:vortex-file-compressed	139350316 / 140232764 / -0.6%	286431507 / 276997944 / +3.4%	0.49 / 0.51 / -3.9%

datafusion / parquet / ns (1.013x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
vortex_q00/datafusion:parquet	135311608 / 135363027 / -0.0%	1146768019 / 1144859625 / +0.2%	0.12 / 0.12 / -0.2%
vortex_q01/datafusion:parquet	69887379 / 67400446 / +3.7%	113126789 / 118279685 / -4.4%	0.62 / 0.57 / +8.4%
vortex_q02/datafusion:parquet	288841306 / 288004474 / +0.3%	651252647 / 666077955 / -2.2%	0.44 / 0.43 / +2.6%

duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
vortex_q00/duckdb:vortex-file-compressed	191251102 / 187867357 / +1.8%	959860031 / 921470607 / +4.2%	0.20 / 0.20 / -2.3%
vortex_q01/duckdb:vortex-file-compressed	91010018 / 90685079 / +0.4%	312377566 / 365760504 / -14.6% 🟢	0.29 / 0.25 / +17.5%
vortex_q02/duckdb:vortex-file-compressed	177477102 / 177913323 / -0.2%	477665748 / 505781720 / -5.6%	0.37 / 0.35 / +5.6%

duckdb / parquet / ns (1.021x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
vortex_q00/duckdb:parquet	279631868 / 275863185 / +1.4%	799353210 / 800340898 / -0.1%	0.35 / 0.34 / +1.5%
vortex_q01/duckdb:parquet	164222895 / 159050146 / +3.3%	171020449 / 170335120 / +0.4%	0.96 / 0.93 / +2.8%
vortex_q02/duckdb:parquet	346350433 / 340843293 / +1.6%	643928167 / 578742872 / +11.3% 🔴	0.54 / 0.59 / -8.7%

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

github-actions · 2026-11-02T20:59:14Z

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 1d180587 vs base d8e7467f
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.4%
Engines: DataFusion No clear signal (+1.5%, environment too noisy confidence) · DuckDB No clear signal (-10.0%, environment too noisy confidence)
Vortex (geomean): hot 0.989x ➖ · cold 1.009x ➖
Parquet (geomean): hot 1.035x ➖ · cold 0.995x ➖
Shifts: Parquet (control) +3.5% · Median polish +1.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.025x ➖, 1↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	362841305 / 383347668 / -5.3%	939643725 / 1215198650 / -22.7%	0.39 / 0.32 / +22.4%
tpch_q02/datafusion:vortex-file-compressed	531862185 / 491213500 / +8.3%	1129464339 / 1005600810 / +12.3%	0.47 / 0.49 / -3.6%
tpch_q03/datafusion:vortex-file-compressed	543082270 / 574326849 / -5.4%	1379328248 / 1262748486 / +9.2%	0.39 / 0.45 / -13.4%
tpch_q04/datafusion:vortex-file-compressed	416978694 / 470738590 / -11.4%	692530716 / 624783598 / +10.8%	0.60 / 0.75 / -20.1%
tpch_q05/datafusion:vortex-file-compressed	730566719 / 696884947 / +4.8%	973807326 / 1152513328 / -15.5%	0.75 / 0.60 / +24.1%
tpch_q06/datafusion:vortex-file-compressed	282387822 / 355544313 / -20.6%	493975023 / 483152512 / +2.2%	0.57 / 0.74 / -22.3%
tpch_q07/datafusion:vortex-file-compressed	664747511 / 1011088336 / -34.3% 🟢	974106019 / 1272652829 / -23.5%	0.68 / 0.79 / -14.1%
tpch_q08/datafusion:vortex-file-compressed	1293798292 / 1030886522 / +25.5%	1698372144 / 1221431394 / +39.0% 🔴	0.76 / 0.84 / -9.7%
tpch_q09/datafusion:vortex-file-compressed	946999387 / 818139441 / +15.8%	1255761322 / 1097365756 / +14.4%	0.75 / 0.75 / +1.2%
tpch_q10/datafusion:vortex-file-compressed	729618788 / 604822400 / +20.6%	1164425924 / 967909144 / +20.3%	0.63 / 0.62 / +0.3%
tpch_q11/datafusion:vortex-file-compressed	527401308 / 388950811 / +35.6% 🔴	1046418428 / 583962395 / +79.2% 🔴	0.50 / 0.67 / -24.3%
tpch_q12/datafusion:vortex-file-compressed	385606722 / 390276636 / -1.2%	606726514 / 625290839 / -3.0%	0.64 / 0.62 / +1.8%
tpch_q13/datafusion:vortex-file-compressed	283244795 / 270301423 / +4.8%	533628642 / 495290001 / +7.7%	0.53 / 0.55 / -2.7%
tpch_q14/datafusion:vortex-file-compressed	410789738 / 397535871 / +3.3%	570907653 / 456731416 / +25.0%	0.72 / 0.87 / -17.3%
tpch_q15/datafusion:vortex-file-compressed	579254224 / 619296930 / -6.5%	962608677 / 1059679233 / -9.2%	0.60 / 0.58 / +3.0%
tpch_q16/datafusion:vortex-file-compressed	984844046 / 514867852 / +91.3% 🔴	2253242667 / 856553613 / +163.1% 🔴	0.44 / 0.60 / -27.3%
tpch_q17/datafusion:vortex-file-compressed	763949229 / 787849239 / -3.0%	830789772 / 1006999537 / -17.5%	0.92 / 0.78 / +17.5%
tpch_q18/datafusion:vortex-file-compressed	1029172182 / 935007454 / +10.1%	1043052374 / 1009150755 / +3.4%	0.99 / 0.93 / +6.5%
tpch_q19/datafusion:vortex-file-compressed	421778180 / 452823832 / -6.9%	734530938 / 668069990 / +9.9%	0.57 / 0.68 / -15.3%
tpch_q20/datafusion:vortex-file-compressed	529633557 / 578343950 / -8.4%	877391202 / 700246795 / +25.3%	0.60 / 0.83 / -26.9%
tpch_q21/datafusion:vortex-file-compressed	987748935 / 1185635450 / -16.7%	1136753336 / 1307206435 / -13.0%	0.87 / 0.91 / -4.2%
tpch_q22/datafusion:vortex-file-compressed	281584416 / 262824428 / +7.1%	1032727693 / 733317999 / +40.8% 🔴	0.27 / 0.36 / -23.9%

datafusion / vortex-compact / ns (1.039x ➖, 1↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	390488648 / 347962693 / +12.2%	817253665 / 819741516 / -0.3%	0.48 / 0.42 / +12.6%
tpch_q02/datafusion:vortex-compact	530059130 / 498994619 / +6.2%	953609869 / 988055288 / -3.5%	0.56 / 0.51 / +10.1%
tpch_q03/datafusion:vortex-compact	482393282 / 488173475 / -1.2%	1297251052 / 1245735380 / +4.1%	0.37 / 0.39 / -5.1%
tpch_q04/datafusion:vortex-compact	344931426 / 418890080 / -17.7%	540352212 / 520771949 / +3.8%	0.64 / 0.80 / -20.6%
tpch_q05/datafusion:vortex-compact	689605044 / 664842292 / +3.7%	899061405 / 846697366 / +6.2%	0.77 / 0.79 / -2.3%
tpch_q06/datafusion:vortex-compact	224429841 / 212218206 / +5.8%	459976788 / 394605981 / +16.6%	0.49 / 0.54 / -9.3%
tpch_q07/datafusion:vortex-compact	826632904 / 571442001 / +44.7% 🔴	1135368889 / 872914465 / +30.1% 🔴	0.73 / 0.65 / +11.2%
tpch_q08/datafusion:vortex-compact	998208363 / 843150582 / +18.4%	1234717819 / 1146552299 / +7.7%	0.81 / 0.74 / +9.9%
tpch_q09/datafusion:vortex-compact	704554447 / 716282006 / -1.6%	1152123068 / 1078559543 / +6.8%	0.61 / 0.66 / -7.9%
tpch_q10/datafusion:vortex-compact	507428126 / 1233988357 / -58.9% 🟢	834912012 / 1243388910 / -32.9% 🟢	0.61 / 0.99 / -38.8%
tpch_q11/datafusion:vortex-compact	365858374 / 354253761 / +3.3%	699049361 / 538460682 / +29.8%	0.52 / 0.66 / -20.4%
tpch_q12/datafusion:vortex-compact	358161333 / 395824633 / -9.5%	457043247 / 634048508 / -27.9%	0.78 / 0.62 / +25.5%
tpch_q13/datafusion:vortex-compact	372036794 / 266774454 / +39.5% 🔴	711361624 / 486658905 / +46.2% 🔴	0.52 / 0.55 / -4.6%
tpch_q14/datafusion:vortex-compact	331631856 / 366296939 / -9.5%	584539657 / 448161584 / +30.4% 🔴	0.57 / 0.82 / -30.6%
tpch_q15/datafusion:vortex-compact	604331339 / 670325784 / -9.8%	816980864 / 1019831885 / -19.9%	0.74 / 0.66 / +12.5%
tpch_q16/datafusion:vortex-compact	359353664 / 242853518 / +48.0% 🔴	743076619 / 458179887 / +62.2% 🔴	0.48 / 0.53 / -8.8%
tpch_q17/datafusion:vortex-compact	777934138 / 763711207 / +1.9%	806317334 / 796478057 / +1.2%	0.96 / 0.96 / +0.6%
tpch_q18/datafusion:vortex-compact	710038501 / 576582452 / +23.1%	666974861 / 731483027 / -8.8%	1.06 / 0.79 / +35.1%
tpch_q19/datafusion:vortex-compact	392928746 / 376549389 / +4.3%	606775491 / 502492660 / +20.8%	0.65 / 0.75 / -13.6%
tpch_q20/datafusion:vortex-compact	566784655 / 487507951 / +16.3%	828877830 / 668866734 / +23.9%	0.68 / 0.73 / -6.2%
tpch_q21/datafusion:vortex-compact	1225406842 / 898148080 / +36.4% 🔴	1320700823 / 1046159611 / +26.2%	0.93 / 0.86 / +8.1%
tpch_q22/datafusion:vortex-compact	261072784 / 273231840 / -4.5%	539775672 / 582088844 / -7.3%	0.48 / 0.47 / +3.0%

datafusion / parquet / ns (1.017x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	246191573 / 246337069 / -0.1%	641599577 / 609031626 / +5.3%	0.38 / 0.40 / -5.1%
tpch_q02/datafusion:parquet	459547212 / 443952978 / +3.5%	933518674 / 1158185970 / -19.4%	0.49 / 0.38 / +28.4%
tpch_q03/datafusion:parquet	601558247 / 501838898 / +19.9%	1078055174 / 1027765584 / +4.9%	0.56 / 0.49 / +14.3%
tpch_q04/datafusion:parquet	352584120 / 269168938 / +31.0% 🔴	487778468 / 492332019 / -0.9%	0.72 / 0.55 / +32.2%
tpch_q05/datafusion:parquet	604108029 / 601894956 / +0.4%	918003342 / 786015642 / +16.8%	0.66 / 0.77 / -14.1%
tpch_q06/datafusion:parquet	212943829 / 190210738 / +12.0%	327644285 / 399192700 / -17.9%	0.65 / 0.48 / +36.4%
tpch_q07/datafusion:parquet	626361308 / 843118109 / -25.7%	778483586 / 956911545 / -18.6%	0.80 / 0.88 / -8.7%
tpch_q08/datafusion:parquet	678397767 / 669426821 / +1.3%	1107590221 / 1035739116 / +6.9%	0.61 / 0.65 / -5.2%
tpch_q09/datafusion:parquet	862499079 / 1110850516 / -22.4%	1056234373 / 1352893758 / -21.9%	0.82 / 0.82 / -0.5%
tpch_q10/datafusion:parquet	1067923469 / 1058577668 / +0.9%	1241490356 / 1605596636 / -22.7%	0.86 / 0.66 / +30.5%
tpch_q11/datafusion:parquet	371641060 / 371955132 / -0.1%	662794358 / 525172879 / +26.2%	0.56 / 0.71 / -20.8%
tpch_q12/datafusion:parquet	374691718 / 375831375 / -0.3%	509432034 / 519583004 / -2.0%	0.74 / 0.72 / +1.7%
tpch_q13/datafusion:parquet	396912393 / 403666139 / -1.7%	712498967 / 709002601 / +0.5%	0.56 / 0.57 / -2.2%
tpch_q14/datafusion:parquet	406793884 / 406040621 / +0.2%	634611821 / 641296946 / -1.0%	0.64 / 0.63 / +1.2%
tpch_q15/datafusion:parquet	661419821 / 552210312 / +19.8%	924858624 / 738317671 / +25.3%	0.72 / 0.75 / -4.4%
tpch_q16/datafusion:parquet	201626665 / 214678332 / -6.1%	422329792 / 475638616 / -11.2%	0.48 / 0.45 / +5.8%
tpch_q17/datafusion:parquet	584024358 / 727930079 / -19.8%	817791060 / 738514960 / +10.7%	0.71 / 0.99 / -27.5%
tpch_q18/datafusion:parquet	739843606 / 524517650 / +41.1% 🔴	957487319 / 694798327 / +37.8% 🔴	0.77 / 0.75 / +2.4%
tpch_q19/datafusion:parquet	444829912 / 464796009 / -4.3%	523105121 / 563339990 / -7.1%	0.85 / 0.83 / +3.1%
tpch_q20/datafusion:parquet	1013421415 / 799523552 / +26.8%	994463146 / 1038556152 / -4.2%	1.02 / 0.77 / +32.4%
tpch_q21/datafusion:parquet	903056009 / 1033475314 / -12.6%	1081102249 / 1083865315 / -0.3%	0.84 / 0.95 / -12.4%
tpch_q22/datafusion:parquet	403025097 / 397549343 / +1.4%	702334641 / 642804544 / +9.3%	0.57 / 0.62 / -7.2%

duckdb / vortex-file-compressed / ns (0.931x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	1068688437 / 920182327 / +16.1%	1271541076 / 1331932788 / -4.5%	0.84 / 0.69 / +21.7%
tpch_q02/duckdb:vortex-file-compressed	638416041 / 528962565 / +20.7%	730897856 / 739936322 / -1.2%	0.87 / 0.71 / +22.2%
tpch_q03/duckdb:vortex-file-compressed	1219212972 / 1182472843 / +3.1%	1636858613 / 1494569947 / +9.5%	0.74 / 0.79 / -5.9%
tpch_q04/duckdb:vortex-file-compressed	972871622 / 953188069 / +2.1%	1188079556 / 1181377751 / +0.6%	0.82 / 0.81 / +1.5%
tpch_q05/duckdb:vortex-file-compressed	1100254519 / 1126527568 / -2.3%	1379891800 / 1431271820 / -3.6%	0.80 / 0.79 / +1.3%
tpch_q06/duckdb:vortex-file-compressed	750197519 / 806058902 / -6.9%	851049286 / 986197609 / -13.7%	0.88 / 0.82 / +7.8%
tpch_q07/duckdb:vortex-file-compressed	1320569564 / 1194216407 / +10.6%	1518111284 / 1367485532 / +11.0%	0.87 / 0.87 / -0.4%
tpch_q08/duckdb:vortex-file-compressed	1165207337 / 1213786619 / -4.0%	1411545292 / 1440450804 / -2.0%	0.83 / 0.84 / -2.0%
tpch_q09/duckdb:vortex-file-compressed	1319641130 / 1339460196 / -1.5%	1607910901 / 1608440997 / -0.0%	0.82 / 0.83 / -1.4%
tpch_q10/duckdb:vortex-file-compressed	1586661818 / 1405520831 / +12.9%	1604446991 / 1758181831 / -8.7%	0.99 / 0.80 / +23.7%
tpch_q11/duckdb:vortex-file-compressed	373398063 / 357892821 / +4.3%	408120624 / 583253316 / -30.0% 🟢	0.91 / 0.61 / +49.1%
tpch_q12/duckdb:vortex-file-compressed	906783275 / 973817770 / -6.9%	1166262939 / 1282948364 / -9.1%	0.78 / 0.76 / +2.4%
tpch_q13/duckdb:vortex-file-compressed	756809803 / 837066503 / -9.6%	1076351410 / 1166328139 / -7.7%	0.70 / 0.72 / -2.0%
tpch_q14/duckdb:vortex-file-compressed	905774449 / 1074275260 / -15.7%	1075453301 / 1177363877 / -8.7%	0.84 / 0.91 / -7.7%
tpch_q15/duckdb:vortex-file-compressed	829198460 / 856263902 / -3.2%	976116250 / 997446928 / -2.1%	0.85 / 0.86 / -1.0%
tpch_q16/duckdb:vortex-file-compressed	289523883 / 300162483 / -3.5%	329428543 / 380087613 / -13.3%	0.88 / 0.79 / +11.3%
tpch_q17/duckdb:vortex-file-compressed	956496431 / 2357158675 / -59.4% 🟢	1092776855 / 1925021002 / -43.2% 🟢	0.88 / 1.22 / -28.5%
tpch_q18/duckdb:vortex-file-compressed	1336779782 / 1426649987 / -6.3%	1609209279 / 1353935492 / +18.9%	0.83 / 1.05 / -21.2%
tpch_q19/duckdb:vortex-file-compressed	1035411216 / 1069400690 / -3.2%	1152413117 / 1288256368 / -10.5%	0.90 / 0.83 / +8.2%
tpch_q20/duckdb:vortex-file-compressed	1001181030 / 1287659034 / -22.2%	1215597255 / 1582682383 / -23.2%	0.82 / 0.81 / +1.2%
tpch_q21/duckdb:vortex-file-compressed	2482189567 / 3290220353 / -24.6%	2487692669 / 3607447714 / -31.0% 🟢	1.00 / 0.91 / +9.4%
tpch_q22/duckdb:vortex-file-compressed	375217528 / 427384940 / -12.2%	545094782 / 788918011 / -30.9% 🟢	0.69 / 0.54 / +27.1%

duckdb / vortex-compact / ns (0.964x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	883145229 / 999648084 / -11.7%	1335151069 / 1234034120 / +8.2%	0.66 / 0.81 / -18.3%
tpch_q02/duckdb:vortex-compact	499085939 / 565673131 / -11.8%	602146255 / 789706694 / -23.8%	0.83 / 0.72 / +15.7%
tpch_q03/duckdb:vortex-compact	1265714354 / 1254372840 / +0.9%	1893307303 / 1710718694 / +10.7%	0.67 / 0.73 / -8.8%
tpch_q04/duckdb:vortex-compact	858952914 / 858453275 / +0.1%	1029843622 / 1213836061 / -15.2%	0.83 / 0.71 / +17.9%
tpch_q05/duckdb:vortex-compact	1030850224 / 1124326252 / -8.3%	1341400898 / 1593694185 / -15.8%	0.77 / 0.71 / +8.9%
tpch_q06/duckdb:vortex-compact	788362015 / 766224272 / +2.9%	1010126466 / 972296026 / +3.9%	0.78 / 0.79 / -1.0%
tpch_q07/duckdb:vortex-compact	1322686253 / 1201783288 / +10.1%	1733259639 / 1461425436 / +18.6%	0.76 / 0.82 / -7.2%
tpch_q08/duckdb:vortex-compact	1267735554 / 1352969450 / -6.3%	1585368534 / 1424813848 / +11.3%	0.80 / 0.95 / -15.8%
tpch_q09/duckdb:vortex-compact	1265744990 / 1352115249 / -6.4%	1485908030 / 1779537727 / -16.5%	0.85 / 0.76 / +12.1%
tpch_q10/duckdb:vortex-compact	1666011319 / 2346859808 / -29.0%	1704187508 / 2273543623 / -25.0%	0.98 / 1.03 / -5.3%
tpch_q11/duckdb:vortex-compact	383733161 / 517250816 / -25.8%	484956581 / 554210959 / -12.5%	0.79 / 0.93 / -15.2%
tpch_q12/duckdb:vortex-compact	828182053 / 848686244 / -2.4%	1087470162 / 1250590013 / -13.0%	0.76 / 0.68 / +12.2%
tpch_q13/duckdb:vortex-compact	847887871 / 733309791 / +15.6%	1096606734 / 1082827349 / +1.3%	0.77 / 0.68 / +14.2%
tpch_q14/duckdb:vortex-compact	1057469504 / 921439918 / +14.8%	1116952804 / 1075387378 / +3.9%	0.95 / 0.86 / +10.5%
tpch_q15/duckdb:vortex-compact	820542091 / 872104974 / -5.9%	995552056 / 1027263447 / -3.1%	0.82 / 0.85 / -2.9%
tpch_q16/duckdb:vortex-compact	309820013 / 300926447 / +3.0%	413677280 / 372193791 / +11.1%	0.75 / 0.81 / -7.4%
tpch_q17/duckdb:vortex-compact	948030601 / 1020425593 / -7.1%	1056313465 / 1136793264 / -7.1%	0.90 / 0.90 / -0.0%
tpch_q18/duckdb:vortex-compact	1079086075 / 1000370056 / +7.9%	1376219516 / 1261304304 / +9.1%	0.78 / 0.79 / -1.1%
tpch_q19/duckdb:vortex-compact	1048651534 / 1093903806 / -4.1%	1106670562 / 1193795286 / -7.3%	0.95 / 0.92 / +3.4%
tpch_q20/duckdb:vortex-compact	1007647354 / 1020272069 / -1.2%	1255441886 / 1216816144 / +3.2%	0.80 / 0.84 / -4.3%
tpch_q21/duckdb:vortex-compact	2248309466 / 2400601551 / -6.3%	2404929110 / 2387538768 / +0.7%	0.93 / 1.01 / -7.0%
tpch_q22/duckdb:vortex-compact	391937030 / 370631400 / +5.7%	614156802 / 608273195 / +1.0%	0.64 / 0.61 / +4.7%

duckdb / parquet / ns (1.053x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	441248562 / 308524463 / +43.0% 🔴	380211028 / 427205878 / -11.0%	1.16 / 0.72 / +60.7%
tpch_q02/duckdb:parquet	587632007 / 578900274 / +1.5%	726692325 / 801060009 / -9.3%	0.81 / 0.72 / +11.9%
tpch_q03/duckdb:parquet	561395892 / 761988052 / -26.3%	753520843 / 936876362 / -19.6%	0.75 / 0.81 / -8.4%
tpch_q04/duckdb:parquet	451013012 / 406302672 / +11.0%	660543488 / 621737294 / +6.2%	0.68 / 0.65 / +4.5%
tpch_q05/duckdb:parquet	836852266 / 783602290 / +6.8%	1441806387 / 875171864 / +64.7% 🔴	0.58 / 0.90 / -35.2%
tpch_q06/duckdb:parquet	399784918 / 237280189 / +68.5% 🔴	322943862 / 451581108 / -28.5%	1.24 / 0.53 / +135.6%
tpch_q07/duckdb:parquet	873305598 / 893474417 / -2.3%	976447965 / 721434767 / +35.3% 🔴	0.89 / 1.24 / -27.8%
tpch_q08/duckdb:parquet	965970296 / 1032876035 / -6.5%	1057511253 / 1095660564 / -3.5%	0.91 / 0.94 / -3.1%
tpch_q09/duckdb:parquet	1028894661 / 996251088 / +3.3%	1139032327 / 1137682865 / +0.1%	0.90 / 0.88 / +3.2%
tpch_q10/duckdb:parquet	874068231 / 815474732 / +7.2%	1049529486 / 1004385302 / +4.5%	0.83 / 0.81 / +2.6%
tpch_q11/duckdb:parquet	374979787 / 370340072 / +1.3%	424394286 / 387078489 / +9.6%	0.88 / 0.96 / -7.7%
tpch_q12/duckdb:parquet	387040284 / 429056554 / -9.8%	522545085 / 882299259 / -40.8% 🟢	0.74 / 0.49 / +52.3%
tpch_q13/duckdb:parquet	577642896 / 673536386 / -14.2%	645559128 / 682562531 / -5.4%	0.89 / 0.99 / -9.3%
tpch_q14/duckdb:parquet	599740594 / 606868299 / -1.2%	653600938 / 689219042 / -5.2%	0.92 / 0.88 / +4.2%
tpch_q15/duckdb:parquet	530855960 / 480593845 / +10.5%	536588122 / 360895493 / +48.7% 🔴	0.99 / 1.33 / -25.7%
tpch_q16/duckdb:parquet	400607111 / 310690455 / +28.9%	435846007 / 371623310 / +17.3%	0.92 / 0.84 / +9.9%
tpch_q17/duckdb:parquet	594883148 / 606259864 / -1.9%	666408521 / 702921387 / -5.2%	0.89 / 0.86 / +3.5%
tpch_q18/duckdb:parquet	546264734 / 490515783 / +11.4%	633028878 / 535971820 / +18.1%	0.86 / 0.92 / -5.7%
tpch_q19/duckdb:parquet	598155330 / 586806713 / +1.9%	675616626 / 711788390 / -5.1%	0.89 / 0.82 / +7.4%
tpch_q20/duckdb:parquet	873167967 / 865791696 / +0.9%	886707683 / 768951445 / +15.3%	0.98 / 1.13 / -12.5%
tpch_q21/duckdb:parquet	850361469 / 726545720 / +17.0%	698978795 / 1064893318 / -34.4% 🟢	1.22 / 0.68 / +78.3%
tpch_q22/duckdb:parquet	533365217 / 541572529 / -1.5%	552840124 / 560876513 / -1.4%	0.96 / 0.97 / -0.1%

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

mhk197 · 2026-11-03T21:26:30Z

Fixing upstream here: apache/arrow-rs#12057

mhk197 added the changelog/performance A performance improvement label Nov 2, 2026

mhk197 added this pull request to stack #11112 November 2, 2026 19:58

mhk197 added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 2, 2026

github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 2, 2026

mhk197 removed this pull request from stack #11112 November 2, 2026 20:24

mhk197 changed the base branch from mk/keep-input-dictionaries to develop November 2, 2026 20:24

mhk197 force-pushed the mk/primitive-dict-arrow-export branch from 7b65132 to 48d770f Compare November 2, 2026 20:26

build arrow dictionaries for primitive arrays with one fxhash pass

e30bd12

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

mhk197 force-pushed the mk/primitive-dict-arrow-export branch from 48d770f to e30bd12 Compare November 2, 2026 20:27

mhk197 added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 2, 2026

github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 2, 2026

mhk197 changed the title ~~Build Arrow dictionaries for plain primitives without arrow_cast~~ Build Arrow dictionaries for primitives without arrow_cast Nov 2, 2026

reuse vortex-array's dict encoder for primitive export

1d18058

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

mhk197 added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 2, 2026

github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 2, 2026

mhk197 closed this Nov 3, 2026

Conversation

mhk197 commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Changes

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Appian on NVME 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: JOB on NVME 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Vortex queries 📖

Uh oh!

github-actions Bot commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on S3 📖

Uh oh!

mhk197 commented Nov 3, 2026

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

mhk197 commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading

github-actions Bot commented Nov 2, 2026 •

edited

Loading