Skip to content

Default DuckDB to Scan V2 and optimize sparse and wide scans - #10964

Draft
joseph-isaacs wants to merge 8 commits into
developfrom
ji/codex/scan-v2-topk-feedback
Draft

joseph-isaacs wants to merge 8 commits into
developfrom
ji/codex/scan-v2-topk-feedback

Integrate sparse scans with layout-aware DuckDB work scheduling

7dcaf56
Select commit
Loading
Failed to load commit list.
CodSpeed / CodSpeed Performance Analysis failed Oct 30, 2026 in 0s

Performance Regression: -5.77%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 3 benchmarks with a significant change ran in a different software environment

Their base and head results were measured with a different OS or toolchain, such as compiler, runtime or library versions, so the changes might come from this difference rather than from the code. Open an affected benchmark to see what changed.

See affected benchmarks

⚡ 4 improved benchmarks
❌ 6 regressed benchmarks
✅ 2308 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation filter_powerlaw_by_random[10000] 993.7 ns 1,300.8 ns -23.61%
❌ CPU Simulation bench_compare_varbin[(50000, 2)] 132.2 µs 162.1 µs -18.45%
❌ CPU Simulation bench_compare_varbin[(50000, 64)] 134.2 µs 164 µs -18.2%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(7500, 10000)] 199.3 µs 227.7 µs -12.47%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(1000, 10000)] 77.8 µs 88.8 µs -12.4%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(10000, 10000)] 205.6 µs 234 µs -12.15%
⚡ CPU Simulation take_filter_primitive_small_uncached_random_mask_random_indices[4096, 10] 23.9 µs 20.7 µs +15.63%
⚡ CPU Simulation test_repeated_scan_filter[int] 2.4 ms 2.1 ms +12.96%
⚡ CPU Simulation test_scan_filter_to_arrow_array[int] 2.8 ms 2.5 ms +11.25%
⚡ CPU Simulation test_scan_filter[int] 2.9 ms 2.6 ms +10.69%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/codex/scan-v2-topk-feedback (7dcaf56) with develop (7baa376)

Open in CodSpeed