Skip to content

ci: add import-time benchmarks - #126

Open
art049 wants to merge 2 commits into
masterfrom
ci/import-time-benchmarks
Open

art049 wants to merge 2 commits into
masterfrom
ci/import-time-benchmarks

ci: remove obsolete Valgrind setup from CodSpeed workflow

7c66604
Select commit
Loading
Failed to load commit list.
CodSpeed / CodSpeed Performance Analysis failed May 29, 2026 in 0s

24 benchmarks regressed

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 18 improved benchmarks
❌ 22 regressed benchmarks
✅ 237 untouched benchmarks
🆕 12 new benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
🆕 WallTime import rich N/A 57.3 ms N/A
🆕 WallTime import pytest_codspeed N/A 403.6 ms N/A
🆕 WallTime import pytest N/A 393.7 ms N/A
🆕 WallTime import pytest_codspeed.plugin N/A 403.9 ms N/A
🆕 WallTime import pluggy N/A 110.3 ms N/A
🆕 WallTime python startup N/A 37.5 ms N/A
❌ WallTime test_multiprocessing_map[10000] 84.3 ms 108.2 ms -22.12%
⚡ WallTime test_fs_read[1000] 879.2 ns 861 ns +2.11%
⚡ WallTime test_sum_of_squares[sum_of_squares_sum_comprehension_product] 201.3 µs 197.2 µs +2.08%
❌ WallTime test_hostname_resolution[localhost] 121.2 µs 124 µs -2.23%
⚡ WallTime test_threadpool_map[10] 2.4 ms 2.3 ms +3.12%
⚡ WallTime test_tcp_connection[google.com-443] 1.2 ms 1.2 ms +6.35%
❌ WallTime test_match_word_pattern[aba-GraphTreesGraph] 106.3 µs 108.7 µs -2.2%
⚡ WallTime test_noop_pass 533.8 ns 510.7 ns +4.51%
❌ WallTime test_generate_all_permutations[sequence1] 163.8 µs 171.6 µs -4.5%
❌ WallTime test_open_close_fd[10] 92.1 µs 94.5 µs -2.56%
❌ WallTime test_make_bandpass 5.5 µs 5.6 µs -2.32%
❌ WallTime test_mmap_operation[40960] 48.2 µs 51.5 µs -6.33%
❌ WallTime test_generate_all_subsequences[sequence1] 97.3 µs 100.4 µs -3.05%
⚡ WallTime test_multiprocessing_map[100] 57.7 ms 56.4 ms +2.33%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ci/import-time-benchmarks (7c66604) with master (b2d12d8)

Open in CodSpeed