Skip to content

Switch to 1 job per Bitcoin integration test, overcoming the GitHub Action matrix limit of 256 - #7526

Open
dhaney-stacks wants to merge 8 commits into
stacks-network:mainfrom
dhaney-stacks:main
Open

Switch to 1 job per Bitcoin integration test, overcoming the GitHub Action matrix limit of 256#7526
dhaney-stacks wants to merge 8 commits into
stacks-network:mainfrom
dhaney-stacks:main

Conversation

@dhaney-stacks

@dhaney-stacks dhaney-stacks commented Aug 21, 2026

Copy link
Copy Markdown
Collaborator

Description

Switch to 1 job per Bitcoin integration test, overcoming the GitHub Action matrix limit of 256

Applicable issues

N/A

Additional info (benefits, drawbacks, caveats)

Some of our integration tests are pretty consistently slow. They also tend to run together when batched, making some test jobs take 20-30 minutes or even time out.

This PR makes every test run in its own job. And since we can run hundreds of jobs concurrently, this should significantly speed up our CI pipeline.

Checklist

N/A

@dhaney-stacks dhaney-stacks changed the title Isolate slow Bitcoin integration tests into their own jobs and increase the batch size for all other jobs Switch to 1 job per Bitcoin integration test, overcoming the GitHub Action matrix limit of 256 Aug 21, 2026
@coveralls

coveralls commented Aug 21, 2026

Copy link
Copy Markdown

Coverage Report for CI Build 32521656103

Coverage decreased (-0.03%) to 86.58%

Details

  • Coverage decreased (-0.03%) from the base build.
  • Patch coverage: No coverable lines changed in this PR.
  • 160 coverage regressions across 31 files.

Uncovered Changes

No uncovered changes found.

Coverage Regressions

160 previously-covered lines in 31 files lost coverage.

Top 10 Files by Coverage Loss Lines Losing Coverage Coverage
clarity/src/vm/functions/bitcoin_madhouse.rs 36 82.26%
stacks-node/src/neon_node.rs 19 82.99%
stackslib/src/net/stackerdb/sync.rs 14 75.0%
stackslib/src/net/inv/epoch2x.rs 11 79.38%
clarity/src/vm/costs/mod.rs 6 83.66%
stackslib/src/chainstate/nakamoto/coordinator/mod.rs 6 79.87%
stacks-signer/src/chainstate/v2.rs 6 88.38%
stacks-signer/src/v0/signer.rs 6 88.35%
stackslib/src/burnchains/bitcoin/network.rs 5 79.8%
stackslib/src/chainstate/nakamoto/mod.rs 5 84.77%

Coverage Stats

Coverage Status
Relevant Lines: 233624
Covered Lines: 202272
Line Coverage: 86.58%
Coverage Strength: 19407928.98 hits per line

💛 - Coveralls

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants