Skip to content

fix(conformance): preserve protected matrix failure diagnostics #140

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
BunsDev merged 7 commits into from
Sep 7, 2026
Merged

fix(conformance): preserve protected matrix failure diagnostics #140

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
c19159b
test(conformance): split protected failure boundaries
BunsDev Sep 7, 2026
a4ae9a0
ci(conformance): bind protected substage diagnostics
BunsDev Sep 7, 2026
b7a04af
test(conformance): bind protected substage authority
BunsDev Sep 7, 2026
0907e81
fix(conformance): preserve protected substage diagnostics
BunsDev Sep 7, 2026
630bb0a
test(conformance): bind propagated diagnostics
BunsDev Sep 7, 2026
50ad599
fix(conformance): preserve diagnostics across cleanup failures
BunsDev Sep 7, 2026
25b3bc6
test(conformance): pin cleanup diagnostic authority
BunsDev Sep 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions .github/workflows/client-v1-conformance.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8818,14 +8818,14 @@ jobs:
@('scripts\owned-temp-directory.mjs', 6965, 'a9c55c85cf2b7d70310d278bafd2c8e7695d66f4ae38b9c3f1f12fce0b442095'),
@('scripts\phase1-artifact-secret-scan.mjs', 21183, 'be0ec302b9c4372f232d6bd1efcba873fd3380cc5de7f756cd0b9eeeec07222a'),
@('scripts\phase1-conformance-lock.mjs', 48544, '2d8db4e5442fe2f585c0b005d2b059832b27d88047441e0e7dbc26dc22a00e99'),
@('scripts\phase1-conformance.mjs', 199227, 'fc232db10c270ec92fcd700ad44e213c04abee01492c9804f82643b4513b2199'),
@('scripts\phase1-conformance.mjs', 199944, '67ba91257a71c36c7d91ef01796c5a348d106e40b4a6f1ef59fde6980a5ba584'),
@('scripts\phase1-evidence-contract.mjs', 15088, '24180ae03835fa6aac45559682adb3c1e626bab76466eddc55b9e2300f0a2b7f'),
@('scripts\phase1-evidence-runtime.mjs', 6078, '3d227c354e6d908c5912d2b8244336e3b79c3bbd4dec79b0ad219ed65b8cb159'),
@('scripts\phase1-linux-secret-service.mjs', 4270, 'ddf834c6f57853c5116b4b1f345952a218ff0687c5d741737c68e20bc2ecda92'),
@('scripts\phase1-macos-keychain.mjs', 5091, 'ab0c2dd08cf606d9502f5da206175707d471d99f484e8c8c79b5b08a5772b9a4'),
@('scripts\phase1-process-supervisor.mjs', 3820, '16b51fb1a33b4bfef98daca549aacf5dc2d2c098cfbd664753b69c940d1e6f6c'),
@('scripts\phase1-schema-v2-evidence.mjs', 51642, 'a7cab994aa0ee97baceb4b2c475ec1ff253ae5681f39e2c3d15fb1035b2d2387'),
@('scripts\phase1-schema-v2-producer.mjs', 165661, '4e938521a6436c3441781b91f0e0f52fe6e3ac6f44faedfcab0458b144ccd714'),
@('scripts\phase1-schema-v2-producer.mjs', 168581, '023b65fbf2a6b29dc8a85c14e0eb002f5e10751308f5af372505ba75273a8beb'),
@('scripts\process-owned-artifact-root.mjs', 11205, '9ee158453044cd57b91c77c50262092a91993c6b1533b6584c61e1cbadfd794a'),
@('scripts\supervised-exec.mjs', 2875, 'a5edfd985b934d3b46247a0da3141682c411d30bb582edf87ae7b29791dad65b'),
@('scripts\supervisor-status.mjs', 854, 'ac332ca7b6b040ecc846088bb3a6ad5e7112a0454eb3ea71d2a819d55e64254e')
Expand Down Expand Up @@ -9510,14 +9510,14 @@ jobs:
['scripts/owned-temp-directory.mjs', [6965, 'a9c55c85cf2b7d70310d278bafd2c8e7695d66f4ae38b9c3f1f12fce0b442095']],
['scripts/phase1-artifact-secret-scan.mjs', [21183, 'be0ec302b9c4372f232d6bd1efcba873fd3380cc5de7f756cd0b9eeeec07222a']],
['scripts/phase1-conformance-lock.mjs', [48544, '2d8db4e5442fe2f585c0b005d2b059832b27d88047441e0e7dbc26dc22a00e99']],
['scripts/phase1-conformance.mjs', [199227, 'fc232db10c270ec92fcd700ad44e213c04abee01492c9804f82643b4513b2199']],
['scripts/phase1-conformance.mjs', [199944, '67ba91257a71c36c7d91ef01796c5a348d106e40b4a6f1ef59fde6980a5ba584']],
['scripts/phase1-evidence-contract.mjs', [15088, '24180ae03835fa6aac45559682adb3c1e626bab76466eddc55b9e2300f0a2b7f']],
['scripts/phase1-evidence-runtime.mjs', [6078, '3d227c354e6d908c5912d2b8244336e3b79c3bbd4dec79b0ad219ed65b8cb159']],
['scripts/phase1-linux-secret-service.mjs', [4270, 'ddf834c6f57853c5116b4b1f345952a218ff0687c5d741737c68e20bc2ecda92']],
['scripts/phase1-macos-keychain.mjs', [5091, 'ab0c2dd08cf606d9502f5da206175707d471d99f484e8c8c79b5b08a5772b9a4']],
['scripts/phase1-process-supervisor.mjs', [3820, '16b51fb1a33b4bfef98daca549aacf5dc2d2c098cfbd664753b69c940d1e6f6c']],
['scripts/phase1-schema-v2-evidence.mjs', [51642, 'a7cab994aa0ee97baceb4b2c475ec1ff253ae5681f39e2c3d15fb1035b2d2387']],
['scripts/phase1-schema-v2-producer.mjs', [165661, '4e938521a6436c3441781b91f0e0f52fe6e3ac6f44faedfcab0458b144ccd714']],
['scripts/phase1-schema-v2-producer.mjs', [168581, '023b65fbf2a6b29dc8a85c14e0eb002f5e10751308f5af372505ba75273a8beb']],
['scripts/process-owned-artifact-root.mjs', [11205, '9ee158453044cd57b91c77c50262092a91993c6b1533b6584c61e1cbadfd794a']],
['scripts/supervised-exec.mjs', [2875, 'a5edfd985b934d3b46247a0da3141682c411d30bb582edf87ae7b29791dad65b']],
['scripts/supervisor-status.mjs', [854, 'ac332ca7b6b040ecc846088bb3a6ad5e7112a0454eb3ea71d2a819d55e64254e']],
Expand Down
12 changes: 9 additions & 3 deletions docs/phase1-conformance.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1046,6 +1046,12 @@ owned-artifact cleanup retain an earlier execution failure instead of replacing
it. Captured command output, filesystem paths, and the underlying error remain
private in-memory causes and are not serialized into the public failure result.

Checkout failures identify the Chat, SDK, Cave, Coven, integrity, validator, or
producer boundary. Evidence finalization failures identify report construction,
operator-state capture, isolation, assertions, evidence construction, serialization,
scanning, or retention. These allowlisted diagnostics survive nested stage wrappers;
underlying command output and private paths remain excluded from public errors.

Frozen consumer failures are further bounded to authority verification,
artifact loading, harness creation, offline installation, isolation checks,
Cave fixture matching, packed build, packed verification, or cleanup. The
Expand Down Expand Up @@ -1091,20 +1097,20 @@ The later SDK validator repin must use these exact committed file bytes:

| File | Bytes | SHA-256 |
| --- | ---: | --- |
| `.github/workflows/client-v1-conformance.yml` | 463,033 | `6f1a362be64f1bb0a6bac5980ac4acb87af7fed525a33d55ace9d111b9238fe3` |
| `.github/workflows/client-v1-conformance.yml` | 463,033 | `e76c4361fb94c0b9525680f2aac176ca377174665b0323b5aefaf219fa452d02` |
| `scripts/contract-canary.mjs` | 39,346 | `63b2a95c8563143d0d748d36ef2bdbae656e7babdb23b986efca97bbbc9b8d83` |
| `scripts/executable-resolution.mjs` | 9,154 | `31e3c412ff8c835f14522f36a59e91f4a4ba82913210ae8e3b4455217503f430` |
| `scripts/owned-temp-directory.mjs` | 6,965 | `a9c55c85cf2b7d70310d278bafd2c8e7695d66f4ae38b9c3f1f12fce0b442095` |
| `scripts/phase1-artifact-secret-scan.mjs` | 21,183 | `be0ec302b9c4372f232d6bd1efcba873fd3380cc5de7f756cd0b9eeeec07222a` |
| `scripts/phase1-conformance-lock.mjs` | 48,544 | `2d8db4e5442fe2f585c0b005d2b059832b27d88047441e0e7dbc26dc22a00e99` |
| `scripts/phase1-conformance.mjs` | 199,227 | `fc232db10c270ec92fcd700ad44e213c04abee01492c9804f82643b4513b2199` |
| `scripts/phase1-conformance.mjs` | 199,944 | `67ba91257a71c36c7d91ef01796c5a348d106e40b4a6f1ef59fde6980a5ba584` |
| `scripts/phase1-evidence-contract.mjs` | 15,088 | `24180ae03835fa6aac45559682adb3c1e626bab76466eddc55b9e2300f0a2b7f` |
| `scripts/phase1-evidence-runtime.mjs` | 6,078 | `3d227c354e6d908c5912d2b8244336e3b79c3bbd4dec79b0ad219ed65b8cb159` |
| `scripts/phase1-linux-secret-service.mjs` | 4,270 | `ddf834c6f57853c5116b4b1f345952a218ff0687c5d741737c68e20bc2ecda92` |
| `scripts/phase1-macos-keychain.mjs` | 5,091 | `ab0c2dd08cf606d9502f5da206175707d471d99f484e8c8c79b5b08a5772b9a4` |
| `scripts/phase1-process-supervisor.mjs` | 3,820 | `16b51fb1a33b4bfef98daca549aacf5dc2d2c098cfbd664753b69c940d1e6f6c` |
| `scripts/phase1-schema-v2-evidence.mjs` | 51,642 | `a7cab994aa0ee97baceb4b2c475ec1ff253ae5681f39e2c3d15fb1035b2d2387` |
| `scripts/phase1-schema-v2-producer.mjs` | 165,661 | `4e938521a6436c3441781b91f0e0f52fe6e3ac6f44faedfcab0458b144ccd714` |
| `scripts/phase1-schema-v2-producer.mjs` | 168,581 | `023b65fbf2a6b29dc8a85c14e0eb002f5e10751308f5af372505ba75273a8beb` |
| `scripts/process-owned-artifact-root.mjs` | 11,205 | `9ee158453044cd57b91c77c50262092a91993c6b1533b6584c61e1cbadfd794a` |
| `scripts/supervised-exec.mjs` | 2,875 | `a5edfd985b934d3b46247a0da3141682c411d30bb582edf87ae7b29791dad65b` |
| `scripts/supervisor-status.mjs` | 854 | `ac332ca7b6b040ecc846088bb3a6ad5e7112a0454eb3ea71d2a819d55e64254e` |
Expand Down
18 changes: 9 additions & 9 deletions phase1-conformance.lock.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,16 +18,16 @@
},
"harness": {
"repository": "OpenCoven/chat",
"revision": "223adb33c0595df244feb4561aa0273c4afecf48"
"revision": "50ad59966d9ebdae3a97459bc21670e461bd6dd9"
},
"harnessAuthority": {
"revision": "223adb33c0595df244feb4561aa0273c4afecf48",
"tree": "34b5836cb9f901466971a89afef43d8331e82517",
"revision": "50ad59966d9ebdae3a97459bc21670e461bd6dd9",
"tree": "0883076e180169216be4d6e339bb9f4bb225c422",
"files": [
{
"path": "scripts/phase1-conformance.mjs",
"blob": "c69fb54d0a4123b315d9fcc005c609410347ddd5",
"sha256": "fc232db10c270ec92fcd700ad44e213c04abee01492c9804f82643b4513b2199"
"blob": "2d6ee8c26ebfc78cc0f4959079af5c31fdab2f64",
"sha256": "67ba91257a71c36c7d91ef01796c5a348d106e40b4a6f1ef59fde6980a5ba584"
},
{
"path": "scripts/phase1-conformance-launcher.sh",
Expand Down Expand Up @@ -81,8 +81,8 @@
},
{
"path": "scripts/phase1-schema-v2-producer.mjs",
"blob": "64198513dec00d35e0dc189eb179fa92c843f724",
"sha256": "4e938521a6436c3441781b91f0e0f52fe6e3ac6f44faedfcab0458b144ccd714"
"blob": "9ecfe45795c83d1bd5a11b0053972bb912909ea5",
"sha256": "023b65fbf2a6b29dc8a85c14e0eb002f5e10751308f5af372505ba75273a8beb"
},
{
"path": "scripts/phase1-linux-secret-service.mjs",
Expand Down Expand Up @@ -146,8 +146,8 @@
},
{
"path": ".github/workflows/client-v1-conformance.yml",
"blob": "0061e4ad2b7abd1a3864070134c69ffea7cd28df",
"sha256": "6f1a362be64f1bb0a6bac5980ac4acb87af7fed525a33d55ace9d111b9238fe3"
"blob": "be5b78b10dc756acd370e72967f82ad79f1bf343",
"sha256": "e76c4361fb94c0b9525680f2aac176ca377174665b0323b5aefaf219fa452d02"
}
],
"productionDeltas": [
Expand Down
15 changes: 15 additions & 0 deletions scripts/phase1-conformance.mjs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -309,7 +309,22 @@ const publicPhase1DiagnosticIds = new Set([
'phase1.environment.directories.failed',
'phase1.stage.toolchain.failed',
'phase1.stage.checkouts.failed',
'phase1.stage.checkouts.chat.failed',
'phase1.stage.checkouts.sdk.failed',
'phase1.stage.checkouts.cave.failed',
'phase1.stage.checkouts.coven.failed',
'phase1.stage.checkouts.integrity.failed',
'phase1.stage.checkouts.validator.failed',
'phase1.stage.checkouts.producer.failed',
'phase1.stage.evidence-authority.failed',
'phase1.stage.evidence-authority.report.failed',
'phase1.stage.evidence-authority.operator-state.failed',
'phase1.stage.evidence-authority.isolation.failed',
'phase1.stage.evidence-authority.assertions.failed',
'phase1.stage.evidence-authority.build.failed',
'phase1.stage.evidence-authority.serialize.failed',
'phase1.stage.evidence-authority.scan.failed',
'phase1.stage.evidence-authority.retain.failed',
'phase1.stage.packaging.failed',
'phase1.packaging.frozen-consumer.failed',
...FROZEN_PACKED_CONSUMER_STAGES.map(
Expand Down
Loading
Loading