Skip to content
Merged
Show file tree
Hide file tree
Changes from 5 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -149,6 +149,7 @@ Adding workers reduces wall-clock time only while independent shards remain queu
| `examples/multi-host/fleet.json` | Fictional two-project, two-location controller topology |
| `SECURITY.md` | Secret handling and vulnerability reporting |
| `AGENTS.md` | Non-negotiable rules for humans and coding agents |
| `docs/UPDATING.md` | Keeping a derived private repository current: schema vs template versions, releases, migrations, Dependabot |

## Public and private boundary

Expand Down
133 changes: 133 additions & 0 deletions docs/UPDATING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,133 @@
# Keeping a private configuration repository up to date

A private configuration repository is created from this public template
and then lives its own life. This guide explains how it stays current.

## Two different version numbers

- **`schema_version`** (inside `fleet.json`) is the version of the
*data contract* — the fields the engine and validator understand. It
changes rarely and only through an explicit migration (see below).
- **Template version** is the version of the *starting content* — the
scripts, validators, examples, and documentation you copied from this
template. It is tracked by the template's tagged releases, not by
anything inside `fleet.json`.

Bumping one never bumps the other. A new template release can ship
validator fixes with an unchanged `schema_version`; a schema migration
can happen without any other template change.
Comment thread
Nickfost marked this conversation as resolved.
Outdated

## Template releases are versioned

This template publishes tagged releases. Record the release you started
from in your private repository (for example in its README), and review
release notes when updating. Treat template files as vendored code:
update them deliberately, not casually.

## GitHub template repositories have no fork ancestry

A repository created with GitHub's "Use this template" button is **not**
a fork: it has no git ancestry link to the template, so
`git pull upstream` does not work and GitHub will never offer sync PRs.
Updating is an explicit operation:

1. Add the template as a remote and fetch its tags into that remote's
tracking namespace. `--no-tags` prevents Git from also creating
adopter-visible tags, and the non-forced refspec fails closed if an
upstream tag is ever rewritten:

```bash
git remote add template https://github.com/RandomDevelopment/ci-fleet-config-template.git
Comment thread
Nickfost marked this conversation as resolved.
Outdated
git fetch --no-tags template 'refs/tags/*:refs/remotes/template/tags/*'
Comment thread
Nickfost marked this conversation as resolved.
Outdated
```

2. Record the adopter commit, then merge the target template release
without committing. The explicit unrelated-history flag is required
on the first update and harmless after the first merge establishes
common ancestry:

```bash
ADOPTER_HEAD="$(git rev-parse HEAD)"
git merge --no-ff --no-commit --allow-unrelated-histories \
refs/remotes/template/tags/<new-tag>
```

If Git reports conflicts, leave the merge in progress and continue.
Whether or not it conflicted, restore the adopter-owned configuration
from the recorded pre-merge commit, then resolve and stage every other
conflict:

Comment thread
Nickfost marked this conversation as resolved.
```bash
git restore --source="$ADOPTER_HEAD" --staged --worktree -- fleet.json
git status --short
```

If the release keeps the same `schema_version`, prove `fleet.json`
still has no staged change:

```bash
git diff --cached --exit-code -- fleet.json
```

If the release changes `schema_version`, run the target release's
migration tooling now, while this template merge is still pending,
then stage and review the mechanical `fleet.json` migration.
3. Validate and review the complete staged result before committing:

Comment thread
Nickfost marked this conversation as resolved.
```bash
./scripts/validate.sh --strict
git diff --cached
git status --short
git commit
```

Do not cherry-pick or format-patch a tag range: either can omit
intermediate or merge-result changes.

## Validation is pinned to immutable releases

Controller `engine_ref` values and any reusable workflow references must
be full reviewed commit SHAs, not moving tags or branches. When you
update the pinned engine, resolve the exact merge commit on the engine's
default branch, review it, and pin that 40-hex SHA.

One limitation to understand: `./scripts/validate.sh --strict` runs the
validator **vendored in your repository**, so it verifies that
`engine_ref` is a well-formed 40-hex SHA but does not fetch that commit
or check it against the engine's actual contract. When you adopt a new
engine release, update the vendored schema/validator from the matching
template release in the same change (per the update procedure above) so
validation actually exercises the pinned contract.
Comment thread
Nickfost marked this conversation as resolved.
Outdated
Comment thread
Nickfost marked this conversation as resolved.
Outdated

## Dependabot update PRs

Keep a `.github/dependabot.yml` in the private repository covering
GitHub Actions. When your workflows pin actions or reusable workflows to
commit SHAs, Dependabot still opens update PRs for them (it understands
SHA-pinned actions with version comments). Review each PR like any
engine update: confirm the new SHA is a reviewed upstream release, then
let the strict validator and CI run before merge.

## Schema migrations are explicit tooling

When the engine introduces a new `schema_version`, the migration is a
reviewed, mechanical transformation — not a hand edit. Apply it inside
the pending template merge above so the new schema, validator, migration,
and migrated private configuration are validated and committed together:

1. Read the migration notes for the new schema version.
2. Start the template merge, restore the adopter's pre-merge
`fleet.json`, and run the migration tooling shipped with that target
engine/template release before committing the merge.
3. Run `./scripts/validate.sh --strict` and review the diff.
Comment thread
Nickfost marked this conversation as resolved.
4. Merge only when every still-deployed `active` or `drained` controller
runs an engine that understands the new schema. Retained `disabled`
declarations have no running host and do not gate the migration.

## Optional adopter registration, never telemetry

This project collects **no telemetry** and there is no phone-home of any
kind. If the community wants visibility into who operates a fleet, it is
strictly optional and opt-in: an `ADOPTERS.md` pull request or a
registration issue form on the public engine repository. Never a
requirement, never automatic.
18 changes: 18 additions & 0 deletions scripts/test_policy.py
Original file line number Diff line number Diff line change
Expand Up @@ -410,6 +410,24 @@ def test_standard_task_plan_path_is_required(self) -> None:
first_project(config)["ci_contract"]["task_plan"] = "ci/custom.json"
self.assert_rejected(config, "standard task-plan path")

def test_updating_guide_preserves_adopter_state_before_commit(self) -> None:
guide = (ROOT / "docs" / "UPDATING.md").read_text(encoding="utf-8")
required_in_order = (
"git fetch --no-tags template",
"refs/tags/*:refs/remotes/template/tags/*",
'ADOPTER_HEAD="$(git rev-parse HEAD)"',
'git restore --source="$ADOPTER_HEAD"',
"migration tooling now",
Comment thread
Nickfost marked this conversation as resolved.
Outdated
"./scripts/validate.sh --strict",
"git commit",
)
positions = []
for value in required_in_order:
self.assertIn(value, guide)
positions.append(guide.index(value))
self.assertEqual(positions, sorted(positions))
self.assertNotIn("git fetch template '+refs/tags/", guide)


if __name__ == "__main__":
unittest.main()