Skip to content

Alert on feed-recovery relation drift; document repin - #216

Merged
Kenbak merged 3 commits into
mainfrom
new/zift-recovery-drift
Nov 2, 2026
Merged

Kenbak merged 3 commits into
mainfrom
new/zift-recovery-drift

Conversation

@Kenbak

@Kenbak Kenbak commented Nov 1, 2026

Copy link
Copy Markdown
Owner

Problem

Each Zift dataset batch added tables to the ask_public_core_v1 subscription (8 → 15) but not to the host's /etc/zecblock-ask-recovery/config.json. Since 2026-10-31 13:53 UTC (batch 1 rollout), feed-recovery.py logs blocked / copy_incomplete every run, so a publisher restart or transport disconnect would not be auto-resumed. Nothing alerted.

Change

  • analytics-availability.py: the read-only probe also lists subscribed relations and compares them with the installed recovery config. A mismatch raises recovery_relations_drift (unreadable config: recovery_config_unreadable; no config installed: no check).
  • feed-recovery.md: reviewed repin procedure for adding a replicated table, rollback first. Updating the list changes the pinned digest, so the saved origin floor must be re-armed from a healthy observation, not by deleting state.
  • Tests for both cases.

Not done (needs owner approval)

No host change. Applying the repin (config + state edit, then one oneshot) and deploying this alert are separate approved steps. Once deployed before the repin, the alert will fire recovery_relations_drift until the repin lands.

🤖 Generated with Claude Code

Dataset rollouts added tables to ask_public_core_v1 without updating
/etc/zecblock-ask-recovery/config.json, so feed-recovery.py has reported
blocked/copy_incomplete since 2026-10-31 13:53 UTC and would not resume a
disconnected feed. The availability alert now compares the installed
recovery config with pg_subscription_rel (recovery_relations_drift), and
feed-recovery.md documents the reviewed repin with its rollback first.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@vercel

vercel Bot commented Nov 1, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

3 Skipped Deployments
Project Deployment Actions Updated
zecblock Ignored Ignored Preview Nov 2, 2026 1:20pm UTC
zecblock-crosslink Ignored Ignored Preview Nov 2, 2026 1:20pm UTC
zecblock-testnet Ignored Ignored Preview Nov 2, 2026 1:20pm UTC

Request Review

@Kenbak
Kenbak merged commit 66ef926 into main Nov 2, 2026
29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant