feat(automation): Phase 6.1 – Production Validation helpers, CLI and tests by Copilot · Pull Request #2495 · lightspeedwp/.github

Copilot · 2026-08-29T15:13:34Z

Implements the five Phase 6.1 production validation deliverables (deployment checklist, environment setup, smoke tests, rollback plan, monitoring/alerting) as a testable Node.js module, mirroring the existing staging-validation-helpers.js pattern.

Changes

scripts/automation/production-validation-helpers.js — pure functions for each deliverable:

runDeploymentChecklist — verifies all deployment checklist items
setupProductionEnvironment — confirms required services are running and healthy
runSmokeTests — exercises key production endpoints (health, auth, report generation, webhooks)
validateRollbackPlan — asserts plan is documented, tested, and within time threshold
configureMonitoring — wires notification channels and validates alert thresholds
executeAllProductionValidations — orchestrates all five, returns GO/NO-GO + summary

scripts/automation/production-validation.js — CLI wrapper; supports --task <name> or --all, with --verbose, --no-dry-run, and --max-rollback flags.

scripts/automation/__tests__/production-validation.test.js — 56 unit, integration, and edge-case tests; all passing, 0 CodeQL alerts.

Changelog

Added

production-validation-helpers.js: seven functions covering all Phase 6.1 validation deliverables.
production-validation.js: CLI script for running individual or all production checks.
production-validation.test.js: 56-test suite (unit + integration + edge cases).

Checklist (Global DoD / PR)

Fixes Reporting Agent v2 Phase 6.1: Production Validation #2043

…d tests Closes #2043 - production-validation-helpers.js: five Phase 6.1 deliverable functions (runDeploymentChecklist, setupProductionEnvironment, runSmokeTests, validateRollbackPlan, configureMonitoring) plus parseProductionArguments and executeAllProductionValidations - production-validation.js: CLI script mirroring staging-validation.js - __tests__/production-validation.test.js: 56 unit, integration, and edge-case tests – all passing

…terministic durationMs in runSmokeTests

Copilot

🟡 Changes recommended

There are API/CLI usability issues (empty override arrays silently falling back to defaults and failures not surfacing error messages) plus a potentially risky lockfile change removing libc constraints for native optional deps.

Once you've addressed the issues Copilot identified, you can request another Copilot review.

Pull request overview

Adds a Phase 6.1 “production validation” automation module (helpers + CLI) under scripts/automation/, modelled on the existing staging validation pattern, plus a Jest test suite to exercise the new helpers.

Changes:

Added production-validation-helpers.js with pure helper functions for checklist, environment, smoke tests, rollback validation, monitoring config, arg parsing, and orchestration.
Added production-validation.js CLI entrypoint to run a single task or all checks and set process exit codes accordingly.
Added production-validation.test.js Jest suite covering defaults, overrides, and edge cases for the helpers.

File summaries

File	Description
scripts/automation/production-validation.js	New CLI wrapper for running Phase 6.1 production validation tasks and reporting results.
scripts/automation/production-validation-helpers.js	New helper module implementing the production validation task functions and orchestration.
scripts/automation/tests/production-validation.test.js	New Jest coverage for the production validation helper functions.
package-lock.json	Lockfile update removing `libc` constraints from several platform-specific optional native packages.

Review details

Suppressed comments (1)

scripts/automation/production-validation-helpers.js:220

Similar to the checklist helper, providing options.channels: [] currently falls back to the default channels. This is surprising for an API that accepts overrides and makes it hard to intentionally configure zero channels during testing. Only default when options.channels is undefined, and fail fast on an empty array.

  const channels =
    options.channels && options.channels.length > 0
      ? options.channels
      : defaultChannels;

Files reviewed: 3/4 changed files
Comments generated: 3
Review effort level: Lite

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

github-actions · 2026-08-29T16:50:56Z

🔍 Reviewer Summary for PR #2495

CI Status: ❌ pending
Files changed: 4

Recommendations

CI checks not green

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Signed-off-by: Ash Shaw <ashley@lightspeedwp.agency>

github-actions · 2026-08-29T16:52:28Z

🔍 Reviewer Summary for PR #2495

CI Status: ❌ pending
Files changed: 4

Recommendations

CI checks not green

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Signed-off-by: Ash Shaw <ashley@lightspeedwp.agency>

github-actions · 2026-08-29T17:10:29Z

🚫 This PR description is missing required template content.

Missing required section(s): Linked issues, Global DoD checklist

Please update the PR body using one of the repository PR templates:

Empty placeholders, unchecked checklist boxes, and stub issue references do not count.

github-actions · 2026-08-29T17:19:21Z

🔍 Reviewer Summary for PR #2495

CI Status: ❌ pending
Files changed: 4

Recommendations

CI checks not green

github-actions · 2026-08-29T17:21:41Z

🔍 Reviewer Summary for PR #2495

CI Status: ❌ pending
Files changed: 4

Recommendations

CI checks not green

github-actions · 2026-08-29T17:22:45Z

🔍 Reviewer Summary for PR #2495

CI Status: ❌ pending
Files changed: 4

Recommendations

CI checks not green

github-actions · 2026-08-30T09:54:57Z

⚠️ Branch Naming Issue

This PR's branch name copilot/reporting-agent-v2-phase-6-1 doesn't follow the standard pattern.

Standard pattern: {type}/{scope}-{title} (e.g., feat/something, fix/bug-name)

Based on linked issue type: task

Correct template should be: pr_feature.md

No action required — this is informational. Future PRs should use the correct branch name.

See Branching Strategy for more info.

github-actions · 2026-08-30T09:55:17Z

🔍 Reviewer Summary for PR #2495

CI Status: ❌ pending
Files changed: 4

Recommendations

CI checks not green

github-actions · 2026-09-02T17:08:20Z

❌ Branch Name Validation Failed

The branch name copilot/reporting-agent-v2-phase-6-1 does not follow the LightSpeed branching strategy.

Required Format

{type}/{scope}-{short-title}

type: one of the allowed prefixes (lowercase)
scope: lowercase, hyphens only (no underscores or uppercase)
title: lowercase, hyphens only (no underscores or uppercase)

Allowed Branch Types

feat, fix, hotfix, release, refactor, chore, docs, test, perf, ci, build, deps, security, revert, research, design, a11y, ux, i18n, ops, proto, ds, api, schema, telemetry, content, seo, config, migrate, qa, uat, audit, codex

Valid Examples

✓ feat/branch-naming-enforcement
✓ fix/validation-script-bug
✓ chore/update-dependencies
✓ docs/branching-strategy-guide
✓ hotfix/critical-security-patch

Invalid Examples

✗ claude/my-branch (type "claude" not allowed)
✗ Feature/MyBranch (uppercase not allowed)
✗ fix-bug (missing type prefix)
✗ feat/my_feature (underscores not allowed)
✗ feat/MyFeature (uppercase not allowed)

Solution

Rename your branch to follow the pattern and update the PR.

For more information, see docs/BRANCHING_STRATEGY.md.

Initial plan

784e018

Copilot AI assigned Copilot and ashleyshaw Aug 29, 2026

Copilot started work on behalf of ashleyshaw August 29, 2026 15:30 View session

Copilot AI linked an issue Aug 29, 2026 that may be closed by this pull request

Reporting Agent v2 Phase 6.1: Production Validation #2043

Open

Copilot AI added 2 commits August 29, 2026 15:34

fix(automation): address code review – add Array.isArray guard and de…

1dc6097

…terministic durationMs in runSmokeTests

Copilot AI changed the title ~~[WIP] Finalize production validation for reporting agent v2~~ feat(automation): Phase 6.1 – Production Validation helpers, CLI and tests Aug 29, 2026

Copilot finished work on behalf of ashleyshaw August 29, 2026 15:40

Copilot AI requested a review from ashleyshaw August 29, 2026 15:40

ashleyshaw requested a lite review from Copilot August 29, 2026 16:17

Copilot started reviewing on behalf of ashleyshaw August 29, 2026 16:17 View session

Copilot AI reviewed Aug 29, 2026

View reviewed changes

Comment thread scripts/automation/production-validation-helpers.js Outdated

Comment thread scripts/automation/production-validation-helpers.js

Comment thread scripts/automation/production-validation.js

ashleyshaw marked this pull request as ready for review August 29, 2026 16:31

Merge branch 'develop' into copilot/reporting-agent-v2-phase-6-1

396d239

ashleyshaw enabled auto-merge (squash) August 29, 2026 16:52

Potential fix for pull request finding

9446652

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Signed-off-by: Ash Shaw <ashley@lightspeedwp.agency>

ashleyshaw and others added 2 commits August 29, 2026 18:52

Potential fix for pull request finding

0a1688d

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Signed-off-by: Ash Shaw <ashley@lightspeedwp.agency>

Potential fix for pull request finding

b1a7bc4

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Signed-off-by: Ash Shaw <ashley@lightspeedwp.agency>

ashleyshaw added this to the v1.1 milestone Aug 30, 2026

Merge branch 'develop' into copilot/reporting-agent-v2-phase-6-1

da3c7c4

Merge branch 'develop' into copilot/reporting-agent-v2-phase-6-1

2c9d8e0

claude Bot added area:ci Build and CI pipelines area:scripts Scripts & tooling area:tests Test suites & harnesses lang:js JavaScript/TypeScript lang:json JSON config/content type:bug Bug or defect labels Sep 2, 2026

Navigation Menu

Uh oh!

feat(automation): Phase 6.1 – Production Validation helpers, CLI and tests - #2495

feat(automation): Phase 6.1 – Production Validation helpers, CLI and tests#2495
ashleyshaw with Copilot wants to merge 9 commits into
developfrom
copilot/reporting-agent-v2-phase-6-1

Copilot AI commented Aug 29, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented Aug 29, 2026

Uh oh!

github-actions Bot commented Aug 29, 2026

Uh oh!

github-actions Bot commented Aug 29, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 29, 2026

Uh oh!

github-actions Bot commented Aug 29, 2026

Uh oh!

github-actions Bot commented Aug 29, 2026

Uh oh!

github-actions Bot commented Aug 30, 2026

Uh oh!

github-actions Bot commented Aug 30, 2026

Uh oh!

github-actions Bot commented Sep 2, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

Copilot AI commented Aug 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Changelog

Added

Checklist (Global DoD / PR)

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟡 Changes recommended

Suppressed comments (1)

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented Aug 29, 2026

🔍 Reviewer Summary for PR #2495

Recommendations

Uh oh!

github-actions Bot commented Aug 29, 2026

🔍 Reviewer Summary for PR #2495

Recommendations

Uh oh!

github-actions Bot commented Aug 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Aug 29, 2026

🔍 Reviewer Summary for PR #2495

Recommendations

Uh oh!

github-actions Bot commented Aug 29, 2026

🔍 Reviewer Summary for PR #2495

Recommendations

Uh oh!

github-actions Bot commented Aug 29, 2026

🔍 Reviewer Summary for PR #2495

Recommendations

Uh oh!

github-actions Bot commented Aug 30, 2026

Uh oh!

github-actions Bot commented Aug 30, 2026

🔍 Reviewer Summary for PR #2495

Recommendations

Uh oh!

github-actions Bot commented Sep 2, 2026

❌ Branch Name Validation Failed

Required Format

Allowed Branch Types

Valid Examples

Invalid Examples

Solution

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Copilot AI commented Aug 29, 2026 •

edited

Loading

github-actions Bot commented Aug 29, 2026 •

edited

Loading