ci: run UI e2e tests in CI - #742
Conversation
|
Warning Review limit reached
Next review available in: 21 minutes You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository. How can I continue?After more reviews become available, a review can be triggered using the To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews. How do review limits work?CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability. For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window. Please refer docs for additional details. No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Plus Run ID: ⛔ Files ignored due to path filters (1)
📒 Files selected for processing (1)
🚧 Files skipped from review as they are similar to previous changes (1)
📝 WalkthroughWalkthroughThe PR adds a UI E2E job to CI with Playwright report artifacts, configurable local or registry-based cluster images, optional GHCR authentication, updated frontend test configuration, and documentation for the CI flow. ChangesUI E2E CI integration
Estimated code review effort: 3 (Moderate) | ~25 minutes Merge Risk: ⚪ Minimal · up to No actionable merge-blocking risk remains; the PR is merge-ready after normal checks and review. Sequence Diagram(s)sequenceDiagram
participant GitHubActions
participant Nix
participant Makefile
participant Kind
participant Playwright
participant ArtifactStorage
GitHubActions->>Nix: Configure the test environment
Nix->>Makefile: Run UI E2E target
Makefile->>Kind: Create the configured E2E cluster
Kind->>Playwright: Execute UI E2E tests
Playwright->>ArtifactStorage: Upload the HTML report
Suggested labels: Suggested reviewers: 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Actionable comments posted: 1
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
Inline comments:
In @.github/workflows/test-e2e.yaml:
- Around line 52-79: Update the test-ui-e2e job to mirror the existing test-e2e
job’s needs: buildAndPush dependency and job-level if condition requiring the
ok-to-e2e and ok-to-image labels. Keep the existing runner, setup steps,
environment, and test command unchanged.
🪄 Autofix
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: defaults
Review profile: CHILL
Plan: Pro Plus
Run ID: 6241679b-acbb-4fa6-aad5-f74a7d181b65
⛔ Files ignored due to path filters (1)
web/pnpm-lock.yamlis excluded by!**/pnpm-lock.yaml
📒 Files selected for processing (8)
.github/workflows/test-e2e.yamlMakefiledocs/developer-guide/frontend-development.mdhack/dev-cluster.shweb/e2e/pipeline-journey.spec.tsweb/package.jsonweb/playwright.config.tsweb/tsconfig.json
Coverage Report for CI Build 31800651011Coverage remained the same at 80.329%Details
Uncovered ChangesNo uncovered changes found. Coverage Regressions6 previously-covered lines in 2 files lost coverage.
Coverage Stats
💛 - Coveralls |
What
Runs the Playwright UI e2e suite in CI, with failures reported in the PR.
Closes #627
Why
The UI had no CI coverage at all
Run strategy: the new job hangs off
buildAndPush, reusing the existingok-to-e2e/ok-to-imagegate instead of adding an additional label.Reporting: Playwright's built-in
githubreporter writes failure annotations into the PR diff, and the HTML report (with traces and failure screenshots) is attached to the run as theplaywright-reportartifact.Testing
Notes for reviewers
dev-cluster.shcreatesghcr-pull-secretwheneverGHCR_TOKENis non-empty, including locally if you have it exportedChecklist
Summary by CodeRabbit
New Features
Bug Fixes
Documentation
Chores