feat(eval): per-agent per-version eval scorecard + release gate#1873

Open

itomek wants to merge 20 commits into

mainfrom

feat/issue-1862-eval-scorecard

Commits on Jun 25, 2026

test(eval): add TDD tests for release scorecard + gate (frozen contract)
Tomasz Iniewicz
committed
feat(eval): add release_scorecard + scorecard_gate modules (increments 1-3)
Tomasz Iniewicz
committed
feat(eval): add email adapter gen_scorecard.py + fix loose-coupling test (increments 4)
Tomasz Iniewicz
committed
feat(eval): docs, hello-world scorecard, CI gate, npm wiring (increments 5-6)
Tomasz Iniewicz
committed
feat(eval): deepen validate_scorecard with nested-field checks
Tomasz Iniewicz
committed
feat(eval): record eval limit + derive model in email scorecard adapter
Tomasz Iniewicz
committed
ci(eval): pin scorecard-gate setup-python to @v6
Tomasz Iniewicz
committed

Commits on Jun 26, 2026

feat(eval): email v0.2.4 scorecard from real benchmark run
Tomasz Iniewicz
committed
feat(eval): scorecard refresh/reject CI loop, adoption skill, correct taxonomy ref
Tomasz Iniewicz
committed
feat(eval): surface eval scorecard in Agent Hub worker and publish flow
Tomasz Iniewicz
committed
feat(eval): show eval score and scorecard link in Agent UI detail modal
Tomasz Iniewicz
committed
Merge branch 'main' into feat/issue-1862-eval-scorecard
itomek
authored
feat(eval): regenerate email v0.2.4 scorecard against relabeled corpus
Tomasz Iniewicz
committed
Merge remote-tracking branch 'origin/main' into feat/issue-1862-eval-scorecard
Tomasz Iniewicz
committed
refactor(eval): single SCORECARD.md per agent, new gate interface, reproduction section
Tomasz Iniewicz
committed
refactor(eval): replace scorecards/ dirs with single SCORECARD.md per agent
Tomasz Iniewicz
committed
refactor(eval): update hub worker, workflows, and publish for SCORECARD.md
Tomasz Iniewicz
committed
docs(eval): update scorecard docs and skill for single SCORECARD.md convention
Tomasz Iniewicz
committed
fix(eval): scorecard_gate pylint and black formatting
Tomasz Iniewicz
committed
feat(eval): email SCORECARD.md from full-corpus run (46.0); portable reproduction
Tomasz Iniewicz
committed