Skip to content

test(evaluation): update the evaluation tests for the current agents CORE-803 - #322

Merged
musayann merged 1 commit into
feat/structured-output-promptsfrom
feat/upgrade-gemini-3-models
Oct 8, 2026
Merged

test(evaluation): update the evaluation tests for the current agents CORE-803#322
musayann merged 1 commit into
feat/structured-output-promptsfrom
feat/upgrade-gemini-3-models

Conversation

@irumvanselme

@irumvanselme irumvanselme commented Oct 5, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor
  • expect FORMAL_SECTOR_WAGED_EMPLOYMENT for paid work (there is no self-employment work type any more)
  • follow the current agent APIs (classifier result, explorer metadata, phase handler LLM providers, skill explorer args)
  • set an application config and a locale for every evaluation test
  • use the deep reasoning tier for the LLM judges instead of a retired model
  • add the infer occupation tool test results

Fixes:

@irumvanselme
irumvanselme added this pull request to stack #319 October 5, 2026 08:50
@irumvanselme
irumvanselme force-pushed the feat/upgrade-gemini-3-models branch from 4a2e680 to ee570df Compare October 7, 2026 06:37
@irumvanselme irumvanselme changed the title test(evaluation): update the evaluation tests for the current agents test(evaluation): update the evaluation tests for the current agents CORE 803 Oct 7, 2026
@irumvanselme irumvanselme changed the title test(evaluation): update the evaluation tests for the current agents CORE 803 test(evaluation): update the evaluation tests for the current agents CORE-803 Oct 7, 2026
@irumvanselme
irumvanselme force-pushed the feat/upgrade-gemini-3-models branch from ee570df to 5befa06 Compare October 7, 2026 08:41
@irumvanselme
test(evaluation): update the evaluation tests for the current agents
a0f534d 
- expect FORMAL_SECTOR_WAGED_EMPLOYMENT for paid work (there is no self-employment work type any more)
- follow the current agent APIs (classifier result, explorer metadata, phase handler LLM providers, skill explorer args)
- set an application config and a locale for every evaluation test
- use the deep reasoning tier for the LLM judges instead of a retired model
- add the infer occupation tool test results
@irumvanselme
irumvanselme force-pushed the feat/upgrade-gemini-3-models branch from 5befa06 to a0f534d Compare October 7, 2026 09:41
@musayann
musayann merged commit 37ad4b9 into main Oct 8, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@musayann musayann musayann approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@irumvanselme @musayann