Issues

• --display none hides setup errors: inspect eval exits 1 with no message

  UKGovernmentBEIS/inspect_ai#6029 · Filter by author cwklurks opened on Oct 22, 2026

• [DRAFT - IGNORE FOR NOW] Inspect catches broad Exception below its fault barriers in 84 places; narrow them and add a lint gate

  UKGovernmentBEIS/inspect_ai#6021 · Filter by author art-dsit opened on Oct 22, 2026

• CompactionAuto falls back to summary compaction on provider errors, not only NotImplementedError, with only a stderr warning

  UKGovernmentBEIS/inspect_ai#6020 · Filter by author art-dsit opened on Oct 22, 2026

• react(): a token or cost limit hit during forced compaction is lost and the sample records as success with the default truncation="disabled"

  UKGovernmentBEIS/inspect_ai#6019 · Filter by author art-dsit opened on Oct 22, 2026

• web_search("google") swallows LimitExceededError and ModelRefusalError raised by its relevance model calls

  UKGovernmentBEIS/inspect_ai#6018 · Filter by author art-dsit opened on Oct 22, 2026

• on_sample_event hooks cannot enforce limits: the sample event emitter swallows LimitExceededError, contrary to the hooks docs

  UKGovernmentBEIS/inspect_ai#6017 · Filter by author art-dsit opened on Oct 22, 2026

• math(): an answer equal to the target inside a set, tuple or interval is scored INCORRECT because a sympy .equals failure is swallowed

  UKGovernmentBEIS/inspect_ai#6016 · Filter by author art-dsit opened on Oct 22, 2026
  1

• Sample, message, and event dataframe readers do not forward strict=False when reading EvalColumns

  UKGovernmentBEIS/inspect_ai#6015 · Filter by author wo658 opened on Oct 22, 2026

• Sample keeps running in an empty sandbox after its Kubernetes pod is replaced, even with restarted_container_behavior="raise"

  UKGovernmentBEIS/inspect_ai#6011 · Filter by author tadamcz opened on Oct 22, 2026
  8

• ModelEvent.input gives messages with identical content the id of the first one

  UKGovernmentBEIS/inspect_ai#6010 · Filter by author andrei-apollo opened on Oct 21, 2026
  

• Checkpoint resume leaves restored turns outside their "checkpoint restore" span when a checkpoint fired inside a tool

  UKGovernmentBEIS/inspect_ai#6008 · Filter by author brandly opened on Oct 21, 2026
  

• Tool result images break parallel tool calls on Chat Completions

  UKGovernmentBEIS/inspect_ai#5997 · Filter by author dragonstyle opened on Oct 21, 2026

• dont assume PATH or override it

  UKGovernmentBEIS/inspect_ai#5996 · Filter by author teto opened on Oct 21, 2026

• recognize other linux distributions

  UKGovernmentBEIS/inspect_ai#5995 · Filter by author teto opened on Oct 21, 2026

• match(numeric=True) scores a correct number INCORRECT when it is attached to a label or = without a space (ANSWER:60, 28+32=60)

  UKGovernmentBEIS/inspect_ai#5994 · Filter by author Fruiterer333 opened on Oct 21, 2026

• Docker Sandbox (sbx) microVMs

  UKGovernmentBEIS/inspect_ai#5993 · Filter by author hdevereux-turing opened on Oct 21, 2026

• Inspect AI 0.3.281: _retry.py passes tenacity's deprecated initial= to wait_exponential_jitter (DeprecationWarning with tenacity 9.2.1)

  UKGovernmentBEIS/inspect_ai#5989 · Filter by author tyfong-lbl opened on Oct 21, 2026
  1

• read_eval_log(exclude_fields={"events"}) fails with ValidationError when samples have timelines

  UKGovernmentBEIS/inspect_ai#5984 · Filter by author avgvi opened on Oct 20, 2026
  2

• evals_df() model_args column has the base URL instead of the model args

  UKGovernmentBEIS/inspect_ai#5983 · Filter by author avgvi opened on Oct 20, 2026
  1

• react(): AgentSubmit name and description are ignored when the submit tool is a ToolDef

  UKGovernmentBEIS/inspect_ai#5982 · Filter by author avgvi opened on Oct 20, 2026

• OpenRouter rewrites reasoning_effort "max" to xhigh

  UKGovernmentBEIS/inspect_ai#5980 · Filter by author Arz-Gev opened on Oct 20, 2026

• Empty completions can score CORRECT in model_graded_qa and choice

  acceptedbugscoring
  UKGovernmentBEIS/inspect_ai#5978 · Filter by author jacob-securebio opened on Oct 20, 2026
  1

• Bayes@N for repeated binary scores: placement and completeness contract

  UKGovernmentBEIS/inspect_ai#5977 · Filter by author mohsenhariri opened on Oct 20, 2026

• OpenAI Responses: content-filter stop is lost when the response already contains function calls

  UKGovernmentBEIS/inspect_ai#5971 · Filter by author ollijarviniemiAISI opened on Oct 19, 2026
  1

• agent_bridge + anthropic/claude-sonnet-5-5: 400 "assistant message prefill" on the third model call of a chat-completions tool loop

  UKGovernmentBEIS/inspect_ai#5970 · Filter by author AlexandreManai opened on Oct 19, 2026