Skip to content

Reset the local inference cache before standalone re-inference.#17

Merged
maleadt merged 1 commit into
mainfrom
tb/reset-inference-cache
Jul 3, 2026
Merged

Reset the local inference cache before standalone re-inference.#17
maleadt merged 1 commit into
mainfrom
tb/reset-inference-cache

Conversation

@maleadt

@maleadt maleadt commented Jul 3, 2026

Copy link
Copy Markdown
Owner

The callee walk in typeinf! re-infers callees via typeinf_code on the same interpreter that ran the root inference cascade. The interpreter-local cache can still hold tombstoned (LimitedAccuracy) const-prop results from that deeper context, suppressing const-prop that would succeed in the standalone entry and storing under-optimized source (e.g. unfolded Symbol dispatch, failing GPU IR validation; JuliaGPU/CUDA.jl#3185). Clear the cache before each re-inference, matching the runtime's fresh-interpreter-per-entry behavior.

The callee walk in `typeinf!` re-infers callees via `typeinf_code` on the
same interpreter that ran the root inference cascade. The interpreter-local
cache can still hold tombstoned (LimitedAccuracy) const-prop results from
that deeper context, suppressing const-prop that would succeed in the
standalone entry and storing under-optimized source (e.g. unfolded Symbol
dispatch, failing GPU IR validation; JuliaGPU/CUDA.jl#3185). Clear the cache
before each re-inference, matching the runtime's fresh-interpreter-per-entry
behavior.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@maleadt maleadt merged commit 1b40a34 into main Jul 3, 2026
22 checks passed
@maleadt maleadt deleted the tb/reset-inference-cache branch July 3, 2026 11:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant