Skip to content

Automatically download and cache the pinned Kev 0.8B ONNX export - #60

Merged
elbruno merged 4 commits into
mainfrom
elbruno-local-decision-inference
Oct 22, 2026
Merged

elbruno merged 4 commits into
mainfrom
elbruno-local-decision-inference

Conversation

@elbruno

@elbruno elbruno commented Oct 22, 2026

Copy link
Copy Markdown
Owner

Summary

Follow-up to the native Kev integration. The user approved publishing a public preconverted ONNX export and making Kev behave like the library's other automatically acquired models.

  • Publish and verify anonymous access to elbruno/kev-0.8b-onnx, pinned export revision deec2b78a30db0c4d00ee36386e87be5382dafd7, with original licenses, reference results, manifest and provenance.
  • Support AddLocalKevDecisions() and new KevOnnxDecisionClient() without a local path. Acquisition happens only on first use, using the existing Hugging Face downloader with atomic/resumable writes and a revision-specific cache.
  • Verify manifest SHA-256 hashes before recording completion; recognize complete cache offline and repair missing/changed assets. Coordinate clients/processes and preserve cancellation and actionable errors.
  • Preserve existing explicit-path APIs without downloads, shared DI ordering, Laya defaults and native scoring behavior.
  • Update SharedDecisions --kev, documentation and coordinated 0.24.1 release metadata. No Python, conversion, Ollama or server is needed by consumers.

Verification

  • Public download from an empty cache followed by all six Choice/Score/Assessment reference cases passed, within 1e-4. A fresh client repeated the cases with HTTP blocked and made no additional HTTP attempts.
  • Actual default SharedDecisions --kev ran successfully.
  • New offline coverage exercises incomplete/corrupt cache, hash rejection, local-only paths, cancellation/retry, concurrent acquisition, process-lock cancellation and lazy registration.
  • 111 offline decision tests pass, three live tests skip by default. Local Laya and Kev inference also passed.
  • Full solution Release build and default solution test run passed; the existing CI -p:NoBuild=false override is retained.
  • All five coordinated packages packed and passed 0.24.1 assembly/version validation.

The previous merged pull request remains unchanged; this is a new follow-up change.

Fixes: #58

Copilot and others added 4 commits October 22, 2026 16:37
Convert the pinned original Kev checkpoint and trained pointer head to CPU ONNX, preserve reference tokenization and complete probabilities, and prepare coordinated 0.24.0 packages. Document Tev1 licensing and remaining decision-model candidates without an Ollama backend.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: b4f53065-9fd2-4ae9-86c1-c5086fc1c8ae
Publish the verified preconverted Kev 0.8B export, acquire it lazily with integrity validation and reusable offline cache, preserve explicit-path APIs, and prepare coordinated 0.24.1 packages.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: b4f53065-9fd2-4ae9-86c1-c5086fc1c8ae
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: b4f53065-9fd2-4ae9-86c1-c5086fc1c8ae
@elbruno
elbruno merged commit fc639b6 into main Oct 22, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Validate local IDecisionClient inference with Laya and investigate Tev1 0.8B ONNX backend

1 participant