Skip to content

feature(asr-workers,extract-worker,translation-worker): model cache#62

Open
ClemDoum wants to merge 1 commit into
mainfrom
feature(datashare-python)/model-cache
Open

feature(asr-workers,extract-worker,translation-worker): model cache#62
ClemDoum wants to merge 1 commit into
mainfrom
feature(datashare-python)/model-cache

Conversation

@ClemDoum

@ClemDoum ClemDoum commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

⚠️ breaking datashare-python

Descriptions

Implement shared resources caching.

Changes

datashare-python

Changed

  • renamed Shared into SharedResources
  • limited SharedResources API to get_or_cache_resource(key: str, default_factory: Callable[[], Any]) -> Any
  • remove async Shared APIs (since they are unused and it simplifies implem)

Added

  • introduced ResourceCacheConfig to help configuring cache per worker app

asr-worker, extract-worker, translation-worker

Added

  • implemented component caching

asr-worker

Changed

  • removed translator level hunyuan caching in favor of activity level caching

@ClemDoum
ClemDoum force-pushed the feature(datashare-python)/model-cache branch 3 times, most recently from b4eb548 to 447d00a Compare July 16, 2026 16:09
@ClemDoum
ClemDoum marked this pull request as ready for review July 17, 2026 07:46
@ClemDoum ClemDoum self-assigned this Jul 17, 2026
@ClemDoum
ClemDoum requested a review from winsomeglint July 17, 2026 07:46
@ClemDoum
ClemDoum force-pushed the feature(datashare-python)/model-cache branch from 447d00a to f5c84b6 Compare July 17, 2026 07:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant