Repository navigation
Add portable Qwen CPU/CUDA/ROCm backends alongside MLX - #95
Conversation
|
Linux x64 actual CPU synthesis passed: live run 43022955802. English and Italian, offline, official pinned 0.6B CustomVoice, float32/SDPA, 2 CPU threads; one warm-model load. The uploaded JSON records timing and hashes only. Warm Italian request: 10.65 s for 2.64 s audio (RTF 4.04), so this is deliberately not a real-time CPU claim. Linux/macOS Python suites also passed. Windows initially caught two pre-existing POSIX chmod assertions; these now assert permission bits only on POSIX while still checking directory creation everywhere. The ADR now declares its proposed status for the docs checker. |
|
Final validation on head db05de6: CI passed, including the Linux/macOS Python suites, Windows portable tests, documentation, invariants and all existing module jobs: https://github.com/phoebus-84/video-studio/actions/runs/43028839487 . The opt-in actual Linux x64 CPU synthesis also passed again: https://github.com/phoebus-84/video-studio/actions/runs/43028839825 . CUDA/ROCm performance remains explicitly unmeasured; no GGUF backend or portable alignment/ASR is claimed. The isolated worktree is clean, and this PR has not been merged. |
|
Real hardware validation completed on cecino without modifying/restarting ComfyUI: RX 7900 XTX, Python 3.12.16, Torch 2.11.0+rocm7.2, qwen-tts 0.1.1, cuda:0/BF16/SDPA, offline official 1.7B weights. 422 Python tests passed (6 opt-in skipped); live English/Italian smoke passed with one warm model load. Extended Italian preset: 10.80 s audio / 24.48 s wall; synthetic-only consented Base clone: 6.40 s / 71.29 s including first-use costs; deleting the enrolled profile blocked further synthesis. Both longer samples transcribed offline by faster-whisper large-v3 with zero normalized word errors. No listening/voice-similarity approval or controlled performance claim. Reports/logs and synthetic WAVs remain in the isolated ~/ai/video-studio-pr95-smoke/ directory, never git. Integration fixes preserve runtime in studio synthesis receipts and pass explicit preset seeds through; ADR renumbered to 0051 so film keeps 0050. |
Summary
Extend video-studio/packages/voice, not the website or an independent TTS repository. Based on the latest main at the start of work (
3d51988), developed in a separate worktree; the operator's existing checkout/branch and changes were not switched, reset or stashed.Backend choice
GGUF implementations were inspected, but are not advertised as implemented. Their complete speech pipeline, profile/control parity, native artifacts and runtime baseline need an independently pinned/benchmarked adapter. This chooses broad official-model compatibility, not an unsubstantiated “fastest everywhere” claim.
Integrity / provenance
*-torchdirectories. Existing*-8bitinstalls are not overwritten or reused as Torch models.Validation completed locally
npm run checkpassed across the monorepo (21 module test runs, zero failed).npm run check:contractspassed after adding runtime provenance (416 tests).npm run docs:buildpassed.Explicit limitations
packages/voice/docs/backends.md; these are not a controlled throughput benchmark or listening-quality approval. NVIDIA CUDA hardware remains untested.npm run checkpassed (22 workspace test runs), docs build passed, studio synthesis receipts preserve worker runtime and explicit preset seeds are forwarded. CI, including the opt-in Linux CPU live smoke, passed.CI now runs real hardware-independent tests on Linux/macOS, portable adapter/config/lifecycle/contracts/synthesis tests on Windows. Apply
voice-live-smoketo explicitly opt into the pinned public-model Linux x64 CPU live smoke (or dispatch the workflow manually after it is on main); it uploads JSON measurements only.