feat: Qwen3-TTS 1.7B VoiceDesign ONNX backend#2
Closed
wavekat-eason wants to merge 13 commits intomainfrom
Closed
Conversation
Switch qwen3-tts backend from 0.6B/elbruno to the WaveKat 1.7B VoiceDesign ONNX repo with INT4 by default. - download: replace ureq HTTP with hf-hub client; downloads int4/ ONNX + embeddings/ + tokenizer/ from wavekat/Qwen3-TTS-1.7B-VoiceDesign-ONNX (pinned revision) - model: HIDDEN_DIM 1024→2048, MAX_NEW_TOKENS 2048→8192, sampling updated to config.json values (top_k=50, temp=0.9), non-streaming prefill (all text in prefill, matches generate_onnx.py), fix last-position logits extraction bug, min_new_tokens=2, VoiceDesign codec prefix (4 tokens, no speaker slot), int4/ and embeddings/ subdirectory paths - sampler: replace top_p with top_k - tokenizer: load from tokenizer/ subdirectory Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
- Add `instruction` field to `SynthesizeRequest` with `with_instruction()` - Qwen3-TTS backend builds user-turn prefix from instruction tokens; warns on stderr when no instruction is provided - Upgrade hf-hub 0.3 → 0.5 (fixes relative-Location redirect bug) - synthesize example: default instruction, /lang, /langs, /instruct, /status, /help commands for live session control Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
ModelPrecisionenumSynthesizeRequest::with_instruction) for style controlTest plan
make test-qwen3passescargo run --example synthesize --features qwen3-tts,hound -- "Hello"downloads INT4 and produces audiocargo run --example synthesize --features qwen3-tts,hound -- --precision fp32 "Hello"downloads FP32 and produces audiocargo run --example synthesize --features qwen3-tts,hound -- -ienters interactive modeWAVEKAT_MODEL_DIR=<path> cargo run --example synthesize --features qwen3-tts,hound -- "Hello"loads from local dir🤖 Generated with Claude Code