Speed values below 0.3 produce noise, and 0.1 generates 10x the normal
audio length which can consume 20+ GB VRAM and freeze the system.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Each line starting with [Tag] now begins a new segment so users don't need
blank lines between tagged speeches. Continuation lines (no tag) are joined
to the previous tagged segment for multi-line speeches.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
- Add OmniVoiceSpeaker node (label + ref_audio + ref_text → OMNIVOICE_SPEAKER)
- Add OmniVoiceSpeakers node (roster with dynamic speaker_N inputs driven by
num_speakers INT widget; slots expand/collapse via ComfyUI JS extension)
- Add web/multi_speaker.js: ComfyUI extension that hooks onNodeCreated and
onConfigure to sync speaker_N inputs in real time (max 8 speakers)
- Extend OmniVoiceGenerate with optional speakers (OMNIVOICE_SPEAKERS) input;
when connected it routes each paragraph to the assigned speaker and
concatenates the results — supports alternate_paragraphs and tagged_speakers modes
- Remove OmniVoiceMultiSpeakerGenerate (generation now lives in the existing
Generate node)
- Refactor generator.py: extract _write_tmp_wav helper, add _tensors_to_audio
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Chinese characters vs English words are self-identifying to the model.
No need for a separate language signal on either node.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Voice Design now outputs (instruct, language) — wire language directly
into Generate to avoid setting it in two places. Generate's language
input is now a STRING (accepts the connection or manual 'auto').
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
- Generate: language dropdown (auto/English/Chinese), passed only in
voice_design and auto_voice modes where it selects the instruct vocab
- VoiceDesign: Chinese mode with dialect/age/pitch/gender dropdowns
using the model's validated Chinese instruct vocabulary (全角逗号)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
The model's _resolve_instruct() validates against a fixed vocabulary.
Only 10 accents are supported — removed all unsupported additions.
Updated tooltip to reflect actual constraints.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
If instruct is set alongside ref_audio, it is now forwarded to
model.generate() — allowing accent/style transfer on top of the
cloned voice identity. Model may or may not honour both simultaneously.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Language: ~170 world languages with type-to-filter dropdown
Accent: 50+ regional varieties grouped by area
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
OmniVoiceVoiceDesign: structured dropdowns for gender/age/pitch/accent
that compose into an instruct string — wire to Generate's instruct input.
OmniVoiceGenerate: new optional language dropdown (auto + 11 languages)
and guidance_scale (CFG, default 2.0) parameters.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
OmniVoice chunks long text internally; each chunk is a separate diffusion
pass with different random noise, causing voice drift between paragraphs.
Setting the same seed before each generate() call anchors the RNG state
and keeps the voice consistent. seed=0 means random (default behaviour).
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Users should connect a ComfyUI Whisper node to ref_text instead of
relying on omnivoice's internal ASR. Removes the error-catch workaround
and updates the tooltip accordingly.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
install.py: restore transformers>=5.0.0 (capping it would break other nodes).
generator.py: catch the torchcodec RuntimeError that fires when ref_text is
blank and transformers 5.x auto-transcription requires missing FFmpeg libs.
Raises a human-readable error telling the user to fill in ref_text manually.
Also updates the ref_text tooltip to recommend providing it explicitly.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Ethanfel