Ethanfel/ComfyUI-Prompt-Calibrator
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add SxCP Audio Prompt Guide node (audio -> waveform image + timing summary)

Browse Source 
New node for audio-guided video prompts (LTX): takes a ComfyUI AUDIO clip + free-text
motion notes and outputs (1) a rendered energy-envelope IMAGE with beat/segment markers
so the vision model can see the audio shape, and (2) an audio_summary STRING with
duration, tempo/beats (librosa optional), per-segment energy + 8n+1-snapped frame counts
+ stage hints + the notes. Wire waveform_image -> Judge.reference_image and audio_summary
-> Judge.user_prompt (chat mode, json_output) for beat-aligned LTX JSON. librosa optional
(energy envelope + segments work without it). Registered in __init__; README workflow added.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
Ethanfel
2026-07-04 22:02:12 +02:00
co-authored by Claude Opus 4.8
parent 8b567cb531
commit 6e6232d4ab
4 changed files with 204 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
requirements.txt
+3
View File
@@ -8,5 +8,8 @@ pillow
numpy
# for precision=nf4 (4-bit) — needed to run the 30B-A3B abliterated judge on 32 GB:
bitsandbytes
# optional, for the Audio Prompt Guide node — adds tempo (BPM) + beat times
# (energy envelope + segments work without it):
# librosa
# optional, for faster attention on the RTX 5090:
# flash-attn