Spaces:
Paused
Paused
Commit History
-
NINA Phase 2: vocal isolation + speaker diarization + name attributionβ
Malina +1: Claude Opus 4.8- enhance.py: torchaudio Hybrid Demucs vocal isolation (best-effort, chunked). In ingest, when the first ASR pass is unreliable (musical/distorted), isolate the voice and re-transcribe; keep it only if it scores better. - diarize.py: pyannote speaker diarization β per-segment speaker labels, friendly Speaker 1/2 display names, multilingual self-introduction β name roster, and region speaker annotation. All best-effort (no-op if pyannote/token unavailable). - pipeline: third parallel ingest branch (Whisper β₯ CLIP β₯ diarization); speakers attached after join; region speakers + speaker note threaded to synthesis. - synthesis: fragments tagged with speaker; system prompt attributes lines and uses a self-introduced name for all of that speaker's lines (handles the gamer 'I won' case) β done inside the single existing LLM call (no extra inference credits). - requirements: torchaudio==2.12.0, pyannote.audio==3.3.2. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>e2c96b8