Spaces:
Paused
Paused
Commit History
-
Fix diarization hub kwarg, yt-dlp cookies, stronger output formatting
Malina +1: Claude Opus 4.8- diarize: shim huggingface_hub.hf_hub_download/snapshot_download to translate the removed use_auth_token kwarg → token, so pyannote 3.3.2 loads on hub 1.x (fixes "Diarization unavailable: ... unexpected keyword argument 'use_auth_token'"). - fetch: support YouTube/Facebook cookies (YT_DLP_COOKIES[_B64] secret) + a real browser UA, the actual fix for "Sign in to confirm you're not a bot / age" on cloud IPs; still best-effort. - synthesis/chat: enforce a strong "CRITICAL OUTPUT FORMAT" (headings, bullets, numbered steps, tables for comparisons; no walls of text) for scannable answers. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>d0ff022
-
NINA: stop identity hallucination, fix diarization shims, drop output header
Malina +1: Claude Opus 4.8- VLM prompt: forbid naming a person from appearance/resemblance (the "Mark Twain" hallucination). Only use a name if it's written on screen or spoken; otherwise refer generically and say identity can't be determined. - diarize.py: pyannote 3.3.2 hits more removed torchaudio symbols on 2.11 (list/get/set_audio_backend); stub the whole removed I/O-backend API in one place. - synthesis.format_output: remove the "🧠 Based on uploaded video…" pre-message; output is now just the answer. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>6dd7da1 -
NINA: fix diarization (torchaudio AudioMetaData shim) + OCR score parsing
Malina +1: Claude Opus 4.8- diarize.py: pyannote 3.3.2 references torchaudio.AudioMetaData, removed in torchaudio 2.11. We feed pyannote an in-memory tensor (no file I/O), so shim the symbol before import to let it load. Fixes "module 'torchaudio' has no attribute 'AudioMetaData'". - ocr.py: RapidOCR 1.2.3 may return the confidence as a string → '>=' str/float crash. Parse score defensively; also pass BGR (cv2 convention) for the bottom strip. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>7342244 -
NINA: fix Space build — torch/torchaudio 2.11 matched pair; pyannote token kwarg
Malina +1: Claude Opus 4.8torchaudio has no 2.12 release (max 2.11), and it pins an exact torch, so pin both to 2.11.0. Keep pyannote.audio 3.3.2 (no torchcodec; compatible with hub 1.15). Make diarization auth robust to the hub token/use_auth_token rename. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>57dbdb2 -
NINA Phase 2: vocal isolation + speaker diarization + name attribution
Malina +1: Claude Opus 4.8- enhance.py: torchaudio Hybrid Demucs vocal isolation (best-effort, chunked). In ingest, when the first ASR pass is unreliable (musical/distorted), isolate the voice and re-transcribe; keep it only if it scores better. - diarize.py: pyannote speaker diarization → per-segment speaker labels, friendly Speaker 1/2 display names, multilingual self-introduction → name roster, and region speaker annotation. All best-effort (no-op if pyannote/token unavailable). - pipeline: third parallel ingest branch (Whisper ∥ CLIP ∥ diarization); speakers attached after join; region speakers + speaker note threaded to synthesis. - synthesis: fragments tagged with speaker; system prompt attributes lines and uses a self-introduced name for all of that speaker's lines (handles the gamer 'I won' case) — done inside the single existing LLM call (no extra inference credits). - requirements: torchaudio==2.12.0, pyannote.audio==3.3.2. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>e2c96b8