Spaces:
Running on Zero
Download README.md from Hayeonbang/PitchIn: direct link, hf CLI and curl.
- Browser
- Download file 2.1 kB
-
https://huggingface.co/spaces/Hayeonbang/PitchIn/resolve/main/README.md
- Command line
-
hf download hf://spaces/Hayeonbang/PitchIn/README.md
-
curl -L -o README.md https://huggingface.co/spaces/Hayeonbang/PitchIn/resolve/main/README.md
A newer version of the Gradio SDK is available: 6.32.0
title: PitchIn
emoji: 🎙️
colorFrom: green
colorTo: blue
sdk: gradio
sdk_version: 5.49.1
python_version: '3.12'
app_file: app.py
pinned: false
short_description: Ask questions about your singing with PitchIn-Q
PitchIn
Upload a short singing recording and ask a question. PitchIn-Q generates English coaching feedback using Qwen2.5-Omni-7B adapted on Focused QA and Overall Feedback.
This initial research demo accepts 1–60 seconds of audio and questions up to 1,000 characters. Each request is independent. The model may miss or misidentify issues. This interactive demo is not a benchmark evaluation.
Deployment
Use Gradio + ZeroGPU. Gradio and spaces are provided by the Space runtime.
The deployment runtime supplies PyTorch 2.13; torchvision 0.28 matches it and is
needed by the multimodal processor even for audio-only requests. The local
smoke-test environment uses the existing research PyTorch 2.7 / torchvision 0.22.
The Space stores the 617 MiB PitchIn-Q adapter in adapter/ and the exact
paper processor in processor/. It downloads the public base model pinned to
revision ae9e1690543ffd5c0221dc27f79834d0294cba00, merges the adapter at startup,
and moves the model to CUDA before requests. No account token is needed by the app.
For local use, PITCHIN_MODEL_PATH can point to the existing merged checkpoint;
alternatively set PITCHIN_BASE_MODEL, PITCHIN_ADAPTER_PATH, and
PITCHIN_PROCESSOR_PATH to local directories. Inference is text-only, BF16,
SDPA, with the checkpoint's native user audio/text chat template. No extra
system prompt or vocal separation is applied. Sampling is temperature 0.6,
top-p 0.85, top-k 30, repetition penalty 1.08, and at most 384 output tokens.
The 60-second limit applies only to this demo, not to paper evaluation inputs.
For a local UI-only preview, set PITCHIN_PREVIEW_ONLY=1. It is visibly labeled
and refuses inference; it never supplies simulated model responses.
Set GRADIO_SERVER_NAME=0.0.0.0 in the Space environment. Locally the app binds
only to loopback unless explicitly configured otherwise.