--- license: other license_name: per-file tags: [onnx, audio, singing, source-separation, pitch-estimation, speech-recognition, forced-alignment, beat-tracking] --- # singcheck models The networks the singcheck app runs on the user's own computer to prepare a song for singing along: the singer's voice alone, her melody, the words with their times, the exact word starts, who sings each line, the beats. ONNX exports (made with `scripts/export_onnx.py` of the singcheck project, each checked against the original PyTorch model); the app fetches them once (about 2.4 GB) and runs them with ONNX Runtime — no audio leaves the computer. Big weights are stored in float16 and turned into float32 when loaded (half the download, the same results). | File | What | Source | License | |---|---|---|---| | `htdemucs.onnx` | the voice alone: htdemucs between its STFT and iSTFT (its 1D convolutions as 2D) | [facebookresearch/demucs](https://github.com/facebookresearch/demucs) | MIT | | `crepe_full.onnx` | the singer's melody: CREPE full | [marl/crepe](https://github.com/marl/crepe) via [torchcrepe](https://github.com/maxrmorrison/torchcrepe) | MIT | | `parakeet-fp16w/` | words with timestamps: Parakeet TDT 0.6B v3; `nemo128.onnx` is onnx-asr's preprocessor | [nvidia/parakeet-tdt-0.6b-v3](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3) via [istupakov/parakeet-tdt-0.6b-v3-onnx](https://huggingface.co/istupakov/parakeet-tdt-0.6b-v3-onnx), [onnx-asr](https://github.com/istupakov/onnx-asr) | CC-BY-4.0 (model), MIT (onnx-asr) | | `mms_fa.fp16w.onnx` (+ `.data`) | the lyrics aligner: MMS_FA (wav2vec2, with the star token) | [torchaudio MMS_FA](https://pytorch.org/audio/stable/generated/torchaudio.pipelines.MMS_FA.html), Pratap et al. 2023, *Scaling Speech Technology to 1,000+ Languages* | CC-BY-NC-4.0 — non-commercial use only | | `ecapa.onnx` | a speaker print (with its Fbank): ECAPA-TDNN | [speechbrain/spkrec-ecapa-voxceleb](https://huggingface.co/speechbrain/spkrec-ecapa-voxceleb) | Apache-2.0 | | `beat_this.onnx` | the beats: Beat This! (final0) on 1500-frame chunks | [CPJKU/beat_this](https://github.com/CPJKU/beat_this) | MIT | Each file keeps its upstream license; with MMS_FA in it the set as a whole is for non-commercial use.