Hugging Face's logo

DeepBeepMeep
/
TTS

Diffusion Single File
Safetensors
Model card Files
xet
 Community
TTS / sheetsage2 /README.md
DeepBeepMeep's picture
DeepBeepMeep
Add merged BF16 SheetSage2 and MERT2 checkpoint for YuE2 scoring
864a479 verified
preview code
|
Raw History Blame Contribute Delete
1.19 kB

SheetSage2 / MERT2 for WanGP

Merged BF16 music-transcription checkpoint prepared for WanGP YuE2 source-song scoring. It extracts a melody or melody and chords as ABC notation; lyrics must be supplied separately.

Sources and attribution: Multimodal Art Projection (MAP) Team and collaborators.

Weights are subject to CC BY-NC 4.0 (non-commercial use); see the accompanying upstream license files.

SheetSage2 attention adapters are merged into MERT2 in FP32 before BF16 conversion. Four audio frontend buffers remain FP32. Shared embeddings are recorded using MMGP tied-weight metadata. The conversion manifest records source revisions and tensor coverage.

Place SheetSage2_MERT2_bf16.safetensors in ckpts/sheetsage2/. WanGP loads it only when source scoring is requested and releases the model after transcription. This checkpoint uses WanGP's local SheetSage2 implementation.

Checkpoint SHA-256: b4b0d83c2fa0c6e912479866078a2c22f4a0ff4e4e63ed33b780b941cc2bad47.