Papers
arxiv:2610.05336

SheetSage2: Coherent Lead-Sheet Transcription with Synthetic Supervision

Published on Oct 4
· Submitted by
Ruibin Yuan
on Oct 8
Authors:
,
,
,
,
,

Abstract

Transcribing music into a human-readable score requires a coherent understanding of rhythm, harmony, melody, and form. Two obstacles limit this goal: annotated recordings are scarce, and accurate local predictions can still produce inconsistent musical sequences. We present SheetSage2, a unified music transcription framework that combines synthetic data, task-specific structured decoding, and autoregressive distillation. Automatically annotated MIDI, rendered into audio, provides scalable supervision across music understanding tasks. Task-specific structured decoders integrate complementary musical cues and their temporal dependencies to produce musically coherent scores. Autoregressive distillation further retains transcription accuracy without task-specific dynamic programming at inference. Across eight benchmark collections, a single SheetSage2-AR model exceeds the listed prior systems on 12 of 15 benchmark--metric pairs in our evaluation, substantially improving over SheetSage1 and surpassing task-specific models on several benchmarks. Model weights and inference code are publicly available.

Community

Paper submitter

We're sharing SheetSage2, a unified framework for turning music recordings into coherent, editable lead sheets and timed musical annotations. It transcribes melody, chords, beats, downbeats, key, and structure.

The framework combines scalable supervision from automatically annotated MIDI rendered into audio, task-specific structured decoding, and autoregressive distillation. A single SheetSage2-AR model outperforms the compared prior systems on 12 of 15 benchmark-metric pairs across eight benchmark collections, while avoiding task-specific dynamic programming at inference.

Model weights and inference code are available, with ABC and MIDI outputs for editing and downstream music workflows.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.05336
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 2

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.05336 in a dataset README.md to link it from this page.

Spaces citing this paper 63

Browse 63 spaces citing this paper

Collections including this paper 1