Add MAESTRO-E robust piano v3 polytune checkpoint
Browse filesAdds an official-weight-initialized checkpoint fine-tuned on expanded multi-piano synthetic data with original-example replay. Existing official checkpoint paths are unchanged.
MAESTRO-E/robust-piano-v3/README.md
ADDED
|
@@ -0,0 +1,69 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: pytorch
|
| 4 |
+
tags:
|
| 5 |
+
- music-information-retrieval
|
| 6 |
+
- piano
|
| 7 |
+
- error-detection
|
| 8 |
+
- polytune
|
| 9 |
+
- audio-to-midi
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# PolyTune MAESTRO-E Robust Piano v3
|
| 13 |
+
|
| 14 |
+
This is an **additional robustness checkpoint**. It does not replace or
|
| 15 |
+
overwrite the official PolyTune MAESTRO-E checkpoint at
|
| 16 |
+
`MAESTRO-E/best.ckpt`.
|
| 17 |
+
|
| 18 |
+
## What is different
|
| 19 |
+
|
| 20 |
+
The model was initialized strictly from the official MAESTRO-E PolyTune weights
|
| 21 |
+
and then fine-tuned on a larger, more acoustically diverse piano dataset.
|
| 22 |
+
Training added synthesized piano performances, multiple piano timbres, and
|
| 23 |
+
replay of original MAESTRO-E examples to improve robustness while limiting
|
| 24 |
+
original-domain forgetting. The target contract and correct, missed, and extra
|
| 25 |
+
note classes remain compatible with the published PolyTune evaluator.
|
| 26 |
+
|
| 27 |
+
This is a data-diversity fine-tune, not a replacement architecture or a claim
|
| 28 |
+
that the official checkpoint's published results have changed.
|
| 29 |
+
|
| 30 |
+
## Selection
|
| 31 |
+
|
| 32 |
+
Checkpoint step: **104,000**.
|
| 33 |
+
|
| 34 |
+
This checkpoint was selected by repository-native, free-running note-error F1,
|
| 35 |
+
not by minimum teacher-forced validation loss. A later step reached lower loss
|
| 36 |
+
but regressed on the same extra/missed-note gates and was rejected.
|
| 37 |
+
|
| 38 |
+
| Fixed three-piece gate | Onset F1 | Extra F1 | Missed F1 | Correct F1 |
|
| 39 |
+
| --- | ---: | ---: | ---: | ---: |
|
| 40 |
+
| Original | 0.9472 | 0.8222 | 0.3550 | 0.9591 |
|
| 41 |
+
| Held-out Splendid piano | 0.8912 | 0.6420 | 0.3040 | 0.9036 |
|
| 42 |
+
|
| 43 |
+
These small fixed gates were used for checkpoint selection and are not a
|
| 44 |
+
replacement for a full release evaluation with confidence intervals.
|
| 45 |
+
|
| 46 |
+
## File
|
| 47 |
+
|
| 48 |
+
`MAESTRO-E/robust-piano-v3/model.ckpt`
|
| 49 |
+
|
| 50 |
+
- Size: 2,301,842,776 bytes
|
| 51 |
+
- SHA-256: `83259ea35ce8bc598978d66c073fb6c675a7d44d500480c239571fccddf8599d`
|
| 52 |
+
- Initialization: official MAESTRO-E PolyTune checkpoint
|
| 53 |
+
- Training status: checkpoint selected by native F1 at step 104,000
|
| 54 |
+
|
| 55 |
+
## Recommended use
|
| 56 |
+
|
| 57 |
+
Use this variant as the robustness-oriented PolyTune integration checkpoint.
|
| 58 |
+
Use `MAESTRO-E/best.ckpt` for exact official-result reproduction. LadderSym
|
| 59 |
+
robust v3 remains the recommended default for the live application because its
|
| 60 |
+
advantage is concentrated in application-critical extra- and missed-note F1,
|
| 61 |
+
especially on the held-out piano.
|
| 62 |
+
|
| 63 |
+
## Limitations
|
| 64 |
+
|
| 65 |
+
- The reported selection gates contain three fixed pieces per domain.
|
| 66 |
+
- Missed-note detection remains the hardest and lowest-F1 class.
|
| 67 |
+
- Synthetic diversity does not cover every acoustic piano, microphone, room,
|
| 68 |
+
noise source, vocal input, or reference-playback leakage condition.
|
| 69 |
+
- This model is research software and is not a calibrated pedagogical score.
|
MAESTRO-E/robust-piano-v3/manifest.json
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"architecture": "polytune",
|
| 3 |
+
"base_checkpoint": "MAESTRO-E/best.ckpt",
|
| 4 |
+
"bytes": 2301842776,
|
| 5 |
+
"checkpoint_step": 104000,
|
| 6 |
+
"description": "Official-weight initialization fine-tuned on expanded multi-piano synthetic data with original-example replay for robustness.",
|
| 7 |
+
"path_in_repo": "MAESTRO-E/robust-piano-v3/model.ckpt",
|
| 8 |
+
"selection": "repository-native free-running error F1 on fixed original and held-out-piano gates",
|
| 9 |
+
"sha256": "83259ea35ce8bc598978d66c073fb6c675a7d44d500480c239571fccddf8599d",
|
| 10 |
+
"variant": "maestro-e-robust-piano-v3"
|
| 11 |
+
}
|
MAESTRO-E/robust-piano-v3/model.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:83259ea35ce8bc598978d66c073fb6c675a7d44d500480c239571fccddf8599d
|
| 3 |
+
size 2301842776
|