| datasets: | |
| - breadlicker45/toast-midi-dataset | |
| tags: | |
| - music | |
| - midi | |
| - music generation | |
| - midi generation | |
| ## Training Details | |
| ### Training Data | |
| - [breadlicker45/toast-midi-dataset](https://huggingface.co/datasets/breadlicker45/toast-midi-dataset) | |
| #### Training Hyperparameters | |
| - model: phi3 | |
| - config: tv2o-medium | |
| - max-len: 2048 | |
| - lr: 1e-4 then 2e-5 | |
| - weight-decay: 0.01 | |
| - batch-size-per-gpu: 8 | |
| - GPUs: 2 A100 80gb | |
| - bfloat16 precision | |
| #### Loss | |
| - val loss: 0.2740 | |
| ## Files | |
| - model.ckpt: latest model checkpoint |