Apollo

Decoder-only Transformer (RoPE, RMSNorm, SwiGLU, tied embeddings) that generates monophonic melodies as symbolic tokens (BAR / POS / PITCH / DUR) conditioned on a header (tempo, time signature, key, bars, density, register, ...).

• model.safetensors: fp16 weights. lm_head is tied to emb.weight, so head.weight is not stored; build the model, load with strict=False, and the tie fills it.
• config.json: architecture (cfg), context length, training step and validation loss.
• vocab.json: token list in id order.
• best/ and last/: training checkpoints (.pt), used for resuming; load only from sources you trust.

Trained on melodies extracted from the Lakh MIDI dataset. Check the licensing of the source data before any commercial use.