Commit History
-
release(2.0.0): base-template retrain on posix-sdc v2.0.0
Tiara RodneyUnverified signatureNew r=16 attention-only adapter (prior champion was r=32 + MLP) trained AND served with EuroLLM-9B-Instruct's exact ChatML template (apply_chat_template + normalize_for_template, no placeholder markers), 4-bit QLoRA on the gate-hardened posix-sdc v2.0.0 corpus. Fixes the prior render mismatch (placeholder-trained weights no-op'd in deployment). - weights + teletype-lora-f16.gguf regenerated; tokenizer carries the base template verbatim - bounded/greedy held-out eval: operate 1.0, clean 7/16, verified 0.75; does the work but under-terminates at r=16 (base 0/16, verified 0.19) - card + loss/outcomes figures regenerated; training logs refreshedad4a0fd
-
feat(2): promote r=32+MLP adapter to v1.1.0
Tiara RodneyUnverified signatureSwap the held-out winner (ckpt-euro-787-r32-mlp) in as the repo's adapter: r=32, alpha=64, targets q/k/v/o + gate/up/down_proj (101.8M trainable, 1.10%; weights 71MB -> 407MB). Base path in adapter_config restored to the HF id. Card + changelog updated to the v1.1.0 held-out numbers (temp 0.7): terminate 0.56 -> 0.69, verified 0.56 -> 0.75, clean 4/16 -> 6/16, with text_replace success 1/8 -> 4/8. Result figures (loss, outcomes) regenerated for the r=32+MLP run; loss.gp title updated. The v1.0.0 narrative is retained with the capacity finding folded in: the live frontier moved from 'won't terminate' to exit-vs-panic discrimination on already-completed work.1e241a0 -
feat: commit trained adapter, QLoRA config, and held-out eval results
Tiara RodneyUnverified signatureThe v1.0.0 artifact: the EuroLLM-9B-Teletype LoRA adapter, its exact training configuration, and the measured held-out scores. Training (sekft-train, on a Tesla V100-32GB): base utter-project/EuroLLM-9B-Instruct quant 4-bit QLoRA (nf4, bitsandbytes), fp16 compute LoRA r=16, alpha=32, dropout=0.05, bias=none targets q_proj, k_proj, v_proj, o_proj (attention only) schedule 3 epochs, lr 2e-4, batch 1, grad-accum 8, max-len 4096 data tiararodney/posix-sdc v1.2.2, 787 trajectories (785 usable) loss assistant-only mask, ChatML train=serve render contract result assistant-only loss 2.24 (start) -> 0.55 (final), 297 steps Held-out eval (16 scenarios, 8 text_replace + 8 permissions, no scaffold): adapter operate 1.00 terminate 0.56 verified 0.56 clean 4/16 base ctrl operate 0.00 terminate 0.00 verified 0.44 clean 0/16 The adapter installs operation and termination outright; the verified near-tie is the trivially-re…b04e8df -
chore: scaffold EuroLLM-9B-Teletype model card and pipeline figures
Tiara RodneyUnverified signature4802c1c