Upload docs/RETRAIN_RESULTS_2026-09-03.md with huggingface_hub

docs/RETRAIN_RESULTS_2026-09-03.md

@@ -0,0 +1,48 @@
+# Corrected-cache retrain results -- 2026-09-03
+
+Models: run7' (base_c), arm B' (armB_c), arm C' (armC_c), arm A' (armA_c),
+all trained under YARN_ORIG_MAXPOS=4096 and evaluated under the same.
+Generative substring-match scoring, greedy, bf16, N=100 per cell.
+
+## PROMPT_LEN=1024
+```
+task,armA_c,armB_c,armC_c,base_c
+niah_single,89.0,87.0,92.0,87.0
+val_backward,2.0,2.0,1.0,3.0
+```
+
+## PROMPT_LEN=2048
+```
+task,armA_c,armB_c,armC_c,base_c
+niah_single,76.0,73.0,82.0,82.0
+val_backward,0.0,0.0,0.0,1.0
+```
+
+## PROMPT_LEN=4096
+```
+task,armA_c,armB_c,armC_c,base_c
+niah_single,62.0,60.0,68.0,71.0
+val_backward,2.0,1.0,3.0,4.0
+```
+
+## PROMPT_LEN=8192
+```
+task,armA_c,armB_c,armC_c,base_c
+niah_single,34.0,31.0,37.0,38.0
+val_backward,1.0,2.0,2.0,4.0
+```
+
+## PROMPT_LEN=16360
+```
+task,armA_c,armB_c,armC_c,base_c
+niah_single,25.0,23.0,26.0,27.0
+val_backward,4.0,1.0,0.0,0.0
+```
+
+## Training losses
+```
+run7'  (run 6, step 750): loss: 2.383854
+arm B' (run 7, step 400): loss: 2.775537
+arm c' : loss: 2.866560
+arm a' : loss: 2.550660
+```