Spaces:
Running
Running
banner: fakt zamiast zapowiedzi (board still lists earlier values)
Browse files- index.html +1 -1
index.html
CHANGED
|
@@ -44,7 +44,7 @@
|
|
| 44 |
<span class="tag">ON THE BOARD</span> (Glint Tiny-ML, org <b>Fabryka AI</b>):
|
| 45 |
<b>GoLLeM-v5 64M</b> — eff 75.81 (BLiMP 75.83 / ARC-E 47.94 / byte_ppl 2.372) ·
|
| 46 |
<b>32M</b> — eff 75.41 (73.48 / 44.44 / 2.5386) ·
|
| 47 |
-
<b>16M</b> — eff 74.33 (70.08 / 40.91 / 2.6746). BLiMP recomputed on the full 67k-pair set after a fix in our eval harness (it counted 6 phenomena twice); board
|
| 48 |
<span class="tag">GOAL: #1 EFF</span> — JugnuLM-110M-R2+ holds eff 80.20. At 64M we need BLiMP+ARC > 133.5 with byte_ppl ~2.0 (we have 123.8): a ~9.7-point gap, to be closed by data, not size.<br>
|
| 49 |
<span class="tag">NOW TRAINING</span> — <b>data A/B from one shared 64M checkpoint (step 320k)</b>, same seed and recipe: control (ARC-MIX) vs fork-B (ARC-MIX + educational). We found the first fork-B blend confounded (non-shuffled source sampling), so its result is reported as blend-vs-control only; a clean rebuild runs next. Plus a <b>128M</b> scale reference: scale lifts quality, but the size multiplier cancels most of the gain on eff.
|
| 50 |
· board: <a href="https://huggingface.co/spaces/Glint-Research/Tiny-ML-Leaderboard">Glint Tiny-ML</a>
|
|
|
|
| 44 |
<span class="tag">ON THE BOARD</span> (Glint Tiny-ML, org <b>Fabryka AI</b>):
|
| 45 |
<b>GoLLeM-v5 64M</b> — eff 75.81 (BLiMP 75.83 / ARC-E 47.94 / byte_ppl 2.372) ·
|
| 46 |
<b>32M</b> — eff 75.41 (73.48 / 44.44 / 2.5386) ·
|
| 47 |
+
<b>16M</b> — eff 74.33 (70.08 / 40.91 / 2.6746). BLiMP recomputed on the full 67k-pair set after a fix in our eval harness (it counted 6 phenomena twice); the board still lists the earlier values.<br>
|
| 48 |
<span class="tag">GOAL: #1 EFF</span> — JugnuLM-110M-R2+ holds eff 80.20. At 64M we need BLiMP+ARC > 133.5 with byte_ppl ~2.0 (we have 123.8): a ~9.7-point gap, to be closed by data, not size.<br>
|
| 49 |
<span class="tag">NOW TRAINING</span> — <b>data A/B from one shared 64M checkpoint (step 320k)</b>, same seed and recipe: control (ARC-MIX) vs fork-B (ARC-MIX + educational). We found the first fork-B blend confounded (non-shuffled source sampling), so its result is reported as blend-vs-control only; a clean rebuild runs next. Plus a <b>128M</b> scale reference: scale lifts quality, but the size multiplier cancels most of the gain on eff.
|
| 50 |
· board: <a href="https://huggingface.co/spaces/Glint-Research/Tiny-ML-Leaderboard">Glint Tiny-ML</a>
|