wepiqx commited on
Commit
d0a4efd
·
1 Parent(s): 6fc8779

cards: ling duel + v7.1, ornith 1.5 PPLs

Browse files
docs/README-Ling.md CHANGED
@@ -39,6 +39,7 @@ MoE-specific handling: routers (`ffn_gate_inp`, `exp_probs_b`) pinned at F16 out
39
  | `Ling-3.0-tiny-BF16-ASHQ1-5000.gguf` | 4861 MiB | **13.0681 ± 0.1051** | Bottom-up, best of the duel — smaller and better |
40
  | `Ling-3.0-tiny-BF16-TOPDOWN-5000.gguf` | 4999 MiB | 13.1094 ± 0.1054 | Top-down challenger (local only) |
41
  | `Ling-3.0-tiny-BF16-TOPDOWN-6000.gguf` | 6013 MiB | **13.0001 ± 0.1047** | Top-down, first MoE quant |
 
42
  | `Ling-3.0-tiny-i1-Q6_K.gguf` | 6198 MiB | 13.0123 ± 0.1049 | Uniform Q6_K with imatrix (reference, local only) |
43
 
44
  ## Bottom-up vs top-down (@5000, same budget)
 
39
  | `Ling-3.0-tiny-BF16-ASHQ1-5000.gguf` | 4861 MiB | **13.0681 ± 0.1051** | Bottom-up, best of the duel — smaller and better |
40
  | `Ling-3.0-tiny-BF16-TOPDOWN-5000.gguf` | 4999 MiB | 13.1094 ± 0.1054 | Top-down challenger (local only) |
41
  | `Ling-3.0-tiny-BF16-TOPDOWN-6000.gguf` | 6013 MiB | **13.0001 ± 0.1047** | Top-down, first MoE quant |
42
+ | `Ling-3.0-tiny-BF16-TOPDOWN-6000-v7.1.gguf` | 6016 MiB | 12.9802 ± 0.1045 | Top-down + phase-2 slack filling (local only) |
43
  | `Ling-3.0-tiny-i1-Q6_K.gguf` | 6198 MiB | 13.0123 ± 0.1049 | Uniform Q6_K with imatrix (reference, local only) |
44
 
45
  ## Bottom-up vs top-down (@5000, same budget)
docs/README-Ornith-MTP-1.5.md CHANGED
@@ -41,7 +41,7 @@ ASHQ1 quantization of Ornith with **explicit MTP (Multi-Token Prediction) handli
41
  | `Ornith-1.5-9B-MTP-BF16-TOPDOWN-6500.gguf` | 6509 MiB | **8.6337 ± 0.0611** | Experimental top-down mode, norms at Q4_K — same PPL |
42
  | `Ornith-1.5-9B-MTP-BF16-ASHQ1-4500.gguf` | 4518 MiB | **10.1077 ± 0.0719** | Compact, IQ tiers via `--allow-q3-or-lower` |
43
  | `Ornith-1.5-9B-MTP-BF16-ASHQ1-4500-TOX.gguf` | 4518 MiB | **9.9629 ± 0.0709** | Same budget, sub-4-bit toxicity (`TOXICITY_SUB4`) — 99 → 79 sub-4 tensors, −0.145 PPL |
44
- | `Ornith-1.5-9B-i1-Q6_K.gguf` | TBD | TBD | Uniform Q6_K with imatrix (reference) |
45
 
46
  ## Benchmark vs ASHQ1-Remix (same model, same wiki.test.raw band)
47
 
 
41
  | `Ornith-1.5-9B-MTP-BF16-TOPDOWN-6500.gguf` | 6509 MiB | **8.6337 ± 0.0611** | Experimental top-down mode, norms at Q4_K — same PPL |
42
  | `Ornith-1.5-9B-MTP-BF16-ASHQ1-4500.gguf` | 4518 MiB | **10.1077 ± 0.0719** | Compact, IQ tiers via `--allow-q3-or-lower` |
43
  | `Ornith-1.5-9B-MTP-BF16-ASHQ1-4500-TOX.gguf` | 4518 MiB | **9.9629 ± 0.0709** | Same budget, sub-4-bit toxicity (`TOXICITY_SUB4`) — 99 → 79 sub-4 tensors, −0.145 PPL |
44
+ | `Ornith-1.5-9B-i1-Q6_K.gguf` | 7209 MiB | 9.2025 ± 0.0677 | Uniform Q6_K with imatrix (reference) |
45
 
46
  ## Benchmark vs ASHQ1-Remix (same model, same wiki.test.raw band)
47