AbstractPhil commited on
Commit
75fb3dd
·
verified ·
1 Parent(s): 6a3e504

the repo card

Browse files
Files changed (1) hide show
  1. README.md +2 -5
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- license: cc-by-nc-sa-4.0
3
  base_model: AbstractPhil/mini-beatrix-3
4
  library_name: geolip-alephllm
5
  tags:
@@ -97,6 +97,7 @@ The readout files carry every number; the results files carry every block of eve
97
  | qwen3/mse_untrained_o0 (the untrained-copy control: the same recipe on a random-initialization copy of the trunk, seed 0; mounts on such a copy only) | final, 2,000 steps | the random trunk reads the two surfaces alike before any arm (.92-.94); its arm reaches .985: the gauge saturates on an untrained trunk, so the trained trunk's closure is the arm's work | .995-.999 |
98
  | qwen3/mse_solo_o0 (the solo: the same recipe with the arm alone on the bare trunk, no stage arms underneath) | final, 4,000 steps | 0.956 at block 31, 0.953-0.977 at blocks 8-28 (the arm over the eight: 0.892; 0.952-0.971); leads the arm over the eight at 28 of 32 blocks | lowest 0.9880 (the arm over the eight 0.9822); +0.0003 bits per byte on web text |
99
  | qwen3/mse_gXA_o0_lamA8 (lambda 8 on the plain rows: the whitened-silence fallback, over the gXA eight) | final, 4,000 steps | 0.881 at block 31, 0.949-0.966 at blocks 8-28 (the seed-A arm over the eight at lambda 2: 0.892; mean over the served blocks 0.954 against 0.958) | lowest 0.9899 (block 31; at lambda 2: 0.9822); leads the lambda-2 arm's silence at 30 of 32 blocks; -0.0000 bits per byte on web text |
 
100
  | bert/mse_solo_o0 (BERT's WordPiece spelling (lower case, '##' continuations), seed A, alone on the trunk) | final, 4,000 steps | 0.742 at block 31, 0.847-0.915 at blocks 8-28 (before training 0.87 / 0.67 at blocks 12 / 31) | lowest 0.9832 (block 31); +0.0006 bits per byte on web text |
101
  | clip/mse_solo_o0 (CLIP's spelling (the byte map with word-end marks, lower case), seed A, alone on the trunk) | final, 4,000 steps | 0.784 at block 12, 0.676-0.912 at blocks 8-28 (before training 0.43 / 0.29 at blocks 12 / 31) | lowest 0.9819 (block 31); +0.0003 bits per byte on web text |
102
  | t5/mse_gXA_o0 (T5's sentence-piece spelling, seed A, over the frozen eight) | final, 4,000 steps | 0.857 at block 31, 0.932-0.958 at blocks 8-28 (before training 0.64 / 0.32 at blocks 12 / 31) | lowest 0.9756 (block 31); +0.0005 bits per byte on web text |
@@ -104,7 +105,3 @@ The readout files carry every number; the results files carry every block of eve
104
 
105
  The bar for the gap was .85 at every served block from 12 on; the bar for silence .995 at every block beside +.012 bits per byte.
106
  The MSE form is the one carried forward.
107
-
108
- ## Licence
109
-
110
- The weights are **non-commercial**: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/), because the training text includes CHILDES child-directed speech (CC BY-NC-SA, via TalkBank) and Wikipedia / WikiText (CC BY-SA). These add-on modules are trained on the Beatrix core and carry its terms; the code that trains and mounts them is MIT ([AbstractEyes/alephllm](https://github.com/AbstractEyes/alephllm)). The full terms and the list of training sources: [LICENSE.md](LICENSE.md).
 
1
  ---
2
+ license: mit
3
  base_model: AbstractPhil/mini-beatrix-3
4
  library_name: geolip-alephllm
5
  tags:
 
97
  | qwen3/mse_untrained_o0 (the untrained-copy control: the same recipe on a random-initialization copy of the trunk, seed 0; mounts on such a copy only) | final, 2,000 steps | the random trunk reads the two surfaces alike before any arm (.92-.94); its arm reaches .985: the gauge saturates on an untrained trunk, so the trained trunk's closure is the arm's work | .995-.999 |
98
  | qwen3/mse_solo_o0 (the solo: the same recipe with the arm alone on the bare trunk, no stage arms underneath) | final, 4,000 steps | 0.956 at block 31, 0.953-0.977 at blocks 8-28 (the arm over the eight: 0.892; 0.952-0.971); leads the arm over the eight at 28 of 32 blocks | lowest 0.9880 (the arm over the eight 0.9822); +0.0003 bits per byte on web text |
99
  | qwen3/mse_gXA_o0_lamA8 (lambda 8 on the plain rows: the whitened-silence fallback, over the gXA eight) | final, 4,000 steps | 0.881 at block 31, 0.949-0.966 at blocks 8-28 (the seed-A arm over the eight at lambda 2: 0.892; mean over the served blocks 0.954 against 0.958) | lowest 0.9899 (block 31; at lambda 2: 0.9822); leads the lambda-2 arm's silence at 30 of 32 blocks; -0.0000 bits per byte on web text |
100
+ | qwen3/mse_solo_o0_bytes (Qwen3's spelling read at EVERY byte (the segmentation-free variant), seed A, alone on the trunk) | final, 4,000 steps | 0.963 at block 12, 0.948-0.988 at blocks 8-28 (before training 0.69 / 0.50 at blocks 12 / 31) | lowest 0.9947 (block 1); +0.0001 bits per byte on web text |
101
  | bert/mse_solo_o0 (BERT's WordPiece spelling (lower case, '##' continuations), seed A, alone on the trunk) | final, 4,000 steps | 0.742 at block 31, 0.847-0.915 at blocks 8-28 (before training 0.87 / 0.67 at blocks 12 / 31) | lowest 0.9832 (block 31); +0.0006 bits per byte on web text |
102
  | clip/mse_solo_o0 (CLIP's spelling (the byte map with word-end marks, lower case), seed A, alone on the trunk) | final, 4,000 steps | 0.784 at block 12, 0.676-0.912 at blocks 8-28 (before training 0.43 / 0.29 at blocks 12 / 31) | lowest 0.9819 (block 31); +0.0003 bits per byte on web text |
103
  | t5/mse_gXA_o0 (T5's sentence-piece spelling, seed A, over the frozen eight) | final, 4,000 steps | 0.857 at block 31, 0.932-0.958 at blocks 8-28 (before training 0.64 / 0.32 at blocks 12 / 31) | lowest 0.9756 (block 31); +0.0005 bits per byte on web text |
 
105
 
106
  The bar for the gap was .85 at every served block from 12 on; the bar for silence .995 at every block beside +.012 bits per byte.
107
  The MSE form is the one carried forward.