AbstractPhil commited on
Commit
0f97ff9
·
verified ·
1 Parent(s): 13390b2

Licence: weights CC BY-NC-SA 4.0 (non-commercial); code, design and training process MIT

Browse files
Files changed (2) hide show
  1. LICENSE.md +65 -0
  2. README.md +5 -1
LICENSE.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Licence
2
+
3
+ **The model weights are non-commercial. The code, the model design and the training process are MIT.**
4
+
5
+ | what | licence |
6
+ |---|---|
7
+ | Trained weights in this repository: the core model and every add-on module ("arm"), in every precision and checkpoint | [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/) (attribution, non-commercial, share-alike) |
8
+ | Code files in this repository (modeling, configuration, loaders) | MIT (text below) (no code files are kept in this repository) |
9
+ | The model design and the complete training process: the training library, recipes, configs and reports | MIT, at [github.com/AbstractEyes/alephllm](https://github.com/AbstractEyes/alephllm) |
10
+
11
+ ## Why the weights are non-commercial
12
+
13
+ The Beatrix line is trained from scratch on openly licensed text. Some of that text carries terms that the trained
14
+ weights keep:
15
+
16
+ - child-directed speech from CHILDES, via TalkBank, is licensed CC BY-NC-SA 3.0, and TalkBank's rules exclude its use
17
+ in commercial models;
18
+ - Wikipedia and WikiText are licensed CC BY-SA (share-alike).
19
+
20
+ So the weights are released for non-commercial use, with attribution and share-alike. Anything you make with the
21
+ weights under these terms must carry this licence file. The code, the design and the full recipe stay MIT: you can
22
+ reproduce or adapt the process for any purpose, including training your own model on data you are licensed to use.
23
+
24
+ ## Training sources
25
+
26
+ The sources of mini-beatrix-3, the broadest mix of the line. Earlier generations trained on subsets of these; each
27
+ generation's manifest in the [training repository](https://huggingface.co/AbstractPhil/alephllm-mini-beatrix-training)
28
+ lists its own.
29
+
30
+ | source | licence |
31
+ |---|---|
32
+ | [FineWeb-Edu](https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu) | ODC-By 1.0 (and the Common Crawl terms of use) |
33
+ | [WikiText-103](https://huggingface.co/datasets/Salesforce/wikitext) | CC BY-SA 3.0 / GFDL |
34
+ | [Wikipedia, simple and English](https://huggingface.co/datasets/wikimedia/wikipedia) (2023-11-01) | CC BY-SA / GFDL |
35
+ | CHILDES child-directed speech via [AO-CHILDES](https://huggingface.co/datasets/deven367/babylm-100M-aochildes) | CC BY-NC-SA 3.0 ([TalkBank](https://talkbank.org/0share/rules.html)) |
36
+ | [TinyStories](https://huggingface.co/datasets/roneneldan/TinyStories) | CDLA-Sharing-1.0 |
37
+ | [Cosmopedia v2](https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus) | ODC-By |
38
+ | [SODA](https://huggingface.co/datasets/allenai/soda) | CC BY 4.0 |
39
+ | [Social IQa](https://huggingface.co/datasets/allenai/social_i_qa) | CC BY 4.0 |
40
+ | [bAbI tasks v1.2](https://huggingface.co/datasets/facebook/babi_qa) | CC BY 3.0 |
41
+ | [ProofWriter](https://allenai.org/data/proofwriter) | CC BY (as reported; the upstream terms are being confirmed) |
42
+ | [ATOMIC 2020](https://github.com/allenai/comet-atomic-2020) | CC BY |
43
+ | [OpenGloss v1.3 definitions](https://huggingface.co/datasets/mjbommar/opengloss-v1.3-definitions) | CC BY 4.0 |
44
+ | [Project Gutenberg English](https://huggingface.co/datasets/sedthh/gutenberg_english) | public-domain texts |
45
+ | Procedural generators and identity text from the training library | MIT |
46
+
47
+ Some of these sources are machine-generated by other providers' models (TinyStories, SODA, OpenGloss, Cosmopedia);
48
+ their dataset cards describe how.
49
+
50
+ ## MIT licence (code, design, process)
51
+
52
+ Copyright (c) 2026 AbstractPhil
53
+
54
+ Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated
55
+ documentation files (the "Software"), to deal in the Software without restriction, including without limitation the
56
+ rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit
57
+ persons to whom the Software is furnished to do so, subject to the following conditions:
58
+
59
+ The above copyright notice and this permission notice shall be included in all copies or substantial portions of the
60
+ Software.
61
+
62
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE
63
+ WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR
64
+ COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR
65
+ OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- license: mit
3
  base_model: AbstractPhil/mini-beatrix-3
4
  library_name: geolip-alephllm
5
  tags:
@@ -104,3 +104,7 @@ The readout files carry every number; the results files carry every block of eve
104
 
105
  The bar for the gap was .85 at every served block from 12 on; the bar for silence .995 at every block beside +.012 bits per byte.
106
  The MSE form is the one carried forward.
 
 
 
 
 
1
  ---
2
+ license: cc-by-nc-sa-4.0
3
  base_model: AbstractPhil/mini-beatrix-3
4
  library_name: geolip-alephllm
5
  tags:
 
104
 
105
  The bar for the gap was .85 at every served block from 12 on; the bar for silence .995 at every block beside +.012 bits per byte.
106
  The MSE form is the one carried forward.
107
+
108
+ ## Licence
109
+
110
+ The weights are **non-commercial**: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/), because the training text includes CHILDES child-directed speech (CC BY-NC-SA, via TalkBank) and Wikipedia / WikiText (CC BY-SA). These add-on modules are trained on the Beatrix core and carry its terms; the code that trains and mounts them is MIT ([AbstractEyes/alephllm](https://github.com/AbstractEyes/alephllm)). The full terms and the list of training sources: [LICENSE.md](LICENSE.md).