jjrussell10 commited on
Commit
0d96a04
·
verified ·
1 Parent(s): d79a473

Model cards: cite russell2026wildai; root tokenizer (part 2)

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. 19.9m-g008-ai-r17.5/README.md +2 -2
  2. 19.9m-g008-ai-r2.13/README.md +2 -2
  3. 19.9m-g008-ai-r4.32/README.md +2 -2
  4. 19.9m-g008-control/README.md +2 -2
  5. 19.9m-g009-ai-r17.5/README.md +2 -2
  6. 19.9m-g009-ai-r2.13/README.md +2 -2
  7. 19.9m-g009-ai-r4.32/README.md +2 -2
  8. 19.9m-g009-control/README.md +2 -2
  9. 19.9m-g010-ai-r0.025/README.md +2 -2
  10. 19.9m-g010-ai-r0.05/README.md +2 -2
  11. 19.9m-g010-ai-r0.1/README.md +2 -2
  12. 19.9m-g010-ai-r0.25/README.md +2 -2
  13. 19.9m-g010-ai-r0.5/README.md +2 -2
  14. 19.9m-g010-ai-r1/README.md +2 -2
  15. 19.9m-g010-ai-r16/README.md +2 -2
  16. 19.9m-g010-ai-r2/README.md +2 -2
  17. 19.9m-g010-ai-r32/README.md +2 -2
  18. 19.9m-g010-ai-r4/README.md +2 -2
  19. 19.9m-g010-ai-r8/README.md +2 -2
  20. 19.9m-g010-control/README.md +2 -2
  21. 19.9m-g010-human-r0.025/README.md +2 -2
  22. 19.9m-g010-human-r0.05/README.md +2 -2
  23. 19.9m-g010-human-r2/README.md +2 -2
  24. 19.9m-g010-human-r4/README.md +2 -2
  25. 19.9m-g010-repeat-r1/README.md +2 -2
  26. 19.9m-g010-repeat-r4/README.md +2 -2
  27. 19.9m-g010-repeat-r8/README.md +2 -2
  28. 19.9m-g011-ai-r0.05/README.md +2 -2
  29. 19.9m-g011-ai-r0.1/README.md +2 -2
  30. 19.9m-g011-ai-r0.25/README.md +2 -2
  31. 19.9m-g011-ai-r0.5/README.md +2 -2
  32. 19.9m-g011-ai-r1/README.md +2 -2
  33. 19.9m-g011-control/README.md +2 -2
  34. 19.9m-g012-ai-r0.05/README.md +2 -2
  35. 19.9m-g012-ai-r0.1/README.md +2 -2
  36. 19.9m-g012-ai-r0.25/README.md +2 -2
  37. 19.9m-g012-ai-r0.5/README.md +2 -2
  38. 19.9m-g012-ai-r1/README.md +2 -2
  39. 19.9m-g012-control/README.md +2 -2
  40. 19.9m-g013-ai-r17.2/README.md +2 -2
  41. 19.9m-g013-ai-r2.1/README.md +2 -2
  42. 19.9m-g013-ai-r4.25/README.md +2 -2
  43. 19.9m-g013-ai-r8.57/README.md +2 -2
  44. 19.9m-g013-control/README.md +2 -2
  45. 19.9m-g013-human-r2/README.md +2 -2
  46. 19.9m-g014-ai-r0.25/README.md +2 -2
  47. 19.9m-g014-ai-r1/README.md +2 -2
  48. 19.9m-g014-control/README.md +2 -2
  49. 19.9m-g015-ai-r0.05/README.md +2 -2
  50. 19.9m-g015-ai-r0.1/README.md +2 -2
19.9m-g008-ai-r17.5/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g008-ai-r2.13/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g008-ai-r4.32/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g008-control/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g009-ai-r17.5/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g009-ai-r2.13/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g009-ai-r4.32/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g009-control/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r0.025/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r0.05/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r0.1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r0.25/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r0.5/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r16/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r2/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r32/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r4/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-ai-r8/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-control/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-human-r0.025/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-human-r0.05/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-human-r2/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-human-r4/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-repeat-r1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -71,7 +71,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
71
  ## Citation
72
 
73
  ```bibtex
74
- @article{russell2026aitoken,
75
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
76
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
77
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
71
  ## Citation
72
 
73
  ```bibtex
74
+ @article{russell2026wildai,
75
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
76
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
77
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-repeat-r4/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -71,7 +71,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
71
  ## Citation
72
 
73
  ```bibtex
74
- @article{russell2026aitoken,
75
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
76
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
77
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
71
  ## Citation
72
 
73
  ```bibtex
74
+ @article{russell2026wildai,
75
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
76
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
77
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g010-repeat-r8/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -71,7 +71,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
71
  ## Citation
72
 
73
  ```bibtex
74
- @article{russell2026aitoken,
75
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
76
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
77
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
71
  ## Citation
72
 
73
  ```bibtex
74
+ @article{russell2026wildai,
75
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
76
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
77
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g011-ai-r0.05/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g011-ai-r0.1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g011-ai-r0.25/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g011-ai-r0.5/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g011-ai-r1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g011-control/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g012-ai-r0.05/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g012-ai-r0.1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g012-ai-r0.25/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g012-ai-r0.5/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g012-ai-r1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g012-control/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g013-ai-r17.2/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g013-ai-r2.1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g013-ai-r4.25/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g013-ai-r8.57/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g013-control/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g013-human-r2/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g014-ai-r0.25/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g014-ai-r1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g014-control/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g015-ai-r0.05/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
19.9m-g015-ai-r0.1/README.md CHANGED
@@ -18,7 +18,7 @@ tags:
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
- A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of 844 models that measure how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
@@ -95,7 +95,7 @@ The nanochat GPT recipe: rotary embeddings, RMSNorm without weights (also on que
95
  ## Citation
96
 
97
  ```bibtex
98
- @article{russell2026aitoken,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},
 
18
 
19
  > **License: [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).** The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
20
 
21
+ A 19.9M decoder-only language model trained from scratch for [*How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text*](https://arxiv.org/abs/2609.40295), one of the paper's models measuring how wild AI-generated web text in pretraining data changes a model's loss. It is a research artifact for studying scaling laws, not an assistant: it has had no instruction tuning or safety training.
22
 
23
  ## Training data
24
 
 
95
  ## Citation
96
 
97
  ```bibtex
98
+ @article{russell2026wildai,
99
  title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
100
  author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
101
  journal = {arXiv preprint arXiv:2609.40295},