WildAI
Collection
Language models trained on controlled mixtures of human and wild AI-generated web text, and the WildAI dataset. • 3 items • Updated
WildAI models
License: CC BY-NC-SA 4.0. The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license.
The language models released with How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text, from 19.9M to 973M parameters, trained on controlled mixtures of human and wild AI-generated web text. Each model is in the subfolder named after it, with its own model card; load one by passing that name as subfolder, which downloads only that model:
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("pangram/WildAI-models", subfolder="19.9m-g001-control", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("pangram/WildAI-models", subfolder="19.9m-g001-control", trust_remote_code=True, dtype=torch.bfloat16)
inputs = tokenizer("The history of the printing press", return_tensors="pt")
output = model.generate(**inputs, max_new_tokens=40, do_sample=False)
print(tokenizer.decode(output[0], skip_special_tokens=True))
The tokenizer prepends <|bos|> to every text, as in training; pass add_special_tokens=False to skip it. The model predicts <|bos|> where a document ends, and generation stops there. Weights are stored in bfloat16, the precision the paper's losses were computed in; dtype=torch.float32 computes in float32 instead.
Models
Names are <size>-<group>-<arm>[-r<ratio>]. A group g001-g099 is one human-only control (control) and every model trained on exactly its human documents plus added AI text (ai), fresh human text (human) or its own human text repeated (repeat), with r added tokens per human token. f01-f19 are filtering pairs: a 2026 web mix (web-mix) and the same mix with its AI documents removed (ai-removed). In the tables, r is the realized AI-to-human token ratio and C4 the held-out loss in bits per byte.
19.9M
| Model | Arm | r | Human tokens | Training tokens | C4 |
|---|---|---|---|---|---|
19.9m-g001-control |
control | 0 | 57.7M | 57.7M | 1.4759 |
19.9m-g001-ai-r0.05 |
ai | 0.0435 | 58.0M | 60.6M | 1.4611 |
19.9m-g001-ai-r0.1 |
ai | 0.0875 | 58.3M | 63.4M | 1.4366 |
19.9m-g001-ai-r0.25 |
ai | 0.224 | 58.9M | 72.1M | 1.3998 |
19.9m-g001-ai-r0.5 |
ai | 0.456 | 59.4M | 86.5M | 1.3786 |
19.9m-g001-ai-r1 |
ai | 0.953 | 59.1M | 115.3M | 1.3612 |
19.9m-g002-control |
control | 0 | 57.7M | 57.7M | 1.4757 |
19.9m-g002-ai-r0.0227 |
ai | 0.0227 | 57.7M | 59.0M | 1.4752 |
19.9m-g002-ai-r0.0459 |
ai | 0.0459 | 57.6M | 60.3M | 1.4588 |
19.9m-g002-ai-r2.01 |
ai | 2.01 | 57.7M | 173.8M | 1.3475 |
19.9m-g002-ai-r4.24 |
ai | 4.24 | 57.7M | 302.3M | 1.3324 |
19.9m-g002-ai-r8.73 |
ai | 8.73 | 57.7M | 561.3M | 1.3310 |
19.9m-g002-ai-r17.7 |
ai | 17.7 | 57.7M | 1.08B | 1.3334 |
19.9m-g002-ai-r35.5 |
ai | 35.5 | 57.7M | 2.11B | 1.3364 |
19.9m-g002-ai-r70.6 |
ai | 70.6 | 57.7M | 4.13B | 1.3339 |
19.9m-g002-human-r0.025 |
human | 0 | 59.0M | 59.0M | 1.4675 |
19.9m-g002-human-r0.05 |
human | 0 | 60.6M | 60.6M | 1.4611 |
19.9m-g002-human-r4 |
human | 0 | 288.4M | 288.4M | 1.2631 |
19.9m-g003-control |
control | 0 | 57.7M | 57.7M | 1.4740 |
19.9m-g003-ai-r0.025 |
ai | 0.0227 | 57.7M | 59.0M | 1.4596 |
19.9m-g003-ai-r0.05 |
ai | 0.0459 | 57.6M | 60.3M | 1.4502 |
19.9m-g003-ai-r0.1 |
ai | 0.0898 | 57.7M | 62.9M | 1.4360 |
19.9m-g003-ai-r2 |
ai | 2.01 | 57.7M | 173.8M | 1.3407 |
19.9m-g003-ai-r8 |
ai | 8.73 | 57.7M | 561.3M | 1.3289 |
19.9m-g003-human-r0.025 |
human | 0 | 59.0M | 59.0M | 1.4614 |
19.9m-g003-human-r0.05 |
human | 0 | 60.6M | 60.6M | 1.4494 |
19.9m-g004-control |
control | 0 | 57.7M | 57.7M | 1.4785 |
19.9m-g004-ai-r0.025 |
ai | 0.0227 | 57.7M | 59.0M | 1.4691 |
19.9m-g004-ai-r0.05 |
ai | 0.0459 | 57.6M | 60.3M | 1.4603 |
19.9m-g004-ai-r0.1 |
ai | 0.0898 | 57.7M | 62.9M | 1.4428 |
19.9m-g004-human-r0.025 |
human | 0 | 59.0M | 59.0M | 1.4717 |
19.9m-g004-human-r0.05 |
human | 0 | 60.6M | 60.6M | 1.4609 |
19.9m-g005-control |
control | 0 | 94.1M | 94.1M | 1.3544 |
19.9m-g005-ai-r0.025 |
ai | 0.0229 | 94.1M | 96.2M | 1.3486 |
19.9m-g005-ai-r0.05 |
ai | 0.0456 | 94.0M | 98.3M | 1.3454 |
19.9m-g005-ai-r0.1 |
ai | 0.0915 | 94.1M | 102.8M | 1.3404 |
19.9m-g005-ai-r0.25 |
ai | 0.236 | 94.1M | 116.4M | 1.3357 |
19.9m-g005-ai-r0.5 |
ai | 0.483 | 94.2M | 139.7M | 1.3293 |
19.9m-g005-ai-r1 |
ai | 0.998 | 94.1M | 188.0M | 1.3216 |
19.9m-g005-ai-r2 |
ai | 2.09 | 94.1M | 291.0M | 1.3132 |
19.9m-g005-ai-r4 |
ai | 4.31 | 94.1M | 499.9M | 1.3149 |
19.9m-g005-ai-r8 |
ai | 8.79 | 94.1M | 921.2M | 1.3177 |
19.9m-g005-ai-r16 |
ai | 17.7 | 94.1M | 1.76B | 1.3238 |
19.9m-g005-ai-r32 |
ai | 35.3 | 94.1M | 3.41B | 1.3268 |
19.9m-g005-ai-r64 |
ai | 70.1 | 94.1M | 6.69B | 1.3298 |
19.9m-g005-human-r0.025 |
human | 0 | 96.2M | 96.2M | 1.3482 |
19.9m-g005-human-r0.05 |
human | 0 | 98.3M | 98.3M | 1.3444 |
19.9m-g005-human-r4 |
human | 0 | 499.9M | 499.9M | 1.2458 |
19.9m-g006-control |
control | 0 | 230.7M | 230.7M | 1.2743 |
19.9m-g006-ai-r0.05 |
ai | 0.0496 | 230.8M | 242.2M | 1.2728 |
19.9m-g006-ai-r0.1 |
ai | 0.0999 | 230.7M | 253.8M | 1.2714 |
19.9m-g006-ai-r0.25 |
ai | 0.254 | 229.9M | 288.4M | 1.2729 |
19.9m-g006-ai-r0.5 |
ai | 0.518 | 228.0M | 346.0M | 1.2761 |
19.9m-g006-ai-r1 |
ai | 1.05 | 225.0M | 461.4M | 1.2786 |
19.9m-g007-control |
control | 0 | 230.7M | 230.7M | 1.2750 |
19.9m-g007-ai-r0.0244 |
ai | 0.0244 | 230.6M | 236.2M | 1.2746 |
19.9m-g007-ai-r0.0495 |
ai | 0.0495 | 230.8M | 242.2M | 1.2738 |
19.9m-g007-ai-r2.13 |
ai | 2.13 | 230.7M | 721.9M | 1.2802 |
19.9m-g007-ai-r4.32 |
ai | 4.32 | 230.7M | 1.23B | 1.2898 |
19.9m-g007-ai-r8.71 |
ai | 8.71 | 230.7M | 2.24B | 1.3019 |
19.9m-g007-ai-r17.5 |
ai | 17.5 | 230.7M | 4.26B | 1.3116 |
19.9m-g007-ai-r34.7 |
ai | 34.7 | 230.7M | 8.24B | 1.3185 |
19.9m-g007-ai-r69 |
ai | 69 | 230.7M | 16.15B | 1.3237 |
19.9m-g007-human-r0.025 |
human | 0 | 236.5M | 236.5M | 1.2750 |
19.9m-g007-human-r0.05 |
human | 0 | 242.2M | 242.2M | 1.2708 |
19.9m-g007-human-r2 |
human | 0 | 692.1M | 692.1M | 1.2302 |
19.9m-g007-human-r4 |
human | 0 | 1.15B | 1.15B | 1.2193 |
19.9m-g008-control |
control | 0 | 230.7M | 230.7M | 1.2712 |
19.9m-g008-ai-r2.13 |
ai | 2.13 | 230.7M | 721.9M | 1.2793 |
19.9m-g008-ai-r4.32 |
ai | 4.32 | 230.7M | 1.23B | 1.2904 |
19.9m-g008-ai-r17.5 |
ai | 17.5 | 230.7M | 4.26B | 1.3120 |
19.9m-g009-control |
control | 0 | 230.7M | 230.7M | 1.2768 |
19.9m-g009-ai-r2.13 |
ai | 2.13 | 230.7M | 721.9M | 1.2816 |
19.9m-g009-ai-r4.32 |
ai | 4.32 | 230.7M | 1.23B | 1.2905 |
19.9m-g009-ai-r17.5 |
ai | 17.5 | 230.7M | 4.26B | 1.3110 |
19.9m-g010-control |
control | 0 | 376.2M | 376.2M | 1.2530 |
19.9m-g010-ai-r0.025 |
ai | 0.0255 | 376.3M | 385.9M | 1.2493 |
19.9m-g010-ai-r0.05 |
ai | 0.0516 | 376.2M | 395.6M | 1.2486 |
19.9m-g010-ai-r0.1 |
ai | 0.103 | 376.2M | 415.0M | 1.2506 |
19.9m-g010-ai-r0.25 |
ai | 0.258 | 376.3M | 473.4M | 1.2499 |
19.9m-g010-ai-r0.5 |
ai | 0.52 | 376.3M | 571.7M | 1.2532 |
19.9m-g010-ai-r1 |
ai | 1.05 | 376.2M | 769.9M | 1.2590 |
19.9m-g010-ai-r2 |
ai | 2.12 | 376.2M | 1.17B | 1.2702 |
19.9m-g010-ai-r4 |
ai | 4.29 | 376.2M | 1.99B | 1.2823 |
19.9m-g010-ai-r8 |
ai | 8.65 | 376.2M | 3.63B | 1.2953 |
19.9m-g010-ai-r16 |
ai | 17.3 | 376.2M | 6.88B | 1.3057 |
19.9m-g010-ai-r32 |
ai | 34.4 | 376.2M | 13.33B | 1.3154 |
19.9m-g010-human-r0.025 |
human | 0 | 385.9M | 385.9M | 1.2483 |
19.9m-g010-human-r0.05 |
human | 0 | 395.6M | 395.6M | 1.2473 |
19.9m-g010-human-r2 |
human | 0 | 1.17B | 1.17B | 1.2190 |
19.9m-g010-human-r4 |
human | 0 | 1.99B | 1.99B | 1.2113 |
19.9m-g011-control |
control | 0 | 461.4M | 461.4M | 1.2419 |
19.9m-g011-ai-r0.05 |
ai | 0.0512 | 460.8M | 484.4M | 1.2415 |
19.9m-g011-ai-r0.1 |
ai | 0.103 | 460.3M | 507.5M | 1.2414 |
19.9m-g011-ai-r0.25 |
ai | 0.26 | 457.7M | 576.7M | 1.2465 |
19.9m-g011-ai-r0.5 |
ai | 0.522 | 454.8M | 692.1M | 1.2491 |
19.9m-g011-ai-r1 |
ai | 1.05 | 450.2M | 922.7M | 1.2551 |
19.9m-g012-control |
control | 0 | 692.1M | 692.1M | 1.2306 |
19.9m-g012-ai-r0.05 |
ai | 0.0505 | 691.7M | 726.7M | 1.2312 |
19.9m-g012-ai-r0.1 |
ai | 0.101 | 691.1M | 761.3M | 1.2313 |
19.9m-g012-ai-r0.25 |
ai | 0.256 | 688.8M | 865.1M | 1.2349 |
19.9m-g012-ai-r0.5 |
ai | 0.515 | 685.2M | 1.04B | 1.2395 |
19.9m-g012-ai-r1 |
ai | 1.04 | 678.9M | 1.38B | 1.2471 |
19.9m-g013-control |
control | 0 | 692.1M | 692.1M | 1.2306 |
19.9m-g013-ai-r2.1 |
ai | 2.1 | 692.0M | 2.15B | 1.2607 |
19.9m-g013-ai-r4.25 |
ai | 4.25 | 692.0M | 3.63B | 1.2754 |
19.9m-g013-ai-r8.57 |
ai | 8.57 | 692.0M | 6.62B | 1.2902 |
19.9m-g013-ai-r17.2 |
ai | 17.2 | 692.1M | 12.57B | 1.3021 |
19.9m-g013-human-r2 |
human | 0 | 2.08B | 2.08B | 1.2105 |
19.9m-g014-control |
control | 0 | 692.1M | 692.1M | 1.2296 |
19.9m-g014-ai-r0.25 |
ai | 0.256 | 688.5M | 865.1M | 1.2341 |
19.9m-g014-ai-r1 |
ai | 1.04 | 678.9M | 1.38B | 1.2473 |
19.9m-g015-control |
control | 0 | 752.4M | 752.4M | 1.2282 |
19.9m-g015-ai-r0.05 |
ai | 0.0509 | 752.4M | 790.6M | 1.2284 |
19.9m-g015-ai-r0.1 |
ai | 0.102 | 752.3M | 828.9M | 1.2294 |
19.9m-g015-ai-r0.25 |
ai | 0.256 | 752.4M | 944.8M | 1.2321 |
19.9m-g015-ai-r0.5 |
ai | 0.513 | 752.3M | 1.14B | 1.2375 |
19.9m-g015-ai-r1 |
ai | 1.04 | 752.3M | 1.53B | 1.2488 |
19.9m-g016-control |
control | 0 | 922.7M | 922.7M | 1.2243 |
19.9m-g016-ai-r0.05 |
ai | 0.0503 | 922.5M | 968.9M | 1.2251 |
19.9m-g016-ai-r0.1 |
ai | 0.101 | 922.0M | 1.02B | 1.2251 |
19.9m-g016-ai-r0.25 |
ai | 0.255 | 919.2M | 1.15B | 1.2285 |
19.9m-g016-ai-r0.5 |
ai | 0.513 | 915.1M | 1.38B | 1.2342 |
19.9m-g016-ai-r1 |
ai | 1.03 | 907.2M | 1.85B | 1.2424 |
19.9m-g017-control |
control | 0 | 1.09B | 1.09B | 1.2206 |
19.9m-g017-ai-r0.05 |
ai | 0.0505 | 1.09B | 1.15B | 1.2213 |
19.9m-g017-ai-r0.1 |
ai | 0.101 | 1.09B | 1.20B | 1.2217 |
19.9m-g017-ai-r0.25 |
ai | 0.254 | 1.09B | 1.37B | 1.2253 |
19.9m-g017-ai-r0.5 |
ai | 0.511 | 1.09B | 1.65B | 1.2314 |
19.9m-g017-ai-r1 |
ai | 1.03 | 1.09B | 2.21B | 1.2406 |
19.9m-g017-ai-r2 |
ai | 2.09 | 1.09B | 3.37B | 1.2547 |
19.9m-g017-ai-r4 |
ai | 4.23 | 1.09B | 5.70B | 1.2713 |
19.9m-g017-ai-r8 |
ai | 8.53 | 1.09B | 10.38B | 1.2863 |
19.9m-g017-ai-r16 |
ai | 17.1 | 1.09B | 19.77B | 1.3005 |
19.9m-g017-human-r2 |
human | 0 | 3.37B | 3.37B | 1.2050 |
19.9m-g018-control |
control | 0 | 1.15B | 1.15B | 1.2198 |
19.9m-g018-ai-r0.05 |
ai | 0.0503 | 1.15B | 1.21B | 1.2204 |
19.9m-g018-ai-r0.1 |
ai | 0.101 | 1.15B | 1.27B | 1.2216 |
19.9m-g018-ai-r0.25 |
ai | 0.254 | 1.15B | 1.44B | 1.2249 |
19.9m-g018-ai-r0.5 |
ai | 0.512 | 1.14B | 1.73B | 1.2307 |
19.9m-g018-ai-r1 |
ai | 1.03 | 1.14B | 2.31B | 1.2401 |
19.9m-g019-control |
control | 0 | 1.45B | 1.45B | 1.2158 |
19.9m-g019-ai-r0.05 |
ai | 0.0504 | 1.45B | 1.53B | 1.2158 |
19.9m-g019-ai-r0.1 |
ai | 0.101 | 1.45B | 1.60B | 1.2171 |
19.9m-g019-ai-r0.25 |
ai | 0.253 | 1.45B | 1.82B | 1.2216 |
19.9m-g019-ai-r0.5 |
ai | 0.509 | 1.45B | 2.19B | 1.2281 |
19.9m-g019-ai-r1 |
ai | 1.03 | 1.45B | 2.95B | 1.2378 |
19.9m-g020-control |
control | 0 | 1.74B | 1.74B | 1.2130 |
19.9m-g020-ai-r0.05 |
ai | 0.0503 | 1.74B | 1.83B | 1.2142 |
19.9m-g020-ai-r0.1 |
ai | 0.101 | 1.74B | 1.92B | 1.2152 |
19.9m-g020-ai-r0.25 |
ai | 0.253 | 1.74B | 2.18B | 1.2187 |
19.9m-g020-ai-r0.5 |
ai | 0.508 | 1.74B | 2.63B | 1.2254 |
19.9m-g020-ai-r1 |
ai | 1.03 | 1.74B | 3.53B | 1.2354 |
19.9m-f01-ai-removed |
filtered | 0 | 179.0M | 179.0M | 1.2878 |
19.9m-f01-web-mix |
natural | 0.285 | 179.6M | 230.7M | 1.2862 |
19.9m-f02-ai-removed |
filtered | 0 | 358.4M | 358.4M | 1.2509 |
19.9m-f02-web-mix |
natural | 0.296 | 356.1M | 461.4M | 1.2532 |
19.9m-f03-ai-removed |
filtered | 0 | 537.4M | 537.4M | 1.2369 |
19.9m-f03-web-mix |
natural | 0.295 | 534.2M | 692.1M | 1.2404 |
19.9m-f04-ai-removed |
filtered | 0 | 716.7M | 716.7M | 1.2290 |
19.9m-f04-web-mix |
natural | 0.294 | 712.9M | 922.7M | 1.2355 |
19.9m-f05-ai-removed |
filtered | 0 | 896.0M | 896.0M | 1.2246 |
19.9m-f05-web-mix |
natural | 0.293 | 892.0M | 1.15B | 1.2319 |
19.9m-g010-repeat-r1 |
repeat | 0 | 376.2M | 769.9M | 1.2301 |
19.9m-g010-repeat-r4 |
repeat | 0 | 376.2M | 1.99B | 1.2174 |
19.9m-g010-repeat-r8 |
repeat | 0 | 376.2M | 3.63B | 1.2135 |
35.8M
| Model | Arm | r | Human tokens | Training tokens | C4 |
|---|---|---|---|---|---|
35.8m-g021-control |
control | 0 | 115.9M | 115.9M | 1.2682 |
35.8m-g021-ai-r0.05 |
ai | 0.0461 | 116.3M | 121.6M | 1.2644 |
35.8m-g021-ai-r0.1 |
ai | 0.0926 | 116.6M | 127.4M | 1.2616 |
35.8m-g021-ai-r0.25 |
ai | 0.239 | 117.0M | 145.0M | 1.2514 |
35.8m-g021-ai-r0.5 |
ai | 0.485 | 117.0M | 173.8M | 1.2439 |
35.8m-g021-ai-r1 |
ai | 1.01 | 115.7M | 232.0M | 1.2355 |
35.8m-g022-control |
control | 0 | 115.9M | 115.9M | 1.2678 |
35.8m-g022-ai-r0.0234 |
ai | 0.0234 | 115.8M | 118.5M | 1.2666 |
35.8m-g022-ai-r0.0465 |
ai | 0.0465 | 116.0M | 121.4M | 1.2654 |
35.8m-g022-ai-r2.1 |
ai | 2.1 | 115.8M | 359.1M | 1.2300 |
35.8m-g022-ai-r4.31 |
ai | 4.31 | 115.9M | 615.5M | 1.2261 |
35.8m-g022-ai-r8.76 |
ai | 8.76 | 115.9M | 1.13B | 1.2255 |
35.8m-g022-ai-r17.6 |
ai | 17.6 | 115.9M | 2.15B | 1.2263 |
35.8m-g022-ai-r35 |
ai | 35 | 115.9M | 4.18B | 1.2275 |
35.8m-g022-ai-r69.6 |
ai | 69.6 | 115.9M | 8.18B | 1.2290 |
35.8m-g022-human-r0.025 |
human | 0 | 118.8M | 118.8M | 1.2654 |
35.8m-g022-human-r0.05 |
human | 0 | 121.6M | 121.6M | 1.2624 |
35.8m-g022-human-r4 |
human | 0 | 579.9M | 579.9M | 1.1584 |
35.8m-g023-control |
control | 0 | 168.8M | 168.8M | 1.2305 |
35.8m-g023-ai-r0.025 |
ai | 0.0238 | 168.7M | 172.8M | 1.2291 |
35.8m-g023-ai-r0.05 |
ai | 0.0478 | 168.9M | 176.9M | 1.2271 |
35.8m-g023-ai-r0.1 |
ai | 0.0969 | 168.7M | 185.1M | 1.2249 |
35.8m-g023-ai-r0.25 |
ai | 0.247 | 168.8M | 210.5M | 1.2207 |
35.8m-g023-ai-r0.5 |
ai | 0.506 | 168.8M | 254.3M | 1.2164 |
35.8m-g023-ai-r1 |
ai | 1.04 | 168.8M | 344.5M | 1.2141 |
35.8m-g023-ai-r2 |
ai | 2.12 | 168.8M | 527.4M | 1.2117 |
35.8m-g023-ai-r4 |
ai | 4.33 | 168.8M | 899.7M | 1.2106 |
35.8m-g023-ai-r8 |
ai | 8.74 | 168.8M | 1.64B | 1.2160 |
35.8m-g023-ai-r16 |
ai | 17.5 | 168.8M | 3.13B | 1.2190 |
35.8m-g023-ai-r32 |
ai | 34.9 | 168.8M | 6.06B | 1.2232 |
35.8m-g023-ai-r64 |
ai | 69.1 | 168.8M | 11.84B | 1.2262 |
35.8m-g023-human-r0.025 |
human | 0 | 172.8M | 172.8M | 1.2296 |
35.8m-g023-human-r0.05 |
human | 0 | 176.9M | 176.9M | 1.2285 |
35.8m-g023-human-r4 |
human | 0 | 899.7M | 899.7M | 1.1431 |
35.8m-g024-control |
control | 0 | 464.0M | 464.0M | 1.1665 |
35.8m-g024-ai-r0.05 |
ai | 0.0511 | 463.4M | 487.1M | 1.1652 |
35.8m-g024-ai-r0.1 |
ai | 0.102 | 463.2M | 510.4M | 1.1654 |
35.8m-g024-ai-r0.25 |
ai | 0.256 | 461.5M | 579.9M | 1.1652 |
35.8m-g024-ai-r0.5 |
ai | 0.519 | 458.3M | 696.0M | 1.1676 |
35.8m-g024-ai-r1 |
ai | 1.05 | 453.7M | 928.0M | 1.1708 |
35.8m-g025-control |
control | 0 | 464.0M | 464.0M | 1.1674 |
35.8m-g025-ai-r0.0256 |
ai | 0.0256 | 463.9M | 475.8M | 1.1675 |
35.8m-g025-ai-r0.0514 |
ai | 0.0514 | 464.0M | 487.8M | 1.1666 |
35.8m-g025-ai-r2.11 |
ai | 2.11 | 464.0M | 1.44B | 1.1778 |
35.8m-g025-ai-r4.28 |
ai | 4.28 | 464.0M | 2.45B | 1.1867 |
35.8m-g025-ai-r8.61 |
ai | 8.61 | 464.0M | 4.46B | 1.1977 |
35.8m-g025-ai-r17.2 |
ai | 17.2 | 464.0M | 8.46B | 1.2073 |
35.8m-g025-ai-r34.4 |
ai | 34.4 | 464.0M | 16.42B | 1.2144 |
35.8m-g025-human-r0.025 |
human | 0 | 475.5M | 475.5M | 1.1663 |
35.8m-g025-human-r0.05 |
human | 0 | 487.1M | 487.1M | 1.1649 |
35.8m-g025-human-r2 |
human | 0 | 1.39B | 1.39B | 1.1314 |
35.8m-g025-human-r4 |
human | 0 | 2.32B | 2.32B | 1.1220 |
35.8m-g026-control |
control | 0 | 675.5M | 675.5M | 1.1532 |
35.8m-g026-ai-r0.025 |
ai | 0.0255 | 675.6M | 692.8M | 1.1526 |
35.8m-g026-ai-r0.05 |
ai | 0.051 | 675.4M | 709.9M | 1.1523 |
35.8m-g026-ai-r0.1 |
ai | 0.102 | 675.7M | 744.5M | 1.1511 |
35.8m-g026-ai-r0.25 |
ai | 0.256 | 675.6M | 848.6M | 1.1523 |
35.8m-g026-ai-r0.5 |
ai | 0.514 | 675.5M | 1.02B | 1.1548 |
35.8m-g026-ai-r1 |
ai | 1.04 | 675.5M | 1.38B | 1.1600 |
35.8m-g026-ai-r2 |
ai | 2.1 | 675.5M | 2.10B | 1.1703 |
35.8m-g026-ai-r4 |
ai | 4.25 | 675.5M | 3.55B | 1.1812 |
35.8m-g026-ai-r8 |
ai | 8.57 | 675.5M | 6.47B | 1.1923 |
35.8m-g026-ai-r16 |
ai | 17.2 | 675.5M | 12.27B | 1.2028 |
35.8m-g026-ai-r32 |
ai | 34.4 | 675.5M | 23.92B | 1.2118 |
35.8m-g026-human-r0.025 |
human | 0 | 692.8M | 692.8M | 1.1518 |
35.8m-g026-human-r0.05 |
human | 0 | 709.9M | 709.9M | 1.1509 |
35.8m-g026-human-r2 |
human | 0 | 2.10B | 2.10B | 1.1237 |
35.8m-g026-human-r4 |
human | 0 | 3.55B | 3.55B | 1.1135 |
35.8m-g027-control |
control | 0 | 928.0M | 928.0M | 1.1416 |
35.8m-g027-ai-r0.05 |
ai | 0.0502 | 927.8M | 974.4M | 1.1423 |
35.8m-g027-ai-r0.1 |
ai | 0.101 | 927.3M | 1.02B | 1.1419 |
35.8m-g027-ai-r0.25 |
ai | 0.255 | 924.4M | 1.16B | 1.1452 |
35.8m-g027-ai-r0.5 |
ai | 0.512 | 920.4M | 1.39B | 1.1474 |
35.8m-g027-ai-r1 |
ai | 1.03 | 912.8M | 1.86B | 1.1546 |
35.8m-g028-control |
control | 0 | 1.35B | 1.35B | 1.1326 |
35.8m-g028-ai-r0.05 |
ai | 0.0505 | 1.35B | 1.42B | 1.1327 |
35.8m-g028-ai-r0.1 |
ai | 0.101 | 1.35B | 1.49B | 1.1330 |
35.8m-g028-ai-r0.25 |
ai | 0.253 | 1.35B | 1.69B | 1.1357 |
35.8m-g028-ai-r0.5 |
ai | 0.509 | 1.35B | 2.04B | 1.1397 |
35.8m-g028-ai-r1 |
ai | 1.03 | 1.35B | 2.74B | 1.1469 |
35.8m-g029-control |
control | 0 | 1.39B | 1.39B | 1.1318 |
35.8m-g029-ai-r0.05 |
ai | 0.0503 | 1.39B | 1.46B | 1.1316 |
35.8m-g029-ai-r0.1 |
ai | 0.101 | 1.39B | 1.53B | 1.1320 |
35.8m-g029-ai-r0.25 |
ai | 0.254 | 1.39B | 1.74B | 1.1354 |
35.8m-g029-ai-r0.5 |
ai | 0.51 | 1.38B | 2.09B | 1.1388 |
35.8m-g029-ai-r1 |
ai | 1.03 | 1.37B | 2.78B | 1.1470 |
35.8m-g030-control |
control | 0 | 1.39B | 1.39B | 1.1313 |
35.8m-g030-ai-r2.08 |
ai | 2.08 | 1.39B | 4.29B | 1.1571 |
35.8m-g030-ai-r4.21 |
ai | 4.21 | 1.39B | 7.26B | 1.1709 |
35.8m-g030-ai-r8.51 |
ai | 8.51 | 1.39B | 13.23B | 1.1851 |
35.8m-g030-human-r2 |
human | 0 | 4.18B | 4.18B | 1.1128 |
35.8m-g031-control |
control | 0 | 1.39B | 1.39B | 1.1325 |
35.8m-g031-ai-r0.25 |
ai | 0.253 | 1.39B | 1.74B | 1.1348 |
35.8m-g031-ai-r1 |
ai | 1.03 | 1.37B | 2.78B | 1.1461 |
35.8m-g032-control |
control | 0 | 1.86B | 1.86B | 1.1259 |
35.8m-g032-ai-r0.05 |
ai | 0.0502 | 1.86B | 1.95B | 1.1260 |
35.8m-g032-ai-r0.1 |
ai | 0.1 | 1.86B | 2.04B | 1.1259 |
35.8m-g032-ai-r0.25 |
ai | 0.253 | 1.85B | 2.32B | 1.1295 |
35.8m-g032-ai-r0.5 |
ai | 0.509 | 1.85B | 2.78B | 1.1338 |
35.8m-g032-ai-r1 |
ai | 1.03 | 1.83B | 3.71B | 1.1428 |
35.8m-g033-control |
control | 0 | 1.96B | 1.96B | 1.1240 |
35.8m-g033-ai-r0.05 |
ai | 0.0503 | 1.96B | 2.06B | 1.1248 |
35.8m-g033-ai-r0.1 |
ai | 0.101 | 1.96B | 2.16B | 1.1253 |
35.8m-g033-ai-r0.25 |
ai | 0.252 | 1.96B | 2.45B | 1.1287 |
35.8m-g033-ai-r0.5 |
ai | 0.508 | 1.96B | 2.95B | 1.1331 |
35.8m-g033-ai-r1 |
ai | 1.03 | 1.96B | 3.97B | 1.1418 |
35.8m-g033-ai-r2 |
ai | 2.08 | 1.96B | 6.03B | 1.1536 |
35.8m-g033-ai-r4 |
ai | 4.21 | 1.96B | 10.20B | 1.1686 |
35.8m-g033-ai-r8 |
ai | 8.5 | 1.96B | 18.61B | 1.1833 |
35.8m-g033-human-r2 |
human | 0 | 6.03B | 6.03B | 1.1072 |
35.8m-g034-control |
control | 0 | 2.32B | 2.32B | 1.1219 |
35.8m-g034-ai-r0.05 |
ai | 0.0502 | 2.32B | 2.44B | 1.1218 |
35.8m-g034-ai-r0.1 |
ai | 0.1 | 2.32B | 2.55B | 1.1221 |
35.8m-g034-ai-r0.25 |
ai | 0.253 | 2.32B | 2.90B | 1.1251 |
35.8m-g034-ai-r0.5 |
ai | 0.508 | 2.31B | 3.48B | 1.1294 |
35.8m-g034-ai-r1 |
ai | 1.02 | 2.29B | 4.64B | 1.1401 |
35.8m-g035-control |
control | 0 | 2.61B | 2.61B | 1.1183 |
35.8m-g035-ai-r0.05 |
ai | 0.0502 | 2.61B | 2.74B | 1.1196 |
35.8m-g035-ai-r0.1 |
ai | 0.1 | 2.61B | 2.87B | 1.1217 |
35.8m-g035-ai-r0.25 |
ai | 0.252 | 2.61B | 3.27B | 1.1238 |
35.8m-g035-ai-r0.5 |
ai | 0.507 | 2.61B | 3.94B | 1.1285 |
35.8m-g035-ai-r1 |
ai | 1.02 | 2.61B | 5.28B | 1.1370 |
35.8m-g036-control |
control | 0 | 3.13B | 3.13B | 1.1163 |
35.8m-g036-ai-r0.05 |
ai | 0.0501 | 3.13B | 3.29B | 1.1168 |
35.8m-g036-ai-r0.1 |
ai | 0.1 | 3.13B | 3.45B | 1.1190 |
35.8m-g036-ai-r0.25 |
ai | 0.252 | 3.13B | 3.92B | 1.1203 |
35.8m-g036-ai-r0.5 |
ai | 0.507 | 3.13B | 4.72B | 1.1257 |
35.8m-g036-ai-r1 |
ai | 1.02 | 3.13B | 6.33B | 1.1350 |
35.8m-f06-ai-removed |
filtered | 0 | 360.4M | 360.4M | 1.1792 |
35.8m-f06-web-mix |
natural | 0.297 | 357.8M | 464.0M | 1.1761 |
35.8m-f07-ai-removed |
filtered | 0 | 720.9M | 720.9M | 1.1492 |
35.8m-f07-web-mix |
natural | 0.294 | 717.4M | 928.0M | 1.1508 |
35.8m-f08-ai-removed |
filtered | 0 | 1.08B | 1.08B | 1.1379 |
35.8m-f08-web-mix |
natural | 0.292 | 1.08B | 1.39B | 1.1409 |
35.8m-f09-ai-removed |
filtered | 0 | 1.44B | 1.44B | 1.1310 |
35.8m-f09-web-mix |
natural | 0.292 | 1.44B | 1.86B | 1.1352 |
35.8m-f10-ai-removed |
filtered | 0 | 1.80B | 1.80B | 1.1262 |
35.8m-f10-web-mix |
natural | 0.291 | 1.80B | 2.32B | 1.1295 |
35.8m-g026-repeat-r1 |
repeat | 0 | 675.5M | 1.38B | 1.1334 |
35.8m-g026-repeat-r4 |
repeat | 0 | 675.5M | 3.55B | 1.1203 |
35.8m-g026-repeat-r8 |
repeat | 0 | 675.5M | 6.47B | 1.1156 |
86.2M
| Model | Arm | r | Human tokens | Training tokens | C4 |
|---|---|---|---|---|---|
86.2m-g037-control |
control | 0 | 325.6M | 325.6M | 1.1378 |
86.2m-g037-ai-r0.05 |
ai | 0.0511 | 325.2M | 341.8M | 1.1343 |
86.2m-g037-ai-r0.1 |
ai | 0.102 | 325.5M | 358.6M | 1.1323 |
86.2m-g037-ai-r0.25 |
ai | 0.258 | 323.8M | 407.4M | 1.1276 |
86.2m-g037-ai-r0.5 |
ai | 0.519 | 321.8M | 488.6M | 1.1220 |
86.2m-g037-ai-r1 |
ai | 1.05 | 318.2M | 651.7M | 1.1151 |
86.2m-g038-control |
control | 0 | 325.6M | 325.6M | 1.1380 |
86.2m-g038-ai-r2.12 |
ai | 2.12 | 325.6M | 1.02B | 1.1073 |
86.2m-g038-ai-r4.3 |
ai | 4.3 | 325.6M | 1.73B | 1.1057 |
86.2m-g038-ai-r8.66 |
ai | 8.66 | 325.6M | 3.15B | 1.1069 |
86.2m-g038-ai-r17.3 |
ai | 17.3 | 325.6M | 5.97B | 1.1093 |
86.2m-g038-ai-r34.5 |
ai | 34.5 | 325.6M | 11.55B | 1.1117 |
86.2m-g038-human-r4 |
human | 0 | 1.63B | 1.63B | 1.0458 |
86.2m-g039-control |
control | 0 | 406.8M | 406.8M | 1.1200 |
86.2m-g039-ai-r0.025 |
ai | 0.0255 | 406.9M | 417.3M | 1.1182 |
86.2m-g039-ai-r0.05 |
ai | 0.0516 | 406.8M | 427.8M | 1.1174 |
86.2m-g039-ai-r0.1 |
ai | 0.103 | 406.9M | 448.8M | 1.1154 |
86.2m-g039-ai-r0.25 |
ai | 0.258 | 406.8M | 511.7M | 1.1108 |
86.2m-g039-ai-r0.5 |
ai | 0.519 | 406.9M | 618.1M | 1.1058 |
86.2m-g039-ai-r1 |
ai | 1.05 | 406.7M | 832.0M | 1.1031 |
86.2m-g039-ai-r2 |
ai | 2.12 | 406.9M | 1.27B | 1.0972 |
86.2m-g039-ai-r4 |
ai | 4.28 | 406.8M | 2.15B | 1.0984 |
86.2m-g039-ai-r8 |
ai | 8.63 | 406.8M | 3.92B | 1.1017 |
86.2m-g039-ai-r16 |
ai | 17.3 | 406.9M | 7.44B | 1.1051 |
86.2m-g039-ai-r32 |
ai | 34.4 | 406.8M | 14.42B | 1.1084 |
86.2m-g039-human-r0.025 |
human | 0 | 417.3M | 417.3M | 1.1180 |
86.2m-g039-human-r0.05 |
human | 0 | 427.8M | 427.8M | 1.1160 |
86.2m-g039-human-r4 |
human | 0 | 2.15B | 2.15B | 1.0371 |
86.2m-g040-control |
control | 0 | 1.30B | 1.30B | 1.0541 |
86.2m-g040-ai-r0.05 |
ai | 0.0504 | 1.30B | 1.37B | 1.0528 |
86.2m-g040-ai-r0.1 |
ai | 0.101 | 1.30B | 1.43B | 1.0529 |
86.2m-g040-ai-r0.25 |
ai | 0.253 | 1.30B | 1.63B | 1.0522 |
86.2m-g040-ai-r0.5 |
ai | 0.51 | 1.30B | 1.96B | 1.0540 |
86.2m-g040-ai-r1 |
ai | 1.03 | 1.29B | 2.61B | 1.0556 |
86.2m-g040-ai-r2.08 |
ai | 2.08 | 1.27B | 3.91B | 1.0634 |
86.2m-g040-ai-r4.22 |
ai | 4.22 | 1.25B | 6.52B | 1.0713 |
86.2m-g041-control |
control | 0 | 1.30B | 1.30B | 1.0535 |
86.2m-g041-ai-r2.08 |
ai | 2.08 | 1.30B | 4.02B | 1.0622 |
86.2m-g041-ai-r4.22 |
ai | 4.22 | 1.30B | 6.80B | 1.0710 |
86.2m-g041-ai-r8 |
ai | 8.51 | 1.30B | 12.40B | 1.0811 |
86.2m-g041-human-r2 |
human | 0 | 3.91B | 3.91B | 1.0218 |
86.2m-g042-control |
control | 0 | 1.30B | 1.30B | 1.0536 |
86.2m-g042-ai-r1 |
ai | 1.03 | 1.29B | 2.61B | 1.0560 |
86.2m-g043-control |
control | 0 | 1.30B | 1.30B | 1.0538 |
86.2m-g043-ai-r1 |
ai | 1.03 | 1.29B | 2.61B | 1.0555 |
86.2m-g044-control |
control | 0 | 1.63B | 1.63B | 1.0456 |
86.2m-g044-ai-r0.025 |
ai | 0.0252 | 1.63B | 1.67B | 1.0453 |
86.2m-g044-ai-r0.05 |
ai | 0.0503 | 1.63B | 1.71B | 1.0450 |
86.2m-g044-ai-r0.1 |
ai | 0.101 | 1.63B | 1.79B | 1.0449 |
86.2m-g044-ai-r0.25 |
ai | 0.253 | 1.63B | 2.04B | 1.0456 |
86.2m-g044-ai-r0.5 |
ai | 0.509 | 1.63B | 2.45B | 1.0474 |
86.2m-g044-ai-r1 |
ai | 1.03 | 1.63B | 3.30B | 1.0505 |
86.2m-g044-ai-r2 |
ai | 2.08 | 1.63B | 5.01B | 1.0582 |
86.2m-g044-ai-r4 |
ai | 4.21 | 1.63B | 8.48B | 1.0677 |
86.2m-g044-ai-r8 |
ai | 8.51 | 1.63B | 15.47B | 1.0788 |
86.2m-g044-human-r0.025 |
human | 0 | 1.67B | 1.67B | 1.0449 |
86.2m-g044-human-r0.05 |
human | 0 | 1.71B | 1.71B | 1.0443 |
86.2m-g044-human-r2 |
human | 0 | 5.01B | 5.01B | 1.0172 |
86.2m-g045-control |
control | 0 | 2.61B | 2.61B | 1.0312 |
86.2m-g045-ai-r0.05 |
ai | 0.0501 | 2.61B | 2.74B | 1.0311 |
86.2m-g045-ai-r0.1 |
ai | 0.1 | 2.61B | 2.87B | 1.0306 |
86.2m-g045-ai-r0.25 |
ai | 0.252 | 2.60B | 3.26B | 1.0330 |
86.2m-g045-ai-r0.5 |
ai | 0.507 | 2.60B | 3.91B | 1.0346 |
86.2m-g045-ai-r1 |
ai | 1.02 | 2.58B | 5.22B | 1.0410 |
86.2m-g046-control |
control | 0 | 3.25B | 3.25B | 1.0266 |
86.2m-g046-ai-r0.05 |
ai | 0.0501 | 3.25B | 3.42B | 1.0263 |
86.2m-g046-ai-r0.1 |
ai | 0.1 | 3.25B | 3.58B | 1.0263 |
86.2m-g046-ai-r0.25 |
ai | 0.252 | 3.25B | 4.07B | 1.0281 |
86.2m-g046-ai-r0.5 |
ai | 0.507 | 3.25B | 4.90B | 1.0309 |
86.2m-g046-ai-r1 |
ai | 1.02 | 3.25B | 6.58B | 1.0368 |
86.2m-g047-control |
control | 0 | 3.91B | 3.91B | 1.0221 |
86.2m-g047-ai-r0.05 |
ai | 0.05 | 3.91B | 4.11B | 1.0220 |
86.2m-g047-ai-r0.1 |
ai | 0.1 | 3.91B | 4.30B | 1.0221 |
86.2m-g047-ai-r0.25 |
ai | 0.252 | 3.91B | 4.89B | 1.0242 |
86.2m-g047-ai-r0.5 |
ai | 0.506 | 3.90B | 5.87B | 1.0273 |
86.2m-g047-ai-r1 |
ai | 1.02 | 3.87B | 7.82B | 1.0342 |
86.2m-g047-ai-r2.07 |
ai | 2.07 | 3.82B | 11.74B | 1.0445 |
86.2m-g047-ai-r4.2 |
ai | 4.2 | 3.76B | 19.56B | 1.0567 |
86.2m-g048-control |
control | 0 | 3.91B | 3.91B | 1.0212 |
86.2m-g048-ai-r0.25 |
ai | 0.252 | 3.91B | 4.89B | 1.0235 |
86.2m-g048-ai-r1 |
ai | 1.02 | 3.87B | 7.82B | 1.0348 |
86.2m-g049-control |
control | 0 | 4.72B | 4.72B | 1.0189 |
86.2m-g049-ai-r0.05 |
ai | 0.05 | 4.72B | 4.95B | 1.0189 |
86.2m-g049-ai-r0.1 |
ai | 0.1 | 4.72B | 5.19B | 1.0185 |
86.2m-g049-ai-r0.25 |
ai | 0.252 | 4.72B | 5.90B | 1.0211 |
86.2m-g049-ai-r0.5 |
ai | 0.506 | 4.72B | 7.10B | 1.0244 |
86.2m-g049-ai-r1 |
ai | 1.02 | 4.72B | 9.53B | 1.0311 |
86.2m-g049-ai-r2 |
ai | 2.07 | 4.72B | 14.48B | 1.0414 |
86.2m-g049-ai-r4 |
ai | 4.2 | 4.72B | 24.52B | 1.0549 |
86.2m-g050-control |
control | 0 | 5.22B | 5.22B | 1.0163 |
86.2m-g050-ai-r0.05 |
ai | 0.05 | 5.22B | 5.48B | 1.0168 |
86.2m-g050-ai-r0.1 |
ai | 0.1 | 5.22B | 5.74B | 1.0166 |
86.2m-g050-ai-r0.25 |
ai | 0.251 | 5.21B | 6.52B | 1.0194 |
86.2m-g050-ai-r0.5 |
ai | 0.506 | 5.20B | 7.82B | 1.0228 |
86.2m-g050-ai-r1 |
ai | 1.02 | 5.16B | 10.43B | 1.0294 |
86.2m-g051-control |
control | 0 | 6.29B | 6.29B | 1.0137 |
86.2m-g051-ai-r0.05 |
ai | 0.05 | 6.29B | 6.60B | 1.0135 |
86.2m-g051-ai-r0.1 |
ai | 0.1 | 6.29B | 6.92B | 1.0148 |
86.2m-g051-ai-r0.25 |
ai | 0.251 | 6.29B | 7.87B | 1.0169 |
86.2m-g051-ai-r0.5 |
ai | 0.506 | 6.29B | 9.47B | 1.0205 |
86.2m-g051-ai-r1 |
ai | 1.02 | 6.29B | 12.71B | 1.0278 |
86.2m-g052-control |
control | 0 | 6.52B | 6.52B | 1.0128 |
86.2m-g052-ai-r0.05 |
ai | 0.05 | 6.52B | 6.85B | 1.0131 |
86.2m-g052-ai-r0.1 |
ai | 0.1 | 6.52B | 7.17B | 1.0130 |
86.2m-g052-ai-r0.25 |
ai | 0.251 | 6.51B | 8.15B | 1.0161 |
86.2m-g052-ai-r0.5 |
ai | 0.506 | 6.50B | 9.78B | 1.0196 |
86.2m-g052-ai-r1 |
ai | 1.02 | 6.45B | 13.04B | 1.0270 |
86.2m-g053-control |
control | 0 | 7.54B | 7.54B | 1.0097 |
86.2m-g053-ai-r0.05 |
ai | 0.0499 | 7.54B | 7.92B | 1.0109 |
86.2m-g053-ai-r0.1 |
ai | 0.1 | 7.54B | 8.30B | 1.0116 |
86.2m-g053-ai-r0.25 |
ai | 0.251 | 7.54B | 9.44B | 1.0140 |
86.2m-g053-ai-r0.5 |
ai | 0.506 | 7.54B | 11.35B | 1.0182 |
86.2m-g053-ai-r1 |
ai | 1.02 | 7.54B | 15.24B | 1.0262 |
86.2m-f11-ai-removed |
filtered | 0 | 253.2M | 253.2M | 1.1609 |
86.2m-f11-web-mix |
natural | 0.294 | 251.6M | 325.6M | 1.1473 |
86.2m-f12-ai-removed |
filtered | 0 | 1.01B | 1.01B | 1.0643 |
86.2m-f12-web-mix |
natural | 0.293 | 1.01B | 1.30B | 1.0616 |
86.2m-f13-ai-removed |
filtered | 0 | 2.03B | 2.03B | 1.0387 |
86.2m-f13-web-mix |
natural | 0.291 | 2.02B | 2.61B | 1.0397 |
86.2m-f14-ai-removed |
filtered | 0 | 3.04B | 3.04B | 1.0278 |
86.2m-f14-web-mix |
natural | 0.29 | 3.03B | 3.91B | 1.0297 |
86.2m-f15-ai-removed |
filtered | 0 | 4.05B | 4.05B | 1.0214 |
86.2m-f15-web-mix |
natural | 0.29 | 4.05B | 5.22B | 1.0243 |
86.2m-f16-ai-removed |
filtered | 0 | 5.07B | 5.07B | 1.0171 |
86.2m-f16-web-mix |
natural | 0.289 | 5.06B | 6.52B | 1.0208 |
135M
| Model | Arm | r | Human tokens | Training tokens | C4 |
|---|---|---|---|---|---|
135m-g054-control |
control | 0 | 550.5M | 550.5M | 1.0742 |
135m-g054-ai-r0.0025 |
ai | 0.00256 | 550.1M | 551.6M | 1.0742 |
135m-g054-ai-r0.005 |
ai | 0.00507 | 550.3M | 553.1M | 1.0730 |
135m-g054-ai-r0.01 |
ai | 0.0102 | 550.2M | 555.7M | 1.0738 |
135m-g054-ai-r0.025 |
ai | 0.0257 | 550.0M | 564.1M | 1.0734 |
135m-g054-ai-r0.05 |
ai | 0.0512 | 549.6M | 577.8M | 1.0723 |
135m-g054-ai-r0.1 |
ai | 0.103 | 549.3M | 605.6M | 1.0706 |
135m-g054-ai-r0.25 |
ai | 0.257 | 547.2M | 687.9M | 1.0657 |
135m-g054-ai-r0.5 |
ai | 0.517 | 544.4M | 825.8M | 1.0609 |
135m-g054-ai-r1 |
ai | 1.04 | 539.3M | 1.10B | 1.0555 |
135m-g054-ai-r2 |
ai | 2.11 | 550.5M | 1.71B | 1.0512 |
135m-g054-ai-r4 |
ai | 4.26 | 550.5M | 2.90B | 1.0517 |
135m-g054-ai-r8 |
ai | 8.59 | 550.5M | 5.28B | 1.0536 |
135m-g054-ai-r16 |
ai | 17.2 | 550.5M | 10.01B | 1.0574 |
135m-g054-human-r0.0025 |
human | 0 | 551.6M | 551.6M | 1.0736 |
135m-g054-human-r0.005 |
human | 0 | 553.1M | 553.1M | 1.0736 |
135m-g054-human-r0.01 |
human | 0 | 555.7M | 555.7M | 1.0740 |
135m-g054-human-r0.025 |
human | 0 | 564.1M | 564.1M | 1.0730 |
135m-g054-human-r0.05 |
human | 0 | 577.8M | 577.8M | 1.0717 |
135m-g054-human-r8 |
human | 0 | 4.95B | 4.95B | 0.9800 |
135m-g055-control |
control | 0 | 550.5M | 550.5M | 1.0718 |
135m-g055-ai-r0.025 |
ai | 0.0254 | 550.1M | 564.1M | 1.0715 |
135m-g055-ai-r0.05 |
ai | 0.051 | 549.7M | 577.8M | 1.0702 |
135m-g055-human-r0.025 |
human | 0 | 564.1M | 564.1M | 1.0708 |
135m-g055-human-r0.05 |
human | 0 | 577.8M | 577.8M | 1.0693 |
135m-g056-control |
control | 0 | 550.5M | 550.5M | 1.0757 |
135m-g056-ai-r0.025 |
ai | 0.0255 | 550.1M | 564.1M | 1.0744 |
135m-g056-ai-r0.05 |
ai | 0.0511 | 549.7M | 577.8M | 1.0729 |
135m-g056-human-r0.025 |
human | 0 | 564.1M | 564.1M | 1.0737 |
135m-g056-human-r0.05 |
human | 0 | 577.8M | 577.8M | 1.0716 |
135m-g057-control |
control | 0 | 638.6M | 638.6M | 1.0643 |
135m-g057-ai-r0.0025 |
ai | 0.00254 | 638.5M | 640.2M | 1.0643 |
135m-g057-ai-r0.005 |
ai | 0.00504 | 638.5M | 641.7M | 1.0633 |
135m-g057-ai-r0.01 |
ai | 0.0101 | 638.4M | 644.9M | 1.0628 |
135m-g057-ai-r0.025 |
ai | 0.0256 | 638.5M | 654.8M | 1.0609 |
135m-g057-ai-r0.05 |
ai | 0.051 | 638.5M | 671.1M | 1.0612 |
135m-g057-ai-r0.1 |
ai | 0.102 | 638.4M | 703.6M | 1.0593 |
135m-g057-ai-r0.25 |
ai | 0.256 | 638.6M | 802.2M | 1.0559 |
135m-g057-ai-r0.5 |
ai | 0.515 | 638.7M | 967.3M | 1.0509 |
135m-g057-ai-r1 |
ai | 1.04 | 638.5M | 1.30B | 1.0473 |
135m-g057-ai-r2 |
ai | 2.1 | 638.5M | 1.98B | 1.0458 |
135m-g057-ai-r4 |
ai | 4.26 | 638.6M | 3.36B | 1.0472 |
135m-g057-ai-r8 |
ai | 8.58 | 638.6M | 6.11B | 1.0509 |
135m-g057-ai-r16 |
ai | 17.2 | 638.6M | 11.60B | 1.0557 |
135m-g057-ai-r32 |
ai | 34.4 | 638.6M | 22.60B | 1.0595 |
135m-g057-human-r0.0025 |
human | 0 | 640.2M | 640.2M | 1.0629 |
135m-g057-human-r0.005 |
human | 0 | 641.7M | 641.7M | 1.0628 |
135m-g057-human-r0.01 |
human | 0 | 644.9M | 644.9M | 1.0622 |
135m-g057-human-r0.025 |
human | 0 | 654.8M | 654.8M | 1.0621 |
135m-g057-human-r0.05 |
human | 0 | 671.1M | 671.1M | 1.0605 |
135m-g057-human-r0.5 |
human | 0 | 957.9M | 957.9M | 1.0385 |
135m-g057-human-r8 |
human | 0 | 6.11B | 6.11B | 0.9755 |
135m-g058-control |
control | 0 | 2.20B | 2.20B | 1.0016 |
135m-g058-ai-r0.0025 |
ai | 0.00248 | 2.20B | 2.21B | 1.0014 |
135m-g058-ai-r0.005 |
ai | 0.00503 | 2.20B | 2.21B | 1.0015 |
135m-g058-ai-r0.01 |
ai | 0.0101 | 2.20B | 2.22B | 1.0015 |
135m-g058-ai-r0.025 |
ai | 0.0251 | 2.20B | 2.26B | 1.0009 |
135m-g058-ai-r0.05 |
ai | 0.0502 | 2.20B | 2.31B | 1.0011 |
135m-g058-ai-r0.1 |
ai | 0.101 | 2.20B | 2.42B | 1.0008 |
135m-g058-ai-r0.25 |
ai | 0.252 | 2.20B | 2.75B | 1.0009 |
135m-g058-ai-r0.5 |
ai | 0.508 | 2.19B | 3.30B | 1.0021 |
135m-g058-ai-r1 |
ai | 1.02 | 2.17B | 4.40B | 1.0061 |
135m-g058-ai-r2 |
ai | 2.08 | 2.20B | 6.77B | 1.0117 |
135m-g058-ai-r2.07 |
ai | 2.07 | 2.15B | 6.61B | 1.0126 |
135m-g058-ai-r4 |
ai | 4.2 | 2.20B | 11.46B | 1.0210 |
135m-g058-ai-r4.2 |
ai | 4.2 | 2.12B | 11.01B | 1.0214 |
135m-g058-human-r0.0025 |
human | 0 | 2.21B | 2.21B | 1.0013 |
135m-g058-human-r0.005 |
human | 0 | 2.21B | 2.21B | 1.0015 |
135m-g058-human-r0.01 |
human | 0 | 2.22B | 2.22B | 1.0011 |
135m-g058-human-r0.025 |
human | 0 | 2.26B | 2.26B | 1.0005 |
135m-g058-human-r0.05 |
human | 0 | 2.31B | 2.31B | 1.0000 |
135m-g058-human-r4 |
human | 0 | 11.01B | 11.01B | 0.9659 |
135m-g059-control |
control | 0 | 2.20B | 2.20B | 1.0022 |
135m-g059-ai-r0.25 |
ai | 0.253 | 2.20B | 2.75B | 1.0010 |
135m-g059-ai-r1 |
ai | 1.03 | 2.17B | 4.40B | 1.0063 |
135m-g060-control |
control | 0 | 2.20B | 2.20B | 1.0018 |
135m-g060-ai-r0.025 |
ai | 0.0247 | 2.20B | 2.26B | 1.0016 |
135m-g060-ai-r0.05 |
ai | 0.0494 | 2.20B | 2.31B | 1.0013 |
135m-g060-ai-r0.25 |
ai | 0.252 | 2.20B | 2.75B | 1.0008 |
135m-g060-ai-r1 |
ai | 1.03 | 2.17B | 4.40B | 1.0054 |
135m-g060-human-r0.025 |
human | 0 | 2.26B | 2.26B | 1.0010 |
135m-g060-human-r0.05 |
human | 0 | 2.31B | 2.31B | 1.0004 |
135m-g061-control |
control | 0 | 2.20B | 2.20B | 1.0023 |
135m-g061-ai-r0.025 |
ai | 0.0247 | 2.20B | 2.26B | 1.0013 |
135m-g061-ai-r0.05 |
ai | 0.0494 | 2.20B | 2.31B | 1.0011 |
135m-g061-ai-r0.25 |
ai | 0.252 | 2.20B | 2.75B | 1.0008 |
135m-g061-ai-r1 |
ai | 1.02 | 2.18B | 4.40B | 1.0056 |
135m-g061-human-r0.025 |
human | 0 | 2.26B | 2.26B | 1.0003 |
135m-g061-human-r0.05 |
human | 0 | 2.31B | 2.31B | 0.9999 |
135m-g062-control |
control | 0 | 2.20B | 2.20B | 1.0013 |
135m-g062-ai-r0.25 |
ai | 0.252 | 2.20B | 2.75B | 1.0009 |
135m-g062-ai-r1 |
ai | 1.02 | 2.18B | 4.40B | 1.0055 |
135m-g063-control |
control | 0 | 2.55B | 2.55B | 0.9970 |
135m-g063-ai-r0.0025 |
ai | 0.0025 | 2.55B | 2.56B | 0.9968 |
135m-g063-ai-r0.005 |
ai | 0.00501 | 2.55B | 2.57B | 0.9967 |
135m-g063-ai-r0.01 |
ai | 0.01 | 2.55B | 2.58B | 0.9967 |
135m-g063-ai-r0.025 |
ai | 0.0251 | 2.55B | 2.62B | 0.9965 |
135m-g063-ai-r0.05 |
ai | 0.0502 | 2.55B | 2.68B | 0.9963 |
135m-g063-ai-r0.1 |
ai | 0.1 | 2.55B | 2.81B | 0.9961 |
135m-g063-ai-r0.25 |
ai | 0.252 | 2.55B | 3.20B | 0.9968 |
135m-g063-ai-r0.5 |
ai | 0.507 | 2.55B | 3.85B | 0.9985 |
135m-g063-ai-r1 |
ai | 1.02 | 2.55B | 5.17B | 1.0022 |
135m-g063-ai-r2 |
ai | 2.07 | 2.55B | 7.85B | 1.0090 |
135m-g063-ai-r4 |
ai | 4.2 | 2.55B | 13.29B | 1.0187 |
135m-g063-ai-r8 |
ai | 8.5 | 2.55B | 24.27B | 1.0291 |
135m-g063-human-r0.0025 |
human | 0 | 2.56B | 2.56B | 0.9967 |
135m-g063-human-r0.005 |
human | 0 | 2.57B | 2.57B | 0.9966 |
135m-g063-human-r0.01 |
human | 0 | 2.58B | 2.58B | 0.9966 |
135m-g063-human-r0.025 |
human | 0 | 2.62B | 2.62B | 0.9959 |
135m-g063-human-r0.05 |
human | 0 | 2.68B | 2.68B | 0.9951 |
135m-g063-human-r0.5 |
human | 0 | 3.83B | 3.83B | 0.9856 |
135m-g063-human-r4 |
human | 0 | 13.29B | 13.29B | 0.9629 |
135m-g064-control |
control | 0 | 4.40B | 4.40B | 0.9826 |
135m-g064-ai-r0.025 |
ai | 0.0249 | 4.40B | 4.51B | 0.9823 |
135m-g064-ai-r0.05 |
ai | 0.05 | 4.40B | 4.62B | 0.9822 |
135m-g064-ai-r0.1 |
ai | 0.1 | 4.40B | 4.84B | 0.9826 |
135m-g064-ai-r0.25 |
ai | 0.252 | 4.40B | 5.51B | 0.9842 |
135m-g064-ai-r0.5 |
ai | 0.506 | 4.39B | 6.61B | 0.9869 |
135m-g064-ai-r1 |
ai | 1.02 | 4.36B | 8.81B | 0.9920 |
135m-g064-human-r0.025 |
human | 0 | 4.51B | 4.51B | 0.9817 |
135m-g064-human-r0.05 |
human | 0 | 4.62B | 4.62B | 0.9814 |
135m-g065-control |
control | 0 | 5.11B | 5.11B | 0.9795 |
135m-g065-ai-r0.025 |
ai | 0.025 | 5.11B | 5.24B | 0.9792 |
135m-g065-ai-r0.05 |
ai | 0.05 | 5.11B | 5.36B | 0.9793 |
135m-g065-ai-r0.1 |
ai | 0.1 | 5.11B | 5.62B | 0.9798 |
135m-g065-ai-r0.25 |
ai | 0.252 | 5.11B | 6.39B | 0.9810 |
135m-g065-ai-r0.5 |
ai | 0.506 | 5.11B | 7.69B | 0.9839 |
135m-g065-ai-r1 |
ai | 1.02 | 5.11B | 10.32B | 0.9891 |
135m-g065-human-r0.025 |
human | 0 | 5.24B | 5.24B | 0.9789 |
135m-g065-human-r0.05 |
human | 0 | 5.36B | 5.36B | 0.9777 |
135m-g065-human-r0.5 |
human | 0 | 7.66B | 7.66B | 0.9716 |
135m-g066-control |
control | 0 | 6.61B | 6.61B | 0.9740 |
135m-g066-ai-r0.05 |
ai | 0.05 | 6.61B | 6.94B | 0.9743 |
135m-g066-ai-r0.1 |
ai | 0.1 | 6.61B | 7.27B | 0.9744 |
135m-g066-ai-r0.25 |
ai | 0.251 | 6.60B | 8.26B | 0.9766 |
135m-g066-ai-r0.5 |
ai | 0.506 | 6.58B | 9.91B | 0.9794 |
135m-g066-ai-r1 |
ai | 1.02 | 6.54B | 13.21B | 0.9856 |
135m-g066-human-r0.25 |
human | 0 | 8.26B | 8.26B | 0.9701 |
135m-g067-control |
control | 0 | 7.40B | 7.40B | 0.9718 |
135m-g067-ai-r0.05 |
ai | 0.0499 | 7.40B | 7.77B | 0.9720 |
135m-g067-ai-r0.1 |
ai | 0.1 | 7.40B | 8.14B | 0.9729 |
135m-g067-ai-r0.25 |
ai | 0.251 | 7.40B | 9.26B | 0.9746 |
135m-g067-ai-r0.5 |
ai | 0.506 | 7.40B | 11.15B | 0.9781 |
135m-g067-ai-r1 |
ai | 1.02 | 7.40B | 14.96B | 0.9837 |
135m-g067-human-r0.25 |
human | 0 | 9.26B | 9.26B | 0.9678 |
135m-g068-control |
control | 0 | 8.81B | 8.81B | 0.9690 |
135m-g068-ai-r0.05 |
ai | 0.05 | 8.81B | 9.25B | 0.9690 |
135m-g068-ai-r0.1 |
ai | 0.1 | 8.81B | 9.69B | 0.9694 |
135m-g068-ai-r0.25 |
ai | 0.251 | 8.80B | 11.01B | 0.9718 |
135m-g068-ai-r0.5 |
ai | 0.506 | 8.78B | 13.21B | 0.9754 |
135m-g068-ai-r1 |
ai | 1.02 | 8.72B | 17.62B | 0.9818 |
135m-g068-human-r0.25 |
human | 0 | 11.01B | 11.01B | 0.9655 |
135m-g069-control |
control | 0 | 9.87B | 9.87B | 0.9673 |
135m-g069-ai-r0.05 |
ai | 0.0499 | 9.87B | 10.36B | 0.9673 |
135m-g069-ai-r0.1 |
ai | 0.1 | 9.87B | 10.86B | 0.9682 |
135m-g069-ai-r0.25 |
ai | 0.251 | 9.87B | 12.35B | 0.9704 |
135m-g069-ai-r0.5 |
ai | 0.505 | 9.87B | 14.86B | 0.9738 |
135m-g069-ai-r1 |
ai | 1.02 | 9.87B | 19.94B | 0.9805 |
135m-g069-human-r0.25 |
human | 0 | 12.35B | 12.35B | 0.9637 |
135m-g070-control |
control | 0 | 11.01B | 11.01B | 0.9658 |
135m-g070-ai-r0.05 |
ai | 0.05 | 11.01B | 11.56B | 0.9657 |
135m-g070-ai-r0.1 |
ai | 0.1 | 11.01B | 12.11B | 0.9662 |
135m-g070-ai-r0.25 |
ai | 0.251 | 11.00B | 13.76B | 0.9688 |
135m-g070-ai-r0.5 |
ai | 0.506 | 10.97B | 16.52B | 0.9722 |
135m-g070-ai-r1 |
ai | 1.02 | 10.90B | 22.02B | 0.9790 |
135m-g070-human-r0.25 |
human | 0 | 13.76B | 13.76B | 0.9623 |
135m-g071-control |
control | 0 | 11.84B | 11.84B | 0.9649 |
135m-g071-ai-r0.05 |
ai | 0.0499 | 11.84B | 12.43B | 0.9648 |
135m-g071-ai-r0.1 |
ai | 0.1 | 11.84B | 13.02B | 0.9650 |
135m-g071-ai-r0.25 |
ai | 0.251 | 11.84B | 14.81B | 0.9679 |
135m-g071-ai-r0.5 |
ai | 0.505 | 11.84B | 17.82B | 0.9715 |
135m-g071-ai-r1 |
ai | 1.02 | 11.84B | 23.92B | 0.9781 |
135m-g071-human-r0.25 |
human | 0 | 14.81B | 14.81B | 0.9615 |
268M
| Model | Arm | r | Human tokens | Training tokens | C4 |
|---|---|---|---|---|---|
268m-g072-control |
control | 0 | 1.17B | 1.17B | 0.9968 |
268m-g072-ai-r0.0025 |
ai | 0.0025 | 1.17B | 1.18B | 0.9969 |
268m-g072-ai-r0.005 |
ai | 0.00501 | 1.17B | 1.18B | 0.9968 |
268m-g072-ai-r0.01 |
ai | 0.0101 | 1.17B | 1.19B | 0.9963 |
268m-g072-ai-r0.025 |
ai | 0.0253 | 1.17B | 1.20B | 0.9959 |
268m-g072-ai-r0.05 |
ai | 0.0506 | 1.17B | 1.23B | 0.9952 |
268m-g072-ai-r0.1 |
ai | 0.101 | 1.17B | 1.29B | 0.9937 |
268m-g072-ai-r0.25 |
ai | 0.254 | 1.17B | 1.47B | 0.9908 |
268m-g072-ai-r0.5 |
ai | 0.511 | 1.17B | 1.76B | 0.9886 |
268m-g072-ai-r1 |
ai | 1.03 | 1.16B | 2.35B | 0.9861 |
268m-g072-human-r0.0025 |
human | 0 | 1.18B | 1.18B | 0.9970 |
268m-g072-human-r0.005 |
human | 0 | 1.18B | 1.18B | 0.9966 |
268m-g072-human-r0.01 |
human | 0 | 1.19B | 1.19B | 0.9964 |
268m-g072-human-r0.025 |
human | 0 | 1.20B | 1.20B | 0.9954 |
268m-g072-human-r0.05 |
human | 0 | 1.23B | 1.23B | 0.9941 |
268m-g072-human-r0.25 |
human | 0 | 1.47B | 1.47B | 0.9849 |
268m-g072-human-r1 |
human | 0 | 2.35B | 2.35B | 0.9634 |
268m-g073-control |
control | 0 | 1.17B | 1.17B | 0.9960 |
268m-g073-ai-r0.025 |
ai | 0.0253 | 1.17B | 1.20B | 0.9948 |
268m-g073-ai-r0.05 |
ai | 0.0506 | 1.17B | 1.23B | 0.9939 |
268m-g073-human-r0.025 |
human | 0 | 1.20B | 1.20B | 0.9943 |
268m-g073-human-r0.05 |
human | 0 | 1.23B | 1.23B | 0.9933 |
268m-g074-control |
control | 0 | 1.17B | 1.17B | 0.9968 |
268m-g074-ai-r0.025 |
ai | 0.0253 | 1.17B | 1.20B | 0.9957 |
268m-g074-ai-r0.05 |
ai | 0.0506 | 1.17B | 1.23B | 0.9946 |
268m-g074-human-r0.025 |
human | 0 | 1.20B | 1.20B | 0.9952 |
268m-g074-human-r0.05 |
human | 0 | 1.23B | 1.23B | 0.9940 |
268m-g075-control |
control | 0 | 1.27B | 1.27B | 0.9926 |
268m-g075-ai-r0.0025 |
ai | 0.0025 | 1.27B | 1.27B | 0.9926 |
268m-g075-ai-r0.005 |
ai | 0.005 | 1.27B | 1.27B | 0.9923 |
268m-g075-ai-r0.01 |
ai | 0.0101 | 1.27B | 1.28B | 0.9921 |
268m-g075-ai-r0.025 |
ai | 0.0252 | 1.27B | 1.30B | 0.9917 |
268m-g075-ai-r0.05 |
ai | 0.0506 | 1.27B | 1.33B | 0.9912 |
268m-g075-ai-r0.1 |
ai | 0.101 | 1.27B | 1.39B | 0.9899 |
268m-g075-ai-r0.25 |
ai | 0.253 | 1.27B | 1.59B | 0.9869 |
268m-g075-ai-r0.5 |
ai | 0.509 | 1.27B | 1.91B | 0.9846 |
268m-g075-ai-r1 |
ai | 1.03 | 1.27B | 2.57B | 0.9824 |
268m-g075-ai-r2 |
ai | 2.08 | 1.27B | 3.91B | 0.9823 |
268m-g075-ai-r4 |
ai | 4.22 | 1.27B | 6.61B | 0.9840 |
268m-g075-human-r0.0025 |
human | 0 | 1.27B | 1.27B | 0.9927 |
268m-g075-human-r0.005 |
human | 0 | 1.27B | 1.27B | 0.9924 |
268m-g075-human-r0.01 |
human | 0 | 1.28B | 1.28B | 0.9921 |
268m-g075-human-r0.025 |
human | 0 | 1.30B | 1.30B | 0.9913 |
268m-g075-human-r0.05 |
human | 0 | 1.33B | 1.33B | 0.9901 |
268m-g075-human-r0.25 |
human | 0 | 1.59B | 1.59B | 0.9812 |
268m-g075-human-r1 |
human | 0 | 2.57B | 2.57B | 0.9595 |
268m-g076-control |
control | 0 | 4.70B | 4.70B | 0.9396 |
268m-g076-ai-r0.0025 |
ai | 0.00249 | 4.70B | 4.71B | 0.9395 |
268m-g076-ai-r0.005 |
ai | 0.00501 | 4.70B | 4.72B | 0.9395 |
268m-g076-ai-r0.01 |
ai | 0.01 | 4.70B | 4.74B | 0.9396 |
268m-g076-ai-r0.025 |
ai | 0.025 | 4.70B | 4.82B | 0.9392 |
268m-g076-ai-r0.05 |
ai | 0.05 | 4.70B | 4.93B | 0.9392 |
268m-g076-ai-r0.1 |
ai | 0.1 | 4.70B | 5.17B | 0.9388 |
268m-g076-ai-r0.25 |
ai | 0.252 | 4.69B | 5.87B | 0.9394 |
268m-g076-ai-r0.5 |
ai | 0.506 | 4.68B | 7.05B | 0.9410 |
268m-g076-ai-r1 |
ai | 1.02 | 4.65B | 9.40B | 0.9446 |
268m-g076-human-r0.0025 |
human | 0 | 4.71B | 4.71B | 0.9394 |
268m-g076-human-r0.005 |
human | 0 | 4.72B | 4.72B | 0.9396 |
268m-g076-human-r0.01 |
human | 0 | 4.74B | 4.74B | 0.9394 |
268m-g076-human-r0.025 |
human | 0 | 4.82B | 4.82B | 0.9387 |
268m-g076-human-r0.05 |
human | 0 | 4.93B | 4.93B | 0.9385 |
268m-g076-human-r0.25 |
human | 0 | 5.87B | 5.87B | 0.9337 |
268m-g077-control |
control | 0 | 4.70B | 4.70B | 0.9400 |
268m-g077-ai-r0.25 |
ai | 0.251 | 4.69B | 5.87B | 0.9394 |
268m-g077-ai-r1 |
ai | 1.02 | 4.65B | 9.40B | 0.9452 |
268m-g078-control |
control | 0 | 4.70B | 4.70B | 0.9398 |
268m-g078-ai-r0.025 |
ai | 0.0248 | 4.70B | 4.82B | 0.9398 |
268m-g078-ai-r0.05 |
ai | 0.0497 | 4.70B | 4.93B | 0.9394 |
268m-g078-ai-r0.25 |
ai | 0.252 | 4.69B | 5.87B | 0.9395 |
268m-g078-ai-r0.5 |
ai | 0.506 | 4.68B | 7.05B | 0.9407 |
268m-g078-ai-r1 |
ai | 1.02 | 4.65B | 9.40B | 0.9444 |
268m-g078-human-r0.025 |
human | 0 | 4.82B | 4.82B | 0.9393 |
268m-g078-human-r0.05 |
human | 0 | 4.93B | 4.93B | 0.9387 |
268m-g079-control |
control | 0 | 4.70B | 4.70B | 0.9396 |
268m-g079-ai-r0.025 |
ai | 0.0248 | 4.70B | 4.82B | 0.9397 |
268m-g079-ai-r0.05 |
ai | 0.0497 | 4.70B | 4.93B | 0.9390 |
268m-g079-ai-r0.25 |
ai | 0.252 | 4.69B | 5.87B | 0.9397 |
268m-g079-ai-r0.5 |
ai | 0.506 | 4.68B | 7.05B | 0.9408 |
268m-g079-ai-r1 |
ai | 1.02 | 4.65B | 9.40B | 0.9445 |
268m-g079-human-r0.025 |
human | 0 | 4.82B | 4.82B | 0.9393 |
268m-g079-human-r0.05 |
human | 0 | 4.93B | 4.93B | 0.9384 |
268m-g080-control |
control | 0 | 4.70B | 4.70B | 0.9401 |
268m-g080-ai-r0.25 |
ai | 0.251 | 4.69B | 5.87B | 0.9396 |
268m-g080-ai-r1 |
ai | 1.02 | 4.65B | 9.40B | 0.9449 |
268m-g081-control |
control | 0 | 5.07B | 5.07B | 0.9378 |
268m-g081-ai-r0.0025 |
ai | 0.0025 | 5.07B | 5.08B | 0.9377 |
268m-g081-ai-r0.005 |
ai | 0.005 | 5.07B | 5.09B | 0.9375 |
268m-g081-ai-r0.01 |
ai | 0.01 | 5.07B | 5.12B | 0.9374 |
268m-g081-ai-r0.025 |
ai | 0.025 | 5.07B | 5.19B | 0.9375 |
268m-g081-ai-r0.05 |
ai | 0.05 | 5.07B | 5.32B | 0.9370 |
268m-g081-ai-r0.1 |
ai | 0.1 | 5.07B | 5.58B | 0.9371 |
268m-g081-ai-r0.25 |
ai | 0.251 | 5.07B | 6.34B | 0.9374 |
268m-g081-ai-r0.5 |
ai | 0.506 | 5.07B | 7.63B | 0.9394 |
268m-g081-ai-r1 |
ai | 1.02 | 5.07B | 10.24B | 0.9429 |
268m-g081-ai-r2 |
ai | 2.07 | 5.07B | 15.55B | 0.9491 |
268m-g081-ai-r4 |
ai | 4.2 | 5.07B | 26.35B | 0.9579 |
268m-g081-human-r0.0025 |
human | 0 | 5.08B | 5.08B | 0.9375 |
268m-g081-human-r0.005 |
human | 0 | 5.09B | 5.09B | 0.9375 |
268m-g081-human-r0.01 |
human | 0 | 5.12B | 5.12B | 0.9374 |
268m-g081-human-r0.025 |
human | 0 | 5.19B | 5.19B | 0.9369 |
268m-g081-human-r0.05 |
human | 0 | 5.32B | 5.32B | 0.9363 |
268m-g081-human-r0.25 |
human | 0 | 6.34B | 6.34B | 0.9321 |
268m-g082-control |
control | 0 | 9.40B | 9.40B | 0.9232 |
268m-g082-ai-r0.025 |
ai | 0.0249 | 9.40B | 9.63B | 0.9231 |
268m-g082-ai-r0.05 |
ai | 0.0499 | 9.40B | 9.87B | 0.9228 |
268m-g082-ai-r0.1 |
ai | 0.1 | 9.39B | 10.33B | 0.9234 |
268m-g082-ai-r0.25 |
ai | 0.251 | 9.39B | 11.74B | 0.9248 |
268m-g082-ai-r0.5 |
ai | 0.506 | 9.36B | 14.09B | 0.9272 |
268m-g082-ai-r1 |
ai | 1.02 | 9.30B | 18.79B | 0.9326 |
268m-g082-human-r0.025 |
human | 0 | 9.63B | 9.63B | 0.9225 |
268m-g082-human-r0.05 |
human | 0 | 9.87B | 9.87B | 0.9223 |
268m-g082-human-r0.25 |
human | 0 | 11.74B | 11.74B | 0.9192 |
268m-g082-human-r1 |
human | 0 | 18.79B | 18.79B | 0.9116 |
268m-g083-control |
control | 0 | 10.14B | 10.14B | 0.9218 |
268m-g083-ai-r0.025 |
ai | 0.025 | 10.14B | 10.39B | 0.9216 |
268m-g083-ai-r0.05 |
ai | 0.0499 | 10.14B | 10.64B | 0.9221 |
268m-g083-ai-r0.1 |
ai | 0.1 | 10.14B | 11.15B | 0.9223 |
268m-g083-ai-r0.25 |
ai | 0.251 | 10.14B | 12.68B | 0.9233 |
268m-g083-ai-r0.5 |
ai | 0.506 | 10.14B | 15.26B | 0.9262 |
268m-g083-ai-r1 |
ai | 1.02 | 10.14B | 20.48B | 0.9316 |
268m-g083-human-r0.025 |
human | 0 | 10.39B | 10.39B | 0.9214 |
268m-g083-human-r0.05 |
human | 0 | 10.64B | 10.64B | 0.9207 |
268m-g083-human-r0.25 |
human | 0 | 12.68B | 12.68B | 0.9178 |
268m-g083-human-r1 |
human | 0 | 20.48B | 20.48B | 0.9103 |
268m-g084-control |
control | 0 | 14.09B | 14.09B | 0.9157 |
268m-g084-ai-r0.05 |
ai | 0.05 | 14.09B | 14.80B | 0.9159 |
268m-g084-ai-r0.1 |
ai | 0.1 | 14.09B | 15.50B | 0.9163 |
268m-g084-ai-r0.25 |
ai | 0.251 | 14.08B | 17.62B | 0.9178 |
268m-g084-ai-r0.5 |
ai | 0.506 | 14.04B | 21.14B | 0.9211 |
268m-g084-ai-r1 |
ai | 1.02 | 13.95B | 28.19B | 0.9267 |
268m-g084-human-r0.25 |
human | 0 | 17.62B | 17.62B | 0.9124 |
268m-g085-control |
control | 0 | 14.69B | 14.69B | 0.9154 |
268m-g085-ai-r0.05 |
ai | 0.0499 | 14.69B | 15.42B | 0.9154 |
268m-g085-ai-r0.1 |
ai | 0.1 | 14.69B | 16.16B | 0.9159 |
268m-g085-ai-r0.25 |
ai | 0.251 | 14.69B | 18.38B | 0.9177 |
268m-g085-ai-r0.5 |
ai | 0.505 | 14.69B | 22.12B | 0.9205 |
268m-g085-ai-r1 |
ai | 1.02 | 14.69B | 29.68B | 0.9264 |
268m-g085-human-r0.25 |
human | 0 | 18.38B | 18.38B | 0.9116 |
268m-g086-control |
control | 0 | 18.79B | 18.79B | 0.9115 |
268m-g086-ai-r0.05 |
ai | 0.05 | 18.79B | 19.73B | 0.9117 |
268m-g086-ai-r0.1 |
ai | 0.1 | 18.79B | 20.67B | 0.9121 |
268m-g086-ai-r0.25 |
ai | 0.251 | 18.77B | 23.49B | 0.9139 |
268m-g086-ai-r0.5 |
ai | 0.505 | 18.72B | 28.19B | 0.9172 |
268m-g086-ai-r1 |
ai | 1.02 | 18.60B | 37.58B | 0.9233 |
268m-g086-human-r0.25 |
human | 0 | 23.49B | 23.49B | 0.9084 |
268m-g087-control |
control | 0 | 19.59B | 19.59B | 0.9110 |
268m-g087-ai-r0.05 |
ai | 0.0499 | 19.59B | 20.57B | 0.9112 |
268m-g087-ai-r0.1 |
ai | 0.1 | 19.59B | 21.55B | 0.9119 |
268m-g087-ai-r0.25 |
ai | 0.251 | 19.59B | 24.51B | 0.9132 |
268m-g087-ai-r0.5 |
ai | 0.505 | 19.59B | 29.49B | 0.9167 |
268m-g087-ai-r1 |
ai | 1.02 | 19.59B | 39.58B | 0.9227 |
268m-g087-human-r0.25 |
human | 0 | 24.51B | 24.51B | 0.9083 |
268m-g088-control |
control | 0 | 23.49B | 23.49B | 0.9087 |
268m-g088-ai-r0.05 |
ai | 0.05 | 23.49B | 24.66B | 0.9086 |
268m-g088-ai-r0.1 |
ai | 0.1 | 23.49B | 25.84B | 0.9095 |
268m-g088-ai-r0.25 |
ai | 0.251 | 23.47B | 29.36B | 0.9111 |
268m-g088-ai-r0.5 |
ai | 0.505 | 23.40B | 35.23B | 0.9145 |
268m-g088-ai-r1 |
ai | 1.02 | 23.25B | 46.98B | 0.9210 |
268m-g088-human-r0.1 |
human | 0 | 25.84B | 25.84B | 0.9072 |
477M
| Model | Arm | r | Human tokens | Training tokens | C4 |
|---|---|---|---|---|---|
477m-g089-control |
control | 0 | 2.18B | 2.18B | 0.9509 |
477m-g089-ai-r0.0025 |
ai | 0.0025 | 2.18B | 2.18B | 0.9508 |
477m-g089-ai-r0.025 |
ai | 0.025 | 2.17B | 2.23B | 0.9502 |
477m-g089-ai-r0.05 |
ai | 0.05 | 2.18B | 2.28B | 0.9489 |
477m-g089-ai-r0.1 |
ai | 0.1 | 2.18B | 2.39B | 0.9480 |
477m-g089-ai-r0.25 |
ai | 0.25 | 2.18B | 2.72B | 0.9449 |
477m-g089-ai-r0.5 |
ai | 0.5 | 2.18B | 3.26B | 0.9423 |
477m-g089-ai-r1 |
ai | 1 | 2.18B | 4.35B | 0.9405 |
477m-g089-human-r0.0025 |
human | 0 | 2.18B | 2.18B | 0.9508 |
477m-g089-human-r0.025 |
human | 0 | 2.23B | 2.23B | 0.9495 |
477m-g089-human-r0.05 |
human | 0 | 2.28B | 2.28B | 0.9481 |
477m-g090-control |
control | 0 | 2.25B | 2.25B | 0.9486 |
477m-g090-ai-r0.0025 |
ai | 0.0025 | 2.25B | 2.26B | 0.9485 |
477m-g090-ai-r0.025 |
ai | 0.0251 | 2.25B | 2.31B | 0.9477 |
477m-g090-ai-r0.05 |
ai | 0.0502 | 2.25B | 2.36B | 0.9470 |
477m-g090-ai-r0.1 |
ai | 0.101 | 2.25B | 2.48B | 0.9461 |
477m-g090-ai-r0.25 |
ai | 0.252 | 2.25B | 2.82B | 0.9429 |
477m-g090-ai-r0.5 |
ai | 0.508 | 2.25B | 3.39B | 0.9407 |
477m-g090-ai-r1 |
ai | 1.02 | 2.25B | 4.56B | 0.9387 |
477m-g090-human-r0.0025 |
human | 0 | 2.26B | 2.26B | 0.9483 |
477m-g090-human-r0.025 |
human | 0 | 2.31B | 2.31B | 0.9480 |
477m-g090-human-r0.05 |
human | 0 | 2.36B | 2.36B | 0.9469 |
477m-g091-control |
control | 0 | 8.70B | 8.70B | 0.8973 |
477m-g091-ai-r0.0025 |
ai | 0.0025 | 8.70B | 8.72B | 0.8971 |
477m-g091-ai-r0.025 |
ai | 0.025 | 8.70B | 8.92B | 0.8971 |
477m-g091-ai-r0.05 |
ai | 0.05 | 8.70B | 9.14B | 0.8967 |
477m-g091-ai-r0.1 |
ai | 0.1 | 8.70B | 9.57B | 0.8967 |
477m-g091-ai-r0.25 |
ai | 0.25 | 8.70B | 10.88B | 0.8969 |
477m-g091-ai-r0.5 |
ai | 0.5 | 8.70B | 13.05B | 0.8984 |
477m-g091-ai-r1 |
ai | 1 | 8.70B | 17.41B | 0.9017 |
477m-g091-human-r0.0025 |
human | 0 | 8.72B | 8.72B | 0.8973 |
477m-g091-human-r0.025 |
human | 0 | 8.92B | 8.92B | 0.8968 |
477m-g091-human-r0.05 |
human | 0 | 9.14B | 9.14B | 0.8959 |
477m-g092-control |
control | 0 | 9.01B | 9.01B | 0.8965 |
477m-g092-ai-r0.0025 |
ai | 0.0025 | 9.01B | 9.03B | 0.8964 |
477m-g092-ai-r0.025 |
ai | 0.025 | 9.01B | 9.23B | 0.8961 |
477m-g092-ai-r0.05 |
ai | 0.0499 | 9.01B | 9.46B | 0.8958 |
477m-g092-ai-r0.1 |
ai | 0.1 | 9.01B | 9.91B | 0.8959 |
477m-g092-ai-r0.25 |
ai | 0.251 | 9.01B | 11.27B | 0.8960 |
477m-g092-ai-r0.5 |
ai | 0.506 | 9.01B | 13.56B | 0.8973 |
477m-g092-ai-r1 |
ai | 1.02 | 9.01B | 18.20B | 0.9004 |
477m-g092-human-r0.0025 |
human | 0 | 9.03B | 9.03B | 0.8965 |
477m-g092-human-r0.025 |
human | 0 | 9.23B | 9.23B | 0.8956 |
477m-g092-human-r0.05 |
human | 0 | 9.46B | 9.46B | 0.8952 |
477m-g093-control |
control | 0 | 17.41B | 17.41B | 0.8817 |
477m-g093-ai-r0.05 |
ai | 0.05 | 17.41B | 18.28B | 0.8817 |
477m-g093-ai-r0.25 |
ai | 0.25 | 17.41B | 21.76B | 0.8830 |
477m-g093-ai-r1 |
ai | 1 | 17.41B | 34.81B | 0.8899 |
477m-g094-control |
control | 0 | 18.01B | 18.01B | 0.8811 |
477m-g094-ai-r0.05 |
ai | 0.05 | 18.01B | 18.91B | 0.8808 |
477m-g094-ai-r0.1 |
ai | 0.1 | 18.01B | 19.82B | 0.8814 |
477m-g094-ai-r0.25 |
ai | 0.251 | 18.01B | 22.54B | 0.8820 |
477m-g094-ai-r0.5 |
ai | 0.505 | 18.01B | 27.12B | 0.8854 |
477m-g094-ai-r1 |
ai | 1.02 | 18.01B | 36.40B | 0.8894 |
477m-g095-control |
control | 0 | 26.11B | 26.11B | 0.8750 |
477m-g095-ai-r0.25 |
ai | 0.25 | 26.11B | 32.64B | 0.8764 |
477m-g095-ai-r0.5 |
ai | 0.5 | 26.11B | 39.16B | 0.8800 |
477m-g095-ai-r1 |
ai | 1 | 26.11B | 52.22B | 0.8848 |
477m-g096-control |
control | 0 | 34.81B | 34.81B | 0.8705 |
477m-g096-ai-r0.05 |
ai | 0.05 | 34.81B | 36.55B | 0.8707 |
477m-g096-ai-r0.25 |
ai | 0.25 | 34.81B | 43.52B | 0.8725 |
477m-g096-ai-r0.5 |
ai | 0.5 | 34.81B | 52.22B | 0.8755 |
973M
| Model | Arm | r | Human tokens | Training tokens | C4 |
|---|---|---|---|---|---|
973m-g097-control |
control | 0 | 4.59B | 4.59B | 0.8949 |
973m-g098-control |
control | 0 | 18.37B | 18.37B | 0.8510 |
973m-g098-ai-r0.05 |
ai | 0.05 | 18.37B | 19.29B | 0.8508 |
973m-g098-ai-r0.1 |
ai | 0.1 | 18.37B | 20.21B | 0.8505 |
973m-g098-ai-r0.25 |
ai | 0.25 | 18.37B | 22.96B | 0.8510 |
973m-g098-ai-r0.5 |
ai | 0.5 | 18.37B | 27.55B | 0.8527 |
973m-g098-ai-r1 |
ai | 1 | 18.37B | 36.74B | 0.8553 |
973m-g099-control |
control | 0 | 36.74B | 36.74B | 0.8377 |
973m-g099-ai-r0.05 |
ai | 0.05 | 36.74B | 38.57B | 0.8377 |
973m-g099-ai-r0.1 |
ai | 0.1 | 36.74B | 40.41B | 0.8378 |
973m-g099-ai-r0.25 |
ai | 0.25 | 36.74B | 45.92B | 0.8385 |
973m-g099-ai-r0.5 |
ai | 0.5 | 36.74B | 55.10B | 0.8409 |
973m-f17-ai-removed |
filtered | 0 | 3.57B | 3.57B | 0.9064 |
973m-f17-web-mix |
natural | 0.287 | 3.57B | 4.59B | 0.9010 |
973m-f18-ai-removed |
filtered | 0 | 14.27B | 14.27B | 0.8576 |
973m-f18-web-mix |
natural | 0.287 | 14.27B | 18.37B | 0.8566 |
973m-f19-ai-removed |
filtered | 0 | 28.54B | 28.54B | 0.8420 |
973m-f19-web-mix |
natural | 0.287 | 28.54B | 36.74B | 0.8432 |
License
License: CC BY-NC-SA 4.0. The WildAI code, models and dataset are released under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license: you may use and adapt them for non-commercial purposes, with attribution, and must share adaptations under the same license. The full text is in LICENSE.
Citation
@article{russell2026wildai,
title = {How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text},
author = {Russell, Jenna and Glickenhaus, Ben and Thai, Katherine and Wieting, John and Iyyer, Mohit and Spero, Max and Emi, Bradley},
journal = {arXiv preprint arXiv:2609.40295},
year = {2026},
url = {https://arxiv.org/abs/2609.40295}
}