Regular-context pretraining releases: documents plus aligned Dolma-2 tokens and masks, one repo per source mix. Token counts on each card.
AI & ML interests
None defined yet.
Recent Activity
View all activity
Long-context (16K packing) pretraining releases, same two-parquet contract as the regular mixes. Token counts on each card.
-
placeholderlabs/pretrain-repository-v2-mix-long-context
Viewer • Updated • 5.16M • 1.38k -
placeholderlabs/pretrain-academic-mix-long-context
Viewer • Updated • 2M • 227 -
placeholderlabs/pretrain-commits-v2-mix-long-context
Viewer • Updated • 1.93M • 1.12k -
placeholderlabs/pretrain-nemotron-math-mix-long-context
Viewer • Updated • 84.8k • 219
Regular-context pretraining releases: documents plus aligned Dolma-2 tokens and masks, one repo per source mix. Token counts on each card.
Long-context (16K packing) pretraining releases, same two-parquet contract as the regular mixes. Token counts on each card.
-
placeholderlabs/pretrain-repository-v2-mix-long-context
Viewer • Updated • 5.16M • 1.38k -
placeholderlabs/pretrain-academic-mix-long-context
Viewer • Updated • 2M • 227 -
placeholderlabs/pretrain-commits-v2-mix-long-context
Viewer • Updated • 1.93M • 1.12k -
placeholderlabs/pretrain-nemotron-math-mix-long-context
Viewer • Updated • 84.8k • 219
datasets 37
placeholderlabs/pretrain-commits-v2-mix-long-context
Viewer • Updated • 1.93M • 1.12k
placeholderlabs/pretrain-commits-v2-mix
Viewer • Updated • 61.2M • 1.88k
placeholderlabs/pretrain-ultra-fineweb-mix
Viewer • Updated • 92.9M • 647 • 1
placeholderlabs/pretrain-ultra-fineweb-mix-long-context
Viewer • Updated • 96.2k • 77 • 1
placeholderlabs/pretrain-repository-v2-mix
Viewer • Updated • 48.1M • 1.44k
placeholderlabs/pretrain-repository-v2-mix-long-context
Viewer • Updated • 5.16M • 1.38k
placeholderlabs/pretrain-reasoning-traces-mix
Viewer • Updated • 3.18M • 1.26k
placeholderlabs/pretrain-reasoning-traces-mix-long-context
Viewer • Updated • 1.78k • 143
placeholderlabs/pretrain-nemotron-math-mix
Viewer • Updated • 42.8M • 2.04k
placeholderlabs/pretrain-nemotron-math-mix-long-context
Viewer • Updated • 84.8k • 219