Instructions to use 294-288-pretrain-interaction/31M-random-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use 294-288-pretrain-interaction/31M-random-v2 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("294-288-pretrain-interaction/31M-random-v2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
31M Random β uniform WSD v2
Controlled trigger-injection pretraining with the shared M/C/G stream. Models are trained from scratch; see the configuration and supervision guide.
Planned conditions: MCG/M/C/G Γ 32/16/8/4/2/1 injections per billion tokens, with stable checkpoints and independent 763-update cooldowns. Full states retain weights, AdamW, scheduler, RNG and injection counters. There are no new constant-LR control branches. Checkpoint publication is incremental; repository existence does not imply completion.
uniform-wsd-v2/31m/<run>/eval512/ contains paired JSON and per-token NPZ scores for the frozen
1,536-example Random512 teacher-forced evaluation, without generation. Clean weights are reused from
294-288-pretrain-interaction/31M-fixed-v2 only after identity/parent checks. Imported baseline summaries identify the exact
source revision and checkpoint hash. Shared-GPU pacing is recorded in checkpoint execution metadata.
analysis/results.json and analysis/primary.csv are periodically updated with raw and available matched-Clean
results. Missing Clean matches remain null. Different execution layouts are reported explicitly.