LoopFill experiments: loopahead for ouro-2.6b
This repository contains the selected trained drafter used by the LoopFill
baseline experiments. It requires ByteDance/Ouro-2.6B
at revision 1ed04250da1a9936042725d302e81c8fa2ab5abd. Target weights and tokenizer are downloaded
separately from their original repository.
| Property | Value |
|---|---|
| Method | loopahead |
| Selected checkpoint step | 13000 |
| Trainable parameters | 11051008 |
| Training epochs / final updates | 3 / 13539 |
| Weight file | lad.pt |
| SHA256 | c445ce786366dace9097d0969b90e195dd920bfcc3f90babec9ba900063a5630 |
Download and use
from huggingface_hub import snapshot_download
checkpoint = snapshot_download("zsqzz/loopfill-loopahead-ouro-2.6b")
Use the custom implementation in zhusq20/loop_suffix
and follow its standalone inference guide.
Pass the downloaded directory as --checkpoint to python run_baseline.py infer
with --method loopahead and --model ouro-2.6b. A local matching target model and
JSONL prompts are also required. This artifact is not an independent chat model
or a generic AutoModelForCausalLM checkpoint.
The byte-identical weights, training metadata, selection evidence and source hashes are preserved in this repository. The GitHub experiment archive documents the benchmark inputs, backend, AR denominator, timing boundaries and limitations. LoopAhead is our paper-based implementation, not official author code/weights. DFlash includes our recurrent-target adaptations. Single-seed timing results do not establish cross-seed stability or task-quality equivalence.
Optimizer/RNG states and intermediate training checkpoints are not included. The original target and third-party implementation terms remain applicable; the repository records upstream code license notices where relevant.