LoopFill experiments: loopahead for ouro-1.4b

This repository contains the selected trained drafter used by the LoopFill baseline experiments. It requires ByteDance/Ouro-1.4B at revision 574fa66cb8bf5abdc979642d01cf2b79b16bfab1. Target weights and tokenizer are downloaded separately from their original repository.

Property Value
Method loopahead
Selected checkpoint step 13533
Trainable parameters 11051008
Training epochs / final updates 3 / 13533
Weight file lad.pt
SHA256 d219fda331aeaad2d59ffd41576a56b7d5f2758a8bbd1899d9fcf1ec4692e311

Download and use

from huggingface_hub import snapshot_download
checkpoint = snapshot_download("zsqzz/loopfill-loopahead-ouro-1.4b")

Use the custom implementation in zhusq20/loop_suffix and follow its standalone inference guide. Pass the downloaded directory as --checkpoint to python run_baseline.py infer with --method loopahead and --model ouro-1.4b. A local matching target model and JSONL prompts are also required. This artifact is not an independent chat model or a generic AutoModelForCausalLM checkpoint.

The byte-identical weights, training metadata, selection evidence and source hashes are preserved in this repository. The GitHub experiment archive documents the benchmark inputs, backend, AR denominator, timing boundaries and limitations. LoopAhead is our paper-based implementation, not official author code/weights. DFlash includes our recurrent-target adaptations. Single-seed timing results do not establish cross-seed stability or task-quality equivalence.

Optimizer/RNG states and intermediate training checkpoints are not included. The original target and third-party implementation terms remain applicable; the repository records upstream code license notices where relevant.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support