LoopFill experiments: dflash for ouro-1.4b

This repository contains the selected trained drafter used by the LoopFill baseline experiments. It requires ByteDance/Ouro-1.4B at revision 574fa66cb8bf5abdc979642d01cf2b79b16bfab1. Target weights and tokenizer are downloaded separately from their original repository.

Property Value
Method dflash
Selected checkpoint step 9108
Trainable parameters 163597568
Training epochs / final updates 6 / 9108
Weight file model.safetensors
SHA256 d25b56c5c1f43e35d1c4ced2f32eb9bb102cb3f34e5f0b03a378a8cf2bd48742

Download and use

from huggingface_hub import snapshot_download
checkpoint = snapshot_download("zsqzz/loopfill-dflash-ouro-1.4b")

Use the custom implementation in zhusq20/loop_suffix and follow its standalone inference guide. Pass the downloaded directory as --checkpoint to python run_baseline.py infer with --method dflash and --model ouro-1.4b. A local matching target model and JSONL prompts are also required. This artifact is not an independent chat model or a generic AutoModelForCausalLM checkpoint.

The byte-identical weights, training metadata, selection evidence and source hashes are preserved in this repository. The GitHub experiment archive documents the benchmark inputs, backend, AR denominator, timing boundaries and limitations. LoopAhead is our paper-based implementation, not official author code/weights. DFlash includes our recurrent-target adaptations. Single-seed timing results do not establish cross-seed stability or task-quality equivalence.

Optimizer/RNG states and intermediate training checkpoints are not included. The original target and third-party implementation terms remain applicable; the repository records upstream code license notices where relevant.

Downloads last month
25
Safetensors
Model size
0.2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support