Papers
arxiv:2611.17320

Learning When Diffusion Language Models Should Regenerate

Published on Nov 12
Authors:
,
,
,
,
,
,

Abstract

DiVR, a verifier trained on the correctness of a diffusion language model's own trajectories, improves reasoning accuracy by deciding when to regenerate a block and which alternative to keep without altering the generator.

Remasking allows diffusion language models to revisit generated text, but effective correction requires knowing when and what to revise. Our diagnosis on Sudoku reveals two gaps. Hidden states contain error information that token confidence does not reliably expose, and remasking an isolated error usually reproduces it when the surrounding context remains fixed. These findings motivate DiVR , a verifier that predicts whether a partially generated sequence will reach a correct answer. Trained on the final correctness of the model's own trajectories, DiVR decides when to regenerate a block and which alternative to retain, while the generator itself stays unchanged. On five reasoning benchmarks with LLaDA-8B-Base, DiVR raises the average accuracy of the fine-tuned generator from 35.3\% to 43.4\% at 1.9-3.5times the cost of greedy decoding, above search baselines that use 3.8-7.4times. It also complements post-training such as supervised fine-tuning and reinforcement learning, and generalizes to other generators, including Dream.

Community

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2611.17320
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.17320 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.17320 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.17320 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.