File size: 6,543 Bytes
c9e399b
 
2c248b5
 
 
 
 
 
 
 
 
 
 
bea85f6
c9e399b
2c248b5
d6f1591
 
6ceba92
340412f
 
20ac733
6ceba92
340412f
 
 
bea85f6
340412f
 
 
20ac733
340412f
e638656
340412f
e638656
 
 
340412f
 
 
 
2c248b5
2d7cab3
2c248b5
 
 
 
 
2d7cab3
2c248b5
 
 
 
 
2d7cab3
 
7b9f168
2c248b5
7b9f168
2c248b5
 
 
 
7b9f168
 
bea85f6
2c248b5
7b9f168
2c248b5
 
2d7cab3
2c248b5
 
2d7cab3
2c248b5
340412f
2c248b5
2d7cab3
2c248b5
 
 
340412f
2c248b5
2d7cab3
2c248b5
 
 
2d7cab3
2c248b5
340412f
2c248b5
 
 
bea85f6
 
 
 
 
 
 
 
 
2c248b5
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
---
license: apache-2.0
language:
  - en
pipeline_tag: text-to-video
base_model:
  - Wan-AI/Wan2.1-T2V-1.3B
  - gdhe17/Self-Forcing
tags:
  - video-generation
  - autoregressive
  - diffusion
  - adversarial-gradient-forcing
  - arxiv:2610.14553
---

<h1 align="center" style="font-family: Georgia, 'Times New Roman', serif; font-size: 2.15em; font-weight: 500; line-height: 1.2; margin: 12px 0 8px;">Adversarial <span style="color: #658bc9;">Gradient Forcing</span></h1>
<p align="center" style="font-size: 1.02em; line-height: 1.5; margin: 0 0 14px; opacity: 0.85;">Robust Few-Step Autoregressive Video Generation</p>
<p align="center" style="margin: 8px 0 14px;">
  <sub>Zhejiang University &nbsp;·&nbsp; Alibaba Group &nbsp;·&nbsp; Nanjing University</sub>
</p>
<div align="center" style="display: flex; flex-wrap: wrap; justify-content: center; align-items: center; gap: 8px; margin: 12px 0 22px;"> <a href="https://github.com/wuli-art/Adversarial-Gradient-Forcing"><img src="assets/github.svg" height="44" style="display: inline-block; vertical-align: middle; margin: 4px 3px;" alt="GitHub code"></a> <a href="https://wuli-art.github.io/Adversarial-Gradient-Forcing/"><img src="assets/project.svg" height="44" style="display: inline-block; vertical-align: middle; margin: 4px 3px;" alt="Project page"></a> <a href="https://arxiv.org/abs/2610.14553"><img src="assets/arxiv.svg" height="44" style="display: inline-block; vertical-align: middle; margin: 4px 3px;" alt="arXiv: 2610.14553"></a>
</div>

**AGF** improves long-video generation by training models to withstand **adversarial perturbations in their generated history**. Trained on five-second rollouts, it supports generation up to four minutes with the same four-step sampler.

<p align="center"> <a href="https://wuli-art.github.io/Adversarial-Gradient-Forcing/#gallery"><img src="https://raw.githubusercontent.com/wuli-art/Adversarial-Gradient-Forcing/main/project-page/assets/showcase/agf-scenes.gif" width="960" alt="Selected AGF video excerpts: pirate ships, a robot, felt creatures, a creature by candlelight, a watercolor dance, and a yawning child."></a>
  <br>
  <sub>Generated with AGF · Selected video excerpts</sub>
</p>
<p align="center"><a href="https://wuli-art.github.io/Adversarial-Gradient-Forcing/#gallery">Full videos and comparisons ↗</a></p>

<table style="display: table; width: 100%; table-layout: fixed;">
  <tr>
    <td align="center" width="33%" style="text-align: center; padding: 12px 8px;"><strong>1.3B</strong><br><sub>Wan2.1 backbone</sub></td>
    <td align="center" width="33%" style="text-align: center; padding: 12px 8px;"><strong>4 steps</strong><br><sub>Denoising per block</sub></td>
    <td align="center" width="33%" style="text-align: center; padding: 12px 8px;"><strong>Up to 4 min</strong><br><sub>Video generation</sub></td>
  </tr>
</table>

## 🧩 Model details

AGF selects adversarial history perturbations using distribution-matching gradients from later video blocks, then trains jointly on clean and perturbed histories. A first-step prediction consistency regularizer helps preserve scene structure during the initial training stage.

| Property | Paper checkpoint |
| --- | --- |
| Architecture | Wan2.1 1.3B autoregressive video generator |
| Initialization | Self-Forcing ODE initialization |
| Training | 200 regularized AGF + 200 pure AGF outer iterations |
| Selected weights | Global step 400, `generator_ema` |
| Training rollouts | 5 seconds; effective batch size 64 |
| Training prompts | Filtered, LLM-extended VidProM prompts used by Self-Forcing |
| Inference | 832 × 480, 16 fps, four denoising steps per block |

Iterations count outer training loops; the full schedule contains **80 generator updates**.

## 🚀 Download and inference

The paper checkpoint is available as [`model.pt`](model.pt) (17.03 GB). Download it with the Hugging Face CLI:

```bash
hf download Wuli-art/Adversarial-Gradient-Forcing model.pt \
  --local-dir checkpoints/AGF
```

Follow the [installation and inference guide](https://github.com/wuli-art/Adversarial-Gradient-Forcing/blob/main/docs/inference.md) for the Python/CUDA environment and Wan 1.3B assets. Place the downloaded checkpoint at `checkpoints/AGF/model.pt` and run from the code repository root:

```bash
AGF_RUN_ID=preview bash scripts/infer.sh \
  --checkpoint checkpoints/AGF/model.pt \
  --prompts prompts/examples.txt --latent-frames 21 --gpus 0
```

The script selects **`generator_ema` by default**, matching the paper. Use `--latent-frames 21`, `240`, or `960` for approximately **5 seconds**, **1 minute**, or **4 minutes**. The default policy uses 12 latent frames of local attention, including 3 persistent sink frames, with relative sink positions enabled. See the [training guide](https://github.com/wuli-art/Adversarial-Gradient-Forcing/blob/main/docs/training.md) for the full training and checkpoint-resumption workflow.

## 📊 Results

Paper results under the shared evaluation protocol (higher is better). The 5-second and 60-second evaluations use 944 and 240 VBench prompts, respectively; the 240-second evaluation uses 120 MovieGenVideoBench extended prompts.

| Model | 5 s · VBench Total | 60 s · VBench Total | 240 s · Quality 5 |
| --- | ---: | ---: | ---: |
| **AGF** | **82.03** | **81.47** | **84.82** |

Quality 5 (Q5) is the arithmetic mean of subject consistency, background consistency, motion smoothness, aesthetic quality, and imaging quality. It excludes dynamic degree and is not an official VBench Total score. See the [evaluation protocol](https://github.com/wuli-art/Adversarial-Gradient-Forcing/blob/main/docs/evaluation.md) for metric definitions and reproducibility details.

## Intended use and limitations

AGF is intended for text-to-video generation and research on autoregressive video models. Long sequences may exhibit visual artifacts, motion inconsistencies, or prompt drift.

## 📝 Citation

```bibtex
@misc{xia2026adversarial,
  title         = {Adversarial Gradient Forcing for Robust Few-Step Autoregressive Video Generation},
  author        = {Chenxi Xia and Yixuan Xu and Shan Liu and Jiapeng Wang
                   and Maohua Li and Hanlin Tang and Kan Liu and Tao Lan
                   and Weiyi Lu and Xinggao Liu},
  year          = {2026},
  eprint        = {2610.14553},
  archivePrefix = {arXiv},
  primaryClass  = {cs.CV},
  url           = {https://arxiv.org/abs/2610.14553}
}
```

License: Apache 2.0. Third-party models, datasets, and other assets retain their respective licenses.