Delcher commited on
Commit
1beca34
·
verified ·
1 Parent(s): b9b2149

Model card

Browse files
Files changed (1) hide show
  1. README.md +92 -0
README.md ADDED
@@ -0,0 +1,92 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: stabilityai-ai-community
4
+ license_link: https://huggingface.co/stabilityai/stable-diffusion-3.5-medium/blob/main/LICENSE.md
5
+ base_model: stabilityai/stable-diffusion-3.5-medium
6
+ pipeline_tag: text-to-image
7
+ library_name: diffusers
8
+ tags:
9
+ - lora
10
+ - reinforcement-learning
11
+ - few-step
12
+ - flow-map
13
+ - fewsteprl
14
+ ---
15
+
16
+ # FewStepRL — SD3.5-Medium checkpoints
17
+
18
+ Released checkpoints of **FewStepRL: Fine-tuning Few-step Diffusion Models with Reinforcement Learning**
19
+ (image experiments, 4-step SD3.5-Medium flow map).
20
+
21
+ [Paper (arXiv:2611.08240)](https://arxiv.org/abs/2611.08240) ·
22
+ [Code](https://github.com/EDAPINENUT/fewsteprl-sd35) ·
23
+ [Project page](https://edapinenut.github.io/fewsteprl.page/) ·
24
+ [Video checkpoints (Wan2.1)](https://huggingface.co/Delcher/fewsteprl-wan21)
25
+
26
+ ## Contents
27
+
28
+ ```
29
+ <trial>/
30
+ config.yaml # the config the run saved
31
+ checkpoint-<step>/generator_ema.pt # EMA generator: Stage-3 LoRA + delta_embedder
32
+ aux_vel/{mix,ocr}/
33
+ config.yaml
34
+ aux_v_transformer/ # auxiliary v-predictor (diffusers SD3Transformer2DModel)
35
+ SHA256SUMS
36
+ ```
37
+
38
+ | trial | trainer | reward | step |
39
+ |---|---|---|---|
40
+ | meanflownft_mix | `meanflow_nft` | mixed | 400 |
41
+ | dmdnft_mix | `dmdnft_rl` | mixed | 400 |
42
+ | dmdawm_mix | `dmdawm_rl` | mixed | 400 |
43
+ | fewstepgrpo_mix | `meanflowgrpo_rl` | mixed | 300 |
44
+ | meanflowawm_mix | `meanflowawm_rl` | mixed | 400 |
45
+ | meanflowopsd_mix | `meanflowopsd_rl` | mixed | 400 |
46
+ | reflmx_mix | `meanflowrefl_rl` | mixed | 400 |
47
+ | flowgrpo_mix / awm_mix / nft_mix | original objectives (baselines) | mixed | 400 |
48
+ | meanflownft_ocr | `meanflow_nft` | OCR | 200 |
49
+ | dmdnft_ocr | `dmdnft_rl` | OCR | 200 |
50
+ | dmdawm_ocr | `dmdawm_rl` | OCR | 400 |
51
+ | fewstepgrpo_ocr | `meanflowgrpo_rl` | OCR | 200 |
52
+ | meanflowawm_ocr | `meanflowawm_rl` | OCR | 400 |
53
+
54
+ Scores and per-checkpoint notes:
55
+ [checkpoints/README.md](https://github.com/EDAPINENUT/fewsteprl-sd35/blob/main/checkpoints/README.md).
56
+
57
+ ## Usage
58
+
59
+ Download the weights into the `checkpoints/` directory of the code repository:
60
+
61
+ ```bash
62
+ git clone https://github.com/EDAPINENUT/fewsteprl-sd35 && cd fewsteprl-sd35
63
+ bash download_scripts/download_assets.sh # SD3.5-Medium, AnyFlow Stage-1/2 LoRAs, reward models
64
+ hf download Delcher/fewsteprl-sd35 --local-dir checkpoints --include "*.pt" "*.safetensors"
65
+ cd checkpoints && shasum -a 256 -c SHA256SUMS && cd ..
66
+ ```
67
+
68
+ `generator_ema.pt` is applied **on top of** SD3.5-Medium + the AnyFlow Stage-1 and Stage-2 LoRAs, never alone:
69
+
70
+ ```bash
71
+ bash scripts/eval/sample.sh meanflownft_mix # 4-step sampling with a released checkpoint
72
+ bash scripts/eval/eval_ckpt.sh meanflownft_mix 8 # sample + score
73
+ ```
74
+
75
+ The `aux_vel/{mix,ocr}` v-predictors are only needed to train the `dmd*` trials.
76
+
77
+ ## License
78
+
79
+ The weights are derivatives of SD3.5-Medium and are subject to the
80
+ [Stability AI Community License](https://huggingface.co/stabilityai/stable-diffusion-3.5-medium/blob/main/LICENSE.md).
81
+
82
+ ## Citation
83
+
84
+ ```bibtex
85
+ @article{lin2026fewsteprl,
86
+ title = {FewStepRL: Fine-tuning Few-step Diffusion Models with Reinforcement Learning},
87
+ author = {Lin, Haitao and Ren, Minsi and Li, Yang and Ge, Xingtong and
88
+ Hu, Zheyuan and Hu, Peiyan and Wu, Tailin},
89
+ journal = {arXiv preprint arXiv:2611.08240},
90
+ year = {2026}
91
+ }
92
+ ```