You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

ReDiverse: Restoring Diversity in Distilled Image and Video Generators by Probing Activations

Furkan Horoz1, Ozgur Kara1, Kaan Oktay2, Adil Kaan Akan2, Atakan Kara2, Anand Bhattad3,†, James Matthew Rehg1,†
1University of Illinois at Urbana-Champaign    2fal    3Johns Hopkins University
†Equal advising.

Project page arXiv 2611.18550 Code on GitHub All ReDiverse models

ReDiverse-FT adapter for SD3. Few-step distilled students keep their teacher's activation variance across seeds but concentrate it into far fewer directions at one block of the first denoising step, so different seeds give near-identical samples. This rank-32 LoRA on the student's blocks up to transformer_blocks.12 is trained to match the teacher's activations there and is active in the first sampling step only; the remaining steps run the unmodified student.

Teacher 4-step student This adapter
SD3-Medium TDM, distilled from the teacher ReDiverse-FT LoRA of the student, rediverse_ft.safetensors (89 MB)

SD3, a photo of a backpack: six seed-matched samples of the student and of ReDiverse

Usage

git clone https://github.com/H-furkan/rediverse && cd rediverse   # set up the environments of envs/README.md
hf download ReDiverse/ReDiverse-SD3 --local-dir ReDiverse-SD3
python -m sd3.generate --arm rediverse --adapter ReDiverse-SD3 --prompt "a photo of a fox in the snow" --num-samples 4   # train env

--arm rediverse_ft uses the adapter alone; --arm rediverse (above) also adds the training-free ReDiverse-TF directions, which first runs the teacher on 25 noises for each new prompt (about 15 s on an 80 GB H100) and caches the result. SD3-Medium is gated on the Hub: accept its license and run hf auth login first. Without --adapter, the code downloads the same file from ReDiverse/ReDiverse.

DINO diversity ↑ (GenEval) Student ReDiverse-FT (this adapter) ReDiverse (FT + TF) Teacher (multi-step)
SD3 48.4 53.5 60.1 61.6

License

A Derivative Work of Stable Diffusion 3 Medium under the Stability AI Community License; NOTICE holds the attribution notice. Powered by Stability AI.

Citation

@article{horoz2026rediverse,
  title   = {Restoring Diversity in Distilled Image and Video Generators by Probing Activations},
  author  = {Horoz, Furkan and Kara, Ozgur and Oktay, Kaan and Akan, Adil Kaan and Kara, Atakan
             and Bhattad, Anand and Rehg, James Matthew},
  journal = {arXiv preprint arXiv:2611.18550},
  year    = {2026}
}
Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for ReDiverse/ReDiverse-SD3

Adapter
(1)
this model

Collection including ReDiverse/ReDiverse-SD3

Paper for ReDiverse/ReDiverse-SD3