Instructions to use Akaneqwq/DualDiff with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Akaneqwq/DualDiff with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Akaneqwq/DualDiff", dtype=torch.bfloat16, device_map="cuda") prompt = "Turn this cat into a dog" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0] - Notebooks
- Google Colab
- Kaggle
File size: 1,672 Bytes
777f600 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 | ---
license: other
library_name: diffusers
pipeline_tag: image-to-image
base_model: stabilityai/sd-turbo
tags:
- image-restoration
- novel-view-synthesis
- 3d-gaussian-splatting
- dualdiff3d
---
# DualDiff
Official DualDiff repair checkpoint for
[DualDiff3D](https://github.com/Akaneqwq/DualDiff3D).
DualDiff repairs a degraded novel-view rendering using its structure together
with the appearance of a nearby reference image.
## Usage
The DualDiff3D code downloads this checkpoint automatically:
```bash
python -m DualDiff.hub
```
Run image-pair inference:
```bash
python DualDiff/infer.py \
--input_image /path/to/degraded_render.png \
--ref_image /path/to/reference.png \
--output_dir outputs/repair
```
The checkpoint contains the complete structure and appearance U-Net state
dictionaries plus the trained VAE LoRA and skip-connection parameters. It does
not contain optimizer state. The SD-Turbo VAE, text encoder, tokenizer,
scheduler, and base configuration are loaded separately by the code.
## Citation
```bibtex
@inproceedings{wang2026dualdiff3d,
title = {DualDiff3D: Dual Structure-Appearance Diffusion
Priors for Reliability-Enhanced 3D Gaussian Splatting},
author = {Qian Wang and Yu Wang and Weiqi Li and Xinhua Cheng
and Xiandong Meng and Ronggang Wang and Jian Zhang},
booktitle = {European Conference on Computer Vision (ECCV)},
year = {2026}
}
```
## License
The DualDiff code is released under Apache-2.0. This checkpoint is derived from
[SD-Turbo](https://huggingface.co/stabilityai/sd-turbo); use of the checkpoint
is also subject to the applicable SD-Turbo model license.
|