Instructions to use PeterKocsis/IntrinsiX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use PeterKocsis/IntrinsiX with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("PeterKocsis/IntrinsiX") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
IntrinsiX: High-Quality PBR Generation using Image Priors
Recent generative models directly create shaded images, without any explicit material and shading representation. From text input, we generate renderable PBR maps. We first train separate LoRA modules for the intrinsic properties of albedo, rough/metal, normal. Then, we introduce cross-intrinsic attention using a rerendering loss with importance-weighted light sampling to enable coherent PBR generation. Next to editable image generation, our predictions can be distilled into room-scale scenes using SDS for large-scale PBR texture generation.
https://peter-kocsis.github.io/IntrinsiX/
Citation
If you find our code or paper useful, please cite as
@article
{kocsis2025intrinsix,
author = {Kocsis, Peter and H\"{o}llein, Lukas and Nie\{ss}ner, Matthias},
title = {IntrinsiX: High-Quality PBR Generation using Image Priors},
journal = {Advances in Neural Information Processing Systems (NeurIPS)},
year = {2025},
}
- Downloads last month
- 7
Model tree for PeterKocsis/IntrinsiX
Base model
black-forest-labs/FLUX.1-dev