Instructions to use vladmandic/MicroDecoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use vladmandic/MicroDecoder with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("vladmandic/MicroDecoder", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,20 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
pipeline_tag: text-to-image
|
| 4 |
+
library_name: diffusers
|
| 5 |
---
|
| 6 |
+
|
| 7 |
+
# MicroDecoder
|
| 8 |
+
|
| 9 |
+
**Micro-VAE** that can be trained on *any* diffusion model in ~15min and provides low-quality reconstruction from latents in ~0.01sec.
|
| 10 |
+
Inference includes noise correction based on current timestep, intention blurring and upscale interpolation: all with intention of providing as fast-as-possible reconstruction that is viable on any noise level.
|
| 11 |
+
Intended use-case is live-preview during generative model inference.
|
| 12 |
+
|
| 13 |
+
- Training code [here](https://github.com/vladmandic/sdnext/blob/dev/modules/vae/sd_vae_micro_train.py)
|
| 14 |
+
- Example inference code [here](https://github.com/vladmandic/sdnext/blob/dev/modules/vae/sd_vae_micro.py)
|
| 15 |
+
|
| 16 |
+
Training examples:
|
| 17 |
+
```shell
|
| 18 |
+
sd_vae_micro_train.py --dim 256 --epochs 350 --resolution 512 --scale 8 --lr 0.0003 --folder ~/generative/Input/vae/ --vae AutoencoderKLQwenImage21 --repo Qwen/Qwen-Image-2.1 --output AutoencoderKLQwenImage21.safetensors
|
| 19 |
+
sd_vae_micro_train.py --dim 256 --epochs 350 --resolution 512 --scale 4 --lr 0.0003 --folder ~/generative/Input/vae/ --vae AutoencoderKLFlux2 --repo black-forest-labs/FLUX.2-klein-9B --output AutoencoderKLFlux2.safetensors
|
| 20 |
+
```
|