Instructions to use Felldude/MiniMaxImage_hdr_diffusers_vae with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Felldude/MiniMaxImage_hdr_diffusers_vae with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Felldude/MiniMaxImage_hdr_diffusers_vae", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,109 @@
|
|
| 1 |
---
|
| 2 |
-
license: openrail
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: bigscience-openrail-m
|
| 3 |
+
base_model:
|
| 4 |
+
- MiniMaxAI/MiniMax-H3-Image
|
| 5 |
---
|
| 6 |
+
|
| 7 |
+
**NOTE Encoder was Frozen Using this VAE for Training should not effect outcome**
|
| 8 |
+
|
| 9 |
+
## Overview
|
| 10 |
+
|
| 11 |
+
This repository contains evaluation results for a **MiniMax Image HDR VAE (High Dynamic Range Variational Autoencoder)** designed for MiniMax-H3 image reconstruction and enhancement workflows.
|
| 12 |
+
|
| 13 |
+
The HDR VAE is evaluated against the **BASE MiniMax Image VAE** using a multi-domain reconstruction analysis covering:
|
| 14 |
+
|
| 15 |
+
* perceptual similarity
|
| 16 |
+
* structural energy enhancement
|
| 17 |
+
* color distribution changes
|
| 18 |
+
* saturation enhancement
|
| 19 |
+
* sharpness and high-frequency detail
|
| 20 |
+
* channel-level color differences
|
| 21 |
+
|
| 22 |
+
The objective is not only to measure pixel reconstruction accuracy, but to evaluate how the VAE enhances image characteristics through the encode/decode pipeline.
|
| 23 |
+
|
| 24 |
+
### Image Enhancement
|
| 25 |
+
|
| 26 |
+
Measured through reconstruction comparisons:
|
| 27 |
+
|
| 28 |
+
* RGB pixel deviation
|
| 29 |
+
* saturation changes
|
| 30 |
+
* gradient energy
|
| 31 |
+
* sharpness retention
|
| 32 |
+
* contrast gain
|
| 33 |
+
* high-frequency energy
|
| 34 |
+
* perceptual color difference (DeltaE)
|
| 35 |
+
|
| 36 |
+
These evaluate how reconstruction changes image detail, color intensity, sharpness, and structural information.
|
| 37 |
+
|
| 38 |
+
---
|
| 39 |
+
|
| 40 |
+
# Results Summary
|
| 41 |
+
|
| 42 |
+
## BASE MiniMax Image VAE vs HDR VAE
|
| 43 |
+
|
| 44 |
+
| Metric | BASE MiniMax VAE | HDR VAE |
|
| 45 |
+
| ----------------------------- | ---------------: | ------: |
|
| 46 |
+
| PSNR ↑ | **32.4389** | 28.4966 |
|
| 47 |
+
| SSIM ↑ | 0.87133 | **0.87810** |
|
| 48 |
+
| RGB MAE ↓ | **0.015623** | 0.028214 |
|
| 49 |
+
| Saturation MAE ↓ | **0.034885** | 0.091786 |
|
| 50 |
+
| Gradient Energy Retention | 0.98014 | **1.05029** |
|
| 51 |
+
| Sharpness Retention | **0.96952** | 0.91151 |
|
| 52 |
+
| Contrast Retention | 1.01329 | 1.00179 |
|
| 53 |
+
| High-Frequency Retention | 0.96159 | **1.04110** |
|
| 54 |
+
| DeltaE ↓ | **2.7502** | 7.0100 |
|
| 55 |
+
|
| 56 |
+
---
|
| 57 |
+
|
| 58 |
+
# Interpretation
|
| 59 |
+
|
| 60 |
+
The **BASE MiniMax Image VAE** achieves lower pixel reconstruction error and DeltaE, indicating closer numerical agreement with the original input.
|
| 61 |
+
|
| 62 |
+
The **HDR VAE** demonstrates a different reconstruction profile:
|
| 63 |
+
|
| 64 |
+
* increased gradient energy
|
| 65 |
+
* increased high-frequency energy
|
| 66 |
+
* higher structural similarity
|
| 67 |
+
* stronger saturation changes
|
| 68 |
+
* enhancement-oriented reconstruction behavior
|
| 69 |
+
|
| 70 |
+
The HDR VAE behaves as an enhancement-oriented reconstruction operator rather than a pixel-preservation model, producing measurable changes to image characteristics during reconstruction.
|
| 71 |
+
|
| 72 |
+
---
|
| 73 |
+
|
| 74 |
+
# Design Goal
|
| 75 |
+
|
| 76 |
+
The HDR VAE is designed to improve image characteristics that standard VAEs commonly soften or reduce:
|
| 77 |
+
|
| 78 |
+
* fine texture
|
| 79 |
+
* high-frequency detail
|
| 80 |
+
* local contrast
|
| 81 |
+
* color variation
|
| 82 |
+
* edge definition
|
| 83 |
+
* perceived sharpness
|
| 84 |
+
|
| 85 |
+
Rather than optimizing only for pixel-level similarity, the HDR VAE emphasizes image enhancement through decoder fine-tuning.
|
| 86 |
+
|
| 87 |
+
---
|
| 88 |
+
|
| 89 |
+
# Conclusion
|
| 90 |
+
|
| 91 |
+
The evaluation demonstrates two different reconstruction profiles:
|
| 92 |
+
|
| 93 |
+
**BASE MiniMax Image VAE**
|
| 94 |
+
|
| 95 |
+
* lower PSNR error
|
| 96 |
+
* lower RGB reconstruction error
|
| 97 |
+
* lower DeltaE
|
| 98 |
+
* stronger numerical color preservation
|
| 99 |
+
* more faithful pixel reconstruction
|
| 100 |
+
|
| 101 |
+
**HDR MiniMax Image VAE**
|
| 102 |
+
|
| 103 |
+
* higher SSIM
|
| 104 |
+
* increased gradient energy
|
| 105 |
+
* increased high-frequency energy
|
| 106 |
+
* enhancement-oriented reconstruction
|
| 107 |
+
* greater image characteristic variation
|
| 108 |
+
|
| 109 |
+
The HDR VAE provides an enhancement-oriented reconstruction profile for users seeking increased structural information, richer image characteristics, and enhanced visual detail rather than strict pixel-perfect reconstruction.
|