Diffusers
Safetensors
Felldude commited on
Commit
7a2fa5b
·
verified ·
1 Parent(s): b54a987

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +107 -1
README.md CHANGED
@@ -1,3 +1,109 @@
1
  ---
2
- license: openrail
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: bigscience-openrail-m
3
+ base_model:
4
+ - MiniMaxAI/MiniMax-H3-Image
5
  ---
6
+
7
+ **NOTE Encoder was Frozen Using this VAE for Training should not effect outcome**
8
+
9
+ ## Overview
10
+
11
+ This repository contains evaluation results for a **MiniMax Image HDR VAE (High Dynamic Range Variational Autoencoder)** designed for MiniMax-H3 image reconstruction and enhancement workflows.
12
+
13
+ The HDR VAE is evaluated against the **BASE MiniMax Image VAE** using a multi-domain reconstruction analysis covering:
14
+
15
+ * perceptual similarity
16
+ * structural energy enhancement
17
+ * color distribution changes
18
+ * saturation enhancement
19
+ * sharpness and high-frequency detail
20
+ * channel-level color differences
21
+
22
+ The objective is not only to measure pixel reconstruction accuracy, but to evaluate how the VAE enhances image characteristics through the encode/decode pipeline.
23
+
24
+ ### Image Enhancement
25
+
26
+ Measured through reconstruction comparisons:
27
+
28
+ * RGB pixel deviation
29
+ * saturation changes
30
+ * gradient energy
31
+ * sharpness retention
32
+ * contrast gain
33
+ * high-frequency energy
34
+ * perceptual color difference (DeltaE)
35
+
36
+ These evaluate how reconstruction changes image detail, color intensity, sharpness, and structural information.
37
+
38
+ ---
39
+
40
+ # Results Summary
41
+
42
+ ## BASE MiniMax Image VAE vs HDR VAE
43
+
44
+ | Metric | BASE MiniMax VAE | HDR VAE |
45
+ | ----------------------------- | ---------------: | ------: |
46
+ | PSNR ↑ | **32.4389** | 28.4966 |
47
+ | SSIM ↑ | 0.87133 | **0.87810** |
48
+ | RGB MAE ↓ | **0.015623** | 0.028214 |
49
+ | Saturation MAE ↓ | **0.034885** | 0.091786 |
50
+ | Gradient Energy Retention | 0.98014 | **1.05029** |
51
+ | Sharpness Retention | **0.96952** | 0.91151 |
52
+ | Contrast Retention | 1.01329 | 1.00179 |
53
+ | High-Frequency Retention | 0.96159 | **1.04110** |
54
+ | DeltaE ↓ | **2.7502** | 7.0100 |
55
+
56
+ ---
57
+
58
+ # Interpretation
59
+
60
+ The **BASE MiniMax Image VAE** achieves lower pixel reconstruction error and DeltaE, indicating closer numerical agreement with the original input.
61
+
62
+ The **HDR VAE** demonstrates a different reconstruction profile:
63
+
64
+ * increased gradient energy
65
+ * increased high-frequency energy
66
+ * higher structural similarity
67
+ * stronger saturation changes
68
+ * enhancement-oriented reconstruction behavior
69
+
70
+ The HDR VAE behaves as an enhancement-oriented reconstruction operator rather than a pixel-preservation model, producing measurable changes to image characteristics during reconstruction.
71
+
72
+ ---
73
+
74
+ # Design Goal
75
+
76
+ The HDR VAE is designed to improve image characteristics that standard VAEs commonly soften or reduce:
77
+
78
+ * fine texture
79
+ * high-frequency detail
80
+ * local contrast
81
+ * color variation
82
+ * edge definition
83
+ * perceived sharpness
84
+
85
+ Rather than optimizing only for pixel-level similarity, the HDR VAE emphasizes image enhancement through decoder fine-tuning.
86
+
87
+ ---
88
+
89
+ # Conclusion
90
+
91
+ The evaluation demonstrates two different reconstruction profiles:
92
+
93
+ **BASE MiniMax Image VAE**
94
+
95
+ * lower PSNR error
96
+ * lower RGB reconstruction error
97
+ * lower DeltaE
98
+ * stronger numerical color preservation
99
+ * more faithful pixel reconstruction
100
+
101
+ **HDR MiniMax Image VAE**
102
+
103
+ * higher SSIM
104
+ * increased gradient energy
105
+ * increased high-frequency energy
106
+ * enhancement-oriented reconstruction
107
+ * greater image characteristic variation
108
+
109
+ The HDR VAE provides an enhancement-oriented reconstruction profile for users seeking increased structural information, richer image characteristics, and enhanced visual detail rather than strict pixel-perfect reconstruction.