neonforestmist commited on
Commit
8eb508f
·
verified ·
1 Parent(s): 8a38892

Refine model positioning and evaluation overview; remove duplicate demo link

Browse files
Files changed (1) hide show
  1. README.md +38 -15
README.md CHANGED
@@ -67,23 +67,24 @@ widget:
67
  ![Clover Image Tiny banner](https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/clover-image-tiny-banner.png)
68
 
69
  <p align="center">
70
- <strong>Compact, low-latency image generation for local apps and offline creative work.</strong><br>
71
- 512 × 512 output. A 323.4M-parameter denoiser, optional LoRA styles, and Python and Core ML workflows.
72
  </p>
73
 
74
  <table align="center">
75
  <tr>
76
  <td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/model.svg" alt="HF MODEL" height="36"></a></td>
77
  <td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/inpaint.svg" alt="INPAINTING" height="36"></a></td>
78
- <td align="center"><a href="https://huggingface.co/spaces/neonforestmist/Clover-Image-Tiny-Demo"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/live-demo.svg" alt="LIVE DEMO" height="36"></a></td>
79
  </tr>
80
  <tr>
81
- <td align="center"><a href="https://huggingface.co/spaces/neonforestmist/Clover-Image-Tiny-Demo"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/zero-gpu.svg" alt="ZEROGPU DEMO" height="36"></a></td>
82
  <td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny-iOS"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/ios-app.svg" alt="IPHONE / CORE ML" height="36"></a></td>
83
- <td align="center"><a href="https://github.com/neonforestmist/clover-image-tiny-lora-trainer"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/trainer.svg" alt="LORA TRAINER" height="36"></a></td>
84
  </tr>
85
  <tr>
 
86
  <td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/source.svg" alt="GITHUB SOURCE" height="36"></a></td>
 
 
87
  <td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny/actions/workflows/quality.yml"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/checks.svg" alt="QUALITY CHECKS" height="36"></a></td>
88
  <td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny/blob/main/LICENSE"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/license.svg" alt="MODEL LICENSE" height="36"></a></td>
89
  </tr>
@@ -101,7 +102,7 @@ region of an existing image. Both run locally after the model and dependencies a
101
  | Clover Image Tiny | Clover Inpaint HQ |
102
  |:---:|:---:|
103
  | ![Regular Clover output: a bouquet of blue flowers](https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/3f2a698bc3cbad617970a73d623e0732bb5f87f5/examples/prompt-gallery/original/image_79.png) | ![Published Clover inpainting example: blue sunglasses added to a cat](https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint/resolve/3e22009fb6e61944f28b0389f775fc47e2c48724/examples/sunglasses-result.png) |
104
- | **Text → image.** Compact BK-SDM-Tiny architecture with a 323.4M-parameter U-Net and an additional Clover distillation pass. | **Image + mask + text → edit.** Full SD 1.5 inpainting U-Net with Clover's shared components. Larger than the regular model. |
105
 
106
  The regular Diffusers package is about **1.67 GB**, including its text encoder, VAE,
107
  and safety checker. The 323.4M count describes the denoiser, not the complete pipeline.
@@ -126,9 +127,9 @@ This published before-and-after example uses the prompt **“add blue sunglasses
126
  |:---:|:---:|
127
  | ![Original cat artwork before the masked sunglasses edit](https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint/resolve/3e22009fb6e61944f28b0389f775fc47e2c48724/examples/sunglasses-source.png) | ![Clover inpainting example: the cat with blue sunglasses added](https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint/resolve/3e22009fb6e61944f28b0389f775fc47e2c48724/examples/sunglasses-result.png) |
128
 
129
- Inpaint HQ pairs the full Stable Diffusion 1.5 inpainting denoiser with Clover's shared
130
- components. It is a larger, separate model focused on editing quality. For exact preservation,
131
- composite the result through the original binary mask.
132
 
133
  ## Styles
134
 
@@ -151,8 +152,28 @@ prompt with the base model, Monet, Pointillism, and Watercolor Anime.
151
 
152
  ## Evaluation
153
 
154
- **Compact denoiser, roughly one-second generation.** Clover averaged **1.024 seconds per image**
155
- on an NVIDIA A10G across 16 prompts at 512 × 512, 30 DDIM steps, and guidance 7.5.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
156
 
157
  | Model | U-Net parameters ↓ | Loaded pipeline parameters ↓ | Mean latency ↓ | Peak CUDA memory ↓ | Mean CLIP cosine ↑ |
158
  |---|---:|---:|---:|---:|---:|
@@ -163,11 +184,13 @@ on an NVIDIA A10G across 16 prompts at 512 × 512, 30 DDIM steps, and guidance 7
163
 
164
  **↓ Lower is better for size, latency, and memory; ↑ higher is better for CLIP prompt alignment. Bold marks the best result in each column, including ties.** Parameter counts describe footprint, not image quality.
165
 
166
- Clover's measured strengths are its **joint-smallest denoiser (323.4M parameters)** and **roughly one-second generation (1.024 s/image)** in this test. Its latency is within 0.4% of BK-SDM-Tiny-2M and Segmind Tiny-SD; that small gap is not an established speed advantage. BK-SDM-v2-Tiny is faster here, while Segmind Tiny-SD uses less memory and has the highest CLIP score.
 
 
 
 
167
 
168
- These are GPU measurements, not timings for older devices or iPhones. CLIP is a
169
- prompt-alignment proxy, not an overall image-quality rating.
170
- [Full protocol, outputs, and machine-readable results](https://huggingface.co/neonforestmist/Clover-Image-Tiny/blob/main/benchmarks/text-to-image/results/clover-small-model-comparison-20260825/REPORT.md).
171
 
172
  ## Usage notes
173
 
 
67
  ![Clover Image Tiny banner](https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/clover-image-tiny-banner.png)
68
 
69
  <p align="center">
70
+ <strong>SD 1.4-class image generation in a compact model for local apps and offline use.</strong><br>
71
+ 512 × 512 output · 323.4M-parameter denoiser · LoRA styles · Diffusers and separate Core ML releases.
72
  </p>
73
 
74
  <table align="center">
75
  <tr>
76
  <td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/model.svg" alt="HF MODEL" height="36"></a></td>
77
  <td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/inpaint.svg" alt="INPAINTING" height="36"></a></td>
 
78
  </tr>
79
  <tr>
80
+ <td align="center"><a href="https://huggingface.co/spaces/neonforestmist/Clover-Image-Tiny-Demo"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/live-demo.svg" alt="LIVE DEMO" height="36"></a></td>
81
  <td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny-iOS"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/ios-app.svg" alt="IPHONE / CORE ML" height="36"></a></td>
 
82
  </tr>
83
  <tr>
84
+ <td align="center"><a href="https://github.com/neonforestmist/clover-image-tiny-lora-trainer"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/trainer.svg" alt="LORA TRAINER" height="36"></a></td>
85
  <td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/source.svg" alt="GITHUB SOURCE" height="36"></a></td>
86
+ </tr>
87
+ <tr>
88
  <td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny/actions/workflows/quality.yml"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/checks.svg" alt="QUALITY CHECKS" height="36"></a></td>
89
  <td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny/blob/main/LICENSE"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/license.svg" alt="MODEL LICENSE" height="36"></a></td>
90
  </tr>
 
102
  | Clover Image Tiny | Clover Inpaint HQ |
103
  |:---:|:---:|
104
  | ![Regular Clover output: a bouquet of blue flowers](https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/3f2a698bc3cbad617970a73d623e0732bb5f87f5/examples/prompt-gallery/original/image_79.png) | ![Published Clover inpainting example: blue sunglasses added to a cat](https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint/resolve/3e22009fb6e61944f28b0389f775fc47e2c48724/examples/sunglasses-result.png) |
105
+ | **Text → image.** Compact SD 1.4-class generation with a 323.4M-parameter denoiser. | **Image + mask + text → edit.** SD 1.5-class inpainting with Clover's shared components. A larger, separate checkpoint. |
106
 
107
  The regular Diffusers package is about **1.67 GB**, including its text encoder, VAE,
108
  and safety checker. The 323.4M count describes the denoiser, not the complete pipeline.
 
127
  |:---:|:---:|
128
  | ![Original cat artwork before the masked sunglasses edit](https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint/resolve/3e22009fb6e61944f28b0389f775fc47e2c48724/examples/sunglasses-source.png) | ![Clover inpainting example: the cat with blue sunglasses added](https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint/resolve/3e22009fb6e61944f28b0389f775fc47e2c48724/examples/sunglasses-result.png) |
129
 
130
+ Inpaint HQ provides SD 1.5-class masked editing. For exact preservation outside the
131
+ edited region, composite the result through the original binary mask. Its full-size
132
+ inpainting denoiser and shared components are documented in the inpainting model card.
133
 
134
  ## Styles
135
 
 
152
 
153
  ## Evaluation
154
 
155
+ ### Compact model, practical generation speed
156
+
157
+ Clover combines a **323.4M-parameter denoiser** with **1.024-second mean generation**
158
+ in the published NVIDIA A10G test. It retains the compact architecture while adding
159
+ Clover's distillation pass, style adapters, and separate Core ML deployment options.
160
+
161
+ | Measured on NVIDIA A10G | Clover Image Tiny |
162
+ |---|---:|
163
+ | Mean generation time ↓ | **1.024 s/image** |
164
+ | Peak CUDA memory ↓ | **2,233 MB** |
165
+ | Denoiser parameters ↓ | **323.4M** |
166
+
167
+ **Test settings:** 16 prompts, 512 × 512, 30 DDIM steps, guidance 7.5, after warm-up.
168
+ Lower values mean less time, memory, or denoiser storage—not automatically better images.
169
+ These are GPU results, not older-device or iPhone timings.
170
+
171
+ Clover runs in the same approximate one-second range as BK-SDM-Tiny-2M and Segmind
172
+ Tiny-SD in this test. Other references lead individual latency, memory, and CLIP
173
+ metrics; the comparison does not establish an overall quality or speed lead.
174
+
175
+ <details>
176
+ <summary>Full four-model comparison: latency, memory, and prompt alignment</summary>
177
 
178
  | Model | U-Net parameters ↓ | Loaded pipeline parameters ↓ | Mean latency ↓ | Peak CUDA memory ↓ | Mean CLIP cosine ↑ |
179
  |---|---:|---:|---:|---:|---:|
 
184
 
185
  **↓ Lower is better for size, latency, and memory; ↑ higher is better for CLIP prompt alignment. Bold marks the best result in each column, including ties.** Parameter counts describe footprint, not image quality.
186
 
187
+ CLIP cosine measures prompt alignment, not overall visual quality. The latency gaps
188
+ between Clover, BK-SDM-Tiny-2M, and Segmind Tiny-SD are below 0.4% and should be read
189
+ as near parity, not an established speed advantage.
190
+
191
+ </details>
192
 
193
+ [Benchmark protocol, all outputs, and raw results](https://huggingface.co/neonforestmist/Clover-Image-Tiny/blob/main/benchmarks/text-to-image/results/clover-small-model-comparison-20260825/REPORT.md).
 
 
194
 
195
  ## Usage notes
196