Text-to-Image
Diffusers
Safetensors
StableDiffusionPipeline
local-ai
image-generation
lora
apple-silicon
clover-image
diffusion
stable-diffusion
knowledge-distillation
compact
small-model
local-inference
edge-inference
mobile-inference
core-ml
iphone
sd-1.4-class
Instructions to use neonforestmist/Clover-Image-Tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use neonforestmist/Clover-Image-Tiny with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("nota-ai/bk-sdm-tiny-2m", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("neonforestmist/Clover-Image-Tiny") prompt = "a glass of red wine" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Refine model positioning and evaluation overview; remove duplicate demo link
Browse files
README.md
CHANGED
|
@@ -67,23 +67,24 @@ widget:
|
|
| 67 |

|
| 68 |
|
| 69 |
<p align="center">
|
| 70 |
-
<strong>
|
| 71 |
-
512 × 512 output
|
| 72 |
</p>
|
| 73 |
|
| 74 |
<table align="center">
|
| 75 |
<tr>
|
| 76 |
<td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/model.svg" alt="HF MODEL" height="36"></a></td>
|
| 77 |
<td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/inpaint.svg" alt="INPAINTING" height="36"></a></td>
|
| 78 |
-
<td align="center"><a href="https://huggingface.co/spaces/neonforestmist/Clover-Image-Tiny-Demo"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/live-demo.svg" alt="LIVE DEMO" height="36"></a></td>
|
| 79 |
</tr>
|
| 80 |
<tr>
|
| 81 |
-
<td align="center"><a href="https://huggingface.co/spaces/neonforestmist/Clover-Image-Tiny-Demo"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/
|
| 82 |
<td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny-iOS"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/ios-app.svg" alt="IPHONE / CORE ML" height="36"></a></td>
|
| 83 |
-
<td align="center"><a href="https://github.com/neonforestmist/clover-image-tiny-lora-trainer"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/trainer.svg" alt="LORA TRAINER" height="36"></a></td>
|
| 84 |
</tr>
|
| 85 |
<tr>
|
|
|
|
| 86 |
<td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/source.svg" alt="GITHUB SOURCE" height="36"></a></td>
|
|
|
|
|
|
|
| 87 |
<td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny/actions/workflows/quality.yml"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/checks.svg" alt="QUALITY CHECKS" height="36"></a></td>
|
| 88 |
<td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny/blob/main/LICENSE"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/license.svg" alt="MODEL LICENSE" height="36"></a></td>
|
| 89 |
</tr>
|
|
@@ -101,7 +102,7 @@ region of an existing image. Both run locally after the model and dependencies a
|
|
| 101 |
| Clover Image Tiny | Clover Inpaint HQ |
|
| 102 |
|:---:|:---:|
|
| 103 |
|  |  |
|
| 104 |
-
| **Text → image.** Compact
|
| 105 |
|
| 106 |
The regular Diffusers package is about **1.67 GB**, including its text encoder, VAE,
|
| 107 |
and safety checker. The 323.4M count describes the denoiser, not the complete pipeline.
|
|
@@ -126,9 +127,9 @@ This published before-and-after example uses the prompt **“add blue sunglasses
|
|
| 126 |
|:---:|:---:|
|
| 127 |
|  |  |
|
| 128 |
|
| 129 |
-
Inpaint HQ
|
| 130 |
-
|
| 131 |
-
|
| 132 |
|
| 133 |
## Styles
|
| 134 |
|
|
@@ -151,8 +152,28 @@ prompt with the base model, Monet, Pointillism, and Watercolor Anime.
|
|
| 151 |
|
| 152 |
## Evaluation
|
| 153 |
|
| 154 |
-
|
| 155 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 156 |
|
| 157 |
| Model | U-Net parameters ↓ | Loaded pipeline parameters ↓ | Mean latency ↓ | Peak CUDA memory ↓ | Mean CLIP cosine ↑ |
|
| 158 |
|---|---:|---:|---:|---:|---:|
|
|
@@ -163,11 +184,13 @@ on an NVIDIA A10G across 16 prompts at 512 × 512, 30 DDIM steps, and guidance 7
|
|
| 163 |
|
| 164 |
**↓ Lower is better for size, latency, and memory; ↑ higher is better for CLIP prompt alignment. Bold marks the best result in each column, including ties.** Parameter counts describe footprint, not image quality.
|
| 165 |
|
| 166 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 167 |
|
| 168 |
-
|
| 169 |
-
prompt-alignment proxy, not an overall image-quality rating.
|
| 170 |
-
[Full protocol, outputs, and machine-readable results](https://huggingface.co/neonforestmist/Clover-Image-Tiny/blob/main/benchmarks/text-to-image/results/clover-small-model-comparison-20260825/REPORT.md).
|
| 171 |
|
| 172 |
## Usage notes
|
| 173 |
|
|
|
|
| 67 |

|
| 68 |
|
| 69 |
<p align="center">
|
| 70 |
+
<strong>SD 1.4-class image generation in a compact model for local apps and offline use.</strong><br>
|
| 71 |
+
512 × 512 output · 323.4M-parameter denoiser · LoRA styles · Diffusers and separate Core ML releases.
|
| 72 |
</p>
|
| 73 |
|
| 74 |
<table align="center">
|
| 75 |
<tr>
|
| 76 |
<td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/model.svg" alt="HF MODEL" height="36"></a></td>
|
| 77 |
<td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny-Inpaint"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/inpaint.svg" alt="INPAINTING" height="36"></a></td>
|
|
|
|
| 78 |
</tr>
|
| 79 |
<tr>
|
| 80 |
+
<td align="center"><a href="https://huggingface.co/spaces/neonforestmist/Clover-Image-Tiny-Demo"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/live-demo.svg" alt="LIVE DEMO" height="36"></a></td>
|
| 81 |
<td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny-iOS"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/ios-app.svg" alt="IPHONE / CORE ML" height="36"></a></td>
|
|
|
|
| 82 |
</tr>
|
| 83 |
<tr>
|
| 84 |
+
<td align="center"><a href="https://github.com/neonforestmist/clover-image-tiny-lora-trainer"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/trainer.svg" alt="LORA TRAINER" height="36"></a></td>
|
| 85 |
<td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/source.svg" alt="GITHUB SOURCE" height="36"></a></td>
|
| 86 |
+
</tr>
|
| 87 |
+
<tr>
|
| 88 |
<td align="center"><a href="https://github.com/neonforestmist/Clover-Image-Tiny/actions/workflows/quality.yml"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/checks.svg" alt="QUALITY CHECKS" height="36"></a></td>
|
| 89 |
<td align="center"><a href="https://huggingface.co/neonforestmist/Clover-Image-Tiny/blob/main/LICENSE"><img src="https://huggingface.co/neonforestmist/Clover-Image-Tiny/resolve/main/assets/links/license.svg" alt="MODEL LICENSE" height="36"></a></td>
|
| 90 |
</tr>
|
|
|
|
| 102 |
| Clover Image Tiny | Clover Inpaint HQ |
|
| 103 |
|:---:|:---:|
|
| 104 |
|  |  |
|
| 105 |
+
| **Text → image.** Compact SD 1.4-class generation with a 323.4M-parameter denoiser. | **Image + mask + text → edit.** SD 1.5-class inpainting with Clover's shared components. A larger, separate checkpoint. |
|
| 106 |
|
| 107 |
The regular Diffusers package is about **1.67 GB**, including its text encoder, VAE,
|
| 108 |
and safety checker. The 323.4M count describes the denoiser, not the complete pipeline.
|
|
|
|
| 127 |
|:---:|:---:|
|
| 128 |
|  |  |
|
| 129 |
|
| 130 |
+
Inpaint HQ provides SD 1.5-class masked editing. For exact preservation outside the
|
| 131 |
+
edited region, composite the result through the original binary mask. Its full-size
|
| 132 |
+
inpainting denoiser and shared components are documented in the inpainting model card.
|
| 133 |
|
| 134 |
## Styles
|
| 135 |
|
|
|
|
| 152 |
|
| 153 |
## Evaluation
|
| 154 |
|
| 155 |
+
### Compact model, practical generation speed
|
| 156 |
+
|
| 157 |
+
Clover combines a **323.4M-parameter denoiser** with **1.024-second mean generation**
|
| 158 |
+
in the published NVIDIA A10G test. It retains the compact architecture while adding
|
| 159 |
+
Clover's distillation pass, style adapters, and separate Core ML deployment options.
|
| 160 |
+
|
| 161 |
+
| Measured on NVIDIA A10G | Clover Image Tiny |
|
| 162 |
+
|---|---:|
|
| 163 |
+
| Mean generation time ↓ | **1.024 s/image** |
|
| 164 |
+
| Peak CUDA memory ↓ | **2,233 MB** |
|
| 165 |
+
| Denoiser parameters ↓ | **323.4M** |
|
| 166 |
+
|
| 167 |
+
**Test settings:** 16 prompts, 512 × 512, 30 DDIM steps, guidance 7.5, after warm-up.
|
| 168 |
+
Lower values mean less time, memory, or denoiser storage—not automatically better images.
|
| 169 |
+
These are GPU results, not older-device or iPhone timings.
|
| 170 |
+
|
| 171 |
+
Clover runs in the same approximate one-second range as BK-SDM-Tiny-2M and Segmind
|
| 172 |
+
Tiny-SD in this test. Other references lead individual latency, memory, and CLIP
|
| 173 |
+
metrics; the comparison does not establish an overall quality or speed lead.
|
| 174 |
+
|
| 175 |
+
<details>
|
| 176 |
+
<summary>Full four-model comparison: latency, memory, and prompt alignment</summary>
|
| 177 |
|
| 178 |
| Model | U-Net parameters ↓ | Loaded pipeline parameters ↓ | Mean latency ↓ | Peak CUDA memory ↓ | Mean CLIP cosine ↑ |
|
| 179 |
|---|---:|---:|---:|---:|---:|
|
|
|
|
| 184 |
|
| 185 |
**↓ Lower is better for size, latency, and memory; ↑ higher is better for CLIP prompt alignment. Bold marks the best result in each column, including ties.** Parameter counts describe footprint, not image quality.
|
| 186 |
|
| 187 |
+
CLIP cosine measures prompt alignment, not overall visual quality. The latency gaps
|
| 188 |
+
between Clover, BK-SDM-Tiny-2M, and Segmind Tiny-SD are below 0.4% and should be read
|
| 189 |
+
as near parity, not an established speed advantage.
|
| 190 |
+
|
| 191 |
+
</details>
|
| 192 |
|
| 193 |
+
[Benchmark protocol, all outputs, and raw results](https://huggingface.co/neonforestmist/Clover-Image-Tiny/blob/main/benchmarks/text-to-image/results/clover-small-model-comparison-20260825/REPORT.md).
|
|
|
|
|
|
|
| 194 |
|
| 195 |
## Usage notes
|
| 196 |
|