Text-to-Image
Diffusers
Safetensors
English
MOSSImagePipeline
moss-image
16gb
structured-pruning
alpha
Instructions to use AiArtLab/mossling with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use AiArtLab/mossling with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("AiArtLab/mossling", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
card: step_25000 samples + honest status
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ tags:
|
|
| 16 |
|
| 17 |
_MOSS-Image pruned to fit a 16 GB card: a 30-block DiT instead of 42, a 0.8B text encoder with a 158M adapter instead of the 15.6 GB 9B one._ Text-to-image at 1024 px, **12.4 GB peak**, one consumer GPU.
|
| 18 |
|
| 19 |
-
. Treat it as a working proof that the base model survives a 26.7% cut and a 16× smaller encoder, not as a finished model.
|
| 22 |
|
|
@@ -28,7 +28,7 @@ _MOSS-Image pruned to fit a 16 GB card: a 30-block DiT instead of 42, a 0.8B tex
|
|
| 28 |
|
| 29 |
**scheduler** — `MOSSImageScheduler`, flow-matching Euler, static shift 5.0.
|
| 30 |
|
| 31 |
-
**resolution** — 1024 by default, any positive multiple of 16; 3:4 and 4:3 work (the samples below are 768x1152).
|
| 32 |
|
| 33 |
**peak VRAM** — **12.4 GB** at 1024 px / 30 steps, one forward pair per step, no offload. 9.7 GB at 768x1152 when the encoder is freed before the DiT runs; ~1.15 it/s on a 4080.
|
| 34 |
|
|
@@ -48,15 +48,16 @@ A mossling is a small moss. The base model is MOSS-Image, this is the same plant
|
|
| 48 |
|
| 49 |
## Examples
|
| 50 |
|
| 51 |
-
Every image below comes from this folder:
|
| 52 |
|
| 53 |
| | prompt |
|
| 54 |
| --- | --- |
|
| 55 |
|  | A young woman with curly red hair sits by the window of a sunlit cafe, holding a ceramic cup with both hands, warm morning light on her face, soft shadows, shallow depth of field, 85mm portrait photograph, natural skin texture, detailed eyes |
|
| 56 |
-
| 
|
| 20 |
|
| 21 |
**This is an alpha.** It was assembled in two days on a single **RTX 4080 (16 GB)** and it is **undertrained**: see [Status](#status). Treat it as a working proof that the base model survives a 26.7% cut and a 16× smaller encoder, not as a finished model.
|
| 22 |
|
|
|
|
| 28 |
|
| 29 |
**scheduler** — `MOSSImageScheduler`, flow-matching Euler, static shift 5.0.
|
| 30 |
|
| 31 |
+
**resolution** — 1024 by default, any positive multiple of 16; 3:4 and 4:3 work (the samples below are 768x1152, 768x1024, 864x1152 and 1152x1152).
|
| 32 |
|
| 33 |
**peak VRAM** — **12.4 GB** at 1024 px / 30 steps, one forward pair per step, no offload. 9.7 GB at 768x1152 when the encoder is freed before the DiT runs; ~1.15 it/s on a 4080.
|
| 34 |
|
|
|
|
| 48 |
|
| 49 |
## Examples
|
| 50 |
|
| 51 |
+
Every image below comes from this folder: 50 steps, CFG 3, seed 7, each at its own aspect ratio. The adapter computes the condition first and is freed before the DiT runs. Only the first prompt is mine; the other three are copied verbatim from rows of the fine-tune set, resolutions included.
|
| 52 |
|
| 53 |
| | prompt |
|
| 54 |
| --- | --- |
|
| 55 |
|  | A young woman with curly red hair sits by the window of a sunlit cafe, holding a ceramic cup with both hands, warm morning light on her face, soft shadows, shallow depth of field, 85mm portrait photograph, natural skin texture, detailed eyes |
|
| 56 |
+
|  | This highly detailed CGI rendering captures the iconic character Wolverine from Marvel Comics in his futuristic armor suit. The costume features intricate blue and gold plates, with sharp claws protruding from both hands, emphasizing his signature weapon. The background is dimly lit, highlighting the armored figure's muscular physique and determined expression under a glowing helmet. |
|
| 57 |
+
|  | The image shows a woman seated in a vibrant red chair, with her legs crossed. She is wearing a stylish black leather pajama set with white trim, and a pair of black goggles rests on her head. She is also wearing red lipstick and a watch on her left wrist. In her lap, she cradles a small white dog wearing a black cap. The backdrop is a stark white, with the word "BAZAAR" written in bold black letters at the top. LBD Gigi and Bella Hadid |
|
| 58 |
+
|  | A cartoon of a grey-furred female mouse with golden eyes, her body retaining all the natural, unmistakable features of a mouse—small, round ears, a long, twitching tail, and paws with delicate fingers. She wears simple beige clothing suited for travel, with small, practical bronze armor pieces tailored perfectly for her size. A long, curved sword rests on her shoulder, the hilt grasped firmly in her paw as her stance remains low to the ground, reflecting her nimbleness. The background is an arid desert, with the ruins of an ancient temple in the distance, weathered by time and partially overtaken by shifting sands. |
|
| 59 |
+
|
| 60 |
+
The mouse row's caption continues with twelve random words ("Florgnax qwermbly …"); they are dropped here and were kept out of the prompt.
|
| 61 |
|
| 62 |
## Usage
|
| 63 |
|
|
|
|
| 90 |
|
| 91 |
Honest list, this is what "alpha" means here:
|
| 92 |
|
| 93 |
+
* **The fine-tune is short and flat.** The DiT in this folder is the fused 30-block build after one epoch's worth of fine-tuning: 39 025 captioned rows, stopped at **25 000 of 39 025 steps** (lr 1e-5 cosine to 1e-6, 200-step warmup, no EMA). It did not converge. Re-shot on five fixed prompts with a fixed seed, 25 000 steps are not visibly better than 2 000 and add small-structure regressions on top: an extra arm in the cafe portrait, fused limbs in a ballet shot, mushier faces in a crowded neon street. Stopping was a decision, not an accident — more steps were trading crispness for smoothness. Expect visible roughness on hands, complex geometry and crowded scenes.
|
| 94 |
* **Not a full re-train.** The base model's own training is inherited; only the block merges and the short fine-tune above are new.
|
| 95 |
+
* **Text inside the image degrades** — signs and JSON layouts come out garbled, though one large word can land (the `BAZAAR` sample). Two of the fused blocks carried that ability, and one block plus a low-rank patch does not reproduce it.
|
| 96 |
* **JSON layout prompts are the weakest case** for the adapter as well (cosine 0.756): it was trained on captions, not on layout instructions — the two limitations stack on sign/layout prompts.
|
| 97 |
+
* **One seed per prompt in the samples.** Quality varies with seed, and the four images above are one draw each, seed 7, nothing re-rolled: three prompts are random rows of the fine-tune set (resolutions included), the cafe one is mine. They are picked to show what the model does, not the best of hundreds.
|
| 98 |
* **English prompts**, as in the dataset behind the adapter.
|
| 99 |
|
| 100 |
Quality against the base model, measured on the pruned-but-not-fine-tuned build:
|
|
|
|
| 117 |
adapter/ adapter v1: adapter.safetensors (158M head) + its own src/ and samples/
|
| 118 |
vae/ untouched AutoencoderKLFlux2, fp32
|
| 119 |
scheduler/, tokenizer/ untouched
|
| 120 |
+
samples/ the four images above + hero.jpg
|
| 121 |
src/ compression and training scripts, plus the method write-up
|
| 122 |
```
|
| 123 |
|