Instructions to use retronic/pixeled-image with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Inference
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -10,9 +10,19 @@ tags:
|
|
| 10 |
- pixelship
|
| 11 |
- lora
|
| 12 |
- structured-prompts
|
|
|
|
|
|
|
| 13 |
---
|
| 14 |
|
| 15 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
# Pixeled
|
| 18 |
|
|
@@ -22,22 +32,49 @@ tags:
|
|
| 22 |
|
| 23 |
**Pixeled** is the image-generation model being developed for **Pixelship 2.0**. It is a fine-tune of **FLUX.2-dev** designed to understand Pixelship's highly specific structured JSON prompts.
|
| 24 |
|
|
|
|
|
|
|
| 25 |
Instead of only describing the general idea of an image, Pixelship can specify composition, individual objects, approximate positions, colors, backgrounds, typography, and other visual details. Pixeled is trained on this format so these instructions have a stronger influence over the final generation.
|
| 26 |
|
| 27 |
The goal is not to turn FLUX.2-dev into a deterministic renderer. Pixeled is still a generative image model. Instead, the goal is to make highly detailed prompting more useful, allowing Pixelship to communicate much more information about what an image should look like.
|
| 28 |
|
| 29 |
---
|
| 30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
## Recommended Settings
|
| 32 |
|
| 33 |
-
The settings
|
| 34 |
|
|
|
|
| 35 |
{
|
| 36 |
"lora_scale": 0.5,
|
| 37 |
"guidance_scale": 5,
|
| 38 |
"seed": "random",
|
| 39 |
"num_inference_steps": 50
|
| 40 |
}
|
|
|
|
| 41 |
|
| 42 |
```text
|
| 43 |
FLUX.2-dev + Pixeled LoRA @ 0.5
|
|
@@ -47,23 +84,27 @@ Pixeled is intended to enhance the prompt understanding of FLUX.2-dev rather tha
|
|
| 47 |
|
| 48 |
At these settings, the base model can retain more of its original visual capabilities while Pixeled contributes its learned behavior for interpreting Pixelship's structured prompts.
|
| 49 |
|
| 50 |
-
Higher or lower values can still be experimented with, but
|
|
|
|
|
|
|
| 51 |
|
| 52 |
---
|
| 53 |
|
| 54 |
## Technicals
|
| 55 |
|
| 56 |
-
| Property
|
| 57 |
-
|---|---|
|
| 58 |
-
| **Name**
|
| 59 |
-
| **
|
| 60 |
-
| **
|
| 61 |
-
| **
|
| 62 |
-
| **
|
| 63 |
-
| **
|
| 64 |
-
| **
|
| 65 |
-
| **
|
| 66 |
-
| **
|
|
|
|
|
|
|
| 67 |
|
| 68 |
Pixeled's training prompts follow a structure similar to:
|
| 69 |
|
|
@@ -149,31 +190,49 @@ The descriptions attempt to capture more than the basic subject of an image. The
|
|
| 149 |
|
| 150 |
The training dataset includes multiple types of imagery, particularly material where detailed prompting is useful:
|
| 151 |
|
| 152 |
-
|
| 153 |
-
|
| 154 |
-
|
| 155 |
-
|
| 156 |
-
|
| 157 |
-
|
| 158 |
-
|
| 159 |
-
|
| 160 |
-
|
| 161 |
-
|
| 162 |
-
|
| 163 |
-
|
| 164 |
-
|
| 165 |
|
| 166 |
This gives Pixeled examples of the structured format being applied across very different visual styles instead of training it around one narrow type of image.
|
| 167 |
|
|
|
|
|
|
|
| 168 |
---
|
| 169 |
|
| 170 |
## Current Limitations
|
| 171 |
-
|
|
|
|
| 172 |
|
| 173 |
### Very Big Paragraphs
|
| 174 |
|
| 175 |
-
Pixeled may produce
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 176 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 177 |
|
| 178 |
## Using Pixeled with Pixelship 2.0
|
| 179 |
|
|
@@ -199,6 +258,32 @@ Pixelship handles the planning and prompt construction, while Pixeled handles th
|
|
| 199 |
|
| 200 |
The separation allows Pixelship to reason about what should be generated before asking the image model to render it.
|
| 201 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 202 |
---
|
| 203 |
|
| 204 |
## Conclusion
|
|
@@ -207,18 +292,36 @@ Pixeled is an experiment in giving an existing image model a more precise langua
|
|
| 207 |
|
| 208 |
FLUX.2-dev provides the underlying image-generation capabilities, while the Pixeled fine-tune teaches the model how to better interpret the structured descriptions generated by Pixelship 2.0.
|
| 209 |
|
| 210 |
-
The
|
| 211 |
|
| 212 |
-
|
|
|
|
|
|
|
| 213 |
|
| 214 |
```text
|
| 215 |
FLUX.2-dev
|
| 216 |
+
|
| 217 |
-
Pixeled LoRA @ 0.5
|
| 218 |
+
|
| 219 |
Pixelship Structured JSON
|
| 220 |
↓
|
| 221 |
Pixelship 2.0
|
| 222 |
```
|
| 223 |
|
| 224 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
- pixelship
|
| 11 |
- lora
|
| 12 |
- structured-prompts
|
| 13 |
+
- development
|
| 14 |
+
- experimental
|
| 15 |
---
|
| 16 |
|
| 17 |
+
> **⚠️ DEVELOPMENT PREVIEW**
|
| 18 |
+
>
|
| 19 |
+
> **Pixeled is currently in active development.** The files available in this repository represent an early development version of the model and are primarily intended for testing the Pixeled training approach and Pixelship 2.0 pipeline.
|
| 20 |
+
>
|
| 21 |
+
> **This is not the final or largest Pixeled model.** A larger, more extensively trained version of Pixeled is planned and will be uploaded later as development progresses.
|
| 22 |
+
>
|
| 23 |
+
> Expect the model, dataset, recommended settings, prompt format, and behavior to change between releases.
|
| 24 |
+
|
| 25 |
+
## HF Inference Providers aren't recommended to run the model, as the settings they enforce aren't ideal for Pixeled.
|
| 26 |
|
| 27 |
# Pixeled
|
| 28 |
|
|
|
|
| 32 |
|
| 33 |
**Pixeled** is the image-generation model being developed for **Pixelship 2.0**. It is a fine-tune of **FLUX.2-dev** designed to understand Pixelship's highly specific structured JSON prompts.
|
| 34 |
|
| 35 |
+
The version currently available is a **development build**. It exists to test the training format, structured-prompt understanding, generation quality, and integration with Pixelship 2.0 before the larger model is released.
|
| 36 |
+
|
| 37 |
Instead of only describing the general idea of an image, Pixelship can specify composition, individual objects, approximate positions, colors, backgrounds, typography, and other visual details. Pixeled is trained on this format so these instructions have a stronger influence over the final generation.
|
| 38 |
|
| 39 |
The goal is not to turn FLUX.2-dev into a deterministic renderer. Pixeled is still a generative image model. Instead, the goal is to make highly detailed prompting more useful, allowing Pixelship to communicate much more information about what an image should look like.
|
| 40 |
|
| 41 |
---
|
| 42 |
|
| 43 |
+
## Development Status
|
| 44 |
+
|
| 45 |
+
Pixeled is currently in the **development and experimentation stage**.
|
| 46 |
+
|
| 47 |
+
The model uploaded here should be considered a preview of the Pixeled approach rather than the final Pixelship 2.0 image model.
|
| 48 |
+
|
| 49 |
+
This version is being used to evaluate:
|
| 50 |
+
|
| 51 |
+
* Structured JSON prompt understanding
|
| 52 |
+
* Composition and object placement
|
| 53 |
+
* Typography and text rendering
|
| 54 |
+
* Complex multi-object generations
|
| 55 |
+
* Graphic design and website generation
|
| 56 |
+
* LoRA strength and inference settings
|
| 57 |
+
* Dataset quality
|
| 58 |
+
* Integration with the Pixelship 2.0 pipeline
|
| 59 |
+
|
| 60 |
+
A **larger Pixeled model** trained with more data and further refinement is planned for a later release.
|
| 61 |
+
|
| 62 |
+
Because of this, results from the current model should not be treated as representative of the final capabilities of Pixeled or Pixelship 2.0.
|
| 63 |
+
|
| 64 |
+
---
|
| 65 |
+
|
| 66 |
## Recommended Settings
|
| 67 |
|
| 68 |
+
The recommended settings are:
|
| 69 |
|
| 70 |
+
```json
|
| 71 |
{
|
| 72 |
"lora_scale": 0.5,
|
| 73 |
"guidance_scale": 5,
|
| 74 |
"seed": "random",
|
| 75 |
"num_inference_steps": 50
|
| 76 |
}
|
| 77 |
+
```
|
| 78 |
|
| 79 |
```text
|
| 80 |
FLUX.2-dev + Pixeled LoRA @ 0.5
|
|
|
|
| 84 |
|
| 85 |
At these settings, the base model can retain more of its original visual capabilities while Pixeled contributes its learned behavior for interpreting Pixelship's structured prompts.
|
| 86 |
|
| 87 |
+
Higher or lower values can still be experimented with, but `0.5` is currently recommended.
|
| 88 |
+
|
| 89 |
+
Because Pixeled is still under development, these settings may change in future releases.
|
| 90 |
|
| 91 |
---
|
| 92 |
|
| 93 |
## Technicals
|
| 94 |
|
| 95 |
+
| Property | Value |
|
| 96 |
+
| -------------------------- | ---------------------------------- |
|
| 97 |
+
| **Name** | Pixeled |
|
| 98 |
+
| **Development status** | Experimental / Development Preview |
|
| 99 |
+
| **Base model** | FLUX.2-dev |
|
| 100 |
+
| **Type** | Text-to-image fine-tune |
|
| 101 |
+
| **Current format** | LoRA |
|
| 102 |
+
| **Recommended LoRA scale** | `0.5` |
|
| 103 |
+
| **Prompt format** | Structured JSON |
|
| 104 |
+
| **Composition system** | 16×16 normalized planning grid |
|
| 105 |
+
| **Color representation** | Hexadecimal colors |
|
| 106 |
+
| **Object representation** | Nested structured objects |
|
| 107 |
+
| **Larger model** | Planned for a later release |
|
| 108 |
|
| 109 |
Pixeled's training prompts follow a structure similar to:
|
| 110 |
|
|
|
|
| 190 |
|
| 191 |
The training dataset includes multiple types of imagery, particularly material where detailed prompting is useful:
|
| 192 |
|
| 193 |
+
* Graphic design
|
| 194 |
+
* Posters
|
| 195 |
+
* Advertisements
|
| 196 |
+
* Websites
|
| 197 |
+
* UI and screenshots
|
| 198 |
+
* Realistic imagery
|
| 199 |
+
* Cinematic imagery
|
| 200 |
+
* Comics
|
| 201 |
+
* Illustrations
|
| 202 |
+
* Magazines
|
| 203 |
+
* Artwork
|
| 204 |
+
* Typography-heavy designs
|
| 205 |
+
* Complex multi-object scenes
|
| 206 |
|
| 207 |
This gives Pixeled examples of the structured format being applied across very different visual styles instead of training it around one narrow type of image.
|
| 208 |
|
| 209 |
+
The current development release does **not** represent the full planned training scale. Dataset size, diversity, training duration, and model behavior are expected to expand as development continues.
|
| 210 |
+
|
| 211 |
---
|
| 212 |
|
| 213 |
## Current Limitations
|
| 214 |
+
|
| 215 |
+
Although the development model can already produce strong results, it is **not a finished release** and currently has several known limitations.
|
| 216 |
|
| 217 |
### Very Big Paragraphs
|
| 218 |
|
| 219 |
+
Pixeled may produce gibberish or incorrect characters when asked to generate very large paragraphs of text.
|
| 220 |
+
|
| 221 |
+
Shorter pieces of typography generally provide a more realistic target for the current development model.
|
| 222 |
+
|
| 223 |
+
### Development Model
|
| 224 |
+
|
| 225 |
+
The currently uploaded weights are an early version of Pixeled.
|
| 226 |
+
|
| 227 |
+
They are intended to demonstrate and test the underlying approach rather than represent the maximum planned quality of the project.
|
| 228 |
+
|
| 229 |
+
### Prompt Sensitivity
|
| 230 |
|
| 231 |
+
Because Pixeled is learning a highly structured prompt format, changing inference settings or significantly changing the structure of the JSON may affect results.
|
| 232 |
+
|
| 233 |
+
The format itself may also continue to evolve during development.
|
| 234 |
+
|
| 235 |
+
---
|
| 236 |
|
| 237 |
## Using Pixeled with Pixelship 2.0
|
| 238 |
|
|
|
|
| 258 |
|
| 259 |
The separation allows Pixelship to reason about what should be generated before asking the image model to render it.
|
| 260 |
|
| 261 |
+
As both Pixelship 2.0 and Pixeled are still being developed, this pipeline may change before the final release.
|
| 262 |
+
|
| 263 |
+
---
|
| 264 |
+
|
| 265 |
+
## Future Releases
|
| 266 |
+
|
| 267 |
+
The current repository represents the **development stage of Pixeled**.
|
| 268 |
+
|
| 269 |
+
Development is continuing toward a larger model with expanded training and further refinement.
|
| 270 |
+
|
| 271 |
+
Future versions are expected to focus on:
|
| 272 |
+
|
| 273 |
+
* A larger training run
|
| 274 |
+
* More training data
|
| 275 |
+
* Better structured-prompt adherence
|
| 276 |
+
* Improved typography
|
| 277 |
+
* Better handling of complicated layouts
|
| 278 |
+
* More reliable object placement
|
| 279 |
+
* Better performance on graphic design and UI
|
| 280 |
+
* Improved handling of extremely detailed prompts
|
| 281 |
+
* Further Pixelship 2.0 integration
|
| 282 |
+
|
| 283 |
+
**The larger Pixeled model will be uploaded later.**
|
| 284 |
+
|
| 285 |
+
Until then, the currently available model should be treated as an experimental preview for testing, development, and evaluation.
|
| 286 |
+
|
| 287 |
---
|
| 288 |
|
| 289 |
## Conclusion
|
|
|
|
| 292 |
|
| 293 |
FLUX.2-dev provides the underlying image-generation capabilities, while the Pixeled fine-tune teaches the model how to better interpret the structured descriptions generated by Pixelship 2.0.
|
| 294 |
|
| 295 |
+
**The currently uploaded version is not the final Pixeled model.** It is an active development release intended to test the architecture, training data, prompting system, and Pixelship pipeline before a larger model is released.
|
| 296 |
|
| 297 |
+
Its prompts can be huge, its training images can be huge, and the format will continue to evolve as the model is tested.
|
| 298 |
+
|
| 299 |
+
The current recommended configuration is:
|
| 300 |
|
| 301 |
```text
|
| 302 |
FLUX.2-dev
|
| 303 |
+
|
| 304 |
+
Pixeled Development LoRA @ 0.5
|
| 305 |
+
|
| 306 |
Pixelship Structured JSON
|
| 307 |
↓
|
| 308 |
Pixelship 2.0
|
| 309 |
```
|
| 310 |
|
| 311 |
+
### Current
|
| 312 |
+
|
| 313 |
+
```text
|
| 314 |
+
Pixeled Development Preview
|
| 315 |
+
↓
|
| 316 |
+
Testing + Dataset Expansion
|
| 317 |
+
↓
|
| 318 |
+
Further Training
|
| 319 |
+
↓
|
| 320 |
+
Larger Pixeled Model
|
| 321 |
+
↓
|
| 322 |
+
Pixelship 2.0
|
| 323 |
+
```
|
| 324 |
+
|
| 325 |
+
**More detail. More control. Better images.**
|
| 326 |
+
|
| 327 |
+
> **Pixeled is still being built. The bigger model is coming later.**
|