EmilioSchwaiger commited on
Commit
5b05f2b
·
verified ·
1 Parent(s): 0f4091b

Release pixie-32

Browse files
Files changed (7) hide show
  1. LICENSE +215 -0
  2. NOTICE +37 -0
  3. README.md +89 -0
  4. config.json +15 -0
  5. model.safetensors +3 -0
  6. palette.npy +3 -0
  7. sample.png +0 -0
LICENSE ADDED
@@ -0,0 +1,215 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Copyright 2026 QuarkOS
2
+
3
+ Licensed under the Apache License, Version 2.0 (the "License");
4
+ you may not use this file except in compliance with the License.
5
+ You may obtain a copy of the License at
6
+
7
+ http://www.apache.org/licenses/LICENSE-2.0
8
+
9
+ Unless required by applicable law or agreed to in writing, software
10
+ distributed under the License is distributed on an "AS IS" BASIS,
11
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12
+ See the License for the specific language governing permissions and
13
+ limitations under the License.
14
+
15
+ Apache License
16
+ Version 2.0, January 2004
17
+ http://www.apache.org/licenses/
18
+
19
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
20
+
21
+ 1. Definitions.
22
+
23
+ "License" shall mean the terms and conditions for use, reproduction,
24
+ and distribution as defined by Sections 1 through 9 of this document.
25
+
26
+ "Licensor" shall mean the copyright owner or entity authorized by
27
+ the copyright owner that is granting the License.
28
+
29
+ "Legal Entity" shall mean the union of the acting entity and all
30
+ other entities that control, are controlled by, or are under common
31
+ control with that entity. For the purposes of this definition,
32
+ "control" means (i) the power, direct or indirect, to cause the
33
+ direction or management of such entity, whether by contract or
34
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
35
+ outstanding shares, or (iii) beneficial ownership of such entity.
36
+
37
+ "You" (or "Your") shall mean an individual or Legal Entity
38
+ exercising permissions granted by this License.
39
+
40
+ "Source" form shall mean the preferred form for making modifications,
41
+ including but not limited to software source code, documentation
42
+ source, and configuration files.
43
+
44
+ "Object" form shall mean any form resulting from mechanical
45
+ transformation or translation of a Source form, including but
46
+ not limited to compiled object code, generated documentation,
47
+ and conversions to other media types.
48
+
49
+ "Work" shall mean the work of authorship, whether in Source or
50
+ Object form, made available under the License, as indicated by a
51
+ copyright notice that is included in or attached to the work
52
+ (an example is provided in the Appendix below).
53
+
54
+ "Derivative Works" shall mean any work, whether in Source or Object
55
+ form, that is based on (or derived from) the Work and for which the
56
+ editorial revisions, annotations, elaborations, or other modifications
57
+ represent, as a whole, an original work of authorship. For the purposes
58
+ of this License, Derivative Works shall not include works that remain
59
+ separable from, or merely link (or bind by name) to the interfaces of,
60
+ the Work and Derivative Works thereof.
61
+
62
+ "Contribution" shall mean any work of authorship, including
63
+ the original version of the Work and any modifications or additions
64
+ to that Work or Derivative Works thereof, that is intentionally
65
+ submitted to Licensor for inclusion in the Work by the copyright owner
66
+ or by an individual or Legal Entity authorized to submit on behalf of
67
+ the copyright owner. For the purposes of this definition, "submitted"
68
+ means any form of electronic, verbal, or written communication sent
69
+ to the Licensor or its representatives, including but not limited to
70
+ communication on electronic mailing lists, source code control systems,
71
+ and issue tracking systems that are managed by, or on behalf of, the
72
+ Licensor for the purpose of discussing and improving the Work, but
73
+ excluding communication that is conspicuously marked or otherwise
74
+ designated in writing by the copyright owner as "Not a Contribution."
75
+
76
+ "Contributor" shall mean Licensor and any individual or Legal Entity
77
+ on behalf of whom a Contribution has been received by Licensor and
78
+ subsequently incorporated within the Work.
79
+
80
+ 2. Grant of Copyright License. Subject to the terms and conditions of
81
+ this License, each Contributor hereby grants to You a perpetual,
82
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
83
+ copyright license to reproduce, prepare Derivative Works of,
84
+ publicly display, publicly perform, sublicense, and distribute the
85
+ Work and such Derivative Works in Source or Object form.
86
+
87
+ 3. Grant of Patent License. Subject to the terms and conditions of
88
+ this License, each Contributor hereby grants to You a perpetual,
89
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
90
+ (except as stated in this section) patent license to make, have made,
91
+ use, offer to sell, sell, import, and otherwise transfer the Work,
92
+ where such license applies only to those patent claims licensable
93
+ by such Contributor that are necessarily infringed by their
94
+ Contribution(s) alone or by combination of their Contribution(s)
95
+ with the Work to which such Contribution(s) was submitted. If You
96
+ institute patent litigation against any entity (including a
97
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
98
+ or a Contribution incorporated within the Work constitutes direct
99
+ or contributory patent infringement, then any patent licenses
100
+ granted to You under this License for that Work shall terminate
101
+ as of the date such litigation is filed.
102
+
103
+ 4. Redistribution. You may reproduce and distribute copies of the
104
+ Work or Derivative Works thereof in any medium, with or without
105
+ modifications, and in Source or Object form, provided that You
106
+ meet the following conditions:
107
+
108
+ (a) You must give any other recipients of the Work or
109
+ Derivative Works a copy of this License; and
110
+
111
+ (b) You must cause any modified files to carry prominent notices
112
+ stating that You changed the files; and
113
+
114
+ (c) You must retain, in the Source form of any Derivative Works
115
+ that You distribute, all copyright, patent, trademark, and
116
+ attribution notices from the Source form of the Work,
117
+ excluding those notices that do not pertain to any part of
118
+ the Derivative Works; and
119
+
120
+ (d) If the Work includes a "NOTICE" text file as part of its
121
+ distribution, then any Derivative Works that You distribute must
122
+ include a readable copy of the attribution notices contained
123
+ within such NOTICE file, excluding those notices that do not
124
+ pertain to any part of the Derivative Works, in at least one
125
+ of the following places: within a NOTICE text file distributed
126
+ as part of the Derivative Works; within the Source form or
127
+ documentation, if provided along with the Derivative Works; or,
128
+ within a display generated by the Derivative Works, if and
129
+ wherever such third-party notices normally appear. The contents
130
+ of the NOTICE file are for informational purposes only and
131
+ do not modify the License. You may add Your own attribution
132
+ notices within Derivative Works that You distribute, alongside
133
+ or as an addendum to the NOTICE text from the Work, provided
134
+ that such additional attribution notices cannot be construed
135
+ as modifying the License.
136
+
137
+ You may add Your own copyright statement to Your modifications and
138
+ may provide additional or different license terms and conditions
139
+ for use, reproduction, or distribution of Your modifications, or
140
+ for any such Derivative Works as a whole, provided Your use,
141
+ reproduction, and distribution of the Work otherwise complies with
142
+ the conditions stated in this License.
143
+
144
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
145
+ any Contribution intentionally submitted for inclusion in the Work
146
+ by You to the Licensor shall be under the terms and conditions of
147
+ this License, without any additional terms or conditions.
148
+ Notwithstanding the above, nothing herein shall supersede or modify
149
+ the terms of any separate license agreement you may have executed
150
+ with Licensor regarding such Contributions.
151
+
152
+ 6. Trademarks. This License does not grant permission to use the trade
153
+ names, trademarks, service marks, or product names of the Licensor,
154
+ except as required for reasonable and customary use in describing the
155
+ origin of the Work and reproducing the content of the NOTICE file.
156
+
157
+ 7. Disclaimer of Warranty. Unless required by applicable law or
158
+ agreed to in writing, Licensor provides the Work (and each
159
+ Contributor provides its Contributions) on an "AS IS" BASIS,
160
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
161
+ implied, including, without limitation, any warranties or conditions
162
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
163
+ PARTICULAR PURPOSE. You are solely responsible for determining the
164
+ appropriateness of using or redistributing the Work and assume any
165
+ risks associated with Your exercise of permissions under this License.
166
+
167
+ 8. Limitation of Liability. In no event and under no legal theory,
168
+ whether in tort (including negligence), contract, or otherwise,
169
+ unless required by applicable law (such as deliberate and grossly
170
+ negligent acts) or agreed to in writing, shall any Contributor be
171
+ liable to You for damages, including any direct, indirect, special,
172
+ incidental, or consequential damages of any character arising as a
173
+ result of this License or out of the use or inability to use the
174
+ Work (including but not limited to damages for loss of goodwill,
175
+ work stoppage, computer failure or malfunction, or any and all
176
+ other commercial damages or losses), even if such Contributor
177
+ has been advised of the possibility of such damages.
178
+
179
+ 9. Accepting Warranty or Additional Liability. While redistributing
180
+ the Work or Derivative Works thereof, You may choose to offer,
181
+ and charge a fee for, acceptance of support, warranty, indemnity,
182
+ or other liability obligations and/or rights consistent with this
183
+ License. However, in accepting such obligations, You may act only
184
+ on Your own behalf and on Your sole responsibility, not on behalf
185
+ of any other Contributor, and only if You agree to indemnify,
186
+ defend, and hold each Contributor harmless for any liability
187
+ incurred by, or claims asserted against, such Contributor by reason
188
+ of your accepting any such warranty or additional liability.
189
+
190
+ END OF TERMS AND CONDITIONS
191
+
192
+ APPENDIX: How to apply the Apache License to your work.
193
+
194
+ To apply the Apache License to your work, attach the following
195
+ boilerplate notice, with the fields enclosed by brackets "[]"
196
+ replaced with your own identifying information. (Don't include
197
+ the brackets!) The text should be enclosed in the appropriate
198
+ comment syntax for the file format. We also recommend that a
199
+ file or class name and description of purpose be included on the
200
+ same "printed page" as the copyright notice for easier
201
+ identification within third-party archives.
202
+
203
+ Copyright 2026 QuarkOS
204
+
205
+ Licensed under the Apache License, Version 2.0 (the "License");
206
+ you may not use this file except in compliance with the License.
207
+ You may obtain a copy of the License at
208
+
209
+ http://www.apache.org/licenses/LICENSE-2.0
210
+
211
+ Unless required by applicable law or agreed to in writing, software
212
+ distributed under the License is distributed on an "AS IS" BASIS,
213
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
214
+ See the License for the specific language governing permissions and
215
+ limitations under the License.
NOTICE ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Pixie
2
+ Copyright 2026 Pixie contributors
3
+
4
+ This product (source code and the released Pixie model weights, pixie-32 and
5
+ pixie-16) is licensed under the Apache License, Version 2.0. See LICENSE.
6
+
7
+ -------------------------------------------------------------------------------
8
+ Krea 2 attribution
9
+ -------------------------------------------------------------------------------
10
+
11
+ The images used to train the Pixie models were generated with Krea 2 Turbo,
12
+ which is made available by Krea under the Krea 2 Community License:
13
+ https://github.com/krea-ai/krea-2/blob/main/docs/KREA-2-COMMUNITY-LICENSE
14
+
15
+ Those images are Outputs under that license. Per its section 5.3, Outputs are
16
+ owned by the party who generated them, and Krea claims no ownership of them.
17
+ Pixie is a separately designed and separately trained model family (66M-parameter
18
+ autoregressive transformers over palette indices). It contains no Krea weights,
19
+ parameters, or other components of the Krea Model, and no Krea weights are
20
+ distributed with this repository or with the Pixie model files. The Krea
21
+ sheet-generation scripts under data-pipeline/ load Krea 2 weights that you
22
+ download yourself under Krea's own license.
23
+
24
+ The 16x16 training corpus (also the P32 warm start), Angais/pixel-art-atlas-1.4m
25
+ (https://huggingface.co/datasets/Angais/pixel-art-atlas-1.4m, CC0-1.0), was
26
+ also generated with Krea 2 Turbo.
27
+
28
+ -------------------------------------------------------------------------------
29
+ Third-party components that are not redistributed here
30
+ -------------------------------------------------------------------------------
31
+
32
+ - CLIP ViT-L/14 text encoder (openai/clip-vit-large-patch14). Pixie uses its
33
+ text features as a frozen, external input; the weights are not shipped.
34
+ CLIP is released by OpenAI under the MIT License:
35
+ https://github.com/openai/CLIP/blob/main/LICENSE
36
+ - Qwen3-VL, Wan 2.1 VAE, and stable-diffusion.cpp, used only by the optional
37
+ sheet-generation scripts. Their licenses are upstream.
README.md ADDED
@@ -0,0 +1,89 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: pytorch
4
+ pipeline_tag: text-to-image
5
+ tags:
6
+ - pixel-art
7
+ - sprite-generation
8
+ - text-to-image
9
+ datasets:
10
+ - Angais/pixel-art-atlas-1.4m
11
+ ---
12
+
13
+ # Pixie P32 (pixie-32)
14
+
15
+ A 66M-parameter autoregressive model that paints native 32×32 palette-indexed pixel-art sprites from a short text prompt.
16
+ Code, training pipeline and sampler: [github.com/QuarkOS/pixie](https://github.com/QuarkOS/pixie).
17
+ Sibling model: [EmilioSchwaiger/pixie-16](https://huggingface.co/EmilioSchwaiger/pixie-16).
18
+
19
+ Files: `model.safetensors` (weights), `config.json` (architecture), `palette.npy` (4097×3 uint8 palette; index 0 is transparent).
20
+
21
+ ![Samples: red potion, iron helmet, green slime (4 each, seed 0, CFG 2.0)](sample.png)
22
+
23
+ ## Model
24
+
25
+ | Field | Value |
26
+ | --- | --- |
27
+ | Name | Pixie P32 (`pixie-32`) |
28
+ | Version | Best checkpoint of the first full P32 run: step 17,746, about 1.25M training images seen |
29
+ | Architecture | P32: autoregressive transformer over palette indices. Width 512, 16 layers, 8 heads, 2×2 patch tokens (256 patches of four palette slots), partial axial 2D-RoPE, three palette slots and one style slot. See the README. |
30
+ | Parameters | 66,424,320 (counted from the released `model.safetensors`; 224 float32 tensors) |
31
+ | Checkpoint SHA256 | `1a26888728f3c523075f691e4fddb270889e0a4db814c516da016709a06b9dbc` (`model.safetensors`) |
32
+ | Output | One 32×32 RGBA sprite per sample; index 0 is transparent |
33
+ | Text encoder | External, not shipped: the first 11 layers of the [openai/clip-vit-large-patch14](https://huggingface.co/openai/clip-vit-large-patch14) text model (penultimate features, 18 positions) |
34
+ | Intended use | Generate palette-indexed pixel-art game sprites (items, weapons, characters, creatures, props) from a short English prompt. |
35
+ | Out of scope | Photoreal images, text rendering, anything larger than 32×32, and subjects far outside game-sprite content. |
36
+
37
+ ## Training data
38
+
39
+ | Field | Value |
40
+ | --- | --- |
41
+ | Warm start | Initialised from the 16×16 Pixie v3 model, which was trained on about 1.4M CC0-1.0 rows of [Angais/pixel-art-atlas-1.4m](https://huggingface.co/datasets/Angais/pixel-art-atlas-1.4m) (synthetic 16×16 sprites). Shape-compatible tensors were copied and the position tables expanded. |
42
+ | P32 training set | About 130k native 32×32 sprites generated for this project with Krea 2 Turbo plus a pixel-art LoRA, cut from 3×3 sheets by `data-pipeline/extract_v2.py`. Not released. |
43
+ | License of the data | The atlas is CC0-1.0. The generated sprites are Krea 2 Outputs, owned by their generator per section 5.3 of the [Krea 2 Community License](https://github.com/krea-ai/krea-2/blob/main/docs/KREA-2-COMMUNITY-LICENSE). See [NOTICE](NOTICE). |
44
+ | Holdouts excluded | The Blind-50 and Eval-50 phrase lists were excluded from training by the builder's frozen-holdout check. The lists themselves are not published. |
45
+ | Personal data | None in the weights files. Captions are the generation prompts. |
46
+
47
+ ## Weights license
48
+
49
+ | Field | Value |
50
+ | --- | --- |
51
+ | License | Apache-2.0, the same as the code. See [LICENSE](LICENSE) and [NOTICE](NOTICE). |
52
+ | Inherited restrictions | None claimed. No Krea or CLIP weights are part of the release; CLIP (MIT) is downloaded separately at sampling time. |
53
+
54
+ ## Evaluation
55
+
56
+ | Field | Value |
57
+ | --- | --- |
58
+ | IID validation NLL | 0.5237 at the released step (lowest of the run, which is why this checkpoint was kept) |
59
+ | Blind-50 / Eval-50 | Not reported as a number for this release. |
60
+
61
+ ## Known limitations
62
+
63
+ - Stray magenta pixels: the training sheets used a magenta key background, and
64
+ some samples keep a few magenta background-key pixels near the edges.
65
+ - The run overfits after about 1.25M images; later checkpoints were worse on
66
+ IID NLL, so this is not the last checkpoint of the run.
67
+ - Needs the external CLIP ViT-L/14 text encoder, which is linked, not shipped.
68
+ - Quality varies by subject; many samples are rough. Treat it as a small
69
+ research model, not a finished asset generator.
70
+
71
+ ## How to sample
72
+
73
+ ```bash
74
+ git clone https://github.com/QuarkOS/pixie && cd pixie
75
+ python3 -m venv .venv && . .venv/bin/activate
76
+ pip install torch numpy pillow tokenizers safetensors huggingface_hub
77
+ hf download EmilioSchwaiger/pixie-32 --local-dir pixie-32
78
+ hf download openai/clip-vit-large-patch14 model.safetensors tokenizer.json --local-dir clip-vit-large-patch14
79
+ python -m train.sample_pixie --model-dir pixie-32 \
80
+ --clip clip-vit-large-patch14/model.safetensors \
81
+ --tokenizer clip-vit-large-patch14/tokenizer.json \
82
+ --prompt "red potion" --prompt "iron helmet" --n 4 --out sprites.png
83
+ ```
84
+
85
+ Each row of `sprites.png` is one prompt (32×32 sprites, upscaled with nearest-neighbour).
86
+
87
+ ## License
88
+
89
+ Apache-2.0 for the weights. See [LICENSE](LICENSE) and [NOTICE](NOTICE) (Krea 2 attribution and third-party credits).
config.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "arch": "p32",
3
+ "d_model": 512,
4
+ "n_layer": 16,
5
+ "n_head": 8,
6
+ "ffn_mult": 4,
7
+ "dropout": 0.1,
8
+ "head_mult": 2,
9
+ "text_len": 18,
10
+ "n_pal": 3,
11
+ "style": true,
12
+ "image_size": 32,
13
+ "text_encoder": "openai/clip-vit-large-patch14 (text model, first 11 layers)",
14
+ "palette_file": "palette.npy"
15
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a26888728f3c523075f691e4fddb270889e0a4db814c516da016709a06b9dbc
3
+ size 265717176
palette.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bad6e5a7e34f663c0233119807a9840dd966b6c4f1b847f6fc166bf476fdf6dc
3
+ size 12419
sample.png ADDED