TYTTYTTYT/llama-pixar-477m-p32-stage2
Text Generation • 0.5B • Updated • 158
Multilingual pixel-based language models from the MIXAR paper, plus the MGPT-2 baseline. Code: github.com/april-tools/mixar
Note Recommended. 477M, 32x32 patches, stage 2 (GRPO). The strongest generator.
Note 116M, 32x32 patches, stage 2 (GRPO).
Note 113M, 8x8 patches, stage 2 (GRPO).
Note 477M, 32x32 patches, stage-1 backbone.
Note 116M, 32x32 patches, stage-1 backbone.
Note 113M, 8x8 patches, stage-1 backbone.
Note Ablation: adversarial (GAN) stage 2 of the 113M 8x8 model.
Note Baseline: GPT-2 124M pretrained on the same mC4 corpus.