BudgetPix-MiniT2I / README.md
ozgurkara's picture
Card: the usage downloads config.json with the weights
04b9c46 verified
|
Raw History Blame Contribute Delete
3.02 kB
metadata
license: mit
base_model: MiniT2I/MiniT2I
base_model_relation: finetune
pipeline_tag: text-to-image
tags:
  - budgetany
  - budgetpix
  - adaptive-tokenization
  - diffusion
  - text-to-image
  - pixel-space

BudgetPix-MiniT2I

🌐 Project page  |  💻 Code  |  📄 Paper  |  🧩 BudgetAny

One checkpoint, any token budget. Text-to-image generation at 512 x 512 in pixel space with MiniT2I, fine-tuned with BudgetPix compute-adaptive tokenization. At inference you choose how many tokens the diffusion transformer runs on: an entropy-based detail map merges the flattest regions into coarse tokens first and gives the fine tokens to the most detailed ones. The same weights serve every budget.

Unofficial, open-source implementation, taken from budgetpix/BudgetPix-public: a public reimplementation of BudgetPix: compute-adaptive tokenization for pixel-space image diffusion (JiT, MiniT2I, PixelDiT, pMF). This model is part of BudgetAny, a community reimplementation of BudgetPix (Kara et al., 2026). It is not an official release. Thanks to the BudgetPix authors for the method.

Files

file base model dense tokens parameters size SHA-256
budgetpix_minit2i_b_512.pt MiniT2I-B/16, 512 px 1,024 260 M 1.04 GB 84517824ac2f823e…
budgetpix_minit2i_l_512.pt MiniT2I-L/16, 512 px 1,024 915 M 3.66 GB 3868f0a4faa6ff48…

SHA256SUMS lists the full checksums. The text encoder (google/flan-t5-large) is downloaded from the Hub on first use.

Usage

git clone https://github.com/BudgetAny/BudgetPix && cd BudgetPix    # setup: see README.md
hf download BudgetAny/BudgetPix-MiniT2I budgetpix_minit2i_l_512.pt config.json --local-dir weights
python -m budgetpix.minit2i.sample --ckpt weights/budgetpix_minit2i_l_512.pt --prompts "a corgi in a spacesuit" --budget 512 --cfg 6.0

--budget is the number of tokens per image (1,024 is the dense grid). Default guidance 5.0 (6.0 recommended for L, 2.5-5.0 for B at the dense grid; about 7.0 at 25 % of the grid).

Citation

If you use this model or the code, please cite the BudgetPix paper:

@article{kara2026budgetpix,
  title={BudgetPix: Compute-Adaptive Tokenization for Pixel-Space Image Diffusion},
  author={Ozgur Kara and Yujia Chen and Daniel Watson and David Forsyth and James Matthew Rehg and Wen-Sheng Chu and Du Tran},
  journal={arXiv preprint arXiv:2610.12307},
  year={2026}
}

Built on MiniT2I and APT.

License

MIT, like the MiniT2I weights it derives from.