hazyresearch/ncm-checkpoints

NCM checkpoints

Released tokenizer and generator pairs for Next-Concept Modeling. Each folder holds a config.yaml with the architecture and sampling settings and the .pt checkpoints it names.

folder	task
xsum/	XSum summarization
wmt14/	WMT14 German-English translation
sudoku/	Sudoku, easy / medium / hard
lm1b/	One Billion Word, small / medium / large with a shared tokenizer
tinystories/	TinyStories
owt/	OpenWebText

Citation

@misc{kumbong2026nextconcept,
  title   = {Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation},
  author  = {Kumbong, Hermann and Khare, Ishan S. and Mlauzi, Iddah and Woen, Andrew and Ding, Charles and Buchanan, E. Kelly and Arora, Simran and Mirhoseini, Azalia and R{\'e}, Christopher},
  year    = {2026},
  eprint={2610.14162},
  archivePrefix={arXiv},
  primaryClass={cs.CL},
  url={https://arxiv.org/abs/2610.14162},
}