Text Generation
MLX
English
German
next-concept-modeling
apple-silicon
diffusion-lm
research-code
negative-results
Instructions to use Red-fuchs/ncm-modular with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Red-fuchs/ncm-modular with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("Red-fuchs/ncm-modular") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use Red-fuchs/ncm-modular with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "Red-fuchs/ncm-modular" --prompt "Once upon a time"
- Atomic Chat
File size: 1,639 Bytes
b5731a6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 | ncm-modular
This package is an independent third-party work. It is not affiliated with or endorsed by HazyResearch / Stanford or the NCM authors.
Upstream credit
- Method, architecture, released checkpoints and reference implementation:
"Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation", H. Kumbong et al., arXiv:2610.14162 (2026).
Code: https://github.com/HazyResearch/ncm (MIT, Copyright (c) 2025 Hermann Kumbong).
Checkpoints: https://huggingface.co/hazyresearch/ncm-checkpoints (MIT per upstream; not redistributed here).
- MLX re-implementation used as a dependency (Block, rope tables, BPE, TinyStories codec, checkpoint conversion):
https://github.com/janmus1c/ncm-mlx (MIT). Installed from PyPI/git, not copied.
- codec_mlx.py is our own MLX port of the XSum/WMT14 codec variant, written against the upstream PyTorch model
(models/vqvae.py) as numerical reference. convert.py / ref_torch.py / ref_dump.py import the upstream PyTorch modules from a
separate checkout (NCM_UPSTREAM); upstream source is NOT vendored. If you vendor it, keep the upstream MIT notice.
- Datasets are used for derived metrics only and are not redistributed: MASSIVE (CC BY 4.0, Amazon Science, FitzGerald et al. 2022),
TinyStories (Eldan & Li 2023; CDLA-Sharing-1.0: short modified gold excerpts are included in results/seam/samples.md under that license, see the file header), XSum / WMT14 (only through the pretrained upstream codecs).
Made as a human-AI collaboration: direction and decisions by the human author, code, experiments and docs largely by Claude (Anthropic) agents.
See LICENSES.md for the full audit.
|