Text Generation
MLX
English
German
next-concept-modeling
apple-silicon
diffusion-lm
research-code
negative-results
Instructions to use Red-fuchs/ncm-modular with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Red-fuchs/ncm-modular with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("Red-fuchs/ncm-modular") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use Red-fuchs/ncm-modular with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "Red-fuchs/ncm-modular" --prompt "Once upon a time"
- Atomic Chat
File size: 1,163 Bytes
b5731a6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 | [project]
name = "ncm-modular"
version = "0.1.0"
description = "MLX port of the NCM XSum/WMT14 codecs, surrogate masking, prefix-conditioned NCM generator training and a block-seam experiment (Apple Silicon)"
readme = "README.md"
license = "MIT"
requires-python = ">=3.11"
dependencies = [
"mlx==0.32.3",
"numpy",
"safetensors",
"transformers", # tokenizers (gpt2, Qwen3-0.6B) for codec round trips / MASSIVE pilot
"pyarrow", # massive_build.py reads the MASSIVE parquet files
"ncm-mlx==0.2.0", # janmus1c/ncm-mlx (MIT): official TinyStories codec, Block/rope/BPE used by the seam + generator code
]
[project.urls]
Homepage = "https://github.com/Red-fuchs/ncm-modular"
Repository = "https://github.com/Red-fuchs/ncm-modular"
"Hugging Face" = "https://huggingface.co/Red-fuchs/ncm-modular"
[project.optional-dependencies]
torch = ["torch", "omegaconf", "pyyaml"] # only convert.py / ref_dump.py / ref_torch.py (needs a HazyResearch/ncm checkout via NCM_UPSTREAM)
judge = ["mlx-lm"] # seam/judge.py
[tool.setuptools]
py-modules = [] # scripts, run as `python src/ncm_modular/<script>.py`; no installable package
|