How to use GeneLab/3LM-MLX with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("GeneLab/3LM-MLX") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True)
How to use GeneLab/3LM-MLX with MLX LM:
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "GeneLab/3LM-MLX" --prompt "Once upon a time"
0fb999f
1
2
3
4
5
6
7
8
9
10
11
12
{ "vocab_size": 32000, "block_size": 512, "n_layer": 6, "n_head": 8, "n_embd": 512, "dropout": 0.05, "arch": "3lm", "mlp_hidden": 1408, "rope_theta": 10000.0, "norm_eps": 1e-05 }
