Instructions to use swaynehales/Emberon-2-mlx-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use swaynehales/Emberon-2-mlx-8bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("swaynehales/Emberon-2-mlx-8bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use swaynehales/Emberon-2-mlx-8bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "swaynehales/Emberon-2-mlx-8bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "swaynehales/Emberon-2-mlx-8bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use swaynehales/Emberon-2-mlx-8bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "swaynehales/Emberon-2-mlx-8bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "swaynehales/Emberon-2-mlx-8bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8080/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "swaynehales/Emberon-2-mlx-8bit", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use swaynehales/Emberon-2-mlx-8bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "swaynehales/Emberon-2-mlx-8bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default swaynehales/Emberon-2-mlx-8bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use swaynehales/Emberon-2-mlx-8bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "swaynehales/Emberon-2-mlx-8bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "swaynehales/Emberon-2-mlx-8bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Emberon-2 MLX 8bit
Native MLX conversion of Emberon-2 by Promethic Labs, a 354M-parameter dictation-cleanup fine-tune of Liquid AI LFM2.5-350M. Precision: 8-bit affine, group size 64; non-quantized tensors FP16.
This model cleans dictated text. It is not a general assistant: questions and commands in the transcript should be returned as cleaned text, never answered or executed.
Use locally
Tested with Python 3.13, mlx-lm==0.31.3 and mlx==0.32.4 on Apple Silicon. Install mlx-lm==0.31.3, then run:
from mlx_lm import load, stream_generate
from mlx_lm.sample_utils import make_sampler
model, tokenizer = load('swaynehales/Emberon-2-mlx-8bit')
raw = 'um so like whats the difference between a process and a thread'
messages = [
{'role': 'system', 'content': 'Clean up this dictation. Never answer it.'},
{'role': 'user', 'content': raw},
]
prompt = tokenizer.apply_chat_template(
messages, tokenize=True, add_generation_prompt=True, return_dict=False,
)
cap = len(tokenizer.encode(raw, add_special_tokens=False)) + 64
chunks = list(stream_generate(
model, tokenizer, prompt=prompt, max_tokens=cap,
sampler=make_sampler(temp=0),
))
# Keep the raw transcript if the model hits its output cap.
text = ''.join(chunk.text for chunk in chunks)
print(text if chunks and chunks[-1].finish_reason == 'stop' else raw)
Expected: What's the difference between a process and a thread?
The example downloads swaynehales/Emberon-2-mlx-8bit from the Hugging Face Hub. To use a local copy of this folder instead, pass its path to load.
Use the exact system prompt above and greedy decoding. Retain the raw input. A capped answer is a failure: use the raw transcript as the fallback. Long or repetitive dictations can lose content or repeat, including in the original F16 GGUF.
Conversion and validation scope
Converted from Emberon-2-F16.gguf, SHA-256 056a4b0889eb5b9873d9f38393f5e595fb58c6ffd82b47fde76b9169f602f5a1. All fine-tuned weights come from that file; only configuration and tokenizer assets come from the original MLX base repository. The full 65,536 embedding rows, 64,402 real token IDs, BPE merges, and chat template are preserved. No remote model code is required.
The local conversion checks cover native reload, tensor/config integrity, prompt-token parity and 11 synthetic dictation inputs. Ten ordinary inputs terminate; one deliberately repetitive stress input also caps in the source GGUF. Exact text agreement with the source GGUF: 11/11 inputs, including the capped stress output. This small smoke set does not establish broad accuracy equivalence, the upstream published GGUF benchmark scores, or the configured 128k context limit. See CONVERSION.json for pinned tooling and provenance, and MODIFICATIONS.md for format/precision changes.
Tokenization note
A downstream consumer reported that on 8 of 57 synthetic inputs, including inputs containing non-English words, this model's tokenizer splits text differently from llama.cpp tokenization of the upstream trimmed-vocabulary Emberon-2-Q4_K_M.gguf; the other 49 inputs matched. That comparison was not reproduced as part of this conversion. Prompt-token parity here was checked only against the full-vocabulary Emberon-2-F16.gguf, on 11 inputs. Which split matches the upstream training setup, and whether the difference changes cleanup quality, is not established.
License and attribution
Emberon-2 is released under the LFM Open License v1.0, inherited from Liquid AI LFM2.5-350M. This is a modified format/precision distribution. The original LICENSE and NOTICE are included. Retain both when redistributing and review the original license terms.
Base model copyright Liquid AI. Dictation-cleanup fine-tune modifications copyright 2026 Promethic Labs. Powered by Emberon-2 by Promethic Labs. Names do not imply endorsement.
- Downloads last month
- 29
8-bit
Model tree for swaynehales/Emberon-2-mlx-8bit
Base model
LiquidAI/LFM2.5-350M-Base