Image-Text-to-Text
MLX
Safetensors
qwen3_5
clairic
cloudflare
systemone
structured-output
information-extraction
multimodal
custom-code
conversational
4-bit precision
Instructions to use mlx-community/clairic-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/clairic-4bit with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("mlx-community/clairic-4bit") config = load_config("mlx-community/clairic-4bit") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use mlx-community/clairic-4bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/clairic-4bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "mlx-community/clairic-4bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use mlx-community/clairic-4bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/clairic-4bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default mlx-community/clairic-4bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use mlx-community/clairic-4bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/clairic-4bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "mlx-community/clairic-4bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download NOTICE from mlx-community/clairic-4bit: direct link, hf CLI and curl.
- Browser
- Download file 1.73 kB
-
https://huggingface.co/mlx-community/clairic-4bit/resolve/main/NOTICE
- Command line
-
hf download hf://mlx-community/clairic-4bit/NOTICE
-
curl -L -o NOTICE https://huggingface.co/mlx-community/clairic-4bit/resolve/main/NOTICE
1.73 kB
| Clairic for MLX | |
| This repository is a derivative of Cloudflare's Clairic release | |
| (https://huggingface.co/Cloudflare/clairic and https://huggingface.co/Cloudflare/clairic-flash), | |
| Copyright 2026 Cloudflare, Inc., licensed under the Apache License, Version 2.0 (see LICENSE). | |
| Clairic is fine-tuned from Qwen models by the Qwen Team, also released under Apache-2.0. | |
| Changes made for this MLX port: | |
| - The model weights were converted to the MLX format and the language model's linear layers, token embedding | |
| and vocabulary head were quantized (see README.md for the exact recipe). The typed head | |
| (`clair_head.safetensors`) is the upstream file, unchanged. | |
| - `clairic_runtime/` is the upstream request pipeline with its PyTorch engine replaced: | |
| - removed: `native.py`, `math.py`, `readout.py`, `normalization.py`, `kernels.py`, `gdn/`, `gdn_pool.py`, | |
| `decoder_capture.py`, `decoder_graph.py`, `vision_cache.py`, `attention_metadata.py`, | |
| `recurrent_metadata.py` (PyTorch, Triton and CUDA code); | |
| - added: `mlx_engine.py` (MLX backbone loop, typed head, grammar-constrained decoding) and `processor.py` | |
| (a torch-free processor); | |
| - modified: `model.py` (typed head moved to `mlx_engine.py`; tensor code ported from PyTorch to NumPy), | |
| `backend.py` (`media_payload` and `load`) and `__init__.py` (docstring). Each modified file says so | |
| at its top. All other files in `clairic_runtime/` are unchanged. | |
| - `clairic_mlx.py` replaces `clairic_model.py`; `server.py` and `convert.py` are new. | |
| The MLX backbone uses mlx-vlm's `qwen3_5` model definition (https://github.com/Blaizzy/mlx-vlm, MIT License, | |
| Copyright (c) Prince Canuma); the linear-attention layer loop in `mlx_engine.py` follows that implementation. | |