Image-Text-to-Text
MLX
Safetensors
prism_hadamard_qwen35
zen6
hanzo
zenlm
apple-silicon
ternary
2-bit
mcp
multimodal
conversational
Instructions to use hanzoai/zen6-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use hanzoai/zen6-mlx with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("hanzoai/zen6-mlx") config = load_config("hanzoai/zen6-mlx") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use hanzoai/zen6-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "hanzoai/zen6-mlx"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "hanzoai/zen6-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use hanzoai/zen6-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "hanzoai/zen6-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default hanzoai/zen6-mlx
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use hanzoai/zen6-mlx with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "hanzoai/zen6-mlx"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "hanzoai/zen6-mlx" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download eval_report.json from hanzoai/zen6-mlx: direct link, hf CLI and curl.
- Browser
- Download file 1.02 kB
-
https://huggingface.co/hanzoai/zen6-mlx/resolve/main/eval_report.json
- Command line
-
hf download hf://hanzoai/zen6-mlx/eval_report.json
-
curl -L -o eval_report.json https://huggingface.co/hanzoai/zen6-mlx/resolve/main/eval_report.json
1.02 kB
| { | |
| "size": "27B", | |
| "steps": 24, | |
| "initial_ce_loss": 2.3220329582691193, | |
| "final_ce_loss": 0.9597274884581566, | |
| "mean_updated_trit_pct": 0.3937289553009164, | |
| "max_layer_updated_trit_pct": 0.8854071609675884, | |
| "gguf_eval": { | |
| "identity_nothink": "I'm **Zen 6** (`zen6`), an open-weight Apache-2.0 ternary model built by **Hanzo AI** (`hanzoai`) and **Zen LM**. [end of text]", | |
| "identity_think": "Answer directly as Zen 6 (zen6) by Hanzo AI & Zen LM.\n</think>\n\nI'm **Zen 6** (`zen6`), an open-weight Apache-2.0 ternary model built by **Hanzo AI** and **Zen LM**. [end of text]", | |
| "mcp_tool_call": "<tool_call>\n<function=fs>\n<parameter=action>\nread\n</parameter>\n<parameter=path>\nCargo.toml\n</parameter>\n</function>\n</tool_call> [end of text]", | |
| "persona_mara": "Our perimeter sensors went dark twenty minutes ago and the northern relay went dark with them. Keep your voice down and tell me if the fog has reached the northern relay yet. [end of text]" | |
| }, | |
| "pre_eval": {}, | |
| "post_eval": {} | |
| } |