Image-Text-to-Text
MLX
Safetensors
qwen3_5
apple-silicon
agents
coding-agent
opencode
lora
conversational
3-bit
Instructions to use netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit") config = load_config("netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
|
Download README.md from netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit: direct link, hf CLI and curl.
- Browser
- Download file 8.08 kB
-
https://huggingface.co/netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit/resolve/main/README.md
- Command line
-
hf download hf://netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit/README.md
-
curl -L -o README.md https://huggingface.co/netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit/resolve/main/README.md
8.08 kB
| license: apache-2.0 | |
| base_model: harness-hub/Qwen3.8-27B-opencode-adapted | |
| base_model_relation: quantized | |
| pipeline_tag: image-text-to-text | |
| library_name: mlx | |
| tags: | |
| - mlx | |
| - apple-silicon | |
| - agents | |
| - coding-agent | |
| - opencode | |
| - lora | |
| # Qwen3.8-27B-opencode-adapted for Apple Silicon (MLX, 3-bit) | |
| [harness-hub/Qwen3.8-27B-opencode-adapted](https://huggingface.co/harness-hub/Qwen3.8-27B-opencode-adapted) (revision `b4171c0`) merged into | |
| [Qwen/Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B) (revision `3756181`) and converted to MLX with mlx-vlm, vision | |
| encoder and Qwen's MTP layer included. In this build most linear layers are quantized to 3-bit (affine, group 64); the token embedding, the output layer and the more sensitive v_proj / down_proj layers (the first and last eight layers and every third layer in between) are 4-bit, about 3.9 bits per weight overall. Size: 13.8 GB. | |
| harness-hub trained this LoRA with reinforcement learning (AsyncGRPO in TRL) to be the model behind the | |
| [OpenCode](https://opencode.ai) coding agent on software-engineering and terminal tasks. Their published results, under | |
| OpenCode with thinking off: **SWE-bench Pro (hard 51) 35.3% → 51.0%** and **Terminal-Bench 2.1 46.4% → 52.4%** against | |
| the base model, and with thinking off it matches the base model thinking at its highest effort while generating about | |
| a sixth of the tokens. See the [original adapter card](https://huggingface.co/harness-hub/Qwen3.8-27B-opencode-adapted) | |
| for the method, data and full results. | |
| | Build | Size | Same next token as bf16 | KL vs bf16 | | |
| |---|---|---|---| | |
| | [netprojects/Qwen3.8-27B-opencode-adapted-MLX-6bit](https://huggingface.co/netprojects/Qwen3.8-27B-opencode-adapted-MLX-6bit) (recommended) | 23.1 GB | 98.7% | 0.0014 | | |
| | [netprojects/Qwen3.8-27B-opencode-adapted-MLX-8bit](https://huggingface.co/netprojects/Qwen3.8-27B-opencode-adapted-MLX-8bit) | 30.0 GB | 99.2% | 0.0004 | | |
| | [netprojects/Qwen3.8-27B-opencode-adapted-MLX-4bit](https://huggingface.co/netprojects/Qwen3.8-27B-opencode-adapted-MLX-4bit) | 16.3 GB | 96.7% | 0.0203 | | |
| | [netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit](https://huggingface.co/netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit) | 13.8 GB | 93.4% | 0.0812 | | |
| | [netprojects/Qwen3.8-27B-opencode-adapted-MLX-bf16](https://huggingface.co/netprojects/Qwen3.8-27B-opencode-adapted-MLX-bf16) | 55.6 GB | reference | reference | | |
| | [netprojects/Qwen3.8-27B-opencode-adapted-MLX-adapter](https://huggingface.co/netprojects/Qwen3.8-27B-opencode-adapted-MLX-adapter) | 638 MB | LoRA only, for mlx-lm | on any Qwen3.8-27B MLX build | | |
| The 6-bit build is the recommended balance of size and fidelity; 8-bit is closest to bf16; 4-bit and 3-bit are for Macs with less memory (3-bit fits 24 GB Macs). | |
| ## Use with OpenCode | |
| The adapter was trained and evaluated with **thinking off**, so keep it off. Serve the model with mlx-lm's | |
| OpenAI-compatible server: | |
| ```bash | |
| pip install -U "mlx-lm>=0.32.2" | |
| mlx_lm.server --model netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit --port 8000 \ | |
| --chat-template-args '{"enable_thinking": false}' | |
| ``` | |
| Add it to `~/.config/opencode/opencode.json`: | |
| ```json | |
| { | |
| "$schema": "https://opencode.ai/config.json", | |
| "provider": { | |
| "local": { | |
| "npm": "@ai-sdk/openai-compatible", | |
| "options": { "baseURL": "http://localhost:8000/v1", "apiKey": "dummy" }, | |
| "models": { "netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit": {} } | |
| } | |
| } | |
| } | |
| ``` | |
| ```bash | |
| opencode run --model local/netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit "Find out why the tests in tests/test_parser.py fail and fix the bug." | |
| ``` | |
| ## Use from Python | |
| Text only, with mlx-lm: | |
| ```python | |
| from mlx_lm import load, generate | |
| model, tokenizer = load("netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit") | |
| messages = [{"role": "user", "content": "Write a Python function that parses '1.5M' into bytes."}] | |
| prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, enable_thinking=False, tokenize=False) | |
| print(generate(model, tokenizer, prompt=prompt, max_tokens=512)) | |
| ``` | |
| With images, with mlx-vlm: | |
| ```bash | |
| pip install -U "mlx-vlm>=0.7.11" | |
| mlx_vlm.generate --model netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit --image screenshot.png \ | |
| --prompt "What error does this terminal show?" --max-tokens 300 # thinking stays off unless --enable-thinking | |
| ``` | |
| The tokenizer and chat template are harness-hub's files, unchanged (same vocabulary and tool-call format as Qwen3.8-27B). | |
| Tool calls use Qwen's XML format (`<tool_call><function=...><parameter=...>`), which mlx-lm's server returns as | |
| OpenAI `tool_calls`. | |
| ## Faster decoding with MTP | |
| This build keeps Qwen3.8-27B's own multi-token-prediction (MTP) layer in `model-mtp.safetensors`, quantized to 8-bit and | |
| declared in `config.json` as `mtplx_mtp_quantization`. The adapter does not change that layer. mlx-vlm uses it as a built-in | |
| draft model when you pass the same repository as `--draft-model`: | |
| ```bash | |
| mlx_vlm.generate --model netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit --draft-model netprojects/Qwen3.8-27B-opencode-adapted-MLX-3bit \ | |
| --draft-kind mtp --temperature 0 --max-tokens 512 --prompt "Write a Python function that checks whether a number is prime." | |
| ``` | |
| Every drafted token is checked by the full model. With greedy decoding the text matches plain decoding until a near-tie, | |
| where the batched check can round the other way, so long answers can diverge slightly. | |
| ## What was checked | |
| On a MacBook Pro M5 Max (128 GB), 19 November 2026, with mlx 0.32.4, mlx-lm 0.32.2 and mlx-vlm 0.7.11. The build was made from | |
| [netprojects/Qwen3.8-27B-opencode-adapted-MLX-bf16](https://huggingface.co/netprojects/Qwen3.8-27B-opencode-adapted-MLX-bf16) (every file checked against the Hub's SHA-256 hashes). | |
| - **Quantization.** The build is checked to be exactly the affine (group 64) quantization of the bf16 build, with the bit widths described above. | |
| - **Agreement with bf16** (12 short prompts, 9 with thinking off and 3 with thinking on, 949 teacher-forced positions): same next token as bf16 on 93.4% of positions (mean KL 0.0812). | |
| - **Tool calling and coding** (thinking off, the included chat template): one agent-style prompt with `bash` and `read` tools produced a well-formed tool call; three short Python tasks run against asserts: 3/3. | |
| - **GSM8K, 50 fixed test questions** (thinking off, greedy, 512-token cap): 45/50, against 47/50 for the bf16 build. | |
| - **Thinking** (two short maths prompts): the reply closes `</think>` once and the answer is right: 2/2. | |
| - **Memory.** Peak 14.6 GB with an 8K-token prompt (mlx-lm, text), so a Mac with 24 GB+ of memory runs it with the default GPU memory limit (about two thirds of RAM up to 36 GB). On a Mac just below that you can raise the limit until the next restart (`sudo sysctl iogpu.wired_limit_mb=...`), leaving several GB for macOS, and use short contexts. | |
| - **Vision** (mlx-vlm): asked to name the shapes and colours in a test image, the build answered correctly and answered a text-only question in the same session. | |
| - **MTP layer.** The bundled MTP tensors equal Qwen3.8-27B's `mtp.*` weights quantized to 8-bit; the build loads in mlx-lm and mlx-vlm with the extra file present and decodes with its bundled MTP head. | |
| ## Credits | |
| The adapter is by harness-hub; the base model is Qwen3.8-27B by the Qwen Team, Alibaba Cloud. If you use the model, | |
| please cite their work (see the [adapter card](https://huggingface.co/harness-hub/Qwen3.8-27B-opencode-adapted) and the | |
| [Qwen3.8-27B card](https://huggingface.co/Qwen/Qwen3.8-27B)). | |
| ## License | |
| Apache-2.0, as Qwen3.8-27B and the harness-hub adapter. `LICENSE` is the Apache-2.0 text from the Qwen3.8-27B repository | |
| and `NOTICE` describes the conversion and credits harness-hub and the Qwen Team (Alibaba Cloud). | |
| Published by [NetProjects](https://netprojects.com) (Internet Projects Ltd). Not affiliated with Hugging Face, harness-hub or Alibaba. | |
| More MLX builds from NetProjects: [huggingface.co/netprojects](https://huggingface.co/netprojects) · [netprojects.com](https://netprojects.com) | |