| --- |
| base_model: |
| - Convence/Aroow-Rust-Coder-9B |
| base_model_relation: quantized |
| quantized_by: Atomic-Germ |
| language: |
| - en |
| library_name: q4nx |
| tags: |
| - rust |
| - code |
| - code-generation |
| - code-completion |
| - fill-in-the-middle |
| - reasoning |
| - function-calling |
| - vision |
| - qwen3.8-froggeric-v22.4 |
| - npu2 |
| - fastflowlm |
| - flm |
| - q4nx |
| - v1.0.1 |
| - qwen3.5 |
| --- |
| # Aroow-Rust-Coder-9B-NPU2 |
|
|
| **FastFlowLM Q4NX conversion of `Convence/Aroow-Rust-Coder-9B`** for AMD XDNA NPU inference. |
|
|
| This repository contains a quantized **Q4NX** port of the model, compiled for the FastFlowLM (FLM) runtime. It is **not** a GGUF file. |
|
|
| | Item | Value | |
| |------|-------| |
| | Source model | `Convence/Aroow-Rust-Coder-9B` | |
| | Weights | `model.q4nx` (7.11 GB) | |
| | Modality | language / vision | |
| | FLM version | `1.0.1` | |
| | Converted | 2026-08-28 | |
|
|
| ## Install and run |
|
|
| This repository works with `flm-add`, a small installer that copies the model |
| into the FastFlowLM user directory and registers the tag. It never |
| modifies the system FastFlowLM install. |
|
|
| `pip install flm-add` or `uv tool install flm-add` |
|
|
| ```bash |
| uv tool install flm-add |
| flm-add Atomic-Germ/Aroow-Rust-Coder-9B-NPU2 --family qwen3.5 |
| FLM_CONFIG_PATH="$HOME/.config/flm/model_list.json" FLM_XCLBIN_PATH="$HOME/.config/flm" flm run aroow-rust-coder:9b |
| ``` |
|
|
| ## Files |
|
|
| | File | Description | |
| |------|-------------| |
| | `model.q4nx` | Quantized weights (Q8_0 / Q4_1 / BF16) | |
| | `config.json` | FLM runtime configuration | |
| | `tokenizer.json` | Tokenizer vocabulary | |
| | `tokenizer_config.json` | Tokenizer configuration | |
| | `chat_template.jinja` | Chat template | |
| | `vision_weight.q4nx` | Vision model | |
|
|
|
|
| --- |
|
|
| ## Source model card |
|
|
| See the original model card: `Convence/Aroow-Rust-Coder-9B` on Hugging Face |
|
|
