Atomic-Germ's picture
Upload README.md with huggingface_hub
be4efdd verified
|
Raw History Blame Contribute Delete
1.75 kB
metadata
base_model:
  - Convence/Aroow-Rust-Coder-9B
base_model_relation: quantized
quantized_by: Atomic-Germ
language:
  - en
library_name: q4nx
tags:
  - rust
  - code
  - code-generation
  - code-completion
  - fill-in-the-middle
  - reasoning
  - function-calling
  - vision
  - qwen3.8-froggeric-v22.4
  - npu2
  - fastflowlm
  - flm
  - q4nx
  - v1.0.1
  - qwen3.5

Aroow-Rust-Coder-9B-NPU2

FastFlowLM Q4NX conversion of Convence/Aroow-Rust-Coder-9B for AMD XDNA NPU inference.

This repository contains a quantized Q4NX port of the model, compiled for the FastFlowLM (FLM) runtime. It is not a GGUF file.

Item Value
Source model Convence/Aroow-Rust-Coder-9B
Weights model.q4nx (7.11 GB)
Modality language / vision
FLM version 1.0.1
Converted 2026-08-28

Install and run

This repository works with flm-add, a small installer that copies the model into the FastFlowLM user directory and registers the tag. It never modifies the system FastFlowLM install.

pip install flm-add or uv tool install flm-add

uv tool install flm-add
flm-add Atomic-Germ/Aroow-Rust-Coder-9B-NPU2 --family qwen3.5
FLM_CONFIG_PATH="$HOME/.config/flm/model_list.json" FLM_XCLBIN_PATH="$HOME/.config/flm" flm run aroow-rust-coder:9b

Files

File Description
model.q4nx Quantized weights (Q8_0 / Q4_1 / BF16)
config.json FLM runtime configuration
tokenizer.json Tokenizer vocabulary
tokenizer_config.json Tokenizer configuration
chat_template.jinja Chat template
vision_weight.q4nx Vision model

Source model card

See the original model card: Convence/Aroow-Rust-Coder-9B on Hugging Face