qwen3.5-4B-super-coder MLX 4-bit

MLX 4-bit build of jica98/qwen3.5-4B-super-coder. The source repo only ships the LoRA adapter and GGUF exports, so this was built by:

  1. Loading unsloth/Qwen3.5-4B
  2. Merging the jica98/qwen3.5-4B-super-coder LoRA adapter with Qwen3_5ForConditionalGeneration
  3. Converting the merged Hugging Face model to MLX
  4. Quantizing to 4-bit with mlx-lm No additional training was done.

Use

pip install -U mlx-lm
mlx_lm.generate \
  --model snsnc/qwen3.5-4B-super-coder-MLX-4bit \
  --max-tokens 2048 \
  --temp 0.7 \
  --top-p 0.8 \
  --top-k 20 \
  --chat-template-config '{"enable_thinking":false}' \
  --prompt "Write only executable Python code. Implement an async token-bucket rate limiter."

Thinking is enabled by the upstream chat template unless explicitly disabled.
Downloads last month
584
Safetensors
Model size
4B params
Tensor type
U32
ยท
BF16
ยท
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for snsnc/qwen3.5-4B-super-coder-MLX-4bit

Finetuned
Qwen/Qwen3.5-4B
Quantized
(1)
this model