MLX
Safetensors
qwen3_5
kev
system-one
typed-decisions
8-bit precision
apple-silicon
Eval Results (legacy)
Instructions to use RoderickQiu/kev-4b-mlx-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use RoderickQiu/kev-4b-mlx-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download RoderickQiu/kev-4b-mlx-8bit --local-dir kev-4b-mlx-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Add the 119 trial pages: 8-bit against bf16 on this checkpoint
Verified signature6929ac3 -
Drop the load-time aside and the unrun page-set note
Verified signature8051540 -
Add development-suite evaluation results for the 8-bit file
Verified signatureea7b4df -
Name jaredpalmer/kev-4b as the only base model so the quantization list can see it
Verified signature9d06938 -
Link the 139fdd94 benchmark write-up (kev#162)
Verified signature1f3a2b2 -
Kev-4B 139fdd94: 8-bit weights, head, and development-suite card
Verified signatureReplaces the 485ace87 build. Weights SHA-256 83adf34ef8f2433166225960d0f074def35d3de52449fa8861bc356398312d31.d1da40e -
Update README.md
Verified signature91fe4ba
-
Update README.md
Verified signaturee1c3594
-
Kev-4B merged and quantized to 8 bits for MLX
Verified signaturef560176