MLX
Safetensors
qwen3_5
kev
system-one
typed-decisions
8-bit precision
apple-silicon
Eval Results (legacy)
Instructions to use RoderickQiu/kev-4b-mlx-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use RoderickQiu/kev-4b-mlx-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download RoderickQiu/kev-4b-mlx-8bit --local-dir kev-4b-mlx-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Add development-suite evaluation results for the 8-bit file
Browse files
README.md
CHANGED
|
@@ -10,6 +10,34 @@ tags:
|
|
| 10 |
- typed-decisions
|
| 11 |
- 8-bit
|
| 12 |
- apple-silicon
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
---
|
| 14 |
|
| 15 |
# Kev-4B, merged and quantized to 8 bits for MLX
|
|
|
|
| 10 |
- typed-decisions
|
| 11 |
- 8-bit
|
| 12 |
- apple-silicon
|
| 13 |
+
model-index:
|
| 14 |
+
- name: kev-4b-mlx-8bit
|
| 15 |
+
results:
|
| 16 |
+
- task: { type: text-classification, name: typed decision, 8-bit MLX }
|
| 17 |
+
dataset: { type: mixed, name: "transfer-v4 development (656 questions; 8-bit, same Mac as bf16)" }
|
| 18 |
+
metrics:
|
| 19 |
+
- { type: accuracy, value: 0.817 }
|
| 20 |
+
- { type: brier_score, value: 0.243 }
|
| 21 |
+
- task: { type: text-classification, name: typed decision, 8-bit MLX }
|
| 22 |
+
dataset: { type: mixed, name: "decision-v7 development (1,264 questions; 8-bit, same Mac as bf16)" }
|
| 23 |
+
metrics:
|
| 24 |
+
- { type: accuracy, value: 0.873 }
|
| 25 |
+
- { type: expected_calibration_error, value: 0.010, name: "ECE, as served" }
|
| 26 |
+
- task: { type: text-classification, name: typed decision, 8-bit MLX }
|
| 27 |
+
dataset: { type: mixed, name: "hard-v1 development (1,083 questions; 8-bit, same Mac as bf16)" }
|
| 28 |
+
metrics:
|
| 29 |
+
- { type: accuracy, value: 0.786 }
|
| 30 |
+
- { type: brier_score, value: 0.313 }
|
| 31 |
+
- task: { type: text-classification, name: typed decision, 8-bit MLX }
|
| 32 |
+
dataset: { type: mixed, name: "devtools-v1 development (1,074 questions; 8-bit, same Mac as bf16)" }
|
| 33 |
+
metrics:
|
| 34 |
+
- { type: accuracy, value: 0.746 }
|
| 35 |
+
- { type: brier_score, value: 0.357 }
|
| 36 |
+
- task: { type: text-classification, name: typed decision, 8-bit MLX }
|
| 37 |
+
dataset: { type: mixed, name: "documents-v1 development (920 questions; 8-bit, same Mac as bf16)" }
|
| 38 |
+
metrics:
|
| 39 |
+
- { type: accuracy, value: 0.896 }
|
| 40 |
+
- { type: brier_score, value: 0.173 }
|
| 41 |
---
|
| 42 |
|
| 43 |
# Kev-4B, merged and quantized to 8 bits for MLX
|