Spaces:
Running
Running
Add organization card with flint-nvfp4-coldgptq
Browse files
README.md
CHANGED
|
@@ -1,10 +1,26 @@
|
|
| 1 |
---
|
| 2 |
title: README
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
colorTo: yellow
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
title: README
|
| 3 |
+
colorFrom: indigo
|
| 4 |
+
colorTo: blue
|
|
|
|
| 5 |
sdk: static
|
| 6 |
pinned: false
|
| 7 |
---
|
| 8 |
|
| 9 |
+
# FutureMLS Lab
|
| 10 |
+
|
| 11 |
+
## Models
|
| 12 |
+
|
| 13 |
+
| Model | Base model | Format | Size |
|
| 14 |
+
|---|---|---|---:|
|
| 15 |
+
| [flint-nvfp4-coldgptq](https://huggingface.co/FutureMLS-Lab/flint-nvfp4-coldgptq) | [RecursiveSI/flint](https://huggingface.co/RecursiveSI/flint) | NVFP4 (W4A4) routed experts, BF16 elsewhere | 23.5 GB (BF16: 79.6 GB) |
|
| 16 |
+
|
| 17 |
+
### flint-nvfp4-coldgptq
|
| 18 |
+
|
| 19 |
+
B300, SGLang 0.5.16 with `flint_sglang` 0.1.4, the model's default sampling. Generation length counts completion tokens,
|
| 20 |
+
reasoning included.
|
| 21 |
+
|
| 22 |
+
| Benchmark | Accuracy, BF16 β NVFP4 | Generation length p50 / p90 (tokens), BF16 β NVFP4 |
|
| 23 |
+
|---|---:|---:|
|
| 24 |
+
| GSM8K, 1,319 questions | 96.1 β 96.0 | 451 / 2,796 β 459 / 3,004 |
|
| 25 |
+
| GPQA Diamond, 198 questions Γ 3 samples | 69.2 β 68.9 | 6,718 / 30,918 β 7,440 / 30,553 |
|
| 26 |
+
| AIME 2026, 30 problems Γ 16 samples | 84.4 β 83.8 | 7,927 / 32,768 β 8,294 / 32,768 |
|