Zhongzhu commited on
Commit
d7a754a
Β·
verified Β·
1 Parent(s): a9d12c5

Add organization card with flint-nvfp4-coldgptq

Browse files
Files changed (1) hide show
  1. README.md +20 -4
README.md CHANGED
@@ -1,10 +1,26 @@
1
  ---
2
  title: README
3
- emoji: 🐠
4
- colorFrom: green
5
- colorTo: yellow
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  title: README
3
+ colorFrom: indigo
4
+ colorTo: blue
 
5
  sdk: static
6
  pinned: false
7
  ---
8
 
9
+ # FutureMLS Lab
10
+
11
+ ## Models
12
+
13
+ | Model | Base model | Format | Size |
14
+ |---|---|---|---:|
15
+ | [flint-nvfp4-coldgptq](https://huggingface.co/FutureMLS-Lab/flint-nvfp4-coldgptq) | [RecursiveSI/flint](https://huggingface.co/RecursiveSI/flint) | NVFP4 (W4A4) routed experts, BF16 elsewhere | 23.5 GB (BF16: 79.6 GB) |
16
+
17
+ ### flint-nvfp4-coldgptq
18
+
19
+ B300, SGLang 0.5.16 with `flint_sglang` 0.1.4, the model's default sampling. Generation length counts completion tokens,
20
+ reasoning included.
21
+
22
+ | Benchmark | Accuracy, BF16 β†’ NVFP4 | Generation length p50 / p90 (tokens), BF16 β†’ NVFP4 |
23
+ |---|---:|---:|
24
+ | GSM8K, 1,319 questions | 96.1 β†’ 96.0 | 451 / 2,796 β†’ 459 / 3,004 |
25
+ | GPQA Diamond, 198 questions Γ— 3 samples | 69.2 β†’ 68.9 | 6,718 / 30,918 β†’ 7,440 / 30,553 |
26
+ | AIME 2026, 30 problems Γ— 16 samples | 84.4 β†’ 83.8 | 7,927 / 32,768 β†’ 8,294 / 32,768 |