Update README.md
Browse files
README.md
CHANGED
|
@@ -25,7 +25,7 @@ These files were produced by the **[`hy3`](https://github.com/yuhai-china/hy3)**
|
|
| 25 |
converter (`hy3-convert`) and are meant to be run with the **`hy3` inference
|
| 26 |
engine**, a from-scratch C/Metal/CUDA implementation.
|
| 27 |
|
| 28 |
-
# Recommended: `
|
| 29 |
|
| 30 |
The checkpoint is natively top k-8 of MOE, but **we recommend running with `-experts 4`**
|
| 31 |
— it activates only the 4 highest-scoring routed experts per token instead of 8,
|
|
|
|
| 25 |
converter (`hy3-convert`) and are meant to be run with the **`hy3` inference
|
| 26 |
engine**, a from-scratch C/Metal/CUDA implementation.
|
| 27 |
|
| 28 |
+
# Recommended: `top K experts = 4 instead of 8`
|
| 29 |
|
| 30 |
The checkpoint is natively top k-8 of MOE, but **we recommend running with `-experts 4`**
|
| 31 |
— it activates only the 4 highest-scoring routed experts per token instead of 8,
|