hf-internal-testing
/

tiny-kimi-linear

Model card Files Files and versions

ror HF Staff commited on Sep 4

Commit

f06b4c5

·

verified ·

1 Parent(s): b501957

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -32,7 +32,7 @@
   "model_type": "kimi_linear",
   "moe_intermediate_size": 32,
   "n_group": 1,
-  "n_routed_experts": 8,
   "n_shared_experts": 1,
   "norm_topk_prob": true,
   "num_attention_heads": 4,

   "model_type": "kimi_linear",
   "moe_intermediate_size": 32,
   "n_group": 1,
+  "num_experts": 8,
   "n_shared_experts": 1,
   "norm_topk_prob": true,
   "num_attention_heads": 4,