tiny-random
/

muse-spark-open

yujiepan commited on 1 day ago

Commit

6024917

verified ·

1 Parent(s): 9c88b68

Remove redundant architecture prose and restore standard introduction

Files changed (1) hide show

README.md CHANGED Viewed

@@ -3,9 +3,7 @@ base_model:
 - meta-models/Muse-Spark-Open-816B-A42B
 ---
-This tiny model is randomly initialized for debugging using [meta-models/Muse-Spark-Open-816B-A42B](https://huggingface.co/meta-models/Muse-Spark-Open-816B-A42B).
-Built with Muse Spark Open. Random weights preserve sigmoid top-8 routed MoE, expert pooling, centered norms, residual/attention gates, sliding RoPE and full NoPE attention, NaViT image/video encoding, and the four-stage waveform audio encoder. Vocabulary rows and source precision are unchanged.
 | Feature | Source | Tiny |
 |---|---|---|

 - meta-models/Muse-Spark-Open-816B-A42B
 ---
+This tiny model is intended for debugging. It is randomly initialized using the configuration adapted from [meta-models/Muse-Spark-Open-816B-A42B](https://huggingface.co/meta-models/Muse-Spark-Open-816B-A42B).
 | Feature | Source | Tiny |
 |---|---|---|