| license: apache-2.0 | |
| base_model: stepfun-ai/Step-5-Preview | |
| tags: | |
| - test | |
| - slice | |
| # Step-5-Preview 5-layer slice | |
| A 5-layer slice of [stepfun-ai/Step-5-Preview](https://huggingface.co/stepfun-ai/Step-5-Preview) for testing only — not a usable model. | |
| Keeps original decoder layers 0, 3, 4, 88, 91 (one per layer kind: sliding-window + dense MLP; full sparse attention + FP8 MoE; sliding-window + FP8 MoE; sliding-window + BF16 MoE; full sparse attention + dense MLP), renumbered 0-4, plus the vision tower, embeddings and head; MTP layers dropped. | |
| Weights are copied unchanged (FP8 E4M3 128x128 block scales where the original has them). | |