File size: 775 Bytes
af2288f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | ---
license: apache-2.0
base_model: Jaidchen/Focus-Red
tags:
- mtp
- speculative-decoding
- qwen3.8
---
# Focus-Red-MTP
Detached Multi-Token Prediction (MTP) weights for [Jaidchen/Focus-Red](https://huggingface.co/Jaidchen/Focus-Red), derived from [Qwen/Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B).
This repository is a sidecar, not a standalone causal language model. `model.safetensors` contains only the 15 original `mtp.*` tensors, unchanged in dtype, shape, and tensor names from the source checkpoint.
- dtype: bf16
- tensors: 15
- parameters: 424 699 392
- tensor bytes: 849 398 784
- MTP layers: 1
- compatible target: Focus-Red / Qwen 3.8 27B text architecture
The corresponding tensors are intentionally absent from the Focus-Red checkpoint.
|