Buckets:
11.7 GB
8 files
Updated 7 days ago
Ctrl+K
| Name | Size | Uploaded | Xet hash |
|---|---|---|---|
| .gitattributes | 1.59 kB xet | 82c1e5c5 | |
| README.md | 563 Bytes xet | e03e37af | |
| config.json | 3.1 kB xet | 25f8cc86 | |
| configuration_deepseek.py | 10.6 kB xet | 7418a2fd | |
| model.safetensors.index.json | 157 kB xet | 1f0c9b8f | |
| nextn_layer_parameters.safetensors | 11.7 GB xet | fe74bc39 | |
| tokenizer.json | 7.85 MB xet | 953c933c | |
| tokenizer_config.json | 3.59 kB xet | 38fd0671 |
DeepSeek-R1-NextN
NextN layer exported from deepseek-ai/DeepSeek-R1 model with script. Used for speculative decoding in SGLang.
Usage
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1 --speculative-algo EAGLE --speculative-draft lmsys/DeepSeek-R1-NextN --speculative-num-steps 2 --speculative-eagle-topk 4 --speculative-num-draft-tokens 4 --trust-remote --tp 8
- Total size
- 11.7 GB
- Files
- 8
- Last updated
- Nov 7
- Pre-warmed CDN
- US EU US EU
