File size: 3,417 Bytes
f9d495c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 | ---
license: other
base_model: Skywork/Skywork-OR1-Math-7B
tags:
- llama-cpp
- gguf
- qwen2
- math
- reasoning
language:
- en
pipeline_tag: text-generation
library_name: gguf
---
# Skywork-OR1-Math-7B - GGUF
GGUF quantizations of [Skywork/Skywork-OR1-Math-7B](https://huggingface.co/Skywork/Skywork-OR1-Math-7B).
## Model Description
Skywork-OR1-Math-7B is a math-specialized reasoning model from the Skywork Open Reasoner 1 (OR1) series, trained using large-scale rule-based reinforcement learning. It is fine-tuned on top of DeepSeek-R1-Distill-Qwen-7B with a curated dataset of 110K verifiable math problems and 14K coding questions.
It achieves **69.8 on AIME24** and **52.3 on AIME25**, outperforming all similarly sized models on mathematical reasoning tasks.
## Benchmark Results
| Model | AIME24 (Avg@32) | AIME25 (Avg@32) |
|---|---|---|
| DeepSeek-R1-Distill-Qwen-7B | 55.5 | 39.2 |
| Light-R1-7B-DS | 59.1 | 44.3 |
| **Skywork-OR1-Math-7B** | **69.8** | **52.3** |
## Available Quantizations
| File | Bits | Size (approx) | Use Case |
|---|---|---|---|
| model_f16.gguf | 16 | ~15.3 GB | Maximum quality, reference |
| model_q8_0.gguf | 8 | ~8.1 GB | Best quality, if VRAM allows |
| model_q6_k.gguf | 6 | ~6.3 GB | Very high quality |
| model_q5_k_m.gguf | 5 | ~5.5 GB | Recommended balance |
| model_q5_k_s.gguf | 5 | ~5.3 GB | High quality, slightly smaller |
| model_q4_k_m.gguf | 4 | ~4.7 GB | Good quality, widely used |
| model_q4_k_s.gguf | 4 | ~4.5 GB | Smaller, slight quality loss |
| model_q3_k_l.gguf | 3 | ~4.0 GB | Low VRAM, moderate quality |
| model_q3_k_m.gguf | 3 | ~3.7 GB | Low VRAM |
| model_q3_k_s.gguf | 3 | ~3.5 GB | Minimal VRAM |
| model_q2_k.gguf | 2 | ~2.9 GB | Lowest quality, smallest size |
## VRAM Requirements
| Quantization | VRAM (approx) |
|---|---|
| F16 | ~16 GB |
| Q8_0 | ~9 GB |
| Q6_K | ~7 GB |
| Q5_K_M | ~6 GB |
| Q4_K_M | ~5.5 GB |
| Q3_K_M | ~4.5 GB |
| Q2_K | ~3.5 GB |
## Usage
### llama.cpp
```bash
./llama-cli -m model_q4_k_m.gguf -p "Solve: What is the sum of all prime numbers less than 20?" -n 512
```
### llama-cpp-python
```python
from llama_cpp import Llama
llm = Llama(model_path="model_q4_k_m.gguf", n_ctx=4096)
output = llm("Solve: What is the sum of all prime numbers less than 20?", max_tokens=512)
print(output["choices"][0]["text"])
```
### LM Studio
Download any `.gguf` file from this repository and load it directly in [LM Studio](https://lmstudio.ai/).
### Ollama
```bash
ollama run hf.co/tinyopsec/Skywork-OR1-Math-7B-GGUF:Q4_K_M
```
## Original Model
- **Original model:** [Skywork/Skywork-OR1-Math-7B](https://huggingface.co/Skywork/Skywork-OR1-Math-7B)
- **Base model:** [deepseek-ai/DeepSeek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B)
- **Paper:** [Skywork Open Reasoner 1 Technical Report](https://arxiv.org/abs/2505.22312)
- **License:** [Qwen License](https://huggingface.co/Qwen/Qwen1.5-7B/blob/main/LICENSE)
## Citation
```bibtex
@article{he2025skywork,
title={Skywork Open Reasoner 1 Technical Report},
author={He, Jujie and Liu, Jiacai and Liu, Chris Yuhao and Yan, Rui and Wang, Chaojie and Cheng, Peng and Zhang, Xiaoyu and Zhang, Fuxiang and Xu, Jiacheng and Shen, Wei and Li, Siyuan and Zeng, Liang and Wei, Tianwen and Cheng, Cheng and An, Bo and Liu, Yang and Zhou, Yahui},
journal={arXiv preprint arXiv:2505.22312},
year={2025}
}
``` |