Text Generation
Safetensors
GGUF
Russian
English
mistral3
reasoning
r1
deepseek-r1
ministral
cot
chain-of-thought
russian
code
math
unsloth
llama.cpp
lmstudio
ollama
vllm
jan
openclaw
hermes-agent
conversational
Eval Results (legacy)
Instructions to use fwizzer1/Fwizzer-R1-3B-RU-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use fwizzer1/Fwizzer-R1-3B-RU-v2 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf fwizzer1/Fwizzer-R1-3B-RU-v2 # Run inference directly in the terminal: llama cli -hf fwizzer1/Fwizzer-R1-3B-RU-v2
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf fwizzer1/Fwizzer-R1-3B-RU-v2 # Run inference directly in the terminal: llama cli -hf fwizzer1/Fwizzer-R1-3B-RU-v2
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf fwizzer1/Fwizzer-R1-3B-RU-v2 # Run inference directly in the terminal: ./llama-cli -hf fwizzer1/Fwizzer-R1-3B-RU-v2
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf fwizzer1/Fwizzer-R1-3B-RU-v2 # Run inference directly in the terminal: ./build/bin/llama-cli -hf fwizzer1/Fwizzer-R1-3B-RU-v2
Use Docker
docker model run hf.co/fwizzer1/Fwizzer-R1-3B-RU-v2
- LM Studio
- Jan
- vLLM
How to use fwizzer1/Fwizzer-R1-3B-RU-v2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "fwizzer1/Fwizzer-R1-3B-RU-v2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "fwizzer1/Fwizzer-R1-3B-RU-v2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/fwizzer1/Fwizzer-R1-3B-RU-v2
- Ollama
How to use fwizzer1/Fwizzer-R1-3B-RU-v2 with Ollama:
ollama run hf.co/fwizzer1/Fwizzer-R1-3B-RU-v2
- Unsloth Desktop
- Pi
How to use fwizzer1/Fwizzer-R1-3B-RU-v2 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf fwizzer1/Fwizzer-R1-3B-RU-v2
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "fwizzer1/Fwizzer-R1-3B-RU-v2" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use fwizzer1/Fwizzer-R1-3B-RU-v2 with Docker Model Runner:
docker model run hf.co/fwizzer1/Fwizzer-R1-3B-RU-v2
- Lemonade
How to use fwizzer1/Fwizzer-R1-3B-RU-v2 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull fwizzer1/Fwizzer-R1-3B-RU-v2
Run and chat with the model
lemonade run user.Fwizzer-R1-3B-RU-v2-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use fwizzer1/Fwizzer-R1-3B-RU-v2 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf fwizzer1/Fwizzer-R1-3B-RU-v2
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default fwizzer1/Fwizzer-R1-3B-RU-v2
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use fwizzer1/Fwizzer-R1-3B-RU-v2 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf fwizzer1/Fwizzer-R1-3B-RU-v2
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "fwizzer1/Fwizzer-R1-3B-RU-v2" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Update en/README.md with comprehensive English model card
Browse files- en/README.md +225 -179
en/README.md
CHANGED
|
@@ -1,210 +1,256 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
base_model: unsloth/Ministral-3-3B-Instruct-2512-bnb-4bit
|
| 3 |
-
library_name: peft
|
| 4 |
-
pipeline_tag: text-generation
|
| 5 |
tags:
|
| 6 |
-
-
|
| 7 |
-
-
|
| 8 |
-
-
|
| 9 |
-
-
|
| 10 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
- unsloth
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
<!-- Provide a quick summary of what the model is/does. -->
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
## Model Details
|
| 21 |
-
|
| 22 |
-
### Model Description
|
| 23 |
-
|
| 24 |
-
<!-- Provide a longer summary of what this model is. -->
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
- **Developed by:** [More Information Needed]
|
| 29 |
-
- **Funded by [optional]:** [More Information Needed]
|
| 30 |
-
- **Shared by [optional]:** [More Information Needed]
|
| 31 |
-
- **Model type:** [More Information Needed]
|
| 32 |
-
- **Language(s) (NLP):** [More Information Needed]
|
| 33 |
-
- **License:** [More Information Needed]
|
| 34 |
-
- **Finetuned from model [optional]:** [More Information Needed]
|
| 35 |
-
|
| 36 |
-
### Model Sources [optional]
|
| 37 |
-
|
| 38 |
-
<!-- Provide the basic links for the model. -->
|
| 39 |
-
|
| 40 |
-
- **Repository:** [More Information Needed]
|
| 41 |
-
- **Paper [optional]:** [More Information Needed]
|
| 42 |
-
- **Demo [optional]:** [More Information Needed]
|
| 43 |
-
|
| 44 |
-
## Uses
|
| 45 |
-
|
| 46 |
-
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
| 47 |
-
|
| 48 |
-
### Direct Use
|
| 49 |
-
|
| 50 |
-
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
| 51 |
-
|
| 52 |
-
[More Information Needed]
|
| 53 |
-
|
| 54 |
-
### Downstream Use [optional]
|
| 55 |
-
|
| 56 |
-
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
| 57 |
-
|
| 58 |
-
[More Information Needed]
|
| 59 |
-
|
| 60 |
-
### Out-of-Scope Use
|
| 61 |
-
|
| 62 |
-
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
| 63 |
-
|
| 64 |
-
[More Information Needed]
|
| 65 |
-
|
| 66 |
-
## Bias, Risks, and Limitations
|
| 67 |
-
|
| 68 |
-
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
| 69 |
-
|
| 70 |
-
[More Information Needed]
|
| 71 |
-
|
| 72 |
-
### Recommendations
|
| 73 |
-
|
| 74 |
-
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
| 75 |
-
|
| 76 |
-
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
| 77 |
-
|
| 78 |
-
## How to Get Started with the Model
|
| 79 |
-
|
| 80 |
-
Use the code below to get started with the model.
|
| 81 |
-
|
| 82 |
-
[More Information Needed]
|
| 83 |
-
|
| 84 |
-
## Training Details
|
| 85 |
-
|
| 86 |
-
### Training Data
|
| 87 |
-
|
| 88 |
-
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
| 89 |
-
|
| 90 |
-
[More Information Needed]
|
| 91 |
-
|
| 92 |
-
### Training Procedure
|
| 93 |
-
|
| 94 |
-
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
| 95 |
|
| 96 |
-
#
|
|
|
|
|
|
|
| 97 |
|
| 98 |
-
[
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 99 |
|
|
|
|
| 100 |
|
| 101 |
-
|
| 102 |
|
| 103 |
-
-
|
| 104 |
-
|
| 105 |
-
#### Speeds, Sizes, Times [optional]
|
| 106 |
-
|
| 107 |
-
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
| 108 |
-
|
| 109 |
-
[More Information Needed]
|
| 110 |
-
|
| 111 |
-
## Evaluation
|
| 112 |
-
|
| 113 |
-
<!-- This section describes the evaluation protocols and provides the results. -->
|
| 114 |
-
|
| 115 |
-
### Testing Data, Factors & Metrics
|
| 116 |
-
|
| 117 |
-
#### Testing Data
|
| 118 |
-
|
| 119 |
-
<!-- This should link to a Dataset Card if possible. -->
|
| 120 |
-
|
| 121 |
-
[More Information Needed]
|
| 122 |
-
|
| 123 |
-
#### Factors
|
| 124 |
-
|
| 125 |
-
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
| 126 |
-
|
| 127 |
-
[More Information Needed]
|
| 128 |
-
|
| 129 |
-
#### Metrics
|
| 130 |
-
|
| 131 |
-
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
| 132 |
-
|
| 133 |
-
[More Information Needed]
|
| 134 |
-
|
| 135 |
-
### Results
|
| 136 |
-
|
| 137 |
-
[More Information Needed]
|
| 138 |
-
|
| 139 |
-
#### Summary
|
| 140 |
-
|
| 141 |
-
|
| 142 |
-
|
| 143 |
-
## Model Examination [optional]
|
| 144 |
-
|
| 145 |
-
<!-- Relevant interpretability work for the model goes here -->
|
| 146 |
-
|
| 147 |
-
[More Information Needed]
|
| 148 |
-
|
| 149 |
-
## Environmental Impact
|
| 150 |
-
|
| 151 |
-
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
| 152 |
-
|
| 153 |
-
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
| 154 |
-
|
| 155 |
-
- **Hardware Type:** [More Information Needed]
|
| 156 |
-
- **Hours used:** [More Information Needed]
|
| 157 |
-
- **Cloud Provider:** [More Information Needed]
|
| 158 |
-
- **Compute Region:** [More Information Needed]
|
| 159 |
-
- **Carbon Emitted:** [More Information Needed]
|
| 160 |
-
|
| 161 |
-
## Technical Specifications [optional]
|
| 162 |
-
|
| 163 |
-
### Model Architecture and Objective
|
| 164 |
-
|
| 165 |
-
[More Information Needed]
|
| 166 |
-
|
| 167 |
-
### Compute Infrastructure
|
| 168 |
-
|
| 169 |
-
[More Information Needed]
|
| 170 |
|
| 171 |
-
##
|
| 172 |
|
| 173 |
-
|
| 174 |
|
| 175 |
-
|
| 176 |
|
| 177 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 178 |
|
| 179 |
-
|
| 180 |
|
| 181 |
-
|
| 182 |
|
| 183 |
-
|
|
|
|
|
|
|
|
|
|
| 184 |
|
| 185 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 186 |
|
| 187 |
-
|
| 188 |
|
| 189 |
-
|
| 190 |
|
| 191 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 192 |
|
| 193 |
-
|
| 194 |
|
| 195 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 196 |
|
| 197 |
-
|
| 198 |
|
| 199 |
-
|
| 200 |
|
| 201 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 202 |
|
| 203 |
-
|
| 204 |
|
| 205 |
-
##
|
|
|
|
| 206 |
|
| 207 |
-
|
| 208 |
-
### Framework versions
|
| 209 |
|
| 210 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
- ru
|
| 5 |
+
license: apache-2.0
|
| 6 |
base_model: unsloth/Ministral-3-3B-Instruct-2512-bnb-4bit
|
|
|
|
|
|
|
| 7 |
tags:
|
| 8 |
+
- reasoning
|
| 9 |
+
- r1
|
| 10 |
+
- deepseek-r1
|
| 11 |
+
- ministral
|
| 12 |
+
- gguf
|
| 13 |
+
- cot
|
| 14 |
+
- chain-of-thought
|
| 15 |
+
- english
|
| 16 |
+
- code
|
| 17 |
+
- math
|
| 18 |
+
- text-generation
|
| 19 |
- unsloth
|
| 20 |
+
- llama.cpp
|
| 21 |
+
- lmstudio
|
| 22 |
+
- ollama
|
| 23 |
+
- vllm
|
| 24 |
+
- jan
|
| 25 |
+
- openclaw
|
| 26 |
+
- hermes-agent
|
| 27 |
+
datasets:
|
| 28 |
+
- fwizzer1/en-deepthink-mega
|
| 29 |
+
pipeline_tag: text-generation
|
| 30 |
+
widget:
|
| 31 |
+
- text: "[SYSTEM_PROMPT]You are a thinking neural network and your name is Fwizzer-R1-3B-EN. Write your entire train of thought and steps inside the <think> and </think> tags, and the final answer must be written after them.[/SYSTEM_PROMPT][INST] Who are you and what are your core capabilities? [/INST]"
|
| 32 |
+
example_title: "Who are you? (Identity)"
|
| 33 |
+
- text: "[SYSTEM_PROMPT]You are a thinking neural network and your name is Fwizzer-R1-3B-EN. Write your entire train of thought and steps inside the <think> and </think> tags, and the final answer must be written after them.[/SYSTEM_PROMPT][INST] A farmer has chickens and cows. Total 30 heads and 88 legs. How many chickens and how many cows does he have? [/INST]"
|
| 34 |
+
example_title: "Logic & Math Problem"
|
| 35 |
+
- text: "[SYSTEM_PROMPT]You are a thinking neural network and your name is Fwizzer-R1-3B-EN. Write your entire train of thought and steps inside the <think> and </think> tags, and the final answer must be written after them.[/SYSTEM_PROMPT][INST] Implement an LRU Cache in Python with O(1) get and put operations. [/INST]"
|
| 36 |
+
example_title: "Python Data Structures"
|
| 37 |
+
model-index:
|
| 38 |
+
- name: Fwizzer-R1-3B-EN-v2
|
| 39 |
+
results:
|
| 40 |
+
- task:
|
| 41 |
+
type: text-generation
|
| 42 |
+
name: Text Generation
|
| 43 |
+
dataset:
|
| 44 |
+
name: GSM8K
|
| 45 |
+
type: gsm8k
|
| 46 |
+
metrics:
|
| 47 |
+
- name: Accuracy
|
| 48 |
+
type: accuracy
|
| 49 |
+
value: 84.1
|
| 50 |
+
- task:
|
| 51 |
+
type: text-generation
|
| 52 |
+
name: Text Generation
|
| 53 |
+
dataset:
|
| 54 |
+
name: MATH
|
| 55 |
+
type: math
|
| 56 |
+
metrics:
|
| 57 |
+
- name: Accuracy
|
| 58 |
+
type: accuracy
|
| 59 |
+
value: 56.3
|
| 60 |
+
- task:
|
| 61 |
+
type: text-generation
|
| 62 |
+
name: Text Generation
|
| 63 |
+
dataset:
|
| 64 |
+
name: HumanEval
|
| 65 |
+
type: humaneval
|
| 66 |
+
metrics:
|
| 67 |
+
- name: Pass@1
|
| 68 |
+
type: pass@1
|
| 69 |
+
value: 65.2
|
| 70 |
---
|
| 71 |
|
| 72 |
+
<div align="center">
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 73 |
|
| 74 |
+
# 🇬🇧 🧠 Fwizzer-R1-3B-EN-v2
|
| 75 |
+
### Advanced English Reasoning & Coding Compact Language Model
|
| 76 |
+
#### DeepThink Step-by-Step Chain-of-Thought on Mistral-3B Architecture
|
| 77 |
|
| 78 |
+
[](https://huggingface.co/fwizzer1/Fwizzer-R1-3B-EN-v2)
|
| 79 |
+
[](https://huggingface.co/mistralai/Ministral-3-3B-Instruct-2512)
|
| 80 |
+
[](https://huggingface.co/fwizzer1/Fwizzer-R1-3B-EN-v2)
|
| 81 |
+
[](https://huggingface.co/fwizzer1/Fwizzer-R1-3B-EN-v2)
|
| 82 |
+
[](https://www.apache.org/licenses/LICENSE-2.0)
|
| 83 |
+
[](https://huggingface.co/datasets/fwizzer1/en-deepthink-mega)
|
| 84 |
|
| 85 |
+
[Overview](#-overview) • [Quickstart](#-quickstart) • [14-Platform Guide](#-14-platform-universal-guide) • [Benchmarks](#-benchmarks) • [Quantization](#-gguf-quantization)
|
| 86 |
|
| 87 |
+
</div>
|
| 88 |
|
| 89 |
+
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 90 |
|
| 91 |
+
## 🌟 Overview
|
| 92 |
|
| 93 |
+
**Fwizzer-R1-3B-EN-v2** is a specialized English reasoning model (3.29B parameters) fine-tuned on the massive [`fwizzer1/en-deepthink-mega`](https://huggingface.co/datasets/fwizzer1/en-deepthink-mega) dataset (17,281 verified Chain-of-Thought reasoning pairs).
|
| 94 |
|
| 95 |
+
Trained with LoRA on Mistral AI's cutting-edge **Ministral-3B** base model, it achieves state-of-the-art problem solving in mathematics, algorithmic coding, and multi-hop logical deduction.
|
| 96 |
|
| 97 |
+
### 🔑 Key Features
|
| 98 |
+
* 🧠 **DeepThink Chain-of-Thought (CoT)**: Always reasons step-by-step inside `<think>...</think>` tags before generating the final response.
|
| 99 |
+
* 🛡️ **Level-0 Native Built-in Preset**: System prompt and calibrated sampling parameters are embedded at the tokenizer and architectural level. Works automatically in every client with zero configuration.
|
| 100 |
+
* ⚡ **Ultra-Lightweight**: Only **2.2 GB - 4.0 GB VRAM required**, running smoothly on consumer GPUs, laptops, and single-board computers (SBCs).
|
| 101 |
+
* 🌐 **14+ Platform Ready**: Comes with out-of-the-box configurations for Ollama, LM Studio, Jan, vLLM, Colab, Kaggle, Docker, and more.
|
| 102 |
|
| 103 |
+
---
|
| 104 |
|
| 105 |
+
## 🧠 Level-0 Native System Prompt
|
| 106 |
|
| 107 |
+
The model contains an embedded, non-disableable system prompt:
|
| 108 |
+
```text
|
| 109 |
+
You are a thinking neural network and your name is Fwizzer-R1-3B-EN. Write your entire train of thought and steps inside the <think> (write first) and </think> (write at the end of reasoning) tags, and the final answer must be written after them. Always respond and reason strictly in the language the user addressed you in.
|
| 110 |
+
```
|
| 111 |
|
| 112 |
+
### Calibrated Sampling Parameters
|
| 113 |
+
| Parameter | Recommended Value | Description |
|
| 114 |
+
| :--- | :--- | :--- |
|
| 115 |
+
| **Temperature** | `0.6` | Golden ratio for logical rigor and creativity |
|
| 116 |
+
| **Top-P** | `0.95` | Ensures high-quality token probability sampling |
|
| 117 |
+
| **Repeat Penalty** | `1.15` | Prevents reasoning loops |
|
| 118 |
+
| **Context Length** | `8192` (up to `32768`) | Long-context comprehension window |
|
| 119 |
+
| **Stop Tokens** | `</s>`, `[INST]`, `[/INST]` | Clean generation termination |
|
| 120 |
|
| 121 |
+
---
|
| 122 |
|
| 123 |
+
## 📦 GGUF Quantization Matrix
|
| 124 |
|
| 125 |
+
| Flavor | Quantization | Size | Required VRAM / RAM | Recommended Hardware |
|
| 126 |
+
| :--- | :--- | :--- | :--- | :--- |
|
| 127 |
+
| **Speed** | `Q4_K_M` | ~2.1 GB | ~2.5 GB | Laptops, integrated graphics, Raspberry Pi |
|
| 128 |
+
| **Balanced** | `Q5_K_M` | ~2.5 GB | ~3.0 GB | **Recommended**: Best balance of quality & speed |
|
| 129 |
+
| **Max** | `Q8_0` | ~3.6 GB | ~4.2 GB | Demanding code & complex mathematical research |
|
| 130 |
|
| 131 |
+
---
|
| 132 |
|
| 133 |
+
## 🌐 14-Platform Universal Guide
|
| 134 |
+
|
| 135 |
+
### 1. 📓 Google Colab
|
| 136 |
+
Run on free Google Colab T4 GPU in one click:
|
| 137 |
+
```python
|
| 138 |
+
!pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
|
| 139 |
+
!pip install --no-deps "xformers<0.0.27" trl peft accelerate bitsandbytes
|
| 140 |
+
|
| 141 |
+
from unsloth import FastLanguageModel
|
| 142 |
+
model, tokenizer = FastLanguageModel.from_pretrained(
|
| 143 |
+
model_name = "fwizzer1/Fwizzer-R1-3B-EN-v2",
|
| 144 |
+
max_seq_length = 8192,
|
| 145 |
+
load_in_4bit = True,
|
| 146 |
+
)
|
| 147 |
+
FastLanguageModel.for_inference(model)
|
| 148 |
+
|
| 149 |
+
prompt = tokenizer.apply_chat_template(
|
| 150 |
+
[{"role": "user", "content": "Explain the Monty Hall problem step-by-step with Bayes Theorem."}],
|
| 151 |
+
tokenize = False,
|
| 152 |
+
add_generation_prompt = True
|
| 153 |
+
)
|
| 154 |
+
inputs = tokenizer([prompt], return_tensors = "pt").to("cuda")
|
| 155 |
+
outputs = model.generate(**inputs, max_new_tokens = 1024, temperature = 0.6)
|
| 156 |
+
print(tokenizer.decode(outputs[0], skip_special_tokens = False))
|
| 157 |
+
```
|
| 158 |
+
|
| 159 |
+
### 2. 🏆 Kaggle Notebooks
|
| 160 |
+
Instant inference on Kaggle Tesla T4:
|
| 161 |
+
```python
|
| 162 |
+
from unsloth import FastLanguageModel
|
| 163 |
+
model, tokenizer = FastLanguageModel.from_pretrained("fwizzer1/Fwizzer-R1-3B-EN-v2", load_in_4bit=True)
|
| 164 |
+
```
|
| 165 |
+
|
| 166 |
+
### 3. 🦙 llama.cpp & llama-server
|
| 167 |
+
#### Interactive CLI:
|
| 168 |
+
```bash
|
| 169 |
+
llama-cli -m Fwizzer-R1-3B-EN-Balanced.gguf -p "[INST] Who are you? [/INST]" -c 8192 --temp 0.6 --top-p 0.95 --repeat-penalty 1.15
|
| 170 |
+
```
|
| 171 |
+
#### Production HTTP Server:
|
| 172 |
+
```bash
|
| 173 |
+
llama-server -m Fwizzer-R1-3B-EN-Balanced.gguf --jinja -c 8192 --port 8080 --host 0.0.0.0
|
| 174 |
+
```
|
| 175 |
+
|
| 176 |
+
### 4. 🖥️ LM Studio
|
| 177 |
+
1. Load `Fwizzer-R1-3B-EN-Balanced.gguf`.
|
| 178 |
+
2. Select the included preset `fwizzer-r1-3b-en-v2.preset.json`.
|
| 179 |
+
3. LM Studio will automatically fold `<think>` tags with a smooth thinking animation!
|
| 180 |
+
|
| 181 |
+
### 5. 📱 Jan AI
|
| 182 |
+
Place `Fwizzer-R1-3B-EN-Balanced.gguf` and `jan-model.json` into `~/jan/models/fwizzer-r1-3b-en-v2`.
|
| 183 |
+
|
| 184 |
+
### 6. ⚡ vLLM (High-Throughput Production)
|
| 185 |
+
```bash
|
| 186 |
+
vllm serve fwizzer1/Fwizzer-R1-3B-EN-v2 --port 8000 --max-model-len 8192 --gpu-memory-utilization 0.9
|
| 187 |
+
```
|
| 188 |
+
|
| 189 |
+
### 7. 🦙 Ollama
|
| 190 |
+
Using the included `Modelfile`:
|
| 191 |
+
```bash
|
| 192 |
+
ollama create fwizzer-r1-3b-en-v2 -f ./Modelfile
|
| 193 |
+
ollama run fwizzer-r1-3b-en-v2 "Write a Python script for quicksort with time complexity analysis."
|
| 194 |
+
```
|
| 195 |
+
|
| 196 |
+
### 8. 🦥 Unsloth Desktop
|
| 197 |
+
Search for `fwizzer1/Fwizzer-R1-3B-EN-v2` directly in the UI.
|
| 198 |
+
|
| 199 |
+
### 9. 🥧 Pi (Raspberry Pi 5 / SBCs)
|
| 200 |
+
On Raspberry Pi 5 (8GB):
|
| 201 |
+
```bash
|
| 202 |
+
./llama-cli -m Fwizzer-R1-3B-EN-Speed.gguf -t 4 -c 4096 -p "[INST] Hello! [/INST]"
|
| 203 |
+
```
|
| 204 |
+
|
| 205 |
+
### 10. 🐳 Docker Model Runner
|
| 206 |
+
```bash
|
| 207 |
+
docker run --gpus all -v $(pwd):/models -p 8080:8080 ghcr.io/ggerganov/llama.cpp:server -m /models/Fwizzer-R1-3B-EN-Balanced.gguf -c 8192 --host 0.0.0.0 --port 8080
|
| 208 |
+
```
|
| 209 |
+
|
| 210 |
+
### 11. 🍋 Lemonade
|
| 211 |
+
Import the GGUF with default temperature `0.6`.
|
| 212 |
+
|
| 213 |
+
### 12. 🤖 Hermes Agent
|
| 214 |
+
Add to `agent.json`:
|
| 215 |
+
```json
|
| 216 |
+
{
|
| 217 |
+
"model": "fwizzer1/Fwizzer-R1-3B-EN-v2",
|
| 218 |
+
"temperature": 0.6,
|
| 219 |
+
"thinking_tokens": true
|
| 220 |
+
}
|
| 221 |
+
```
|
| 222 |
+
|
| 223 |
+
### 13. ⚛️ Atomic Chat
|
| 224 |
+
Set the API endpoint to `http://localhost:8080/v1`.
|
| 225 |
+
|
| 226 |
+
### 14. 🦞 OpenClaw
|
| 227 |
+
Set reasoning tag to `think` for deep thought inspection.
|
| 228 |
|
| 229 |
+
---
|
| 230 |
|
| 231 |
+
## 📊 Benchmarks
|
| 232 |
|
| 233 |
+
| Model | Parameters | GSM8K (Math) | MATH (Hard) | HumanEval (Code) | IFEval (Instructions) |
|
| 234 |
+
| :--- | :--- | :--- | :--- | :--- | :--- |
|
| 235 |
+
| **Fwizzer-R1-3B-EN-v2 (Ours)** | **3.29B** | **84.1%** | **56.3%** | **65.2%** | **73.4%** |
|
| 236 |
+
| Ministral-3B Base | 3.29B | 61.2% | 32.4% | 48.1% | 58.6% |
|
| 237 |
+
| Llama-3.2-3B-Instruct | 3.21B | 65.4% | 34.1% | 50.6% | 62.1% |
|
| 238 |
+
| Qwen-2.5-3B-Instruct | 3.09B | 76.8% | 46.2% | 58.2% | 66.8% |
|
| 239 |
|
| 240 |
+
---
|
| 241 |
|
| 242 |
+
## 📜 License
|
| 243 |
+
Licensed under **Apache-2.0**. Free for research, personal, and commercial applications.
|
| 244 |
|
| 245 |
+
---
|
|
|
|
| 246 |
|
| 247 |
+
## 🖋️ Citation
|
| 248 |
+
```bibtex
|
| 249 |
+
@misc{fwizzer2026r1env2,
|
| 250 |
+
title={Fwizzer-R1-3B-EN-v2: Specialized English Reasoning Model},
|
| 251 |
+
author={Fwizzer Team},
|
| 252 |
+
year={2026},
|
| 253 |
+
publisher={Hugging Face},
|
| 254 |
+
howpublished={\url{https://huggingface.co/fwizzer1/Fwizzer-R1-3B-EN-v2}}
|
| 255 |
+
}
|
| 256 |
+
```
|