deepanshupillm commited on
Commit
f80dbfd
·
verified ·
1 Parent(s): 92c7989

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +133 -75
README.md CHANGED
@@ -39,19 +39,16 @@ tags:
39
  <p><b>A 9B open-weight vision-language model for reasoning, coding, and multimodal understanding.</b></p>
40
 
41
  <p>
42
- <a href="https://huggingface.co/169Pi/Alpie_Seed_GGUF"><img src="https://img.shields.io/badge/📦_GGUF-2/3/4--bit-7C3AED?style=for-the-badge&labelColor=1a1a2e" alt="GGUF"></a>
 
 
43
  </p>
44
 
45
  <p>
46
- <a href="https://github.com/169Pi"><img src="https://img.shields.io/badge/💻_GitHub-169Pi-7C3AED?style=for-the-badge&labelColor=1a1a2e" alt="GitHub"></a>
47
- <a href="https://www.linkedin.com/company/169pi"><img src="https://img.shields.io/badge/💼_LinkedIn-169Pi-7C3AED?style=for-the-badge&labelColor=1a1a2e" alt="LinkedIn"></a>
48
- <a href="https://www.instagram.com/169pi.ai/"><img src="https://img.shields.io/badge/📸_Instagram-@169pi.ai-7C3AED?style=for-the-badge&labelColor=1a1a2e" alt="Instagram"></a>
49
- </p>
50
-
51
- <p>
52
- <a href="https://www.youtube.com/@169pi"><img src="https://img.shields.io/badge/▶️_YouTube-@169pi-7C3AED?style=for-the-badge&labelColor=1a1a2e" alt="YouTube"></a>
53
- <a href="https://x.com/169Pi_ai"><img src="https://img.shields.io/badge/𝕏_X-@169Pi__ai-7C3AED?style=for-the-badge&labelColor=1a1a2e" alt="X"></a>
54
- <a href="https://ollama.com/169pi"><img src="https://img.shields.io/badge/🦙_Ollama-169pi-7C3AED?style=for-the-badge&labelColor=1a1a2e" alt="Ollama"></a>
55
  </p>
56
 
57
  </div>
@@ -105,80 +102,141 @@ Training used eight NVIDIA H100 GPUs, with 3,034 GRPO steps across five phases.
105
 
106
  ## Benchmark Results
107
 
108
- > Alpie Seed scores are from the FP16 model and do not apply to the 2-bit, 3-bit, or 4-bit variants. Gold badge = best score in the row; purple badge = Alpie Seed score. Bold = best score in the row. Comparison-model scores are taken from published model cards and reports (including the [Qwen3.5-9B model card](https://huggingface.co/Qwen/Qwen3.5-9B)).
109
 
110
  ### 🧮 Language
111
 
112
- | | Qwen3.5-9B | Gemma 4 12B | Ministral 3 8B | GPT-OSS-20B | Sarvam-30B | Nemotron 3.5 Lightning | **Alpie Seed 9B** |
113
- |:---|:---:|:---:|:---:|:---:|:---:|:---:|:---:|
114
- | **Knowledge & STEM** | | | | | | | |
115
- | MMLU | -- | -- | -- | 85.3 | 85.1 | -- | ![87.30](https://img.shields.io/badge/87.30-F59E0B?style=flat-square) |
116
- | MMLU-Pro | 82.5 | 77.2 | 75.00 | 77.2 | 80.0 | 81.94 | ![82.54](https://img.shields.io/badge/82.54-F59E0B?style=flat-square) |
117
- | GPQA Diamond | 81.7 | 78.8 | 38.6 | 71.5 | 66.5 | 75.44 | ![84.32](https://img.shields.io/badge/84.32-F59E0B?style=flat-square) |
118
- | **Mathematics** | | | | | | | |
119
- | GSM8K | -- | -- | -- | -- | -- | -- | ![98.00](https://img.shields.io/badge/98.00-7C3AED?style=flat-square) |
120
- | Math-500 | -- | -- | -- | 94.2 | **97.0** | -- | ![91.00](https://img.shields.io/badge/91.00-7C3AED?style=flat-square) |
121
- | AIME 2026 | 69.4 | 77.5 | -- | -- | -- | -- | ![83.33](https://img.shields.io/badge/83.33-F59E0B?style=flat-square) |
122
- | **Coding & Software Engineering** | | | | | | | |
123
- | LiveCodeBench v6 | 65.6 | 72.0 | 61.6 | 61.0 | 70.0 | -- | ![72.99](https://img.shields.io/badge/72.99-F59E0B?style=flat-square) |
124
- | SWE-Bench Verified | 60.0 | 52.0 | -- | 60.7 | 34.0 | 51.56 | ![61.20](https://img.shields.io/badge/61.20-F59E0B?style=flat-square) |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
125
 
126
  ### 👁️ Vision Language
127
 
128
- | | GPT-5-Nano-2025-08-07 | Gemini-2.5-Flash-Lite | Qwen3-VL-30B-A3B | Qwen3.5-9B | Gemma 4 12B | **Alpie Seed 9B** |
129
- |:---|:---:|:---:|:---:|:---:|:---:|:---:|
130
- | **STEM and Puzzle** | | | | | | |
131
- | MMMU-Pro | 57.2 | 59.7 | 63.0 | **70.1** | 69.1 | ![68.70](https://img.shields.io/badge/68.70-7C3AED?style=flat-square) |
132
- | MathVision | 62.2 | 52.1 | 65.7 | 78.9 | **79.7** | ![76.76](https://img.shields.io/badge/76.76-7C3AED?style=flat-square) |
133
- | **General VQA** | | | | | | |
134
- | RealWorldQA | 71.8 | 72.2 | 77.4 | 80.3 | -- | ![80.39](https://img.shields.io/badge/80.39-F59E0B?style=flat-square) |
135
- | MMStar | 68.6 | 69.1 | 75.5 | **79.7** | -- | ![78.87](https://img.shields.io/badge/78.87-7C3AED?style=flat-square) |
136
- | HallusionBench | 58.4 | 64.5 | 66.0 | 69.3 | -- | ![79.88](https://img.shields.io/badge/79.88-F59E0B?style=flat-square) |
137
- | **Text Recognition and Document Understanding** | | | | | | |
138
- | OCRBench | 75.3 | 82.5 | 83.9 | 89.2 | -- | ![90.30](https://img.shields.io/badge/90.30-F59E0B?style=flat-square) |
139
-
140
- * SWE-Bench Verified: resolved rate using Mini-SWE-agent, with retries disabled.
141
- * Comparison-model scores were not re-run by 169Pi, and harnesses, prompts, and benchmark versions differ, so cross-model comparisons are indicative rather than strictly like-for-like. Scores vary with dataset versions, prompts, evaluation harnesses, and inference settings.
142
- * Empty cells (--) indicate scores not yet available or not applicable.
143
- * MMLU for GPT-OSS-20B is from OpenAI's model card (high reasoning); MMLU for Sarvam-30B and Math-500 for Sarvam-30B and GPT-OSS-20B are from Sarvam's release comparison. Qwen3.5-9B AIME 2026 is from a third-party evaluation.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
144
 
145
  ## Quickstart
146
 
147
  Serve with vLLM (OpenAI-compatible API):
148
 
149
  ```shell
150
- vllm serve 169Pi/Alpie_seed --port 8000 --max-model-len 262144 --reasoning-parser qwen3
151
- ```
152
-
153
- Run locally with Ollama:
154
-
155
- ```shell
156
- ollama run 169pi/alpie_seed
157
- ```
158
-
159
- Quantized 2-bit, 3-bit, and 4-bit builds are in the [GGUF repository](https://huggingface.co/169Pi/Alpie_Seed_GGUF). Thinking and non-thinking behavior is controlled through the chat template.
160
-
161
- ## Intended Use and Limitations
162
-
163
- Alpie Seed is intended for research, development, and general-purpose applications: reasoning, mathematics, coding, image/chart/document understanding, multilingual use, long-context analysis, and local deployments.
164
-
165
- - Outputs may contain factual errors, unsupported conclusions, or hallucinations.
166
- - Performance varies across languages, domains, and task complexity.
167
- - Long context does not guarantee perfect recall across the whole window.
168
- - Quantization may affect quality, speed, and memory differently across hardware.
169
- - Not a substitute for professional judgment; do not use as the sole basis for medical, legal, financial, or other high-impact decisions.
170
-
171
- ## License
172
-
173
- Apache License 2.0. Users are responsible for ensuring their use and deployment comply with applicable laws and regulations.
174
-
175
- ## Citation
176
-
177
- ```bibtex
178
- @misc{alpie_seed_9b_2026,
179
- title = {Alpie Seed 9B},
180
- author = {{169Pi AI}},
181
- year = {2026},
182
- howpublished = {\url{https://huggingface.co/169Pi/Alpie_seed}}
183
- }
184
- ```
 
39
  <p><b>A 9B open-weight vision-language model for reasoning, coding, and multimodal understanding.</b></p>
40
 
41
  <p>
42
+ <a href="https://huggingface.co/169Pi/Alpie_Seed_GGUF"><img src="https://img.shields.io/badge/📦_GGUF-2%2F3%2F4--bit-0D9488?style=flat&labelColor=042f2e" alt="GGUF"></a>
43
+ <a href="https://ollama.com/169pi"><img src="https://img.shields.io/badge/🦙_Ollama-169pi-0D9488?style=flat&labelColor=042f2e" alt="Ollama"></a>
44
+ <a href="https://github.com/169Pi"><img src="https://img.shields.io/badge/💻_GitHub-169Pi-0D9488?style=flat&labelColor=042f2e" alt="GitHub"></a>
45
  </p>
46
 
47
  <p>
48
+ <a href="https://x.com/169Pi_ai"><img src="https://img.shields.io/badge/🕮_X-@169Pi__ai-0D9488?style=flat&labelColor=042f2e" alt="X"></a>
49
+ <a href="https://www.linkedin.com/company/169pi"><img src="https://img.shields.io/badge/💼_LinkedIn-169Pi-0D9488?style=flat&labelColor=042f2e" alt="LinkedIn"></a>
50
+ <a href="https://www.youtube.com/@169pi"><img src="https://img.shields.io/badge/▶️_YouTube-@169pi-0D9488?style=flat&labelColor=042f2e" alt="YouTube"></a>
51
+ <a href="https://www.instagram.com/169pi.ai/"><img src="https://img.shields.io/badge/📸_Instagram-@169pi.ai-0D9488?style=flat&labelColor=042f2e" alt="Instagram"></a>
 
 
 
 
 
52
  </p>
53
 
54
  </div>
 
102
 
103
  ## Benchmark Results
104
 
105
+ > Alpie Seed scores are from the FP16 model and do not apply to the 2-bit, 3-bit, or 4-bit variants. **Green badge** = best score in row; **Indigo badge** = Alpie Seed score. Bold = best score among comparison models. Comparison-model scores are taken from published model cards and reports (including the [Qwen3.5-9B model card](https://huggingface.co/Qwen/Qwen3.5-9B)).
106
 
107
  ### 🧮 Language
108
 
109
+ <table style="width: 100%; border-collapse: collapse; text-align: center; font-size: 14px;">
110
+ <thead>
111
+ <tr style="border-bottom: 2px solid #7C3AED; color: #7C3AED; font-weight: 600;">
112
+ <th style="text-align: left; padding: 10px;">Benchmark</th>
113
+ <th style="padding: 10px;">Qwen3.5<br>9B</th>
114
+ <th style="padding: 10px;">Gemma 4<br>12B</th>
115
+ <th style="padding: 10px;">Ministral<br>3 8B</th>
116
+ <th style="padding: 10px;">GPT-OSS<br>20B</th>
117
+ <th style="padding: 10px;">Sarvam<br>30B</th>
118
+ <th style="padding: 10px;">Nemotron 3.5<br>Lightning</th>
119
+ <th style="padding: 10px; color: #6D28D9;"><b>Alpie Seed<br>9B</b></th>
120
+ </tr>
121
+ </thead>
122
+ <tbody>
123
+ <tr style="background-color: #F5F3FF; color: #6D28D9; font-weight: bold; text-align: left;">
124
+ <td colspan="8" style="padding: 8px 12px;">Knowledge &amp; STEM</td>
125
+ </tr>
126
+ <tr style="border-bottom: 1px solid #F1F5F9;">
127
+ <td style="text-align: left; padding: 8px 12px;">MMLU</td>
128
+ <td>--</td><td>--</td><td>--</td><td>85.3</td><td>85.1</td><td>--</td>
129
+ <td><img src="https://img.shields.io/badge/87.30-10B981?style=flat-square" alt="87.30"></td>
130
+ </tr>
131
+ <tr style="border-bottom: 1px solid #F1F5F9;">
132
+ <td style="text-align: left; padding: 8px 12px;">MMLU-Pro</td>
133
+ <td>82.5</td><td>77.2</td><td>75.00</td><td>77.2</td><td>80.0</td><td>81.94</td>
134
+ <td><img src="https://img.shields.io/badge/82.54-10B981?style=flat-square" alt="82.54"></td>
135
+ </tr>
136
+ <tr style="border-bottom: 1px solid #F1F5F9;">
137
+ <td style="text-align: left; padding: 8px 12px;">GPQA Diamond</td>
138
+ <td>81.7</td><td>78.8</td><td>38.6</td><td>71.5</td><td>66.5</td><td>75.44</td>
139
+ <td><img src="https://img.shields.io/badge/84.32-10B981?style=flat-square" alt="84.32"></td>
140
+ </tr>
141
+ <tr style="background-color: #F5F3FF; color: #6D28D9; font-weight: bold; text-align: left;">
142
+ <td colspan="8" style="padding: 8px 12px;">Mathematics</td>
143
+ </tr>
144
+ <tr style="border-bottom: 1px solid #F1F5F9;">
145
+ <td style="text-align: left; padding: 8px 12px;">GSM8K</td>
146
+ <td>--</td><td>--</td><td>--</td><td>--</td><td>--</td><td>--</td>
147
+ <td><img src="https://img.shields.io/badge/98.00-10B981?style=flat-square" alt="98.00"></td>
148
+ </tr>
149
+ <tr style="border-bottom: 1px solid #F1F5F9;">
150
+ <td style="text-align: left; padding: 8px 12px;">Math-500</td>
151
+ <td>--</td><td>--</td><td>--</td><td>94.2</td><td><b>97.0</b></td><td>--</td>
152
+ <td><img src="https://img.shields.io/badge/91.00-6366F1?style=flat-square" alt="91.00"></td>
153
+ </tr>
154
+ <tr style="border-bottom: 1px solid #F1F5F9;">
155
+ <td style="text-align: left; padding: 8px 12px;">AIME 2026</td>
156
+ <td>69.4</td><td>77.5</td><td>--</td><td>--</td><td>--</td><td>--</td>
157
+ <td><img src="https://img.shields.io/badge/83.33-10B981?style=flat-square" alt="83.33"></td>
158
+ </tr>
159
+ <tr style="background-color: #F5F3FF; color: #6D28D9; font-weight: bold; text-align: left;">
160
+ <td colspan="8" style="padding: 8px 12px;">Coding &amp; Software Engineering</td>
161
+ </tr>
162
+ <tr style="border-bottom: 1px solid #F1F5F9;">
163
+ <td style="text-align: left; padding: 8px 12px;">LiveCodeBench v6</td>
164
+ <td>65.6</td><td>72.0</td><td>61.6</td><td>61.0</td><td>70.0</td><td>--</td>
165
+ <td><img src="https://img.shields.io/badge/72.99-10B981?style=flat-square" alt="72.99"></td>
166
+ </tr>
167
+ <tr style="border-bottom: 1px solid #F1F5F9;">
168
+ <td style="text-align: left; padding: 8px 12px;">SWE-Bench Verified</td>
169
+ <td>60.0</td><td>52.0</td><td>--</td><td>60.7</td><td>34.0</td><td>51.56</td>
170
+ <td><img src="https://img.shields.io/badge/61.20-10B981?style=flat-square" alt="61.20"></td>
171
+ </tr>
172
+ </tbody>
173
+ </table>
174
 
175
  ### 👁️ Vision Language
176
 
177
+ <table style="width: 100%; border-collapse: collapse; text-align: center; font-size: 14px;">
178
+ <thead>
179
+ <tr style="border-bottom: 2px solid #7C3AED; color: #7C3AED; font-weight: 600;">
180
+ <th style="text-align: left; padding: 10px;">Benchmark</th>
181
+ <th style="padding: 10px;">GPT-5-Nano<br>2025-08-07</th>
182
+ <th style="padding: 10px;">Gemini-2.5<br>Flash-Lite</th>
183
+ <th style="padding: 10px;">Qwen3-VL<br>30B-A3B</th>
184
+ <th style="padding: 10px;">Qwen3.5<br>9B</th>
185
+ <th style="padding: 10px;">Gemma 4<br>12B</th>
186
+ <th style="padding: 10px; color: #6D28D9;"><b>Alpie Seed<br>9B</b></th>
187
+ </tr>
188
+ </thead>
189
+ <tbody>
190
+ <tr style="background-color: #F5F3FF; color: #6D28D9; font-weight: bold; text-align: left;">
191
+ <td colspan="7" style="padding: 8px 12px;">STEM and Puzzle</td>
192
+ </tr>
193
+ <tr style="border-bottom: 1px solid #F1F5F9;">
194
+ <td style="text-align: left; padding: 8px 12px;">MMMU-Pro</td>
195
+ <td>57.2</td><td>59.7</td><td>63.0</td><td><b>70.1</b></td><td>69.1</td>
196
+ <td><img src="https://img.shields.io/badge/68.70-6366F1?style=flat-square" alt="68.70"></td>
197
+ </tr>
198
+ <tr style="border-bottom: 1px solid #F1F5F9;">
199
+ <td style="text-align: left; padding: 8px 12px;">MathVision</td>
200
+ <td>62.2</td><td>52.1</td><td>65.7</td><td>78.9</td><td><b>79.7</b></td>
201
+ <td><img src="https://img.shields.io/badge/76.76-6366F1?style=flat-square" alt="76.76"></td>
202
+ </tr>
203
+ <tr style="background-color: #F5F3FF; color: #6D28D9; font-weight: bold; text-align: left;">
204
+ <td colspan="7" style="padding: 8px 12px;">General VQA</td>
205
+ </tr>
206
+ <tr style="border-bottom: 1px solid #F1F5F9;">
207
+ <td style="text-align: left; padding: 8px 12px;">RealWorldQA</td>
208
+ <td>71.8</td><td>72.2</td><td>77.4</td><td>80.3</td><td>--</td>
209
+ <td><img src="https://img.shields.io/badge/80.39-10B981?style=flat-square" alt="80.39"></td>
210
+ </tr>
211
+ <tr style="border-bottom: 1px solid #F1F5F9;">
212
+ <td style="text-align: left; padding: 8px 12px;">MMStar</td>
213
+ <td>68.6</td><td>69.1</td><td>75.5</td><td><b>79.7</b></td><td>--</td>
214
+ <td><img src="https://img.shields.io/badge/78.87-6366F1?style=flat-square" alt="78.87"></td>
215
+ </tr>
216
+ <tr style="border-bottom: 1px solid #F1F5F9;">
217
+ <td style="text-align: left; padding: 8px 12px;">HallusionBench</td>
218
+ <td>58.4</td><td>64.5</td><td>66.0</td><td>69.3</td><td>--</td>
219
+ <td><img src="https://img.shields.io/badge/79.88-10B981?style=flat-square" alt="79.88"></td>
220
+ </tr>
221
+ <tr style="background-color: #F5F3FF; color: #6D28D9; font-weight: bold; text-align: left;">
222
+ <td colspan="7" style="padding: 8px 12px;">Text Recognition and Document Understanding</td>
223
+ </tr>
224
+ <tr style="border-bottom: 1px solid #F1F5F9;">
225
+ <td style="text-align: left; padding: 8px 12px;">OCRBench</td>
226
+ <td>75.3</td><td>82.5</td><td>83.9</td><td>89.2</td><td>--</td>
227
+ <td><img src="https://img.shields.io/badge/90.30-10B981?style=flat-square" alt="90.30"></td>
228
+ </tr>
229
+ </tbody>
230
+ </table>
231
+
232
+ - SWE-Bench Verified: resolved rate using Mini-SWE-agent, with retries disabled.
233
+ - Comparison-model scores were not re-run by 169Pi, and harnesses, prompts, and benchmark versions differ, so cross-model comparisons are indicative rather than strictly like-for-like. Scores vary with dataset versions, prompts, evaluation harnesses, and inference settings.
234
+ - Empty cells (--) indicate scores not yet available or not applicable.
235
+ - MMLU for GPT-OSS-20B is from OpenAI's model card (high reasoning); MMLU for Sarvam-30B and Math-500 for Sarvam-30B and GPT-OSS-20B are from Sarvam's release comparison. Qwen3.5-9B AIME 2026 is from a third-party evaluation.
236
 
237
  ## Quickstart
238
 
239
  Serve with vLLM (OpenAI-compatible API):
240
 
241
  ```shell
242
+ vllm serve 169Pi/Alpie_seed --port 8000 --max-model-len 262144 --reasoning-parser qwen3