Spaces:
Running
Running
Add Qwen3.5-2B and Qwen3.5-0.8B Pingala-8 to the models table
Browse files- README.md +3 -1
- index.html +4 -2
README.md
CHANGED
|
@@ -19,8 +19,10 @@ Founded by Harshit Goyal, former Google software engineer and IIIT Delhi alumnus
|
|
| 19 |
| [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) | 1.24 GB | 16.64 | 28.61 |
|
| 20 |
| [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit) | 2.39 GB | 9.14 | 12.35 |
|
| 21 |
| [Qwen3.5-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit) | 1.51 GB | 10.97 | 14.75 |
|
|
|
|
|
|
|
| 22 |
|
| 23 |
-
Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them.
|
| 24 |
|
| 25 |
## Pingala-8: 2-bit LLMs for llama.cpp, no retraining
|
| 26 |
|
|
|
|
| 19 |
| [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) | 1.24 GB | 16.64 | 28.61 |
|
| 20 |
| [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit) | 2.39 GB | 9.14 | 12.35 |
|
| 21 |
| [Qwen3.5-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit) | 1.51 GB | 10.97 | 14.75 |
|
| 22 |
+
| [Qwen3.5-2B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit) | 0.78 GB | 15.62 | 29.08 |
|
| 23 |
+
| [Qwen3.5-0.8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit) | 0.35 GB | 25.97 | 85.09 |
|
| 24 |
|
| 25 |
+
Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them. Qwen3.5-2B and Qwen3.5-0.8B need the rebuilt runtime (the released patch plus a loader patch on main); the one-click build cannot load them yet.
|
| 26 |
|
| 27 |
## Pingala-8: 2-bit LLMs for llama.cpp, no retraining
|
| 28 |
|
index.html
CHANGED
|
@@ -27,8 +27,10 @@
|
|
| 27 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a></td><td>1.24 GB</td><td>16.64</td><td>28.61</td></tr>
|
| 28 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a></td><td>2.39 GB</td><td>9.14</td><td>12.35</td></tr>
|
| 29 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a></td><td>1.51 GB</td><td>10.97</td><td>14.75</td></tr>
|
|
|
|
|
|
|
| 30 |
</table>
|
| 31 |
-
<p class="lead">Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them.</p>
|
| 32 |
<h2>Pingala-8: 2-bit LLMs for llama.cpp, no retraining</h2>
|
| 33 |
<ul>
|
| 34 |
<li>85% smaller: Qwen3-4B goes from 8.05 GB to 1.24 GB, and Llama 3.1 8B from 16.08 GB to 2.39 GB.</li>
|
|
@@ -42,7 +44,7 @@
|
|
| 42 |
<li><a href="https://github.com/Genrius-AI/pingala8-llm/releases/tag/v2.4-oneclick" target="_blank" rel="noopener noreferrer">One-click Windows build</a></li>
|
| 43 |
<li><a href="https://github.com/Genrius-AI/pingala8-llm" target="_blank" rel="noopener noreferrer">Code</a></li>
|
| 44 |
<li><a href="https://doi.org/10.5281/zenodo.23481757" target="_blank" rel="noopener noreferrer">Paper</a></li>
|
| 45 |
-
<li><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a>, <a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a> and <a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a> (text only)</li>
|
| 46 |
<li><a href="https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks" target="_blank" rel="noopener noreferrer">Benchmark tables</a></li>
|
| 47 |
</ul>
|
| 48 |
</main>
|
|
|
|
| 27 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a></td><td>1.24 GB</td><td>16.64</td><td>28.61</td></tr>
|
| 28 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a></td><td>2.39 GB</td><td>9.14</td><td>12.35</td></tr>
|
| 29 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a></td><td>1.51 GB</td><td>10.97</td><td>14.75</td></tr>
|
| 30 |
+
<tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-2B-Pingala8-2bit</a></td><td>0.78 GB</td><td>15.62</td><td>29.08</td></tr>
|
| 31 |
+
<tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-0.8B-Pingala8-2bit</a></td><td>0.35 GB</td><td>25.97</td><td>85.09</td></tr>
|
| 32 |
</table>
|
| 33 |
+
<p class="lead">Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them. Qwen3.5-2B and Qwen3.5-0.8B need the rebuilt runtime (the released patch plus a loader patch on main); the one-click build cannot load them yet.</p>
|
| 34 |
<h2>Pingala-8: 2-bit LLMs for llama.cpp, no retraining</h2>
|
| 35 |
<ul>
|
| 36 |
<li>85% smaller: Qwen3-4B goes from 8.05 GB to 1.24 GB, and Llama 3.1 8B from 16.08 GB to 2.39 GB.</li>
|
|
|
|
| 44 |
<li><a href="https://github.com/Genrius-AI/pingala8-llm/releases/tag/v2.4-oneclick" target="_blank" rel="noopener noreferrer">One-click Windows build</a></li>
|
| 45 |
<li><a href="https://github.com/Genrius-AI/pingala8-llm" target="_blank" rel="noopener noreferrer">Code</a></li>
|
| 46 |
<li><a href="https://doi.org/10.5281/zenodo.23481757" target="_blank" rel="noopener noreferrer">Paper</a></li>
|
| 47 |
+
<li><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a>, <a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a> and <a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a> (text only); <a href="https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-2B-Pingala8-2bit</a> and <a href="https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-0.8B-Pingala8-2bit</a> (text only, rebuilt runtime)</li>
|
| 48 |
<li><a href="https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks" target="_blank" rel="noopener noreferrer">Benchmark tables</a></li>
|
| 49 |
</ul>
|
| 50 |
</main>
|