harshit-genrius commited on
Commit
c9fbb7d
·
verified ·
1 Parent(s): ce39289

Add Qwen3.5-2B and Qwen3.5-0.8B Pingala-8 to the models table

Browse files
Files changed (2) hide show
  1. README.md +3 -1
  2. index.html +4 -2
README.md CHANGED
@@ -19,8 +19,10 @@ Founded by Harshit Goyal, former Google software engineer and IIIT Delhi alumnus
19
  | [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) | 1.24 GB | 16.64 | 28.61 |
20
  | [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit) | 2.39 GB | 9.14 | 12.35 |
21
  | [Qwen3.5-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit) | 1.51 GB | 10.97 | 14.75 |
 
 
22
 
23
- Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them.
24
 
25
  ## Pingala-8: 2-bit LLMs for llama.cpp, no retraining
26
 
 
19
  | [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) | 1.24 GB | 16.64 | 28.61 |
20
  | [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit) | 2.39 GB | 9.14 | 12.35 |
21
  | [Qwen3.5-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit) | 1.51 GB | 10.97 | 14.75 |
22
+ | [Qwen3.5-2B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit) | 0.78 GB | 15.62 | 29.08 |
23
+ | [Qwen3.5-0.8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit) | 0.35 GB | 25.97 | 85.09 |
24
 
25
+ Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them. Qwen3.5-2B and Qwen3.5-0.8B need the rebuilt runtime (the released patch plus a loader patch on main); the one-click build cannot load them yet.
26
 
27
  ## Pingala-8: 2-bit LLMs for llama.cpp, no retraining
28
 
index.html CHANGED
@@ -27,8 +27,10 @@
27
  <tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a></td><td>1.24 GB</td><td>16.64</td><td>28.61</td></tr>
28
  <tr><td><a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a></td><td>2.39 GB</td><td>9.14</td><td>12.35</td></tr>
29
  <tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a></td><td>1.51 GB</td><td>10.97</td><td>14.75</td></tr>
 
 
30
  </table>
31
- <p class="lead">Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them.</p>
32
  <h2>Pingala-8: 2-bit LLMs for llama.cpp, no retraining</h2>
33
  <ul>
34
  <li>85% smaller: Qwen3-4B goes from 8.05 GB to 1.24 GB, and Llama 3.1 8B from 16.08 GB to 2.39 GB.</li>
@@ -42,7 +44,7 @@
42
  <li><a href="https://github.com/Genrius-AI/pingala8-llm/releases/tag/v2.4-oneclick" target="_blank" rel="noopener noreferrer">One-click Windows build</a></li>
43
  <li><a href="https://github.com/Genrius-AI/pingala8-llm" target="_blank" rel="noopener noreferrer">Code</a></li>
44
  <li><a href="https://doi.org/10.5281/zenodo.23481757" target="_blank" rel="noopener noreferrer">Paper</a></li>
45
- <li><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a>, <a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a> and <a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a> (text only)</li>
46
  <li><a href="https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks" target="_blank" rel="noopener noreferrer">Benchmark tables</a></li>
47
  </ul>
48
  </main>
 
27
  <tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a></td><td>1.24 GB</td><td>16.64</td><td>28.61</td></tr>
28
  <tr><td><a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a></td><td>2.39 GB</td><td>9.14</td><td>12.35</td></tr>
29
  <tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a></td><td>1.51 GB</td><td>10.97</td><td>14.75</td></tr>
30
+ <tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-2B-Pingala8-2bit</a></td><td>0.78 GB</td><td>15.62</td><td>29.08</td></tr>
31
+ <tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-0.8B-Pingala8-2bit</a></td><td>0.35 GB</td><td>25.97</td><td>85.09</td></tr>
32
  </table>
33
+ <p class="lead">Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them. Qwen3.5-2B and Qwen3.5-0.8B need the rebuilt runtime (the released patch plus a loader patch on main); the one-click build cannot load them yet.</p>
34
  <h2>Pingala-8: 2-bit LLMs for llama.cpp, no retraining</h2>
35
  <ul>
36
  <li>85% smaller: Qwen3-4B goes from 8.05 GB to 1.24 GB, and Llama 3.1 8B from 16.08 GB to 2.39 GB.</li>
 
44
  <li><a href="https://github.com/Genrius-AI/pingala8-llm/releases/tag/v2.4-oneclick" target="_blank" rel="noopener noreferrer">One-click Windows build</a></li>
45
  <li><a href="https://github.com/Genrius-AI/pingala8-llm" target="_blank" rel="noopener noreferrer">Code</a></li>
46
  <li><a href="https://doi.org/10.5281/zenodo.23481757" target="_blank" rel="noopener noreferrer">Paper</a></li>
47
+ <li><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a>, <a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a> and <a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a> (text only); <a href="https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-2B-Pingala8-2bit</a> and <a href="https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-0.8B-Pingala8-2bit</a> (text only, rebuilt runtime)</li>
48
  <li><a href="https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks" target="_blank" rel="noopener noreferrer">Benchmark tables</a></li>
49
  </ul>
50
  </main>