harshit-genrius commited on
Commit
f2077ef
·
verified ·
1 Parent(s): c9fbb7d

Org card: all five models run in the v2.5 one-click build

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -22,7 +22,7 @@ Founded by Harshit Goyal, former Google software engineer and IIIT Delhi alumnus
22
  | [Qwen3.5-2B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit) | 0.78 GB | 15.62 | 29.08 |
23
  | [Qwen3.5-0.8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit) | 0.35 GB | 25.97 | 85.09 |
24
 
25
- Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them. Qwen3.5-2B and Qwen3.5-0.8B need the rebuilt runtime (the released patch plus a loader patch on main); the one-click build cannot load them yet.
26
 
27
  ## Pingala-8: 2-bit LLMs for llama.cpp, no retraining
28
 
@@ -35,6 +35,6 @@ Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock
35
 
36
  - **Models:** [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) and [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit)
37
  - **Benchmarks:** [pingala8-benchmarks](https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks)
38
- - **One-click Windows build:** [v2.4-oneclick](https://github.com/Genrius-AI/pingala8-llm/releases/tag/v2.4-oneclick)
39
  - **Code:** [Genrius-AI/pingala8-llm](https://github.com/Genrius-AI/pingala8-llm)
40
  - **Paper:** [doi.org/10.5281/zenodo.23481757](https://doi.org/10.5281/zenodo.23481757)
 
22
  | [Qwen3.5-2B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit) | 0.78 GB | 15.62 | 29.08 |
23
  | [Qwen3.5-0.8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit) | 0.35 GB | 25.97 | 85.09 |
24
 
25
+ Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them. All five run in the [v2.5 one-click build](https://github.com/Genrius-AI/pingala8-llm/releases/latest) (Windows and Linux); Qwen3.5-2B and Qwen3.5-0.8B need v2.5 or later.
26
 
27
  ## Pingala-8: 2-bit LLMs for llama.cpp, no retraining
28
 
 
35
 
36
  - **Models:** [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) and [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit)
37
  - **Benchmarks:** [pingala8-benchmarks](https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks)
38
+ - **One-click build (Windows and Linux, all five models):** [v2.5](https://github.com/Genrius-AI/pingala8-llm/releases/latest)
39
  - **Code:** [Genrius-AI/pingala8-llm](https://github.com/Genrius-AI/pingala8-llm)
40
  - **Paper:** [doi.org/10.5281/zenodo.23481757](https://doi.org/10.5281/zenodo.23481757)