Spaces:
Running
Running
Org card: all five models run in the v2.5 one-click build
Browse files
README.md
CHANGED
|
@@ -22,7 +22,7 @@ Founded by Harshit Goyal, former Google software engineer and IIIT Delhi alumnus
|
|
| 22 |
| [Qwen3.5-2B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit) | 0.78 GB | 15.62 | 29.08 |
|
| 23 |
| [Qwen3.5-0.8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit) | 0.35 GB | 25.97 | 85.09 |
|
| 24 |
|
| 25 |
-
Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them.
|
| 26 |
|
| 27 |
## Pingala-8: 2-bit LLMs for llama.cpp, no retraining
|
| 28 |
|
|
@@ -35,6 +35,6 @@ Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock
|
|
| 35 |
|
| 36 |
- **Models:** [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) and [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit)
|
| 37 |
- **Benchmarks:** [pingala8-benchmarks](https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks)
|
| 38 |
-
- **One-click Windows
|
| 39 |
- **Code:** [Genrius-AI/pingala8-llm](https://github.com/Genrius-AI/pingala8-llm)
|
| 40 |
- **Paper:** [doi.org/10.5281/zenodo.23481757](https://doi.org/10.5281/zenodo.23481757)
|
|
|
|
| 22 |
| [Qwen3.5-2B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-2B-Pingala8-2bit) | 0.78 GB | 15.62 | 29.08 |
|
| 23 |
| [Qwen3.5-0.8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-0.8B-Pingala8-2bit) | 0.35 GB | 25.97 | 85.09 |
|
| 24 |
|
| 25 |
+
Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them. All five run in the [v2.5 one-click build](https://github.com/Genrius-AI/pingala8-llm/releases/latest) (Windows and Linux); Qwen3.5-2B and Qwen3.5-0.8B need v2.5 or later.
|
| 26 |
|
| 27 |
## Pingala-8: 2-bit LLMs for llama.cpp, no retraining
|
| 28 |
|
|
|
|
| 35 |
|
| 36 |
- **Models:** [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) and [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit)
|
| 37 |
- **Benchmarks:** [pingala8-benchmarks](https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks)
|
| 38 |
+
- **One-click build (Windows and Linux, all five models):** [v2.5](https://github.com/Genrius-AI/pingala8-llm/releases/latest)
|
| 39 |
- **Code:** [Genrius-AI/pingala8-llm](https://github.com/Genrius-AI/pingala8-llm)
|
| 40 |
- **Paper:** [doi.org/10.5281/zenodo.23481757](https://doi.org/10.5281/zenodo.23481757)
|