GGUF tile: measured facts only
Browse files- README.md +1 -1
- index.html +1 -1
README.md
CHANGED
|
@@ -23,7 +23,7 @@ A decision model has to be small enough and fast enough to sit inside a product,
|
|
| 23 |
- [OpenJev GGUF](https://huggingface.co/openjev/openjev-GGUF): llama.cpp builds; Q4_K_M runs text decisions on a 24 GB card (RTX 3090 / 4090), Q8_0 for 40 GB and up.
|
| 24 |
- [OpenJev Flash 9B](https://huggingface.co/openjev/OpenJev-Flash-9B): the 9B model, BF16 weights for text decisions, about 1.6x faster than OpenJev; on par with Clef-Flash, Kev-9B and Nimble on JevBench's public items.
|
| 25 |
- [OpenJev Flash 9B MLX](https://huggingface.co/openjev/OpenJev-Flash-9B-MLX): the 9B model in 8-bit for Apple silicon.
|
| 26 |
-
- [OpenJev Flash 9B MLX 4-bit](https://huggingface.co/openjev/OpenJev-Flash-9B-MLX-4bit), [FP8](https://huggingface.co/openjev/OpenJev-Flash-9B-FP8) and [GGUF](https://huggingface.co/openjev/OpenJev-Flash-9B-GGUF): the 9B for smaller Macs, vLLM without load-time quantization, and llama.cpp.
|
| 27 |
|
| 28 |
**One server. Any model.** [openjev-server](https://huggingface.co/spaces/openjev/openjev-server) runs the same decision API on your own hardware, with OpenJev or any open model you choose, on a GPU or a Mac. `pip install` and one command to serve. Apache 2.0.
|
| 29 |
|
|
|
|
| 23 |
- [OpenJev GGUF](https://huggingface.co/openjev/openjev-GGUF): llama.cpp builds; Q4_K_M runs text decisions on a 24 GB card (RTX 3090 / 4090), Q8_0 for 40 GB and up.
|
| 24 |
- [OpenJev Flash 9B](https://huggingface.co/openjev/OpenJev-Flash-9B): the 9B model, BF16 weights for text decisions, about 1.6x faster than OpenJev; on par with Clef-Flash, Kev-9B and Nimble on JevBench's public items.
|
| 25 |
- [OpenJev Flash 9B MLX](https://huggingface.co/openjev/OpenJev-Flash-9B-MLX): the 9B model in 8-bit for Apple silicon.
|
| 26 |
+
- [OpenJev Flash 9B MLX 4-bit](https://huggingface.co/openjev/OpenJev-Flash-9B-MLX-4bit), [FP8](https://huggingface.co/openjev/OpenJev-Flash-9B-FP8) and [GGUF](https://huggingface.co/openjev/OpenJev-Flash-9B-GGUF): the 9B for smaller Macs, vLLM without load-time quantization, and llama.cpp from 5.6 GB.
|
| 27 |
|
| 28 |
**One server. Any model.** [openjev-server](https://huggingface.co/spaces/openjev/openjev-server) runs the same decision API on your own hardware, with OpenJev or any open model you choose, on a GPU or a Mac. `pip install` and one command to serve. Apache 2.0.
|
| 29 |
|
index.html
CHANGED
|
@@ -31,7 +31,7 @@
|
|
| 31 |
<a href="https://huggingface.co/openjev/OpenJev-Flash-9B-MLX" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B MLX ↗</strong><br><small style="opacity:.75">9B · 8-bit · Apple silicon</small></a>
|
| 32 |
<a href="https://huggingface.co/openjev/OpenJev-Flash-9B-MLX-4bit" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B MLX 4-bit ↗</strong><br><small style="opacity:.75">9B · about 5 GB · Apple silicon</small></a>
|
| 33 |
<a href="https://huggingface.co/openjev/OpenJev-Flash-9B-FP8" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B FP8 ↗</strong><br><small style="opacity:.75">9B · 11.9 GB · GPU</small></a>
|
| 34 |
-
<a href="https://huggingface.co/openjev/OpenJev-Flash-9B-GGUF" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B GGUF ↗</strong><br><small style="opacity:.75">9B · llama.cpp ·
|
| 35 |
</div>
|
| 36 |
<p style="font-size:13px;opacity:.8;margin:0 0 18px">Your labels are supplied at request time. One forward pass per question with up to 52 choices. Open weights for research and non-commercial use under CC BY-NC 4.0. Commercial licence: <a href="mailto:support@loopai.com">support@loopai.com</a>.</p>
|
| 37 |
<h2 style="font-size:21px;letter-spacing:-.4px;margin:18px 0 8px">One server. Any model.</h2>
|
|
|
|
| 31 |
<a href="https://huggingface.co/openjev/OpenJev-Flash-9B-MLX" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B MLX ↗</strong><br><small style="opacity:.75">9B · 8-bit · Apple silicon</small></a>
|
| 32 |
<a href="https://huggingface.co/openjev/OpenJev-Flash-9B-MLX-4bit" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B MLX 4-bit ↗</strong><br><small style="opacity:.75">9B · about 5 GB · Apple silicon</small></a>
|
| 33 |
<a href="https://huggingface.co/openjev/OpenJev-Flash-9B-FP8" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B FP8 ↗</strong><br><small style="opacity:.75">9B · 11.9 GB · GPU</small></a>
|
| 34 |
+
<a href="https://huggingface.co/openjev/OpenJev-Flash-9B-GGUF" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B GGUF ↗</strong><br><small style="opacity:.75">9B · llama.cpp · from 5.6 GB</small></a>
|
| 35 |
</div>
|
| 36 |
<p style="font-size:13px;opacity:.8;margin:0 0 18px">Your labels are supplied at request time. One forward pass per question with up to 52 choices. Open weights for research and non-commercial use under CC BY-NC 4.0. Commercial licence: <a href="mailto:support@loopai.com">support@loopai.com</a>.</p>
|
| 37 |
<h2 style="font-size:21px;letter-spacing:-.4px;margin:18px 0 8px">One server. Any model.</h2>
|