abhishekgahlot commited on
Commit
4bdbf67
·
verified ·
1 Parent(s): 2b20017

GGUF tile: measured facts only

Browse files
Files changed (2) hide show
  1. README.md +1 -1
  2. index.html +1 -1
README.md CHANGED
@@ -23,7 +23,7 @@ A decision model has to be small enough and fast enough to sit inside a product,
23
  - [OpenJev GGUF](https://huggingface.co/openjev/openjev-GGUF): llama.cpp builds; Q4_K_M runs text decisions on a 24 GB card (RTX 3090 / 4090), Q8_0 for 40 GB and up.
24
  - [OpenJev Flash 9B](https://huggingface.co/openjev/OpenJev-Flash-9B): the 9B model, BF16 weights for text decisions, about 1.6x faster than OpenJev; on par with Clef-Flash, Kev-9B and Nimble on JevBench's public items.
25
  - [OpenJev Flash 9B MLX](https://huggingface.co/openjev/OpenJev-Flash-9B-MLX): the 9B model in 8-bit for Apple silicon.
26
- - [OpenJev Flash 9B MLX 4-bit](https://huggingface.co/openjev/OpenJev-Flash-9B-MLX-4bit), [FP8](https://huggingface.co/openjev/OpenJev-Flash-9B-FP8) and [GGUF](https://huggingface.co/openjev/OpenJev-Flash-9B-GGUF): the 9B for smaller Macs, vLLM without load-time quantization, and llama.cpp.
27
 
28
  **One server. Any model.** [openjev-server](https://huggingface.co/spaces/openjev/openjev-server) runs the same decision API on your own hardware, with OpenJev or any open model you choose, on a GPU or a Mac. `pip install` and one command to serve. Apache 2.0.
29
 
 
23
  - [OpenJev GGUF](https://huggingface.co/openjev/openjev-GGUF): llama.cpp builds; Q4_K_M runs text decisions on a 24 GB card (RTX 3090 / 4090), Q8_0 for 40 GB and up.
24
  - [OpenJev Flash 9B](https://huggingface.co/openjev/OpenJev-Flash-9B): the 9B model, BF16 weights for text decisions, about 1.6x faster than OpenJev; on par with Clef-Flash, Kev-9B and Nimble on JevBench's public items.
25
  - [OpenJev Flash 9B MLX](https://huggingface.co/openjev/OpenJev-Flash-9B-MLX): the 9B model in 8-bit for Apple silicon.
26
+ - [OpenJev Flash 9B MLX 4-bit](https://huggingface.co/openjev/OpenJev-Flash-9B-MLX-4bit), [FP8](https://huggingface.co/openjev/OpenJev-Flash-9B-FP8) and [GGUF](https://huggingface.co/openjev/OpenJev-Flash-9B-GGUF): the 9B for smaller Macs, vLLM without load-time quantization, and llama.cpp from 5.6 GB.
27
 
28
  **One server. Any model.** [openjev-server](https://huggingface.co/spaces/openjev/openjev-server) runs the same decision API on your own hardware, with OpenJev or any open model you choose, on a GPU or a Mac. `pip install` and one command to serve. Apache 2.0.
29
 
index.html CHANGED
@@ -31,7 +31,7 @@
31
  <a href="https://huggingface.co/openjev/OpenJev-Flash-9B-MLX" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B MLX ↗</strong><br><small style="opacity:.75">9B · 8-bit · Apple silicon</small></a>
32
  <a href="https://huggingface.co/openjev/OpenJev-Flash-9B-MLX-4bit" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B MLX 4-bit ↗</strong><br><small style="opacity:.75">9B · about 5 GB · Apple silicon</small></a>
33
  <a href="https://huggingface.co/openjev/OpenJev-Flash-9B-FP8" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B FP8 ↗</strong><br><small style="opacity:.75">9B · 11.9 GB · GPU</small></a>
34
- <a href="https://huggingface.co/openjev/OpenJev-Flash-9B-GGUF" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B GGUF ↗</strong><br><small style="opacity:.75">9B · llama.cpp · laptops and CPUs</small></a>
35
  </div>
36
  <p style="font-size:13px;opacity:.8;margin:0 0 18px">Your labels are supplied at request time. One forward pass per question with up to 52 choices. Open weights for research and non-commercial use under CC BY-NC 4.0. Commercial licence: <a href="mailto:support@loopai.com">support@loopai.com</a>.</p>
37
  <h2 style="font-size:21px;letter-spacing:-.4px;margin:18px 0 8px">One server. Any model.</h2>
 
31
  <a href="https://huggingface.co/openjev/OpenJev-Flash-9B-MLX" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B MLX ↗</strong><br><small style="opacity:.75">9B · 8-bit · Apple silicon</small></a>
32
  <a href="https://huggingface.co/openjev/OpenJev-Flash-9B-MLX-4bit" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B MLX 4-bit ↗</strong><br><small style="opacity:.75">9B · about 5 GB · Apple silicon</small></a>
33
  <a href="https://huggingface.co/openjev/OpenJev-Flash-9B-FP8" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B FP8 ↗</strong><br><small style="opacity:.75">9B · 11.9 GB · GPU</small></a>
34
+ <a href="https://huggingface.co/openjev/OpenJev-Flash-9B-GGUF" target="_blank" rel="noopener noreferrer" style="flex:1 1 175px;border:1px solid #82948966;border-radius:9px;padding:14px;color:inherit;text-decoration:none"><strong>OpenJev Flash 9B GGUF ↗</strong><br><small style="opacity:.75">9B · llama.cpp · from 5.6 GB</small></a>
35
  </div>
36
  <p style="font-size:13px;opacity:.8;margin:0 0 18px">Your labels are supplied at request time. One forward pass per question with up to 52 choices. Open weights for research and non-commercial use under CC BY-NC 4.0. Commercial licence: <a href="mailto:support@loopai.com">support@loopai.com</a>.</p>
37
  <h2 style="font-size:21px;letter-spacing:-.4px;margin:18px 0 8px">One server. Any model.</h2>