mertcobanov commited on
Commit
cecc407
·
verified ·
1 Parent(s): fec29e6

Ollaya package for alibiserikbay/JevK5-GGUF

Browse files
Files changed (3) hide show
  1. 4b/calibration.json +9 -0
  2. 4b/decision.json +64 -0
  3. README.md +43 -0
4b/calibration.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "temperature": [
3
+ 1.22,
4
+ 1.22,
5
+ 1.22
6
+ ],
7
+ "temperature_by_options": {},
8
+ "source": "JevK5 v0.3 (4B) GGUF temperature 1.22 from the JevK5-GGUF card and jevk5_config.json (alibiserikbay/JevK5@c4f7fdb3); knockout_temperature 0.93 applies above 16 options, which jevk5-v1 does not read"
9
+ }
4b/decision.json ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "engine": "llama",
3
+ "family": "jevk5",
4
+ "layout": "jevk5-v1",
5
+ "labels": {
6
+ "strings": [
7
+ "A",
8
+ "B",
9
+ "C",
10
+ "D",
11
+ "E",
12
+ "F",
13
+ "G",
14
+ "H",
15
+ "I",
16
+ "J",
17
+ "K",
18
+ "L",
19
+ "M",
20
+ "N",
21
+ "O",
22
+ "P"
23
+ ],
24
+ "ids": [
25
+ 32,
26
+ 33,
27
+ 34,
28
+ 35,
29
+ 36,
30
+ 37,
31
+ 38,
32
+ 39,
33
+ 40,
34
+ 41,
35
+ 42,
36
+ 43,
37
+ 44,
38
+ 45,
39
+ 46,
40
+ 47
41
+ ]
42
+ },
43
+ "upstream": {
44
+ "runtime": "https://github.com/allebee/jevk5",
45
+ "commit": "f944fe37ff1d5ed3830aa4c8d88b7189c8c1268a",
46
+ "source": "jevk5/prompt.py"
47
+ },
48
+ "gguf": {
49
+ "repo": "alibiserikbay/JevK5-GGUF",
50
+ "revision": "ec67b0bfce5119a8b11a2cdb430bb43e3fa3e82a",
51
+ "path": "jevk5-4b-v0.3-Q8_0.gguf",
52
+ "sha256": "aea433883bc7ed399f2fbd539e53d2eac7caf71a946fe6650995a413979d4a30",
53
+ "size": 4482402720,
54
+ "quantization": "Q8_0",
55
+ "architecture": "qwen35",
56
+ "url": "https://huggingface.co/alibiserikbay/JevK5-GGUF/resolve/ec67b0bfce5119a8b11a2cdb430bb43e3fa3e82a/jevk5-4b-v0.3-Q8_0.gguf"
57
+ },
58
+ "llama": {
59
+ "n_ctx": 16384,
60
+ "swa_full": false,
61
+ "plan": "cold",
62
+ "build": "b11146"
63
+ }
64
+ }
README.md ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - alibiserikbay/JevK5-GGUF
5
+ tags:
6
+ - ollaya
7
+ - gguf
8
+ - llama.cpp
9
+ - decision-model
10
+ - system-one
11
+ pipeline_tag: text-classification
12
+ ---
13
+
14
+ # jevk5 for Ollaya
15
+
16
+ [Ollaya](https://github.com/ollaya-dev/ollaya) package of **[alibiserikbay/JevK5-GGUF](https://huggingface.co/alibiserikbay/JevK5-GGUF)** by alibiserikbay.
17
+ Ollaya runs open decision models locally, the way Ollama runs LLMs: typed questions in,
18
+ calibrated answers out, behind a TypeSafe-compatible API.
19
+
20
+ ```sh
21
+ ollaya run jevk5
22
+ ```
23
+
24
+ ## What is in this repository
25
+
26
+ This repository holds only the files Ollaya derives, with no weights. The model is the authors' own GGUF
27
+ file: `ollaya pull` downloads it from their repository, unmodified and pinned to a commit, verifies its
28
+ sha256, and Ollaya runs it on llama.cpp.
29
+
30
+ | Tag | The authors' GGUF | Files |
31
+ |---|---|---|
32
+ | `jevk5:4b` | [alibiserikbay/JevK5-GGUF@ec67b0b](https://huggingface.co/alibiserikbay/JevK5-GGUF/tree/ec67b0bfce5119a8b11a2cdb430bb43e3fa3e82a) `jevk5-4b-v0.3-Q8_0.gguf` | `4b/decision.json`, `4b/calibration.json` |
33
+
34
+ Each tag has `decision.json` (the prompt, the option labels Ollaya reads and llama.cpp's settings) and
35
+ `calibration.json` (temperatures).
36
+
37
+ ## Parity
38
+
39
+ Ollaya's runner matches stock llama-server of the pinned build (b11146) on the same GGUF, CUDA (RTX 4090): 593 questions, every decision the same, option logits within 7.7e-6 and probabilities within 1.6e-6. The prompts are byte-identical to the author's jevk5.prompt.
40
+
41
+ ## License
42
+
43
+ Same as the upstream model (Apache-2.0). Ollaya itself is Apache-2.0.