mertcobanov commited on
Commit
d7629d5
·
verified ·
1 Parent(s): 84f5225

Ollaya package for convaiinnovations/laya

Browse files
README.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - convaiinnovations/laya
5
+ library_name: onnx
6
+ tags:
7
+ - ollaya
8
+ - onnx
9
+ - decision-model
10
+ - system-one
11
+ pipeline_tag: text-classification
12
+ ---
13
+
14
+ # laya for Ollaya
15
+
16
+ [Ollaya](https://github.com/ollaya-dev/ollaya) package of **[convaiinnovations/laya](https://huggingface.co/convaiinnovations/laya)** by Convai Innovations.
17
+ Ollaya runs open decision models locally, the way Ollama runs LLMs: typed questions in,
18
+ calibrated answers out, behind a TypeSafe-compatible API.
19
+
20
+ ```sh
21
+ ollaya run laya
22
+ ```
23
+
24
+ ## What is in this repository
25
+
26
+ This repository holds only the files Ollaya derives, with no weights. Each graph is an ONNX export of the
27
+ original model whose weights **reference the author's own `model.safetensors` by byte offset**,
28
+ so `ollaya pull` downloads the weights from the upstream repository, unmodified and pinned to a
29
+ commit, and verifies their sha256.
30
+
31
+ | Tag | Upstream | Files |
32
+ |---|---|---|
33
+ | `laya:en` | [convaiinnovations/laya@aa8c91c](https://huggingface.co/convaiinnovations/laya/tree/aa8c91ca088ec597df95a0d1c76b3063cb2ae5e8) | `en/model-fp32.onnx`, `en/model-fp16.onnx`, `en/decision.json`, `en/calibration.json` |
34
+ | `laya:multilingual` | [convaiinnovations/laya@aa8c91c](https://huggingface.co/convaiinnovations/laya/tree/aa8c91ca088ec597df95a0d1c76b3063cb2ae5e8) | `multilingual/model-fp32.onnx`, `multilingual/model-fp16.onnx`, `multilingual/decision.json`, `multilingual/calibration.json` |
35
+ | `laya:typed-decisions` | [convaiinnovations/laya@aa8c91c](https://huggingface.co/convaiinnovations/laya/tree/aa8c91ca088ec597df95a0d1c76b3063cb2ae5e8) | `typed-decisions/model-fp32.onnx`, `typed-decisions/model-fp16.onnx`, `typed-decisions/decision.json`, `typed-decisions/calibration.json` |
36
+
37
+ Each tag has an fp32 graph (CPU) and an fp16 graph (GPU). Each tag also has `decision.json` (sequence layout, special tokens) and
38
+ `calibration.json` (temperatures).
39
+
40
+ ## Parity
41
+
42
+ The exports are checked against the PyTorch reference on 2,383 questions per checkpoint.
43
+ The checks use typed-decisions plus multilingual and edge cases:
44
+
45
+ - **fp32:** the same decision on 100% of questions, with probabilities within 1.1e-4.
46
+ - **fp16:** the same decision on 99.1–99.6% of questions. Nearly all of the differences are
47
+ near-ties between the top two options.
48
+
49
+ ## License
50
+
51
+ Same as the upstream model (Apache-2.0). Ollaya itself is Apache-2.0.
en/calibration.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "temperature": [
3
+ 1.6369030475616455,
4
+ 1.2514300346374512,
5
+ 1.983399510383606
6
+ ],
7
+ "temperature_by_options": {
8
+ "choice:3-5": 1.7601518630981445,
9
+ "choice:6-10": 1.0000158548355103,
10
+ "score:3-5": 1.2514300346374512,
11
+ "noul:2": 1.983399510383606,
12
+ "choice:11+": 0.10058280825614929,
13
+ "choice:2": 1.9063563346862793
14
+ }
15
+ }
en/decision.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "engine": "onnx",
3
+ "family": "laya",
4
+ "layout": "laya-markers-v1",
5
+ "encoder": "answerdotai/ModernBERT-large",
6
+ "max_len": 512,
7
+ "head_max_len": 192,
8
+ "special_tokens": {
9
+ "cls": 50281,
10
+ "sep": 50282,
11
+ "mask": 50284,
12
+ "pad": 50283,
13
+ "mask_text": "[MASK]"
14
+ },
15
+ "inputs": [
16
+ "input_ids",
17
+ "attention_mask",
18
+ "marker_pos",
19
+ "marker_mask",
20
+ "qtype"
21
+ ],
22
+ "outputs": [
23
+ "logits",
24
+ "act_logits"
25
+ ],
26
+ "min_markers": 2,
27
+ "opset": 20
28
+ }
en/model-fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32b6a61761499a64d8f20406ed1baa5fe6f0e860a65717c03f804b15bc958886
3
+ size 3708204
en/model-fp32.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c54880e1ab520b5f99ef8417ed2a1f7ef19414e90e87681d1497b39147f8f97a
3
+ size 3722668
multilingual/calibration.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "temperature": [
3
+ 1.0,
4
+ 1.0,
5
+ 1.0
6
+ ],
7
+ "temperature_by_options": {}
8
+ }
multilingual/decision.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "engine": "onnx",
3
+ "family": "laya",
4
+ "layout": "laya-markers-v1",
5
+ "encoder": "jhu-clsp/mmBERT-base",
6
+ "max_len": 1024,
7
+ "head_max_len": 256,
8
+ "special_tokens": {
9
+ "cls": 2,
10
+ "sep": 1,
11
+ "mask": 4,
12
+ "pad": 0,
13
+ "mask_text": "<mask>"
14
+ },
15
+ "inputs": [
16
+ "input_ids",
17
+ "attention_mask",
18
+ "marker_pos",
19
+ "marker_mask",
20
+ "qtype"
21
+ ],
22
+ "outputs": [
23
+ "logits",
24
+ "act_logits"
25
+ ],
26
+ "min_markers": 2,
27
+ "opset": 20
28
+ }
multilingual/model-fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:236fbdec33bd2aa44ee4dae43a83173ef3351c4eed6afd073df387c9486ec7d6
3
+ size 2969921
multilingual/model-fp32.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4437087513397063f5d53a904a2404c4bda3cbf4ab30b3c4813678ea9f49e8e
3
+ size 2981576
typed-decisions/calibration.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "temperature": [
3
+ 1.0148024559020996,
4
+ 1.0374259948730469,
5
+ 1.0575125217437744
6
+ ],
7
+ "temperature_by_options": {
8
+ "choice:3-5": 1.7601518630981445,
9
+ "choice:6-10": 1.0000158548355103,
10
+ "score:3-5": 1.2514300346374512,
11
+ "noul:2": 1.983399510383606,
12
+ "choice:11+": 0.10058280825614929,
13
+ "choice:2": 1.9063563346862793
14
+ }
15
+ }
typed-decisions/decision.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "engine": "onnx",
3
+ "family": "laya",
4
+ "layout": "laya-markers-v1",
5
+ "encoder": "answerdotai/ModernBERT-large",
6
+ "max_len": 1024,
7
+ "head_max_len": 256,
8
+ "special_tokens": {
9
+ "cls": 50281,
10
+ "sep": 50282,
11
+ "mask": 50284,
12
+ "pad": 50283,
13
+ "mask_text": "[MASK]"
14
+ },
15
+ "inputs": [
16
+ "input_ids",
17
+ "attention_mask",
18
+ "marker_pos",
19
+ "marker_mask",
20
+ "qtype"
21
+ ],
22
+ "outputs": [
23
+ "logits",
24
+ "act_logits"
25
+ ],
26
+ "min_markers": 2,
27
+ "opset": 20
28
+ }
typed-decisions/model-fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4e9008a387a95b3c164f8ca3bc3c96bbdd2074f1a91b2d51c952a3b6b5d38ab
3
+ size 3600993
typed-decisions/model-fp32.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d648ef513e8d9f1d66a98ccb1d0a71b6902cb776d5332e90b56cea10c1b6e1e
3
+ size 3722669