Ollaya package for convaiinnovations/laya
Browse files- README.md +51 -0
- en/calibration.json +15 -0
- en/decision.json +28 -0
- en/model-fp16.onnx +3 -0
- en/model-fp32.onnx +3 -0
- multilingual/calibration.json +8 -0
- multilingual/decision.json +28 -0
- multilingual/model-fp16.onnx +3 -0
- multilingual/model-fp32.onnx +3 -0
- typed-decisions/calibration.json +15 -0
- typed-decisions/decision.json +28 -0
- typed-decisions/model-fp16.onnx +3 -0
- typed-decisions/model-fp32.onnx +3 -0
README.md
ADDED
|
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model:
|
| 4 |
+
- convaiinnovations/laya
|
| 5 |
+
library_name: onnx
|
| 6 |
+
tags:
|
| 7 |
+
- ollaya
|
| 8 |
+
- onnx
|
| 9 |
+
- decision-model
|
| 10 |
+
- system-one
|
| 11 |
+
pipeline_tag: text-classification
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# laya for Ollaya
|
| 15 |
+
|
| 16 |
+
[Ollaya](https://github.com/ollaya-dev/ollaya) package of **[convaiinnovations/laya](https://huggingface.co/convaiinnovations/laya)** by Convai Innovations.
|
| 17 |
+
Ollaya runs open decision models locally, the way Ollama runs LLMs: typed questions in,
|
| 18 |
+
calibrated answers out, behind a TypeSafe-compatible API.
|
| 19 |
+
|
| 20 |
+
```sh
|
| 21 |
+
ollaya run laya
|
| 22 |
+
```
|
| 23 |
+
|
| 24 |
+
## What is in this repository
|
| 25 |
+
|
| 26 |
+
This repository holds only the files Ollaya derives, with no weights. Each graph is an ONNX export of the
|
| 27 |
+
original model whose weights **reference the author's own `model.safetensors` by byte offset**,
|
| 28 |
+
so `ollaya pull` downloads the weights from the upstream repository, unmodified and pinned to a
|
| 29 |
+
commit, and verifies their sha256.
|
| 30 |
+
|
| 31 |
+
| Tag | Upstream | Files |
|
| 32 |
+
|---|---|---|
|
| 33 |
+
| `laya:en` | [convaiinnovations/laya@aa8c91c](https://huggingface.co/convaiinnovations/laya/tree/aa8c91ca088ec597df95a0d1c76b3063cb2ae5e8) | `en/model-fp32.onnx`, `en/model-fp16.onnx`, `en/decision.json`, `en/calibration.json` |
|
| 34 |
+
| `laya:multilingual` | [convaiinnovations/laya@aa8c91c](https://huggingface.co/convaiinnovations/laya/tree/aa8c91ca088ec597df95a0d1c76b3063cb2ae5e8) | `multilingual/model-fp32.onnx`, `multilingual/model-fp16.onnx`, `multilingual/decision.json`, `multilingual/calibration.json` |
|
| 35 |
+
| `laya:typed-decisions` | [convaiinnovations/laya@aa8c91c](https://huggingface.co/convaiinnovations/laya/tree/aa8c91ca088ec597df95a0d1c76b3063cb2ae5e8) | `typed-decisions/model-fp32.onnx`, `typed-decisions/model-fp16.onnx`, `typed-decisions/decision.json`, `typed-decisions/calibration.json` |
|
| 36 |
+
|
| 37 |
+
Each tag has an fp32 graph (CPU) and an fp16 graph (GPU). Each tag also has `decision.json` (sequence layout, special tokens) and
|
| 38 |
+
`calibration.json` (temperatures).
|
| 39 |
+
|
| 40 |
+
## Parity
|
| 41 |
+
|
| 42 |
+
The exports are checked against the PyTorch reference on 2,383 questions per checkpoint.
|
| 43 |
+
The checks use typed-decisions plus multilingual and edge cases:
|
| 44 |
+
|
| 45 |
+
- **fp32:** the same decision on 100% of questions, with probabilities within 1.1e-4.
|
| 46 |
+
- **fp16:** the same decision on 99.1–99.6% of questions. Nearly all of the differences are
|
| 47 |
+
near-ties between the top two options.
|
| 48 |
+
|
| 49 |
+
## License
|
| 50 |
+
|
| 51 |
+
Same as the upstream model (Apache-2.0). Ollaya itself is Apache-2.0.
|
en/calibration.json
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"temperature": [
|
| 3 |
+
1.6369030475616455,
|
| 4 |
+
1.2514300346374512,
|
| 5 |
+
1.983399510383606
|
| 6 |
+
],
|
| 7 |
+
"temperature_by_options": {
|
| 8 |
+
"choice:3-5": 1.7601518630981445,
|
| 9 |
+
"choice:6-10": 1.0000158548355103,
|
| 10 |
+
"score:3-5": 1.2514300346374512,
|
| 11 |
+
"noul:2": 1.983399510383606,
|
| 12 |
+
"choice:11+": 0.10058280825614929,
|
| 13 |
+
"choice:2": 1.9063563346862793
|
| 14 |
+
}
|
| 15 |
+
}
|
en/decision.json
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"engine": "onnx",
|
| 3 |
+
"family": "laya",
|
| 4 |
+
"layout": "laya-markers-v1",
|
| 5 |
+
"encoder": "answerdotai/ModernBERT-large",
|
| 6 |
+
"max_len": 512,
|
| 7 |
+
"head_max_len": 192,
|
| 8 |
+
"special_tokens": {
|
| 9 |
+
"cls": 50281,
|
| 10 |
+
"sep": 50282,
|
| 11 |
+
"mask": 50284,
|
| 12 |
+
"pad": 50283,
|
| 13 |
+
"mask_text": "[MASK]"
|
| 14 |
+
},
|
| 15 |
+
"inputs": [
|
| 16 |
+
"input_ids",
|
| 17 |
+
"attention_mask",
|
| 18 |
+
"marker_pos",
|
| 19 |
+
"marker_mask",
|
| 20 |
+
"qtype"
|
| 21 |
+
],
|
| 22 |
+
"outputs": [
|
| 23 |
+
"logits",
|
| 24 |
+
"act_logits"
|
| 25 |
+
],
|
| 26 |
+
"min_markers": 2,
|
| 27 |
+
"opset": 20
|
| 28 |
+
}
|
en/model-fp16.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:32b6a61761499a64d8f20406ed1baa5fe6f0e860a65717c03f804b15bc958886
|
| 3 |
+
size 3708204
|
en/model-fp32.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c54880e1ab520b5f99ef8417ed2a1f7ef19414e90e87681d1497b39147f8f97a
|
| 3 |
+
size 3722668
|
multilingual/calibration.json
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"temperature": [
|
| 3 |
+
1.0,
|
| 4 |
+
1.0,
|
| 5 |
+
1.0
|
| 6 |
+
],
|
| 7 |
+
"temperature_by_options": {}
|
| 8 |
+
}
|
multilingual/decision.json
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"engine": "onnx",
|
| 3 |
+
"family": "laya",
|
| 4 |
+
"layout": "laya-markers-v1",
|
| 5 |
+
"encoder": "jhu-clsp/mmBERT-base",
|
| 6 |
+
"max_len": 1024,
|
| 7 |
+
"head_max_len": 256,
|
| 8 |
+
"special_tokens": {
|
| 9 |
+
"cls": 2,
|
| 10 |
+
"sep": 1,
|
| 11 |
+
"mask": 4,
|
| 12 |
+
"pad": 0,
|
| 13 |
+
"mask_text": "<mask>"
|
| 14 |
+
},
|
| 15 |
+
"inputs": [
|
| 16 |
+
"input_ids",
|
| 17 |
+
"attention_mask",
|
| 18 |
+
"marker_pos",
|
| 19 |
+
"marker_mask",
|
| 20 |
+
"qtype"
|
| 21 |
+
],
|
| 22 |
+
"outputs": [
|
| 23 |
+
"logits",
|
| 24 |
+
"act_logits"
|
| 25 |
+
],
|
| 26 |
+
"min_markers": 2,
|
| 27 |
+
"opset": 20
|
| 28 |
+
}
|
multilingual/model-fp16.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:236fbdec33bd2aa44ee4dae43a83173ef3351c4eed6afd073df387c9486ec7d6
|
| 3 |
+
size 2969921
|
multilingual/model-fp32.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e4437087513397063f5d53a904a2404c4bda3cbf4ab30b3c4813678ea9f49e8e
|
| 3 |
+
size 2981576
|
typed-decisions/calibration.json
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"temperature": [
|
| 3 |
+
1.0148024559020996,
|
| 4 |
+
1.0374259948730469,
|
| 5 |
+
1.0575125217437744
|
| 6 |
+
],
|
| 7 |
+
"temperature_by_options": {
|
| 8 |
+
"choice:3-5": 1.7601518630981445,
|
| 9 |
+
"choice:6-10": 1.0000158548355103,
|
| 10 |
+
"score:3-5": 1.2514300346374512,
|
| 11 |
+
"noul:2": 1.983399510383606,
|
| 12 |
+
"choice:11+": 0.10058280825614929,
|
| 13 |
+
"choice:2": 1.9063563346862793
|
| 14 |
+
}
|
| 15 |
+
}
|
typed-decisions/decision.json
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"engine": "onnx",
|
| 3 |
+
"family": "laya",
|
| 4 |
+
"layout": "laya-markers-v1",
|
| 5 |
+
"encoder": "answerdotai/ModernBERT-large",
|
| 6 |
+
"max_len": 1024,
|
| 7 |
+
"head_max_len": 256,
|
| 8 |
+
"special_tokens": {
|
| 9 |
+
"cls": 50281,
|
| 10 |
+
"sep": 50282,
|
| 11 |
+
"mask": 50284,
|
| 12 |
+
"pad": 50283,
|
| 13 |
+
"mask_text": "[MASK]"
|
| 14 |
+
},
|
| 15 |
+
"inputs": [
|
| 16 |
+
"input_ids",
|
| 17 |
+
"attention_mask",
|
| 18 |
+
"marker_pos",
|
| 19 |
+
"marker_mask",
|
| 20 |
+
"qtype"
|
| 21 |
+
],
|
| 22 |
+
"outputs": [
|
| 23 |
+
"logits",
|
| 24 |
+
"act_logits"
|
| 25 |
+
],
|
| 26 |
+
"min_markers": 2,
|
| 27 |
+
"opset": 20
|
| 28 |
+
}
|
typed-decisions/model-fp16.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4e9008a387a95b3c164f8ca3bc3c96bbdd2074f1a91b2d51c952a3b6b5d38ab
|
| 3 |
+
size 3600993
|
typed-decisions/model-fp32.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d648ef513e8d9f1d66a98ccb1d0a71b6902cb776d5332e90b56cea10c1b6e1e
|
| 3 |
+
size 3722669
|