Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -32,7 +32,7 @@ model never predicts the value directly).
|
|
| 32 |
- live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
|
| 33 |
- gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
|
| 34 |
|
| 35 |
-
This model card describes weights version `v0.3.
|
| 36 |
|
| 37 |
## Architecture
|
| 38 |
|
|
@@ -62,15 +62,15 @@ units, and range handling.
|
|
| 62 |
| --- | ---: |
|
| 63 |
| `charset.json` | 930 bytes |
|
| 64 |
| `classes.json` | 1,571 bytes |
|
| 65 |
-
| `gold_metrics_json_float32.json` | 4,
|
| 66 |
-
| `gold_metrics_json_int8.json` | 4,
|
| 67 |
-
| `gold_metrics_torch.json` | 4,
|
| 68 |
-
| `kaggle_metrics.json` |
|
| 69 |
-
| `matrix.md` |
|
| 70 |
| `sankhya.onnx` | 161,024 bytes |
|
| 71 |
-
| `sankhya.pt` |
|
| 72 |
-
| `sankhya.weights.int8.json` |
|
| 73 |
-
| `sankhya.weights.json` | 397,
|
| 74 |
|
| 75 |
- `sankhya.pt` -- torch checkpoint (vocab, classes, arch, channels, state_dict)
|
| 76 |
- `sankhya.onnx` -- ONNX graph, for interop/inspection
|
|
@@ -92,26 +92,26 @@ card](athrvk/gpu-sankhya-gold)):
|
|
| 92 |
|
| 93 |
| gold set | examples | spans | value_acc | precision | recall | F1 |
|
| 94 |
| --- | ---: | ---: | ---: | ---: | ---: | ---: |
|
| 95 |
-
| gold.jsonl |
|
| 96 |
-
| gold_deva.jsonl |
|
| 97 |
-
| **combined** |
|
| 98 |
|
| 99 |
-
Negatives (zero-gold-span examples):
|
| 100 |
positives: 0 (0.00%).
|
| 101 |
|
| 102 |
Per-category value accuracy (combined):
|
| 103 |
|
| 104 |
| category | spans | value_acc |
|
| 105 |
| --- | ---: | ---: |
|
| 106 |
-
| digits |
|
| 107 |
-
| words |
|
| 108 |
| prefix | 81 | 0.9630 |
|
| 109 |
-
| range |
|
| 110 |
| currency | 48 | 1.0000 |
|
| 111 |
-
| multi_unit |
|
| 112 |
| symbol_unit | 33 | 1.0000 |
|
| 113 |
| mixed_script | 2 | 1.0000 |
|
| 114 |
-
| long |
|
| 115 |
|
| 116 |
## Usage
|
| 117 |
|
|
|
|
| 32 |
- live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
|
| 33 |
- gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
|
| 34 |
|
| 35 |
+
This model card describes weights version `v0.3.4` (arch `v2`).
|
| 36 |
|
| 37 |
## Architecture
|
| 38 |
|
|
|
|
| 62 |
| --- | ---: |
|
| 63 |
| `charset.json` | 930 bytes |
|
| 64 |
| `classes.json` | 1,571 bytes |
|
| 65 |
+
| `gold_metrics_json_float32.json` | 4,572 bytes |
|
| 66 |
+
| `gold_metrics_json_int8.json` | 4,572 bytes |
|
| 67 |
+
| `gold_metrics_torch.json` | 4,572 bytes |
|
| 68 |
+
| `kaggle_metrics.json` | 16,439 bytes |
|
| 69 |
+
| `matrix.md` | 739 bytes |
|
| 70 |
| `sankhya.onnx` | 161,024 bytes |
|
| 71 |
+
| `sankhya.pt` | 167,990 bytes |
|
| 72 |
+
| `sankhya.weights.int8.json` | 59,007 bytes |
|
| 73 |
+
| `sankhya.weights.json` | 397,834 bytes |
|
| 74 |
|
| 75 |
- `sankhya.pt` -- torch checkpoint (vocab, classes, arch, channels, state_dict)
|
| 76 |
- `sankhya.onnx` -- ONNX graph, for interop/inspection
|
|
|
|
| 92 |
|
| 93 |
| gold set | examples | spans | value_acc | precision | recall | F1 |
|
| 94 |
| --- | ---: | ---: | ---: | ---: | ---: | ---: |
|
| 95 |
+
| gold.jsonl | 225 | 197 | 0.9543 | 0.9497 | 0.9594 | 0.9545 |
|
| 96 |
+
| gold_deva.jsonl | 185 | 154 | 0.9740 | 0.9805 | 0.9805 | 0.9805 |
|
| 97 |
+
| **combined** | 410 | 351 | **0.9630** | 0.9632 | 0.9687 | 0.9659 |
|
| 98 |
|
| 99 |
+
Negatives (zero-gold-span examples): 75, false
|
| 100 |
positives: 0 (0.00%).
|
| 101 |
|
| 102 |
Per-category value accuracy (combined):
|
| 103 |
|
| 104 |
| category | spans | value_acc |
|
| 105 |
| --- | ---: | ---: |
|
| 106 |
+
| digits | 92 | 0.9674 |
|
| 107 |
+
| words | 259 | 0.9614 |
|
| 108 |
| prefix | 81 | 0.9630 |
|
| 109 |
+
| range | 27 | 0.8889 |
|
| 110 |
| currency | 48 | 1.0000 |
|
| 111 |
+
| multi_unit | 24 | 0.9167 |
|
| 112 |
| symbol_unit | 33 | 1.0000 |
|
| 113 |
| mixed_script | 2 | 1.0000 |
|
| 114 |
+
| long | 12 | 0.6667 |
|
| 115 |
|
| 116 |
## Usage
|
| 117 |
|