athrvk commited on
Commit
99e34c5
·
verified ·
1 Parent(s): 3bea086

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +18 -18
README.md CHANGED
@@ -32,7 +32,7 @@ model never predicts the value directly).
32
  - live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
33
  - gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
34
 
35
- This model card describes weights version `v0.3.3` (arch `v2`).
36
 
37
  ## Architecture
38
 
@@ -62,15 +62,15 @@ units, and range handling.
62
  | --- | ---: |
63
  | `charset.json` | 930 bytes |
64
  | `classes.json` | 1,571 bytes |
65
- | `gold_metrics_json_float32.json` | 4,314 bytes |
66
- | `gold_metrics_json_int8.json` | 4,295 bytes |
67
- | `gold_metrics_torch.json` | 4,314 bytes |
68
- | `kaggle_metrics.json` | 15,554 bytes |
69
- | `matrix.md` | 409 bytes |
70
  | `sankhya.onnx` | 161,024 bytes |
71
- | `sankhya.pt` | 168,310 bytes |
72
- | `sankhya.weights.int8.json` | 58,997 bytes |
73
- | `sankhya.weights.json` | 397,100 bytes |
74
 
75
  - `sankhya.pt` -- torch checkpoint (vocab, classes, arch, channels, state_dict)
76
  - `sankhya.onnx` -- ONNX graph, for interop/inspection
@@ -92,26 +92,26 @@ card](athrvk/gpu-sankhya-gold)):
92
 
93
  | gold set | examples | spans | value_acc | precision | recall | F1 |
94
  | --- | ---: | ---: | ---: | ---: | ---: | ---: |
95
- | gold.jsonl | 220 | 194 | 0.9536 | 0.9585 | 0.9536 | 0.9561 |
96
- | gold_deva.jsonl | 182 | 151 | 0.9801 | 0.9867 | 0.9801 | 0.9834 |
97
- | **combined** | 402 | 345 | **0.9652** | 0.9708 | 0.9652 | 0.9680 |
98
 
99
- Negatives (zero-gold-span examples): 73, false
100
  positives: 0 (0.00%).
101
 
102
  Per-category value accuracy (combined):
103
 
104
  | category | spans | value_acc |
105
  | --- | ---: | ---: |
106
- | digits | 91 | 0.9780 |
107
- | words | 254 | 0.9606 |
108
  | prefix | 81 | 0.9630 |
109
- | range | 24 | 0.9583 |
110
  | currency | 48 | 1.0000 |
111
- | multi_unit | 21 | 1.0000 |
112
  | symbol_unit | 33 | 1.0000 |
113
  | mixed_script | 2 | 1.0000 |
114
- | long | 10 | 0.8000 |
115
 
116
  ## Usage
117
 
 
32
  - live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
33
  - gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
34
 
35
+ This model card describes weights version `v0.3.4` (arch `v2`).
36
 
37
  ## Architecture
38
 
 
62
  | --- | ---: |
63
  | `charset.json` | 930 bytes |
64
  | `classes.json` | 1,571 bytes |
65
+ | `gold_metrics_json_float32.json` | 4,572 bytes |
66
+ | `gold_metrics_json_int8.json` | 4,572 bytes |
67
+ | `gold_metrics_torch.json` | 4,572 bytes |
68
+ | `kaggle_metrics.json` | 16,439 bytes |
69
+ | `matrix.md` | 739 bytes |
70
  | `sankhya.onnx` | 161,024 bytes |
71
+ | `sankhya.pt` | 167,990 bytes |
72
+ | `sankhya.weights.int8.json` | 59,007 bytes |
73
+ | `sankhya.weights.json` | 397,834 bytes |
74
 
75
  - `sankhya.pt` -- torch checkpoint (vocab, classes, arch, channels, state_dict)
76
  - `sankhya.onnx` -- ONNX graph, for interop/inspection
 
92
 
93
  | gold set | examples | spans | value_acc | precision | recall | F1 |
94
  | --- | ---: | ---: | ---: | ---: | ---: | ---: |
95
+ | gold.jsonl | 225 | 197 | 0.9543 | 0.9497 | 0.9594 | 0.9545 |
96
+ | gold_deva.jsonl | 185 | 154 | 0.9740 | 0.9805 | 0.9805 | 0.9805 |
97
+ | **combined** | 410 | 351 | **0.9630** | 0.9632 | 0.9687 | 0.9659 |
98
 
99
+ Negatives (zero-gold-span examples): 75, false
100
  positives: 0 (0.00%).
101
 
102
  Per-category value accuracy (combined):
103
 
104
  | category | spans | value_acc |
105
  | --- | ---: | ---: |
106
+ | digits | 92 | 0.9674 |
107
+ | words | 259 | 0.9614 |
108
  | prefix | 81 | 0.9630 |
109
+ | range | 27 | 0.8889 |
110
  | currency | 48 | 1.0000 |
111
+ | multi_unit | 24 | 0.9167 |
112
  | symbol_unit | 33 | 1.0000 |
113
  | mixed_script | 2 | 1.0000 |
114
+ | long | 12 | 0.6667 |
115
 
116
  ## Usage
117