wzebrowski commited on
Commit
1815fb1
·
verified ·
1 Parent(s): 95ee42d

Document JSONLite descendant training and main-checkpoint results

Browse files

Documentation only; original base model weights, tokenizer and inference runtime remain unchanged.

PACKAGING_VERIFICATION.json CHANGED
@@ -18,5 +18,5 @@
18
  "scope": "Packaging smoke only. A plausible but repetitive continuation is not an accuracy measurement.",
19
  "matches_historical_prefix": true
20
  },
21
- "documentation_update": "Latest JSONLite joint extraction SFT and matched metrics; base weights, tokenizer, runner and bundle unchanged."
22
  }
 
18
  "scope": "Packaging smoke only. A plausible but repetitive continuation is not an accuracy measurement.",
19
  "matches_historical_prefix": true
20
  },
21
+ "documentation_update": "JSONLite descendant training lineage, scope and main-checkpoint evaluation; base weights unchanged."
22
  }
README.md CHANGED
@@ -173,12 +173,8 @@ Training sources retain their own terms. See `THIRD_PARTY_NOTICES.md`,
173
  not establish blanket underlying-content redistribution clearance.
174
 
175
 
176
- ## Native JSON descendant update
177
 
178
- The JSONLite descendant is intended for short English extraction into a flat object with string, nullable-string or string-array fields. It can omit, merge or misassign values even when its JSON is valid. Nested/record schemas, numeric/Boolean outputs, optional-property logic and advanced schema rules are outside that released runner's verified scope. Its reported scores are specific to the documented evaluation panels. See the descendant model card's **Intended use and limitations** section before choosing it for an application; these statements do not describe new capabilities of the pretrained base.
179
 
180
- The current [OpenSML-JSONLite-175M-Instruct](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M) adds a joint full-weight JSON extraction SFT to its earlier grounded-QA, extraction and native JSON ancestry. The latest stage mixes original source/schema/JSON TRAIN replay, multiple-value examples and authored prose. The released main checkpoint inherits 19,200 presentations from a 21,144-presentation experiment. It directly generates the complete JSON object; validation follows without assembly or repair.
181
-
182
- On the same previously observed 1,444-request SNIPS-derived evaluation, the descendant achieves **1,271/1,444 (88.02%) complete correctness**, **94.17% field accuracy**, **92.88% extracted-value F1**, **92.42% precision**, **93.35% recall**, **95.22% missing-field accuracy** and **100% schema validity**. The observed 60-case playground scores 49/60. Compared with the previous release, 96 requests improve and 24 regress. These are descendant results on repeatedly observed research panels, not scores of this base or a fresh blind benchmark. See the [current JSONLite technical report](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M/blob/main/TECHNICAL_REPORT.md) for the full provenance, protocol and limitations.
183
-
184
- The pretrained base weights, tokenizer, inference runner and source bundle are unchanged.
 
173
  not establish blanket underlying-content redistribution clearance.
174
 
175
 
176
+ ## JSONLite descendant
177
 
178
+ The [OpenSML-JSONLite-175M-Instruct](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M) descendant uses 100,096,883 additional structured-data continued-pretraining tokens followed by one joint full-weight SFT. The main checkpoint inherits 32,000 SFT presentations. On the observed original 1,444-request extraction panel it scores 89.54% complete correctness, 94.91% field accuracy, 93.75% extracted-value F1, 96.13% missing-field accuracy and 99.93% schema validity. Broader structural diagnostics remain weaker: 183/384 complete requests (47.66%). These are descendant results, not scores of this base. See the [JSONLite technical report](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M/blob/main/TECHNICAL_REPORT.md).
179
 
180
+ JSONLite's supplied runner targets short English text and flat string-based schemas. Broader JSON tasks, arbitrary domains, chat and multilingual reliability are not established. Check schema validity and source-grounded meaning separately. The original base weights, tokenizer and inference runtime are unchanged.
 
 
 
 
RUN_GUIDE.md CHANGED
@@ -58,10 +58,8 @@ text. The recorded document loss does not guarantee correct QA, instruction
58
  following or extraction. See the model card and report for measured scope.
59
 
60
 
61
- ## Native JSON descendant update
62
 
63
- The current [OpenSML-JSONLite-175M-Instruct](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M) adds a joint full-weight JSON extraction SFT to its earlier grounded-QA, extraction and native JSON ancestry. The latest stage mixes original source/schema/JSON TRAIN replay, multiple-value examples and authored prose. The released main checkpoint inherits 19,200 presentations from a 21,144-presentation experiment. It directly generates the complete JSON object; validation follows without assembly or repair.
64
 
65
- On the same previously observed 1,444-request SNIPS-derived evaluation, the descendant achieves **1,271/1,444 (88.02%) complete correctness**, **94.17% field accuracy**, **92.88% extracted-value F1**, **92.42% precision**, **93.35% recall**, **95.22% missing-field accuracy** and **100% schema validity**. The observed 60-case playground scores 49/60. Compared with the previous release, 96 requests improve and 24 regress. These are descendant results on repeatedly observed research panels, not scores of this base or a fresh blind benchmark. See the [current JSONLite technical report](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M/blob/main/TECHNICAL_REPORT.md) for the full provenance, protocol and limitations.
66
-
67
- The pretrained base weights, tokenizer, inference runner and source bundle are unchanged.
 
58
  following or extraction. See the model card and report for measured scope.
59
 
60
 
61
+ ## JSONLite descendant
62
 
63
+ The [OpenSML-JSONLite-175M-Instruct](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M) descendant uses 100,096,883 additional structured-data continued-pretraining tokens followed by one joint full-weight SFT. The main checkpoint inherits 32,000 SFT presentations. On the observed original 1,444-request extraction panel it scores 89.54% complete correctness, 94.91% field accuracy, 93.75% extracted-value F1, 96.13% missing-field accuracy and 99.93% schema validity. Broader structural diagnostics remain weaker: 183/384 complete requests (47.66%). These are descendant results, not scores of this base. See the [JSONLite technical report](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M/blob/main/TECHNICAL_REPORT.md).
64
 
65
+ JSONLite's supplied runner targets short English text and flat string-based schemas. Broader JSON tasks, arbitrary domains, chat and multilingual reliability are not established. Check schema validity and source-grounded meaning separately. The original base weights, tokenizer and inference runtime are unchanged.
 
 
SHA256SUMS CHANGED
@@ -1,12 +1,12 @@
1
  01ef768a669337697712a837b5b33464bf4b2d716aeb17e909fe17ab927454b2 CITATION.cff
2
  9c6d4c439acf90f9187ba6cf11f070afb3ea1515d488b52c381adf9356a1d613 EVALUATION_RESULTS.json
3
  c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4 LICENSE
4
- aa0e0453672382a7a0d7ec123d24ad83edde6d19909f141e8305235454d0d027 PACKAGING_VERIFICATION.json
5
  14819fc05509546bb8218153cf8494c6a3c4e2e4744ce504bdc21ef0d7d1ed59 PRETRAINING_SAMPLES.json
6
- 62c52f21446db36c4d9180fd9e312ee97d5250d1630ed5d1d49bca1808f530d7 README.md
7
- 76e43ad45e5814ac1f259ca48c82fb3865df3fc595ee5017cf84e34eb6a1386c RUN_GUIDE.md
8
  c3bd058575a0313f716dabb8de8a3d7b729ff413dae5f74b06525c0737dcfac3 SOURCE_FILES.json
9
- 5a73adb3c6309fe496bfeee993965c0c5a9c1b9c24275b112adf6da2eafbfcfd TECHNICAL_REPORT.md
10
  3235c99f09bfab6e5ee95e64a382a4975978ec7f8988d33a71d4aaeb0215bf15 THIRD_PARTY_NOTICES.md
11
  15a0e3b511b97503a611c0da838a7fde1c06ebed34c7103f7cda1782cc6378a4 checkpoint_metadata.json
12
  b8fa8c812d209a9cb0667294ad17fccd38ab85c3bcabf7ef766ec90fb4fe57a2 checkpoint_provenance.json
 
1
  01ef768a669337697712a837b5b33464bf4b2d716aeb17e909fe17ab927454b2 CITATION.cff
2
  9c6d4c439acf90f9187ba6cf11f070afb3ea1515d488b52c381adf9356a1d613 EVALUATION_RESULTS.json
3
  c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4 LICENSE
4
+ ca872a6a670973217f0c38f0442187a8cbd3b2799ed96a95f3d94d2aa50ed52c PACKAGING_VERIFICATION.json
5
  14819fc05509546bb8218153cf8494c6a3c4e2e4744ce504bdc21ef0d7d1ed59 PRETRAINING_SAMPLES.json
6
+ 5f1448725c155ce5a1411230711a228c72bc0f4ce88d29ecee2b2eec73f6e37a README.md
7
+ 205a48fa7ae5dd8f683e14b924db464015e3ce9b0d809cb97dfbdfdf17d686ca RUN_GUIDE.md
8
  c3bd058575a0313f716dabb8de8a3d7b729ff413dae5f74b06525c0737dcfac3 SOURCE_FILES.json
9
+ 38a9e52795a54c22f92df5465d4ca95b79541f94d8b5c22d4fd14021b1e59203 TECHNICAL_REPORT.md
10
  3235c99f09bfab6e5ee95e64a382a4975978ec7f8988d33a71d4aaeb0215bf15 THIRD_PARTY_NOTICES.md
11
  15a0e3b511b97503a611c0da838a7fde1c06ebed34c7103f7cda1782cc6378a4 checkpoint_metadata.json
12
  b8fa8c812d209a9cb0667294ad17fccd38ab85c3bcabf7ef766ec90fb4fe57a2 checkpoint_provenance.json
TECHNICAL_REPORT.md CHANGED
@@ -151,12 +151,8 @@ this prepared repository. Dataset licenses apply separately; see
151
  underlying-source redistribution clearance.
152
 
153
 
154
- ## Native JSON descendant update
155
 
156
- The JSONLite descendant is intended for short English extraction into a flat object with string, nullable-string or string-array fields. It can omit, merge or misassign values even when its JSON is valid. Nested/record schemas, numeric/Boolean outputs, optional-property logic and advanced schema rules are outside that released runner's verified scope. Its reported scores are specific to the documented evaluation panels. See the descendant model card's **Intended use and limitations** section before choosing it for an application; these statements do not describe new capabilities of the pretrained base.
157
 
158
- The current [OpenSML-JSONLite-175M-Instruct](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M) adds a joint full-weight JSON extraction SFT to its earlier grounded-QA, extraction and native JSON ancestry. The latest stage mixes original source/schema/JSON TRAIN replay, multiple-value examples and authored prose. The released main checkpoint inherits 19,200 presentations from a 21,144-presentation experiment. It directly generates the complete JSON object; validation follows without assembly or repair.
159
-
160
- On the same previously observed 1,444-request SNIPS-derived evaluation, the descendant achieves **1,271/1,444 (88.02%) complete correctness**, **94.17% field accuracy**, **92.88% extracted-value F1**, **92.42% precision**, **93.35% recall**, **95.22% missing-field accuracy** and **100% schema validity**. The observed 60-case playground scores 49/60. Compared with the previous release, 96 requests improve and 24 regress. These are descendant results on repeatedly observed research panels, not scores of this base or a fresh blind benchmark. See the [current JSONLite technical report](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M/blob/main/TECHNICAL_REPORT.md) for the full provenance, protocol and limitations.
161
-
162
- The pretrained base weights, tokenizer, inference runner and source bundle are unchanged.
 
151
  underlying-source redistribution clearance.
152
 
153
 
154
+ ## JSONLite descendant
155
 
156
+ The [OpenSML-JSONLite-175M-Instruct](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M) descendant uses 100,096,883 additional structured-data continued-pretraining tokens followed by one joint full-weight SFT. The main checkpoint inherits 32,000 SFT presentations. On the observed original 1,444-request extraction panel it scores 89.54% complete correctness, 94.91% field accuracy, 93.75% extracted-value F1, 96.13% missing-field accuracy and 99.93% schema validity. Broader structural diagnostics remain weaker: 183/384 complete requests (47.66%). These are descendant results, not scores of this base. See the [JSONLite technical report](https://huggingface.co/wzebrowski/OpenSML-JSONLite-175M/blob/main/TECHNICAL_REPORT.md).
157
 
158
+ JSONLite's supplied runner targets short English text and flat string-based schemas. Broader JSON tasks, arbitrary domains, chat and multilingual reliability are not established. Check schema validity and source-grounded meaning separately. The original base weights, tokenizer and inference runtime are unchanged.