thesanogoeffect commited on
Commit
1045dc0
·
verified ·
1 Parent(s): ee6729d

Name the licence of every training source in the card

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -35,7 +35,7 @@ The full checksums are in `checksums.json`.
35
  - source: main v7: JATS reference strings (PMC, Europe PMC, SciELO, LinkedBooks), no per-paper cap; pdf: the same kind of labels projected onto bibr's own PDF reference strings (parser-pdf-v1); multilingual: references rendered through locale citation styles plus open annotated sets (parser-multiling-v1); crossref: deposited reference strings with distant labels. Every source passed one gate: corpus-split-v1, the exclusion registry (build 7), and a string and title check against every evaluation set, with 0 split mismatches
36
  - labels: JATS mixed-citation and element-citation markup; citation-style variable marks (synthetic rows); aligned Crossref records (distant)
37
  - languages: main v7 is 98% English; the multilingual source covers de, es, fr, it, ja, pl, pt, ru, uk, zh
38
- - licences: main v7 CC BY 499,264 / CC0 8,786 / CC BY-SA 386 rows; Crossref rows rest on the metadata basis (3.5% of rows); synthetic rows from open bibliographic records
39
 
40
  Every evaluation set in the exclusion registry was kept out of training. Registry: exclusions, build manifest sha256 d8d427de3ea7b954. Split: corpus-split-v1, sha256 c6fc246571f435d7.
41
 
@@ -97,5 +97,5 @@ Every evaluation set in the exclusion registry was kept out of training. Registr
97
  ## Licence and attribution
98
 
99
  - model licence: mit
100
- - training data licences: main v7 CC BY 499,264 / CC0 8,786 / CC BY-SA 386 rows; Crossref rows rest on the metadata basis (3.5% of rows); synthetic rows from open bibliographic records
101
  - starts from: jhu-clsp/mmBERT-small (multilingual); that model's own licence and card apply
 
35
  - source: main v7: JATS reference strings (PMC, Europe PMC, SciELO, LinkedBooks), no per-paper cap; pdf: the same kind of labels projected onto bibr's own PDF reference strings (parser-pdf-v1); multilingual: references rendered through locale citation styles plus open annotated sets (parser-multiling-v1); crossref: deposited reference strings with distant labels. Every source passed one gate: corpus-split-v1, the exclusion registry (build 7), and a string and title check against every evaluation set, with 0 split mismatches
36
  - labels: JATS mixed-citation and element-citation markup; citation-style variable marks (synthetic rows); aligned Crossref records (distant)
37
  - languages: main v7 is 98% English; the multilingual source covers de, es, fr, it, ja, pl, pt, ru, uk, zh
38
+ - licences: main v7 CC BY 499,264 / CC0 8,786 / CC BY-SA 386 rows; PDF source rows (train split) CC BY 961,055 / CC0 4,204 / CC BY-SA 50; multilingual train rows 237,360 renderings of CC0 records (OpenAlex, OpenSSCI) through CSL citation styles, which are CC BY-SA 3.0, and 27,115 CC BY 4.0 rows (8,104 annotated references from GROBID's training data, 19,011 Cyrillic synthetic); AnyStyle (BSD-2-Clause) and SIRIS (MIT) rows were kept out by the CC0 / CC BY / CC BY-SA policy; Crossref rows rest on the metadata basis (3.5% of rows)
39
 
40
  Every evaluation set in the exclusion registry was kept out of training. Registry: exclusions, build manifest sha256 d8d427de3ea7b954. Split: corpus-split-v1, sha256 c6fc246571f435d7.
41
 
 
97
  ## Licence and attribution
98
 
99
  - model licence: mit
100
+ - training data licences: main v7 CC BY 499,264 / CC0 8,786 / CC BY-SA 386 rows; PDF source rows (train split) CC BY 961,055 / CC0 4,204 / CC BY-SA 50; multilingual train rows 237,360 renderings of CC0 records (OpenAlex, OpenSSCI) through CSL citation styles, which are CC BY-SA 3.0, and 27,115 CC BY 4.0 rows (8,104 annotated references from GROBID's training data, 19,011 Cyrillic synthetic); AnyStyle (BSD-2-Clause) and SIRIS (MIT) rows were kept out by the CC0 / CC BY / CC BY-SA policy; Crossref rows rest on the metadata basis (3.5% of rows)
101
  - starts from: jhu-clsp/mmBERT-small (multilingual); that model's own licence and card apply