Name the licence of every training source in the card
Browse files
README.md
CHANGED
|
@@ -35,7 +35,7 @@ The full checksums are in `checksums.json`.
|
|
| 35 |
- source: main v7: JATS reference strings (PMC, Europe PMC, SciELO, LinkedBooks), no per-paper cap; pdf: the same kind of labels projected onto bibr's own PDF reference strings (parser-pdf-v1); multilingual: references rendered through locale citation styles plus open annotated sets (parser-multiling-v1); crossref: deposited reference strings with distant labels. Every source passed one gate: corpus-split-v1, the exclusion registry (build 7), and a string and title check against every evaluation set, with 0 split mismatches
|
| 36 |
- labels: JATS mixed-citation and element-citation markup; citation-style variable marks (synthetic rows); aligned Crossref records (distant)
|
| 37 |
- languages: main v7 is 98% English; the multilingual source covers de, es, fr, it, ja, pl, pt, ru, uk, zh
|
| 38 |
-
- licences: main v7 CC BY 499,264 / CC0 8,786 / CC BY-SA 386 rows; Crossref rows rest on the metadata basis (3.5% of rows)
|
| 39 |
|
| 40 |
Every evaluation set in the exclusion registry was kept out of training. Registry: exclusions, build manifest sha256 d8d427de3ea7b954. Split: corpus-split-v1, sha256 c6fc246571f435d7.
|
| 41 |
|
|
@@ -97,5 +97,5 @@ Every evaluation set in the exclusion registry was kept out of training. Registr
|
|
| 97 |
## Licence and attribution
|
| 98 |
|
| 99 |
- model licence: mit
|
| 100 |
-
- training data licences: main v7 CC BY 499,264 / CC0 8,786 / CC BY-SA 386 rows; Crossref rows rest on the metadata basis (3.5% of rows)
|
| 101 |
- starts from: jhu-clsp/mmBERT-small (multilingual); that model's own licence and card apply
|
|
|
|
| 35 |
- source: main v7: JATS reference strings (PMC, Europe PMC, SciELO, LinkedBooks), no per-paper cap; pdf: the same kind of labels projected onto bibr's own PDF reference strings (parser-pdf-v1); multilingual: references rendered through locale citation styles plus open annotated sets (parser-multiling-v1); crossref: deposited reference strings with distant labels. Every source passed one gate: corpus-split-v1, the exclusion registry (build 7), and a string and title check against every evaluation set, with 0 split mismatches
|
| 36 |
- labels: JATS mixed-citation and element-citation markup; citation-style variable marks (synthetic rows); aligned Crossref records (distant)
|
| 37 |
- languages: main v7 is 98% English; the multilingual source covers de, es, fr, it, ja, pl, pt, ru, uk, zh
|
| 38 |
+
- licences: main v7 CC BY 499,264 / CC0 8,786 / CC BY-SA 386 rows; PDF source rows (train split) CC BY 961,055 / CC0 4,204 / CC BY-SA 50; multilingual train rows 237,360 renderings of CC0 records (OpenAlex, OpenSSCI) through CSL citation styles, which are CC BY-SA 3.0, and 27,115 CC BY 4.0 rows (8,104 annotated references from GROBID's training data, 19,011 Cyrillic synthetic); AnyStyle (BSD-2-Clause) and SIRIS (MIT) rows were kept out by the CC0 / CC BY / CC BY-SA policy; Crossref rows rest on the metadata basis (3.5% of rows)
|
| 39 |
|
| 40 |
Every evaluation set in the exclusion registry was kept out of training. Registry: exclusions, build manifest sha256 d8d427de3ea7b954. Split: corpus-split-v1, sha256 c6fc246571f435d7.
|
| 41 |
|
|
|
|
| 97 |
## Licence and attribution
|
| 98 |
|
| 99 |
- model licence: mit
|
| 100 |
+
- training data licences: main v7 CC BY 499,264 / CC0 8,786 / CC BY-SA 386 rows; PDF source rows (train split) CC BY 961,055 / CC0 4,204 / CC BY-SA 50; multilingual train rows 237,360 renderings of CC0 records (OpenAlex, OpenSSCI) through CSL citation styles, which are CC BY-SA 3.0, and 27,115 CC BY 4.0 rows (8,104 annotated references from GROBID's training data, 19,011 Cyrillic synthetic); AnyStyle (BSD-2-Clause) and SIRIS (MIT) rows were kept out by the CC0 / CC BY / CC BY-SA policy; Crossref rows rest on the metadata basis (3.5% of rows)
|
| 101 |
- starts from: jhu-clsp/mmBERT-small (multilingual); that model's own licence and card apply
|