Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,43 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
pipeline_tag: token-classification
|
| 4 |
+
tags:
|
| 5 |
+
- ner
|
| 6 |
+
- bio
|
| 7 |
+
- lfm2
|
| 8 |
+
- data-use
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# lfm2.5-Encoder-350M-datause
|
| 12 |
+
|
| 13 |
+
Fine-tune of `LiquidAI/LFM2.5-Encoder-350M` for BIO data-use mention tagging
|
| 14 |
+
(dataset / survey / census / registry mentions in economics research papers).
|
| 15 |
+
|
| 16 |
+
## Labels
|
| 17 |
+
- `NAMED_DATA` — a proper name, title, or acronym of a specific data source
|
| 18 |
+
- `DESCRIPTIVE_DATA` — a source described in words but not named
|
| 19 |
+
- `VAGUE_DATA` — generic data wording with no identifiable source
|
| 20 |
+
|
| 21 |
+
## Training
|
| 22 |
+
- base model: `LiquidAI/LFM2.5-Encoder-350M`
|
| 23 |
+
- dataset: `rafmacalaba/data-use-mentions` (bio config)
|
| 24 |
+
- epochs: 5
|
| 25 |
+
- learning rate: 2e-05
|
| 26 |
+
- batch size: 16
|
| 27 |
+
- precision: bf16
|
| 28 |
+
|
| 29 |
+
## Evaluation (holdout, label-agnostic)
|
| 30 |
+
|
| 31 |
+
| thr | tp | fp | fn | precision | recall | f0.5 | f1 |
|
| 32 |
+
| --- | --- | --- | --- | --- | --- | --- | --- |
|
| 33 |
+
| 0.10 | 4541 | 1064 | 2805 | 0.8102 | 0.6182 | 0.7628 | 0.7013 |
|
| 34 |
+
| 0.20 | 4541 | 1064 | 2805 | 0.8102 | 0.6182 | 0.7628 | 0.7013 |
|
| 35 |
+
| 0.30 | 4541 | 1063 | 2805 | 0.8103 | 0.6182 | 0.7629 | 0.7013 |
|
| 36 |
+
| 0.40 | 4528 | 1058 | 2818 | 0.8106 | 0.6164 | 0.7625 | 0.7003 |
|
| 37 |
+
| 0.50 | 4469 | 1006 | 2877 | 0.8163 | 0.6084 | 0.7640 | 0.6971 |
|
| 38 |
+
| 0.60 | 4141 | 822 | 3205 | 0.8344 | 0.5637 | 0.7613 | 0.6728 |
|
| 39 |
+
| 0.70 | 3842 | 684 | 3504 | 0.8489 | 0.5230 | 0.7548 | 0.6472 |
|
| 40 |
+
|
| 41 |
+
**Best F0.5**: 0.7640 (thr=0.5)
|
| 42 |
+
**Best F1**: 0.7013 (thr=0.3)
|
| 43 |
+
|