rafmacalaba commited on
Commit
d761bb2
·
verified ·
1 Parent(s): 829fc91

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +43 -0
README.md ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: token-classification
4
+ tags:
5
+ - ner
6
+ - bio
7
+ - lfm2
8
+ - data-use
9
+ ---
10
+
11
+ # lfm2.5-Encoder-350M-datause
12
+
13
+ Fine-tune of `LiquidAI/LFM2.5-Encoder-350M` for BIO data-use mention tagging
14
+ (dataset / survey / census / registry mentions in economics research papers).
15
+
16
+ ## Labels
17
+ - `NAMED_DATA` — a proper name, title, or acronym of a specific data source
18
+ - `DESCRIPTIVE_DATA` — a source described in words but not named
19
+ - `VAGUE_DATA` — generic data wording with no identifiable source
20
+
21
+ ## Training
22
+ - base model: `LiquidAI/LFM2.5-Encoder-350M`
23
+ - dataset: `rafmacalaba/data-use-mentions` (bio config)
24
+ - epochs: 5
25
+ - learning rate: 2e-05
26
+ - batch size: 16
27
+ - precision: bf16
28
+
29
+ ## Evaluation (holdout, label-agnostic)
30
+
31
+ | thr | tp | fp | fn | precision | recall | f0.5 | f1 |
32
+ | --- | --- | --- | --- | --- | --- | --- | --- |
33
+ | 0.10 | 4541 | 1064 | 2805 | 0.8102 | 0.6182 | 0.7628 | 0.7013 |
34
+ | 0.20 | 4541 | 1064 | 2805 | 0.8102 | 0.6182 | 0.7628 | 0.7013 |
35
+ | 0.30 | 4541 | 1063 | 2805 | 0.8103 | 0.6182 | 0.7629 | 0.7013 |
36
+ | 0.40 | 4528 | 1058 | 2818 | 0.8106 | 0.6164 | 0.7625 | 0.7003 |
37
+ | 0.50 | 4469 | 1006 | 2877 | 0.8163 | 0.6084 | 0.7640 | 0.6971 |
38
+ | 0.60 | 4141 | 822 | 3205 | 0.8344 | 0.5637 | 0.7613 | 0.6728 |
39
+ | 0.70 | 3842 | 684 | 3504 | 0.8489 | 0.5230 | 0.7548 | 0.6472 |
40
+
41
+ **Best F0.5**: 0.7640 (thr=0.5)
42
+ **Best F1**: 0.7013 (thr=0.3)
43
+