File size: 1,373 Bytes
75817d2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
---
license: apache-2.0
pipeline_tag: token-classification
tags:
  - ner
  - gliner2
  - data-use
---

# gliner2_datause

Fine-tune of `fastino/gliner2-large-v1` (GLiNER2) for data-use mention extraction
(dataset / survey / census / registry mentions in economics research papers).

## Labels
- `NAMED_DATA` — a proper name, title, or acronym of a specific data source
- `DESCRIPTIVE_DATA` — a source described in words but not named
- `VAGUE_DATA` — generic data wording with no identifiable source

## Training
- base model: `fastino/gliner2-large-v1`
- dataset: `rafmacalaba/data-use-mentions` (gliner2 config)
- epochs: 5
- encoder LR: 1e-05
- task LR: 0.0005
- batch size: 8
- precision: bf16

## Evaluation (holdout, label-agnostic)

| thr | tp | fp | fn | precision | recall | f0.5 | f1 |
| --- | --- | --- | --- | --- | --- | --- | --- |
| 0.10 | 7037 | 3193 | 310 | 0.6879 | 0.9578 | 0.7290 | 0.8007 |
| 0.20 | 6915 | 2509 | 432 | 0.7338 | 0.9412 | 0.7676 | 0.8246 |
| 0.30 | 6789 | 2047 | 558 | 0.7683 | 0.9241 | 0.7951 | 0.8390 |
| 0.40 | 6576 | 1700 | 771 | 0.7946 | 0.8951 | 0.8128 | 0.8418 |
| 0.50 | 6300 | 1339 | 1047 | 0.8247 | 0.8575 | 0.8311 | 0.8408 |
| 0.60 | 5855 | 1001 | 1492 | 0.8540 | 0.7969 | 0.8419 | 0.8245 |
| 0.70 | 5072 | 630 | 2275 | 0.8895 | 0.6903 | 0.8410 | 0.7774 |

**Best F0.5**: 0.8419 (thr=0.6)
**Best F1**: 0.8418 (thr=0.4)