xml-RoBERTa based model with CRF layer for location and address span extraction. Trained on weakly labeled dataset (Part of Dataset 9 of Epstein files). Geographical entities in dataset labeled with qwen3 70b + BIO-tags added automatically. Still needs tests in the wild.
Trained until: Epoch 6 | Loss: 0.234| Token F1: 0.9776 | Binary F1: 0.9744 | Token Acc: 0.9988 | Span Acc: 0.9504 | Partial: 0.9680
Token F1 (Macro F1)- based on token matching Binary F1 - shows performance of Geo Entety extraction only without checking correctness of labels Token Acc - based on token matching (non balanced)
Span Acc - based on span (whole geo entity) matching partial - based on span (whole geo entity) matching (at least 50% correct overlap)
language:
- mainly en
metrics:
- f1
- accuracy
base_model:
- FacebookAI/xlm-roberta-base
pipeline_tag: text-classification
tags:
- geoparsing
- location
- ner
- informationextraction
- GEOINT