Upload DeBERTa-v3-large PII models, tokenizers, and code

9b08c94 verified 2 days ago

1.14 kB

license: mit
tags:
  - deberta
  - pii-detection
  - token-classification
  - kaggle
datasets:
  - pii-data-detection
metrics:
  - f5-score

DeBERTa-v3-large PII Data Detection (Final Model)

This repository contains the fine-tuned DeBERTa-v3-large model checkpoint from the Kaggle PII Data Detection Competition.

Model Details

Base Architecture: microsoft/deberta-v3-large
Task: Token classification for Personally Identifiable Information (PII) detection
Max Sequence Length: 4096
Training Setup:
- Competition training data + moredata_dataset_fixed.json
- Optimizer: AdamW, lr=1e-5, weight_decay=0.0
- Batch size: 2
- Epochs: 5 (Fold 0)
Validation Metric: 0.9692 at Epoch 3

deberta_v3_large_w10_ado4_wd0_bs2_lr1e5_5epo_fold0_best.pth (1.74 GB): Model weights with highest validation score (0.9692).
deberta_v3_large_w10_ado4_wd0_bs2_lr1e5_5epo_fold0_last.pth (5.21 GB): Full training checkpoint including optimizer, scheduler, and scaler states.
Tokenizer files (spm.model, tokenizer.json, config.json, etc.)
Training and inference code under code/.