Andrefty/ssl-pii-data-detection-deberta

DeBERTa-v3-large PII Data Detection (Final Model)

This repository contains the fine-tuned DeBERTa-v3-large model checkpoint from the Kaggle PII Data Detection Competition.

Model Details

• Base Architecture: microsoft/deberta-v3-large
• Task: Token classification for Personally Identifiable Information (PII) detection
• Max Sequence Length: 4096
• Training Setup:
  • Competition training data + moredata_dataset_fixed.json
  • Optimizer: AdamW, lr=1e-5, weight_decay=0.0
  • Batch size: 2
  • Epochs: 5 (Fold 0)
• Validation Metric: 0.9692 at Epoch 3

Checkpoints Included

• deberta_v3_large_w10_ado4_wd0_bs2_lr1e5_5epo_fold0_best.pth (1.74 GB): Model weights with highest validation score (0.9692).
• deberta_v3_large_w10_ado4_wd0_bs2_lr1e5_5epo_fold0_last.pth (5.21 GB): Full training checkpoint including optimizer, scheduler, and scaler states.
• Tokenizer files (spm.model, tokenizer.json, config.json, etc.)
• Training and inference code under code/.