| license: mit | |
| tags: | |
| - deberta | |
| - pii-detection | |
| - token-classification | |
| - kaggle | |
| datasets: | |
| - pii-data-detection | |
| metrics: | |
| - f5-score | |
| # DeBERTa-v3-large PII Data Detection (Final Model) | |
| This repository contains the fine-tuned DeBERTa-v3-large model checkpoint from the Kaggle PII Data Detection Competition. | |
| ## Model Details | |
| - **Base Architecture**: microsoft/deberta-v3-large | |
| - **Task**: Token classification for Personally Identifiable Information (PII) detection | |
| - **Max Sequence Length**: 4096 | |
| - **Training Setup**: | |
| - Competition training data + moredata_dataset_fixed.json | |
| - Optimizer: AdamW, lr=1e-5, weight_decay=0.0 | |
| - Batch size: 2 | |
| - Epochs: 5 (Fold 0) | |
| - **Validation Metric**: **0.9692** at Epoch 3 | |
| ## Checkpoints Included | |
| - `deberta_v3_large_w10_ado4_wd0_bs2_lr1e5_5epo_fold0_best.pth` (1.74 GB): Model weights with highest validation score (0.9692). | |
| - `deberta_v3_large_w10_ado4_wd0_bs2_lr1e5_5epo_fold0_last.pth` (5.21 GB): Full training checkpoint including optimizer, scheduler, and scaler states. | |
| - Tokenizer files (`spm.model`, `tokenizer.json`, `config.json`, etc.) | |
| - Training and inference code under `code/`. | |