File size: 2,811 Bytes
788c2cf ebb4e91 788c2cf ebb4e91 788c2cf 1d7c979 ebb4e91 1d7c979 788c2cf 1d7c979 227657e 788c2cf | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 | # SID-UNet Evaluation Report
### Run Configuration & Hyperparameters
| Hyperparameter / Setting | Configured Value |
|----------------------------|----------------------------------------------------------|
| Project Name | test_smoke |
| Dataset | KhangTruong/IMD2020 |
| Splits | Train: 'train' | Val: 'validation' | Test: 'test' |
| Streaming | False |
| Image Size | [32, 32] |
| Batch Size | 16 |
| Epoch Limit / Steps | 2 samples/epoch |
| Model | unet (features=[8, 16], bilinear=True) |
| Aux Classifier | False (classes=3) |
| Mask Loss | Combined (BCE: 0.5, Dice: 0.5, Focal: 0.5) |
| Aux Loss | cross_entropy (wt=0.2) |
| Post-Processing | Enabled (min_area=64, fill_holes=True, morph=open_close) |
| Optimizer | adamw (lr=0.001, wd=0.0001) |
| Scheduler | cosine |
| Epochs | 1 |
| AMP | False |
### Overall Segmentation & Classification Metrics
| Metric | Value |
|------------------|---------|
| Test Bce Loss | 0.6495 |
| Test Dice Loss | 0.6683 |
| Test Focal Loss | 0.0678 |
| Test Mask Loss | 0.6928 |
| Test Total Loss | 0.6928 |
| Test Iou | 0.2061 |
| Test Dice | 0.2918 |
| Test F1 | 0.2918 |
| Test Pixel F1 | 0.2918 |
| Test Auroc | 0.7468 |
| Test Pixel Auroc | 0.7468 |
| Test Pixel Acc | 0.6748 |
| Test Precision | 0.5 |
| Test Recall | 0.2061 |
| Test Specificity | 0.9688 |
### Per-Subset Metrics Breakdown
| Subset | Mean IoU | Dice / F1 | Pixel Accuracy | Sample Count |
|-----------------------------------|------------|-------------|------------------|----------------|
| Label 0 (Real / Black Mask) | 0 | 0 | 0.9375 | 1 |
| Label 1 (Synthetic / White Mask) | 0.4121 | 0.5837 | 0.4121 | 1 |
| Label 2 (Tampered / Partial Mask) | 0 | 0 | 0 | 0 |
|