Dineth Perera commited on
Commit
0b6122c
·
1 Parent(s): ce209f5

Release all completed test checkpoints

Browse files
Files changed (41) hide show
  1. README.md +48 -48
  2. results/bifa/dsifn_cd/checkpoints/best_model.pth +3 -0
  3. results/bifa/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  4. results/bit_cd/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  5. results/bit_cd/sysu_cd/checkpoints/best_model.pth +3 -0
  6. results/bit_cd/whu_cd/checkpoints/best_model.pth +3 -0
  7. results/cgnet/dsifn_cd/checkpoints/best_model.pth +3 -0
  8. results/cgnet/whu_cd/checkpoints/best_model.pth +3 -0
  9. results/changeformer/dsifn_cd/checkpoints/best_model.pth +3 -0
  10. results/changeformer/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  11. results/changeformer/sysu_cd/checkpoints/best_model.pth +3 -0
  12. results/changemamba/dsifn_cd/checkpoints/best_model.pth +3 -0
  13. results/dsamnet/dsifn_cd/checkpoints/best_model.pth +3 -0
  14. results/dsamnet/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  15. results/dsamnet/whu_cd/checkpoints/best_model.pth +3 -0
  16. results/fc_ef/dsifn_cd/checkpoints/best_model.pth +3 -0
  17. results/fc_ef/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  18. results/fc_ef/sysu_cd/checkpoints/best_model.pth +3 -0
  19. results/fc_ef/whu_cd/checkpoints/best_model.pth +3 -0
  20. results/fc_siam_conc/dsifn_cd/checkpoints/best_model.pth +3 -0
  21. results/fc_siam_conc/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  22. results/fc_siam_conc/sysu_cd/checkpoints/best_model.pth +3 -0
  23. results/fc_siam_conc/whu_cd/checkpoints/best_model.pth +3 -0
  24. results/fc_siam_diff/dsifn_cd/checkpoints/best_model.pth +3 -0
  25. results/fc_siam_diff/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  26. results/fc_siam_diff/sysu_cd/checkpoints/best_model.pth +3 -0
  27. results/fc_siam_diff/whu_cd/checkpoints/best_model.pth +3 -0
  28. results/hanet/dsifn_cd/checkpoints/best_model.pth +3 -0
  29. results/hanet/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  30. results/ifnet/dsifn_cd/checkpoints/best_model.pth +3 -0
  31. results/ifnet/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  32. results/ifnet/sysu_cd/checkpoints/best_model.pth +3 -0
  33. results/ifnet/whu_cd/checkpoints/best_model.pth +3 -0
  34. results/schanger/dsifn_cd/checkpoints/best_model.pth +3 -0
  35. results/schanger/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  36. results/siam_nestedunet/dsifn_cd/checkpoints/best_model.pth +3 -0
  37. results/siam_nestedunet/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  38. results/stanet/dsifn_cd/checkpoints/best_model.pth +3 -0
  39. results/stanet/levir_cd_test_as_val/checkpoints/best_model.pth +3 -0
  40. results/stanet/sysu_cd/checkpoints/best_model.pth +3 -0
  41. tools/generate_hf_model_card.py +21 -22
README.md CHANGED
@@ -179,83 +179,83 @@ Every dataset below is a real YAML file under `configs/datasets/`. The harness e
179
 
180
  ## Results and released checkpoints
181
 
182
- Only completed `metrics_test.json` evaluations are eligible. Rankings are computed per dataset by test-set F1 (descending), and only the rank-1 checkpoint for each dataset is released. Validation-only, incomplete, and checkpoint-only runs are excluded.
183
 
184
  All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.
185
 
186
  The current evaluator records BF1 but not boundary mean IoU (BmIoU), so BmIoU remains explicitly unavailable rather than being inferred from BF1. Boundary IoU and boundary F1 are distinct measures.
187
 
188
- ### Released checkpoint summary
189
 
190
- | Dataset | Selected model | Test F1 | Download | Size |
191
- | --- | --- | --- | --- | --- |
192
- | DSIFN-CD | BIT-CD | 0.6732 | [best_model.pth](https://huggingface.co/dineth18/CD-Models/resolve/main/results/bit_cd/dsifn_cd/checkpoints/best_model.pth?download=true) | 60.8 MiB |
193
- | LEVIR-CD+ (test-as-val protocol) | CGNet | 0.8138 | [best_model.pth](https://huggingface.co/dineth18/CD-Models/resolve/main/results/cgnet/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) | 405.9 MiB |
194
- | SYSU-CD | ChangeMamba | 0.8216 | [best_model.pth](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changemamba/sysu_cd/checkpoints/best_model.pth?download=true) | 619.3 MiB |
195
- | WHU-CD | ChangeMamba | 0.9521 | [best_model.pth](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changemamba/whu_cd/checkpoints/best_model.pth?download=true) | 619.0 MiB |
196
 
197
  ### DSIFN-CD
198
 
199
  | Rank | Model | F1 | mIoU | Overall accuracy | Recall | Precision | BF1 | BmIoU | GFLOPs | GPU (GB) | FPS | Parameters (M) | Checkpoint |
200
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
201
  | 1 | BIT-CD | 0.6732 | 0.6929 | 0.8919 | 0.6552 | 0.6923 | 0.2819 | — | 10.63 | 2.24 | 127.76 | 12.40 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/bit_cd/dsifn_cd/checkpoints/best_model.pth?download=true) |
202
- | 2 | SChanger | 0.6629 | 0.6835 | 0.8857 | 0.6612 | 0.6647 | 0.2847 | — | — | 2.45 | 24.05 | — | — |
203
- | 3 | ChangeMamba | 0.6435 | 0.6729 | 0.8849 | 0.6113 | 0.6792 | 0.1903 | — | 28.70 | 1.93 | 15.42 | 54.00 | — |
204
- | 4 | CGNet | 0.6204 | 0.6290 | 0.8343 | 0.7970 | 0.5079 | 0.2903 | — | 82.23 | 6.52 | 65.39 | 38.99 | — |
205
- | 5 | FC-EF | 0.6078 | 0.6400 | 0.8604 | 0.6365 | 0.5816 | 0.1955 | — | 3.58 | 0.74 | 204.13 | 1.35 | — |
206
- | 6 | ChangeFormer | 0.5964 | 0.6152 | 0.8299 | 0.7397 | 0.4996 | 0.2422 | — | 21.18 | 4.07 | 49.74 | 29.75 | — |
207
- | 7 | BiFA | 0.5876 | 0.6111 | 0.8296 | 0.7142 | 0.4991 | 0.2692 | — | 53.00 | 15.10 | 13.81 | 9.87 | — |
208
- | 8 | Siam-NestedUNet | 0.5839 | 0.6024 | 0.8188 | 0.7482 | 0.4788 | 0.2374 | — | 54.83 | 7.34 | 29.18 | 12.03 | — |
209
- | 9 | FC-Siam-diff | 0.5829 | 0.6277 | 0.8593 | 0.5784 | 0.5875 | 0.1691 | — | 4.73 | 1.06 | 113.98 | 1.35 | — |
210
- | 10 | STANet | 0.5483 | 0.6258 | 0.8829 | 0.4184 | 0.7953 | 0.1613 | — | 13.16 | 14.11 | 133.96 | 16.93 | — |
211
- | 11 | FC-Siam-conc | 0.5479 | 0.5665 | 0.7873 | 0.7583 | 0.4288 | 0.1811 | — | 5.33 | 1.02 | 127.67 | 1.55 | — |
212
- | 12 | DSAMNet | 0.5467 | 0.5757 | 0.8020 | 0.7027 | 0.4474 | 0.2374 | — | 75.39 | 2.91 | 166.43 | 16.95 | — |
213
- | 13 | HANet | 0.5347 | 0.5817 | 0.8193 | 0.6109 | 0.4754 | 0.2418 | — | 17.67 | 11.36 | 42.36 | 3.03 | — |
214
- | 14 | IFNet | 0.4579 | 0.5102 | 0.7524 | 0.6153 | 0.3647 | 0.1325 | — | 82.26 | 6.08 | 104.88 | 50.71 | — |
215
 
216
  ### LEVIR-CD+ (test-as-val protocol)
217
 
218
  | Rank | Model | F1 | mIoU | Overall accuracy | Recall | Precision | BF1 | BmIoU | GFLOPs | GPU (GB) | FPS | Parameters (M) | Checkpoint |
219
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
220
  | 1 | CGNet | 0.8138 | 0.8356 | 0.9856 | 0.7746 | 0.8572 | 0.7651 | — | 82.23 | 6.01 | 44.01 | 38.99 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/cgnet/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
221
- | 2 | Siam-NestedUNet | 0.8046 | 0.8282 | 0.9839 | 0.8129 | 0.7965 | 0.7386 | — | — | 2.67 | 108.71 | — | — |
222
- | 3 | SChanger | 0.8007 | 0.8253 | 0.9836 | 0.8112 | 0.7906 | 0.7364 | — | — | 2.45 | 48.96 | — | — |
223
- | 4 | BIT-CD | 0.7996 | 0.8247 | 0.9838 | 0.7946 | 0.8047 | 0.7143 | — | 10.63 | 2.27 | 236.60 | 12.40 | — |
224
- | 5 | HANet | 0.7841 | 0.8131 | 0.9819 | 0.8064 | 0.7630 | 0.7043 | — | — | 5.04 | 84.44 | — | — |
225
- | 6 | BiFA | 0.7772 | 0.8084 | 0.9818 | 0.7785 | 0.7760 | 0.6581 | — | 53.00 | 15.14 | 30.38 | 9.87 | — |
226
- | 7 | FC-Siam-conc | 0.7650 | 0.7999 | 0.9809 | 0.7623 | 0.7678 | 0.7175 | — | 5.33 | 1.02 | 308.81 | 1.55 | — |
227
- | 8 | STANet | 0.7544 | 0.7921 | 0.9791 | 0.7865 | 0.7249 | 0.6388 | — | — | 4.45 | 174.00 | — | — |
228
- | 9 | ChangeFormer | 0.7488 | 0.7887 | 0.9795 | 0.7505 | 0.7472 | 0.6525 | — | 21.18 | 4.03 | 157.64 | 29.75 | — |
229
- | 10 | DSAMNet | 0.7444 | 0.7850 | 0.9779 | 0.7897 | 0.7040 | 0.5370 | — | 75.39 | 2.90 | 37.84 | 16.95 | — |
230
- | 11 | IFNet | 0.7410 | 0.7833 | 0.9786 | 0.7510 | 0.7313 | 0.3489 | — | 82.26 | 6.08 | 105.44 | 50.71 | — |
231
- | 12 | FC-EF | 0.7319 | 0.7766 | 0.9768 | 0.7785 | 0.6905 | 0.6497 | — | 3.58 | 0.74 | 457.44 | 1.35 | — |
232
- | 13 | FC-Siam-diff | 0.7196 | 0.7667 | 0.9725 | 0.8650 | 0.6160 | 0.5447 | — | 4.73 | 1.06 | 262.80 | 1.35 | — |
233
 
234
  ### SYSU-CD
235
 
236
  | Rank | Model | F1 | mIoU | Overall accuracy | Recall | Precision | BF1 | BmIoU | GFLOPs | GPU (GB) | FPS | Parameters (M) | Checkpoint |
237
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
238
  | 1 | ChangeMamba | 0.8216 | 0.8006 | 0.9214 | 0.7677 | 0.8836 | 0.3197 | — | 28.70 | 1.93 | 77.65 | 54.00 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changemamba/sysu_cd/checkpoints/best_model.pth?download=true) |
239
- | 2 | FC-Siam-conc | 0.7778 | 0.7558 | 0.8975 | 0.7609 | 0.7955 | 0.1939 | — | 5.33 | 1.02 | 356.94 | 1.55 | — |
240
- | 3 | STANet | 0.7728 | 0.7482 | 0.8913 | 0.7841 | 0.7619 | 0.1962 | — | — | 4.45 | 176.02 | — | — |
241
- | 4 | FC-EF | 0.7710 | 0.7489 | 0.8936 | 0.7596 | 0.7828 | 0.1857 | — | 3.58 | 0.73 | 553.75 | 1.35 | — |
242
- | 5 | ChangeFormer | 0.7635 | 0.7382 | 0.8851 | 0.7863 | 0.7420 | 0.1591 | — | 21.18 | 4.03 | 143.73 | 29.75 | — |
243
- | 6 | FC-Siam-diff | 0.7630 | 0.7457 | 0.8956 | 0.7129 | 0.8208 | 0.1853 | — | 4.73 | 1.08 | 552.90 | 1.35 | — |
244
- | 7 | BIT-CD | 0.7618 | 0.7395 | 0.8881 | 0.7584 | 0.7652 | 0.1780 | — | 10.63 | 2.24 | 111.11 | 12.40 | — |
245
- | 8 | IFNet | 0.7145 | 0.7020 | 0.8724 | 0.6772 | 0.7562 | 0.1158 | — | — | 3.29 | 109.80 | — | — |
246
 
247
  ### WHU-CD
248
 
249
  | Rank | Model | F1 | mIoU | Overall accuracy | Recall | Precision | BF1 | BmIoU | GFLOPs | GPU (GB) | FPS | Parameters (M) | Checkpoint |
250
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
251
  | 1 | ChangeMamba | 0.9521 | 0.9519 | 0.9954 | 0.9401 | 0.9644 | 0.8605 | — | 28.70 | 1.93 | 75.28 | 54.00 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changemamba/whu_cd/checkpoints/best_model.pth?download=true) |
252
- | 2 | CGNet | 0.9331 | 0.9340 | 0.9936 | 0.9299 | 0.9364 | 0.8138 | — | 82.23 | 5.62 | 129.54 | 38.99 | — |
253
- | 3 | BIT-CD | 0.8940 | 0.8989 | 0.9899 | 0.8845 | 0.9037 | 0.6879 | — | 10.63 | 2.24 | 46.28 | 12.40 | — |
254
- | 4 | DSAMNet | 0.8905 | 0.8956 | 0.9891 | 0.9167 | 0.8657 | 0.5855 | — | 75.39 | 2.90 | 116.58 | 16.95 | — |
255
- | 5 | IFNet | 0.8389 | 0.8534 | 0.9849 | 0.8147 | 0.8644 | 0.3245 | — | 82.26 | 6.08 | 104.98 | 50.71 | — |
256
- | 6 | FC-EF | 0.8385 | 0.8531 | 0.9850 | 0.8067 | 0.8729 | 0.5818 | — | 3.58 | 0.74 | 498.55 | 1.35 | — |
257
- | 7 | FC-Siam-conc | 0.7789 | 0.8062 | 0.9756 | 0.8907 | 0.6920 | 0.4733 | — | 5.33 | 1.03 | 397.86 | 1.55 | — |
258
- | 8 | FC-Siam-diff | 0.7135 | 0.7580 | 0.9631 | 0.9540 | 0.5699 | 0.2148 | — | 4.73 | 1.09 | 567.87 | 1.35 | — |
259
 
260
  ### Datasets without a released checkpoint
261
 
@@ -800,7 +800,7 @@ python utils/weight_downloader.py --list
800
 
801
  ### Trained checkpoints
802
 
803
- The released rank-1 test checkpoints and direct download links are listed in [Results and released checkpoints](#results-and-released-checkpoints). Local training still writes checkpoints under `results/{model}/{dataset}/checkpoints/`.
804
 
805
  ## Repository Structure
806
 
 
179
 
180
  ## Results and released checkpoints
181
 
182
+ Only completed `metrics_test.json` evaluations are eligible. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released. Validation-only, incomplete, and checkpoint-only runs are excluded.
183
 
184
  All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.
185
 
186
  The current evaluator records BF1 but not boundary mean IoU (BmIoU), so BmIoU remains explicitly unavailable rather than being inferred from BF1. Boundary IoU and boundary F1 are distinct measures.
187
 
188
+ ### Dataset summary
189
 
190
+ | Dataset | Tested models | F1 leader | Best test F1 |
191
+ | --- | --- | --- | --- |
192
+ | DSIFN-CD | 14 | BIT-CD | 0.6732 |
193
+ | LEVIR-CD+ (test-as-val protocol) | 13 | CGNet | 0.8138 |
194
+ | SYSU-CD | 8 | ChangeMamba | 0.8216 |
195
+ | WHU-CD | 8 | ChangeMamba | 0.9521 |
196
 
197
  ### DSIFN-CD
198
 
199
  | Rank | Model | F1 | mIoU | Overall accuracy | Recall | Precision | BF1 | BmIoU | GFLOPs | GPU (GB) | FPS | Parameters (M) | Checkpoint |
200
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
201
  | 1 | BIT-CD | 0.6732 | 0.6929 | 0.8919 | 0.6552 | 0.6923 | 0.2819 | — | 10.63 | 2.24 | 127.76 | 12.40 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/bit_cd/dsifn_cd/checkpoints/best_model.pth?download=true) |
202
+ | 2 | SChanger | 0.6629 | 0.6835 | 0.8857 | 0.6612 | 0.6647 | 0.2847 | — | — | 2.45 | 24.05 | — | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/schanger/dsifn_cd/checkpoints/best_model.pth?download=true) |
203
+ | 3 | ChangeMamba | 0.6435 | 0.6729 | 0.8849 | 0.6113 | 0.6792 | 0.1903 | — | 28.70 | 1.93 | 15.42 | 54.00 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changemamba/dsifn_cd/checkpoints/best_model.pth?download=true) |
204
+ | 4 | CGNet | 0.6204 | 0.6290 | 0.8343 | 0.7970 | 0.5079 | 0.2903 | — | 82.23 | 6.52 | 65.39 | 38.99 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/cgnet/dsifn_cd/checkpoints/best_model.pth?download=true) |
205
+ | 5 | FC-EF | 0.6078 | 0.6400 | 0.8604 | 0.6365 | 0.5816 | 0.1955 | — | 3.58 | 0.74 | 204.13 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_ef/dsifn_cd/checkpoints/best_model.pth?download=true) |
206
+ | 6 | ChangeFormer | 0.5964 | 0.6152 | 0.8299 | 0.7397 | 0.4996 | 0.2422 | — | 21.18 | 4.07 | 49.74 | 29.75 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changeformer/dsifn_cd/checkpoints/best_model.pth?download=true) |
207
+ | 7 | BiFA | 0.5876 | 0.6111 | 0.8296 | 0.7142 | 0.4991 | 0.2692 | — | 53.00 | 15.10 | 13.81 | 9.87 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/bifa/dsifn_cd/checkpoints/best_model.pth?download=true) |
208
+ | 8 | Siam-NestedUNet | 0.5839 | 0.6024 | 0.8188 | 0.7482 | 0.4788 | 0.2374 | — | 54.83 | 7.34 | 29.18 | 12.03 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/siam_nestedunet/dsifn_cd/checkpoints/best_model.pth?download=true) |
209
+ | 9 | FC-Siam-diff | 0.5829 | 0.6277 | 0.8593 | 0.5784 | 0.5875 | 0.1691 | — | 4.73 | 1.06 | 113.98 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_diff/dsifn_cd/checkpoints/best_model.pth?download=true) |
210
+ | 10 | STANet | 0.5483 | 0.6258 | 0.8829 | 0.4184 | 0.7953 | 0.1613 | — | 13.16 | 14.11 | 133.96 | 16.93 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/stanet/dsifn_cd/checkpoints/best_model.pth?download=true) |
211
+ | 11 | FC-Siam-conc | 0.5479 | 0.5665 | 0.7873 | 0.7583 | 0.4288 | 0.1811 | — | 5.33 | 1.02 | 127.67 | 1.55 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_conc/dsifn_cd/checkpoints/best_model.pth?download=true) |
212
+ | 12 | DSAMNet | 0.5467 | 0.5757 | 0.8020 | 0.7027 | 0.4474 | 0.2374 | — | 75.39 | 2.91 | 166.43 | 16.95 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/dsamnet/dsifn_cd/checkpoints/best_model.pth?download=true) |
213
+ | 13 | HANet | 0.5347 | 0.5817 | 0.8193 | 0.6109 | 0.4754 | 0.2418 | — | 17.67 | 11.36 | 42.36 | 3.03 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/hanet/dsifn_cd/checkpoints/best_model.pth?download=true) |
214
+ | 14 | IFNet | 0.4579 | 0.5102 | 0.7524 | 0.6153 | 0.3647 | 0.1325 | — | 82.26 | 6.08 | 104.88 | 50.71 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/ifnet/dsifn_cd/checkpoints/best_model.pth?download=true) |
215
 
216
  ### LEVIR-CD+ (test-as-val protocol)
217
 
218
  | Rank | Model | F1 | mIoU | Overall accuracy | Recall | Precision | BF1 | BmIoU | GFLOPs | GPU (GB) | FPS | Parameters (M) | Checkpoint |
219
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
220
  | 1 | CGNet | 0.8138 | 0.8356 | 0.9856 | 0.7746 | 0.8572 | 0.7651 | — | 82.23 | 6.01 | 44.01 | 38.99 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/cgnet/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
221
+ | 2 | Siam-NestedUNet | 0.8046 | 0.8282 | 0.9839 | 0.8129 | 0.7965 | 0.7386 | — | — | 2.67 | 108.71 | — | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/siam_nestedunet/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
222
+ | 3 | SChanger | 0.8007 | 0.8253 | 0.9836 | 0.8112 | 0.7906 | 0.7364 | — | — | 2.45 | 48.96 | — | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/schanger/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
223
+ | 4 | BIT-CD | 0.7996 | 0.8247 | 0.9838 | 0.7946 | 0.8047 | 0.7143 | — | 10.63 | 2.27 | 236.60 | 12.40 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/bit_cd/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
224
+ | 5 | HANet | 0.7841 | 0.8131 | 0.9819 | 0.8064 | 0.7630 | 0.7043 | — | — | 5.04 | 84.44 | — | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/hanet/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
225
+ | 6 | BiFA | 0.7772 | 0.8084 | 0.9818 | 0.7785 | 0.7760 | 0.6581 | — | 53.00 | 15.14 | 30.38 | 9.87 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/bifa/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
226
+ | 7 | FC-Siam-conc | 0.7650 | 0.7999 | 0.9809 | 0.7623 | 0.7678 | 0.7175 | — | 5.33 | 1.02 | 308.81 | 1.55 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_conc/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
227
+ | 8 | STANet | 0.7544 | 0.7921 | 0.9791 | 0.7865 | 0.7249 | 0.6388 | — | — | 4.45 | 174.00 | — | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/stanet/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
228
+ | 9 | ChangeFormer | 0.7488 | 0.7887 | 0.9795 | 0.7505 | 0.7472 | 0.6525 | — | 21.18 | 4.03 | 157.64 | 29.75 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changeformer/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
229
+ | 10 | DSAMNet | 0.7444 | 0.7850 | 0.9779 | 0.7897 | 0.7040 | 0.5370 | — | 75.39 | 2.90 | 37.84 | 16.95 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/dsamnet/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
230
+ | 11 | IFNet | 0.7410 | 0.7833 | 0.9786 | 0.7510 | 0.7313 | 0.3489 | — | 82.26 | 6.08 | 105.44 | 50.71 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/ifnet/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
231
+ | 12 | FC-EF | 0.7319 | 0.7766 | 0.9768 | 0.7785 | 0.6905 | 0.6497 | — | 3.58 | 0.74 | 457.44 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_ef/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
232
+ | 13 | FC-Siam-diff | 0.7196 | 0.7667 | 0.9725 | 0.8650 | 0.6160 | 0.5447 | — | 4.73 | 1.06 | 262.80 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_diff/levir_cd_test_as_val/checkpoints/best_model.pth?download=true) |
233
 
234
  ### SYSU-CD
235
 
236
  | Rank | Model | F1 | mIoU | Overall accuracy | Recall | Precision | BF1 | BmIoU | GFLOPs | GPU (GB) | FPS | Parameters (M) | Checkpoint |
237
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
238
  | 1 | ChangeMamba | 0.8216 | 0.8006 | 0.9214 | 0.7677 | 0.8836 | 0.3197 | — | 28.70 | 1.93 | 77.65 | 54.00 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changemamba/sysu_cd/checkpoints/best_model.pth?download=true) |
239
+ | 2 | FC-Siam-conc | 0.7778 | 0.7558 | 0.8975 | 0.7609 | 0.7955 | 0.1939 | — | 5.33 | 1.02 | 356.94 | 1.55 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_conc/sysu_cd/checkpoints/best_model.pth?download=true) |
240
+ | 3 | STANet | 0.7728 | 0.7482 | 0.8913 | 0.7841 | 0.7619 | 0.1962 | — | — | 4.45 | 176.02 | — | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/stanet/sysu_cd/checkpoints/best_model.pth?download=true) |
241
+ | 4 | FC-EF | 0.7710 | 0.7489 | 0.8936 | 0.7596 | 0.7828 | 0.1857 | — | 3.58 | 0.73 | 553.75 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_ef/sysu_cd/checkpoints/best_model.pth?download=true) |
242
+ | 5 | ChangeFormer | 0.7635 | 0.7382 | 0.8851 | 0.7863 | 0.7420 | 0.1591 | — | 21.18 | 4.03 | 143.73 | 29.75 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changeformer/sysu_cd/checkpoints/best_model.pth?download=true) |
243
+ | 6 | FC-Siam-diff | 0.7630 | 0.7457 | 0.8956 | 0.7129 | 0.8208 | 0.1853 | — | 4.73 | 1.08 | 552.90 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_diff/sysu_cd/checkpoints/best_model.pth?download=true) |
244
+ | 7 | BIT-CD | 0.7618 | 0.7395 | 0.8881 | 0.7584 | 0.7652 | 0.1780 | — | 10.63 | 2.24 | 111.11 | 12.40 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/bit_cd/sysu_cd/checkpoints/best_model.pth?download=true) |
245
+ | 8 | IFNet | 0.7145 | 0.7020 | 0.8724 | 0.6772 | 0.7562 | 0.1158 | — | — | 3.29 | 109.80 | — | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/ifnet/sysu_cd/checkpoints/best_model.pth?download=true) |
246
 
247
  ### WHU-CD
248
 
249
  | Rank | Model | F1 | mIoU | Overall accuracy | Recall | Precision | BF1 | BmIoU | GFLOPs | GPU (GB) | FPS | Parameters (M) | Checkpoint |
250
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
251
  | 1 | ChangeMamba | 0.9521 | 0.9519 | 0.9954 | 0.9401 | 0.9644 | 0.8605 | — | 28.70 | 1.93 | 75.28 | 54.00 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changemamba/whu_cd/checkpoints/best_model.pth?download=true) |
252
+ | 2 | CGNet | 0.9331 | 0.9340 | 0.9936 | 0.9299 | 0.9364 | 0.8138 | — | 82.23 | 5.62 | 129.54 | 38.99 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/cgnet/whu_cd/checkpoints/best_model.pth?download=true) |
253
+ | 3 | BIT-CD | 0.8940 | 0.8989 | 0.9899 | 0.8845 | 0.9037 | 0.6879 | — | 10.63 | 2.24 | 46.28 | 12.40 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/bit_cd/whu_cd/checkpoints/best_model.pth?download=true) |
254
+ | 4 | DSAMNet | 0.8905 | 0.8956 | 0.9891 | 0.9167 | 0.8657 | 0.5855 | — | 75.39 | 2.90 | 116.58 | 16.95 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/dsamnet/whu_cd/checkpoints/best_model.pth?download=true) |
255
+ | 5 | IFNet | 0.8389 | 0.8534 | 0.9849 | 0.8147 | 0.8644 | 0.3245 | — | 82.26 | 6.08 | 104.98 | 50.71 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/ifnet/whu_cd/checkpoints/best_model.pth?download=true) |
256
+ | 6 | FC-EF | 0.8385 | 0.8531 | 0.9850 | 0.8067 | 0.8729 | 0.5818 | — | 3.58 | 0.74 | 498.55 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_ef/whu_cd/checkpoints/best_model.pth?download=true) |
257
+ | 7 | FC-Siam-conc | 0.7789 | 0.8062 | 0.9756 | 0.8907 | 0.6920 | 0.4733 | — | 5.33 | 1.03 | 397.86 | 1.55 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_conc/whu_cd/checkpoints/best_model.pth?download=true) |
258
+ | 8 | FC-Siam-diff | 0.7135 | 0.7580 | 0.9631 | 0.9540 | 0.5699 | 0.2148 | — | 4.73 | 1.09 | 567.87 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_diff/whu_cd/checkpoints/best_model.pth?download=true) |
259
 
260
  ### Datasets without a released checkpoint
261
 
 
800
 
801
  ### Trained checkpoints
802
 
803
+ All completed test-run checkpoints and direct download links are listed in [Results and released checkpoints](#results-and-released-checkpoints). Local training still writes checkpoints under `results/{model}/{dataset}/checkpoints/`.
804
 
805
  ## Repository Structure
806
 
results/bifa/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:777d27bd6d5bfbad053400fa218a4c0158bf914de4f3a8eedaf5259976c89153
3
+ size 84561542
results/bifa/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:549b457905182d40826af8636e56bb66f255f169f02d97be87f637992e58aed7
3
+ size 84564806
results/bit_cd/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a26249ff69f6c7c032b1021f131caa84c42bc18b15a6db3592b02dc2afb88a58
3
+ size 63780064
results/bit_cd/sysu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdda34754585228f56fe9c3c071d5fc27a50b85ae4207ab9f624c2074199f882
3
+ size 63780064
results/bit_cd/whu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af6821533046ce4ae644470452322c0c2aab3af2443ab0e45fc1f0b5ed18a29d
3
+ size 63780064
results/cgnet/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5066db580376ea4b6e8cca1dd1f1775c8108236faead56dd9ad112ada50b918a
3
+ size 425600242
results/cgnet/whu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d06e9d5b9e46d560e94ee10514a76a97931c39413136989263f276b5f8ce82b2
3
+ size 425600242
results/changeformer/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1fa5ceeb11ae0679876690371c24f7f005953350781a3c311dafa8f5019c3d4
3
+ size 357355596
results/changeformer/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd828dc9e15de4ebe40c914e1c1ca5f9eea2c11e99837cb358e1c93ef7e4b1ca
3
+ size 357352076
results/changeformer/sysu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef4259e5c130f3477236b9ddc03b70ab6e4774568cc94e78688aff8d6fc17a4d
3
+ size 357352012
results/changemamba/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:916d7e4599c4caa48c7e6940f72a662715497d29a2d6312742dcecb3c006c882
3
+ size 648967138
results/dsamnet/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:829c4b4d207c5d03d5a2ebc9a35a43a1f80cefa34dc1056d9542df0e1c802508
3
+ size 203616560
results/dsamnet/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbdd1220fa771bb84e2640dbb6f1d50a9137f0231ff4bc0fa31d8b19d9828a40
3
+ size 203616560
results/dsamnet/whu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2eab14c866ae5aa9deb6d38cdd4eedd50deb004e122ab82a16f3358409795a9
3
+ size 203616560
results/fc_ef/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5678ba743c3e351844a531d58fc4faefe4ad70c0da4f94d55a16e834d71cedca
3
+ size 16336975
results/fc_ef/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9295a37c30c00c339b4e914d520696e9598ef072ba32a1f9e3b49f5d60d96543
3
+ size 16336079
results/fc_ef/sysu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bf76d8806dd805ded499bf6508c72bf34b9f0aba9af1e8f58d7750c8c740e37
3
+ size 16336015
results/fc_ef/whu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30ce6be5cf623fb97d6c93fc8c1496874f07530ea1c7bf8650e81615f8654ad0
3
+ size 16336015
results/fc_siam_conc/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3af93c964bd088e43977a43e75f02e90e53da2121a1c617132e0968d7c8ade4
3
+ size 18681871
results/fc_siam_conc/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e51a57d5ccfd58fb7da7feeb0a7fb806ea4dd2b119dd8a50b657413d4a29605d
3
+ size 18680975
results/fc_siam_conc/sysu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4eeecefaba6392766d7274c4b594dab8b347a157fd150e71be8626cd9c98022b
3
+ size 18680975
results/fc_siam_conc/whu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4042ececb487f19a8657cf6aa61d7fd0f5bf77ec1fd3967138f546844f11755a
3
+ size 18680975
results/fc_siam_diff/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42a203ac1613947362765046d3685e7467cc50f7a71884e454bdf374d2686297
3
+ size 16331791
results/fc_siam_diff/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:acfe4c123f6e19e6ebe7a67603134fae21d6179e2f2bb2aa9398a9c3594aeb0c
3
+ size 16330895
results/fc_siam_diff/sysu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3ca6ba6e92971a5c5cb476f3b2d231ee7e4b9aeab9cf048dd50afc03cf3d074
3
+ size 16330895
results/fc_siam_diff/whu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2c5892d0c8503257e20b06a9b5b3b78030a32c473c3c67a9fdd4413049cd1fb
3
+ size 16330895
results/hanet/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39155f0ea100f6a7cc7a75a50b25b3faefbf52eddafaeb2e620cb273947711f5
3
+ size 33249770
results/hanet/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5de63aa909294de539d14ca36faca11347af12f4ac2f2ab9552622ef74e4f50c
3
+ size 33249834
results/ifnet/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:707245bf39fb2b2fa56a28baec76676bd8badf30a83d2b4975a709d094aa6ac2
3
+ size 606647375
results/ifnet/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e36492c7d5e4cf02c17dc4e4c95fe2eb7bd8e58bb378aa01e63194a1c4ebf548
3
+ size 606647375
results/ifnet/sysu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b6f02c48c0aa22f3815ef481d2d73100dab25873df30b5f815ae52bbaaa8107
3
+ size 606647375
results/ifnet/whu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d784daa39037a72d025b8fed68f20416e03d41095e5f5c714eac3dce81b962a
3
+ size 606647375
results/schanger/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:515cc38ea6b3e9581e74dd49e818579e7cf03c535071c31dd08f53a990cf49d8
3
+ size 29181384
results/schanger/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e05302273b6647c673cd40ce0e75f4c77f93ef908ea8c48f7dbb555908bd79fe
3
+ size 29186056
results/siam_nestedunet/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e010c90978b859477d4c2841efe9e0c148fbfc9e9326fadfadfc24246fc8fe6c
3
+ size 144651936
results/siam_nestedunet/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c4433be2f6e94ab678f8b4066461e57cfac6bbd27252daed729b18cad72da8c
3
+ size 144652000
results/stanet/dsifn_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d00785955c44bb70ecf1ac53634b6114f52726f660bdeb2feebc62f27939f1f
3
+ size 203392350
results/stanet/levir_cd_test_as_val/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7ddef4ae07f4e52cfefa8602e4589a62609a41c376049a894efa3922445e022
3
+ size 203392350
results/stanet/sysu_cd/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5e2333e3af7b21fe2b264d30e252c5680195017a9ebc4c739aa090221049070
3
+ size 203392350
tools/generate_hf_model_card.py CHANGED
@@ -109,17 +109,17 @@ def markdown_table(headers: list[str], rows: list[list[str]]) -> list[str]:
109
 
110
  def build_results() -> tuple[str, list[Path]]:
111
  grouped = load_rows()
112
- winners: list[Path] = []
113
  lines = [
114
  "## Results and released checkpoints",
115
  "",
116
- "Only completed `metrics_test.json` evaluations are eligible. Rankings are computed per dataset by test-set F1 (descending), and only the rank-1 checkpoint for each dataset is released. Validation-only, incomplete, and checkpoint-only runs are excluded.",
117
  "",
118
  "All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.",
119
  "",
120
  "The current evaluator records BF1 but not boundary mean IoU (BmIoU), so BmIoU remains explicitly unavailable rather than being inferred from BF1. Boundary IoU and boundary F1 are distinct measures.",
121
  "",
122
- "### Released checkpoint summary",
123
  "",
124
  ]
125
  summary_rows: list[list[str]] = []
@@ -128,20 +128,15 @@ def build_results() -> tuple[str, list[Path]]:
128
  if not rows:
129
  continue
130
  winner = rows[0]
131
- checkpoint = checkpoint_path(winner)
132
- if not checkpoint.is_file():
133
- raise FileNotFoundError(f"Winning checkpoint is missing: {checkpoint}")
134
- winners.append(checkpoint)
135
  summary_rows.append(
136
  [
137
  DATASET_LABELS[dataset],
 
138
  MODEL_LABELS.get(winner["_model"], winner["_model"]),
139
  fmt(winner["f1"]),
140
- f"[{repo_relative(checkpoint).name}]({download_url(checkpoint)})",
141
- f"{checkpoint.stat().st_size / (1024 ** 2):.1f} MiB",
142
  ]
143
  )
144
- lines.extend(markdown_table(["Dataset", "Selected model", "Test F1", "Download", "Size"], summary_rows))
145
 
146
  headers = [
147
  "Rank",
@@ -164,10 +159,13 @@ def build_results() -> tuple[str, list[Path]]:
164
  lines.extend(["", f"### {DATASET_LABELS[dataset]}", ""])
165
  table_rows: list[list[str]] = []
166
  for rank, row in enumerate(rows, start=1):
167
- link = "—"
168
- if rank == 1:
169
- checkpoint = checkpoint_path(row)
170
- link = f"[Download]({download_url(checkpoint)})"
 
 
 
171
  table_rows.append(
172
  [
173
  str(rank),
@@ -200,7 +198,7 @@ def build_results() -> tuple[str, list[Path]]:
200
  "",
201
  ]
202
  )
203
- return "\n".join(lines), winners
204
 
205
 
206
  def update_readme(results_markdown: str) -> None:
@@ -215,12 +213,13 @@ def update_readme(results_markdown: str) -> None:
215
  text = text[:start] + results_markdown + "\n\n" + text[end:]
216
  old = (
217
  "### Trained checkpoints\n\n"
218
- "Trained benchmark checkpoints are not released in the root README. "
219
- "The sweep writes local checkpoints under `results/{model}/{dataset}/checkpoints/`."
 
220
  )
221
  new = (
222
  "### Trained checkpoints\n\n"
223
- "The released rank-1 test checkpoints and direct download links are listed in "
224
  "[Results and released checkpoints](#results-and-released-checkpoints). Local training still "
225
  "writes checkpoints under `results/{model}/{dataset}/checkpoints/`."
226
  )
@@ -235,14 +234,14 @@ def main() -> None:
235
  parser = argparse.ArgumentParser()
236
  parser.add_argument("--write", action="store_true", help="Replace the README result sections")
237
  args = parser.parse_args()
238
- markdown, winners = build_results()
239
  if args.write:
240
  update_readme(markdown)
241
  else:
242
  print(markdown)
243
- print("Winning checkpoints:")
244
- for winner in winners:
245
- print(repo_relative(winner))
246
 
247
 
248
  if __name__ == "__main__":
 
109
 
110
  def build_results() -> tuple[str, list[Path]]:
111
  grouped = load_rows()
112
+ checkpoints: list[Path] = []
113
  lines = [
114
  "## Results and released checkpoints",
115
  "",
116
+ "Only completed `metrics_test.json` evaluations are eligible. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released. Validation-only, incomplete, and checkpoint-only runs are excluded.",
117
  "",
118
  "All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.",
119
  "",
120
  "The current evaluator records BF1 but not boundary mean IoU (BmIoU), so BmIoU remains explicitly unavailable rather than being inferred from BF1. Boundary IoU and boundary F1 are distinct measures.",
121
  "",
122
+ "### Dataset summary",
123
  "",
124
  ]
125
  summary_rows: list[list[str]] = []
 
128
  if not rows:
129
  continue
130
  winner = rows[0]
 
 
 
 
131
  summary_rows.append(
132
  [
133
  DATASET_LABELS[dataset],
134
+ str(len(rows)),
135
  MODEL_LABELS.get(winner["_model"], winner["_model"]),
136
  fmt(winner["f1"]),
 
 
137
  ]
138
  )
139
+ lines.extend(markdown_table(["Dataset", "Tested models", "F1 leader", "Best test F1"], summary_rows))
140
 
141
  headers = [
142
  "Rank",
 
159
  lines.extend(["", f"### {DATASET_LABELS[dataset]}", ""])
160
  table_rows: list[list[str]] = []
161
  for rank, row in enumerate(rows, start=1):
162
+ checkpoint = checkpoint_path(row)
163
+ if not checkpoint.is_file():
164
+ raise FileNotFoundError(
165
+ f"Tested checkpoint is missing for {row['_model']}/{dataset}: {checkpoint}"
166
+ )
167
+ checkpoints.append(checkpoint)
168
+ link = f"[Download]({download_url(checkpoint)})"
169
  table_rows.append(
170
  [
171
  str(rank),
 
198
  "",
199
  ]
200
  )
201
+ return "\n".join(lines), checkpoints
202
 
203
 
204
  def update_readme(results_markdown: str) -> None:
 
213
  text = text[:start] + results_markdown + "\n\n" + text[end:]
214
  old = (
215
  "### Trained checkpoints\n\n"
216
+ "The released rank-1 test checkpoints and direct download links are listed in "
217
+ "[Results and released checkpoints](#results-and-released-checkpoints). Local training still "
218
+ "writes checkpoints under `results/{model}/{dataset}/checkpoints/`."
219
  )
220
  new = (
221
  "### Trained checkpoints\n\n"
222
+ "All completed test-run checkpoints and direct download links are listed in "
223
  "[Results and released checkpoints](#results-and-released-checkpoints). Local training still "
224
  "writes checkpoints under `results/{model}/{dataset}/checkpoints/`."
225
  )
 
234
  parser = argparse.ArgumentParser()
235
  parser.add_argument("--write", action="store_true", help="Replace the README result sections")
236
  args = parser.parse_args()
237
+ markdown, checkpoints = build_results()
238
  if args.write:
239
  update_readme(markdown)
240
  else:
241
  print(markdown)
242
+ print("Released tested checkpoints:")
243
+ for checkpoint in checkpoints:
244
+ print(repo_relative(checkpoint))
245
 
246
 
247
  if __name__ == "__main__":