card: 689 checkpoints, FGIRFT split to its own repo
Browse files
README.md
CHANGED
|
@@ -19,15 +19,17 @@ visual margins and samples per class are scarce. Every checkpoint is an ImageNet
|
|
| 19 |
the backbone frozen**; only a small set of adapter modules is trained, so a model is a ~340 MB file
|
| 20 |
of which ~2 M parameters were actually learned.
|
| 21 |
|
| 22 |
-
The repository gathers the checkpoints behind
|
| 23 |
|
| 24 |
- **ILA** — the down-sampling inter-layer adapter, and **SAW**, a semantic-adaptation warmup added on
|
| 25 |
top of it (the `ila_*` groups). ILA was introduced in the ECCV 2024 EFM workshop paper below.
|
| 26 |
- **AAA** — the attention-aggregation adapter, which replaces ILA's convolutional down-sampler with a
|
| 27 |
bottleneck attention that fixes the adapter's misplaced attention (the `aaa_*` groups).
|
| 28 |
-
- **FGIRFT** — a full fine-tuning FGIR benchmark on 21 datasets, for reference (the `ft_*` groups).
|
| 29 |
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
| 31 |
`manifest.csv` and loadable by name with the standalone `fgir_zoo` library (no training repo needed).
|
| 32 |
|
| 33 |
Part of the [ERISLab FGIR-ViT collection](https://huggingface.co/collections/ERISLab/fgir-vit-ila-saw-aaa-and-fgirft-6ab2dc3a730388cfe7a5f7b4).
|
|
@@ -57,7 +59,6 @@ spans several resolutions.
|
|
| 57 |
| `aaa_main_224` / `aaa_main_448` / `aaa_main_672` | AAA | vit_b16 | The AAA finals (frozen / adapter / ILA++ / AAA arms), by resolution |
|
| 58 |
| `aaa_fungi` | AAA (breadth) | vit_b16 | FungiTastic breadth probe — kept for completeness, not a paper result |
|
| 59 |
| `medical_idrid`, `medical_petl` | AAA (medical) | vit_b16 | Medical-imaging PETL and IDRiD resolution runs |
|
| 60 |
-
| `ft_224` / `ft_448` | FGIRFT | vit_b16 | Full fine-tunes with FGIR heads (GLSim, MAWS, PSM, CAL, MPNCOV, …) on 21 datasets |
|
| 61 |
|
| 62 |
The ILA/SAW paper evaluates the `ila_main` and `ila_saw` serials; the AAA paper evaluates the
|
| 63 |
`aaa_main_*` serials. `manifest.csv` maps every file to its dataset, method, serial, resolution,
|
|
|
|
| 19 |
the backbone frozen**; only a small set of adapter modules is trained, so a model is a ~340 MB file
|
| 20 |
of which ~2 M parameters were actually learned.
|
| 21 |
|
| 22 |
+
The repository gathers the checkpoints behind two lines of work from the ERIS Lab:
|
| 23 |
|
| 24 |
- **ILA** — the down-sampling inter-layer adapter, and **SAW**, a semantic-adaptation warmup added on
|
| 25 |
top of it (the `ila_*` groups). ILA was introduced in the ECCV 2024 EFM workshop paper below.
|
| 26 |
- **AAA** — the attention-aggregation adapter, which replaces ILA's convolutional down-sampler with a
|
| 27 |
bottleneck attention that fixes the adapter's misplaced attention (the `aaa_*` groups).
|
|
|
|
| 28 |
|
| 29 |
+
The full fine-tuning FGIR benchmark (FGIRFT) is now a separate repository,
|
| 30 |
+
[ERISLab/FGIRFT](https://huggingface.co/ERISLab/FGIRFT).
|
| 31 |
+
|
| 32 |
+
689 checkpoints, one seed per configuration, last epoch only. Everything is described in
|
| 33 |
`manifest.csv` and loadable by name with the standalone `fgir_zoo` library (no training repo needed).
|
| 34 |
|
| 35 |
Part of the [ERISLab FGIR-ViT collection](https://huggingface.co/collections/ERISLab/fgir-vit-ila-saw-aaa-and-fgirft-6ab2dc3a730388cfe7a5f7b4).
|
|
|
|
| 59 |
| `aaa_main_224` / `aaa_main_448` / `aaa_main_672` | AAA | vit_b16 | The AAA finals (frozen / adapter / ILA++ / AAA arms), by resolution |
|
| 60 |
| `aaa_fungi` | AAA (breadth) | vit_b16 | FungiTastic breadth probe — kept for completeness, not a paper result |
|
| 61 |
| `medical_idrid`, `medical_petl` | AAA (medical) | vit_b16 | Medical-imaging PETL and IDRiD resolution runs |
|
|
|
|
| 62 |
|
| 63 |
The ILA/SAW paper evaluates the `ila_main` and `ila_saw` serials; the AAA paper evaluates the
|
| 64 |
`aaa_main_*` serials. `manifest.csv` maps every file to its dataset, method, serial, resolution,
|