fsh-tal / README.md
bds062's picture
Upload README.md with huggingface_hub
5fd2626 verified
|
Raw History Blame Contribute Delete
1.41 kB
---
license: other
license_name: license-tbd
pretty_name: FSH-TAL
tags:
- cichlid
- temporal-action-localization
- animal-behavior
- video
datasets:
- bds062/cichlid-behavior-pairs
---
# FSH-TAL
Model weights for **Automated Temporal Localization of Behavior in Cichlid
Fish with Few-Shot Trajectory Tokens** (WACV 2027). Code, usage and the full
pipeline: **https://github.com/bds062/FSH-TAL**
## Files
| Path | Size | What it is |
|---|---|---|
| `checkpoints/fshtal_release.pt` | 63 MB | FSH-TAL localizer trained on all 17 recordings |
| `backbone/backbone_release.pt` | 537 MB | Trokens++ MIL backbone trained on all 17 recordings |
| `checkpoints/fold{0-4}.pt` | 5 × 63 MB | the paper's 5-fold cross-validation localizers; fold F's never trained on fold F's recordings |
| `features/feats_fold{0-4}/<recording>/feats.npy` | 3.6 GB | the paper's 5-fold cross-validation feature banks |
| `features/feats_release_all17/<recording>/feats.npy` | 0.7 GB | the release backbone's feature bank |
All inputs come from SAM 3.1 tracks (prompt "fish", streamed at 4 fps in 24 s
sessions). Each cross-validation localizer trains on the 13-14 recordings
outside its fold and is scored at its final epoch with its fold's bank, giving
41.0 avg mAP (IoU 0.1-0.7) over the 17 held-out recordings.
## License
TBD — license to be finalized alongside the associated publication. Contact
the authors before reuse.