| # BehaviorCosmos Mistral 7B Models |
|
|
| ### Mistral-7B-v0.1_html_v1/ |
| Model for named entity recognition of behavior entities for zebrafish, trained and evaluated on the gold dataset, version 1 |
|
|
| F1 score: 0.701 (on gold dataset) |
|
|
| ### Mistral-7B-v0.1_html_v2/ |
| Model for named entity recognition of behavior entities for zebrafish, trained and evaluated on the gold dataset, version 2 (for reproducibility) |
|
|
| F1 score: 0.699 (on gold dataset) |
|
|
| ### Mistral-7B-v0.1_html_v3/ |
| Model for named entity recognition of behavior entities for zebrafish, trained and evaluated on the gold dataset, version 3 (for reproducibility) |
|
|
| F1 score: 0.703 (on gold dataset) |
|
|
| ### Mistral-7B-v0.1_html_v4/ |
| Model for named entity recognition of behavior entities for zebrafish, trained and evaluated on the gold dataset, version 4 (for reproducibility) |
|
|
| F1 score: 0.696 (on gold dataset) |
|
|
| ### Mistral-7B-v0.1_zfbehavior_s-0_none_c-none/ |
| Best model for named entity recognition of behavior entities for zebrafish |
|
|
| F1 score: 0.601 (on Paula original dataset) |
|
|
| ### Mistral-7B-v0.1_mclocation_lr3e-5_minlr1e-6_100-epochs/ |
| Best model for named entity recognition of location entities for mice |
|
|
| F1 score: 0.0 (on original dataset) |
|
|
| ### Mistral-7B-v0.1_mcstimulus_lr3e-5_minlr1e-6_100-epochs/ |
| Best model for named entity recognition of stimulus entities for mice |
|
|
| F1 score: 0.0 (on original dataset) |
|
|
| ### Mistral-7B-v0.1_mcgenotype_lr3e-5_minlr1e-6_100-epochs/ |
| Best model for named entity recognition of genotype entities for mice |
|
|
| F1 score: 0.762 (on original dataset) |
|
|
| ### Mistral-7B-v0.1_mcbehavior_lr3e-5_minlr1e-6_100-epochs/ |
| Best model for named entity recognition of behavior entities for mice |
|
|
| F1 score: 0.273 (on original dataset) |
|
|
| ### Mistral-7B-v0.1_zflocation_lr3e-5_minlr1e-6_ep100_100-epochs/ |
| Best model for named entity recognition of location entities for zebrafish |
| |
| F1 score: 0.375 (on Paula original dataset) |
| |
| ### Mistral-7B-v0.1_zfstimulus_lr3e-5_minlr1e-6_ep100_100-epochs/ |
| Best model for named entity recognition of stimulus entities for zebrafish |
|
|
| F1 score: 0.33 (on Paula original dataset) |
|
|
| ### Mistral-7B-v0.1_zfgenotype_lr3e-5_minlr1e-6_100-epochs/ |
| Best model for named entity recognition of genotype entities for zebrafish |
|
|
| F1 score: 0.491 (on Paula original dataset) |
|
|
| ### Mistral-7B-v0.1_zfbehavior_lr3e-5_minlr1e-6_100-epochs/ |
| Model for named entity recognition of behavior entities for zebrafish, same training parameters as for the other 3 entity types, however not the best model for the behavior entity type |
|
|
| F1 score: 0.459 (on Paula original dataset) |
|
|
|
|
