Image-to-Text
Transformers
Safetensors
lana_radgen
feature-extraction
medical-ai
radiology
chest-xray
report-generation
segmentation
anatomical-attention
custom_code
Instructions to use manu02/LAnA-MIMIC with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use manu02/LAnA-MIMIC with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("image-to-text", model="manu02/LAnA-MIMIC", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("manu02/LAnA-MIMIC", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Refresh LAnA collection comparison tables
Browse files
README.md
CHANGED
|
@@ -109,17 +109,17 @@ These comparison tables are refreshed across the full LAnA collection whenever a
|
|
| 109 |
| --- | --- | --- | --- | --- | --- | --- |
|
| 110 |
| Run status | `Completed` | `Completed` | `Completed` | `Completed` | `Completed` | `Model still training` |
|
| 111 |
| Number of studies | `3041` | `3041` | `3041` | `3041` | `3041` | `3041` |
|
| 112 |
-
| ROUGE-L | `0.1513` | `0.1653` | `0.1686` | `0.1670` | `0.1745` | `0.
|
| 113 |
-
| BLEU-1 | `0.1707` | `0.1916` | `0.2091` | `0.2174` | `0.2346` | `0.
|
| 114 |
-
| BLEU-4 | `0.0357` | `0.0386` | `0.0417` | `0.0417` | `0.0484` | `0.
|
| 115 |
-
| METEOR | `0.2079` | `0.2202` | `0.2298` | `0.2063` | `0.2129` | `0.
|
| 116 |
-
| RadGraph F1 | `0.0918` | `0.0921` | `0.1024` | `0.1057` | `0.0939` | `0.
|
| 117 |
-
| RadGraph entity F1 | `0.1399` | `0.1459` | `0.1587` | `0.1569` | `0.1441` | `0.
|
| 118 |
-
| RadGraph relation F1 | `0.1246` | `0.1322` | `0.1443` | `0.1474` | `0.1280` | `0.
|
| 119 |
-
| CheXpert F1 14-micro | `0.1829` | `0.1565` | `0.2116` | `0.1401` | `0.3116` | `0.
|
| 120 |
-
| CheXpert F1 5-micro | `0.2183` | `0.1530` | `0.2512` | `0.2506` | `0.2486` | `0.
|
| 121 |
-
| CheXpert F1 14-macro | `0.1095` | `0.0713` | `0.1095` | `0.0401` | `0.1363` | `0.
|
| 122 |
-
| CheXpert F1 5-macro | `0.1634` | `0.1007` | `0.1644` | `0.1004` | `0.1686` | `0.
|
| 123 |
|
| 124 |
### Cross-Model Comparison: Findings-Only Frontal Test Studies
|
| 125 |
|
|
@@ -127,17 +127,17 @@ These comparison tables are refreshed across the full LAnA collection whenever a
|
|
| 127 |
| --- | --- | --- | --- | --- | --- | --- |
|
| 128 |
| Run status | `Completed` | `Completed` | `Completed` | `Completed` | `Completed` | `Model still training` |
|
| 129 |
| Number of studies | `2210` | `2210` | `2210` | `2210` | `2210` | `2210` |
|
| 130 |
-
| ROUGE-L | `0.1576` | `0.1720` | `0.1771` | `0.1771` | `0.1848` | `0.
|
| 131 |
-
| BLEU-1 | `0.1754` | `0.2003` | `0.2177` | `0.2263` | `0.2480` | `0.
|
| 132 |
-
| BLEU-4 | `0.0405` | `0.0449` | `0.0484` | `0.0487` | `0.0573` | `0.
|
| 133 |
-
| METEOR | `0.2207` | `0.2347` | `0.2466` | `0.2240` | `0.2310` | `0.
|
| 134 |
-
| RadGraph F1 | `0.1010` | `0.1000` | `0.1119` | `0.1181` | `0.1046` | `0.
|
| 135 |
-
| RadGraph entity F1 | `0.1517` | `0.1577` | `0.1713` | `0.1739` | `0.1584` | `0.
|
| 136 |
-
| RadGraph relation F1 | `0.1347` | `0.1413` | `0.1549` | `0.1628` | `0.1405` | `0.
|
| 137 |
-
| CheXpert F1 14-micro | `0.1651` | `0.1442` | `0.1907` | `0.1365` | `0.2921` | `0.
|
| 138 |
-
| CheXpert F1 5-micro | `0.2152` | `0.1716` | `0.2415` | `0.2455` | `0.2394` | `0.
|
| 139 |
-
| CheXpert F1 14-macro | `0.1047` | `0.0700` | `0.1039` | `0.0381` | `0.1326` | `0.
|
| 140 |
-
| CheXpert F1 5-macro | `0.1611` | `0.1112` | `0.1578` | `0.0952` | `0.1636` | `0.
|
| 141 |
|
| 142 |
## Data
|
| 143 |
|
|
@@ -159,7 +159,7 @@ These comparison tables are refreshed across the full LAnA collection whenever a
|
|
| 159 |
- `LAnA-v2`: This version keeps the same training setup as `LAnA`, but increases the effective global batch size from `16` to `128`.
|
| 160 |
- `LAnA-v3`: This version keeps the same training setup as `LAnA`, including the effective global batch size of `16`, but changes how EOS is handled so training and generation follow the same behavior. The model no longer uses the EOS token during training, and generation remained greedy without stopping when an EOS token was produced. In the previous setup, decoding was also greedy, stopped at EOS, and used a maximum of `128` new tokens.
|
| 161 |
- `LAnA-v4`: This version keeps the same decoding behavior as `LAnA-v3`, but increases the effective global batch size from `16` to `128`.
|
| 162 |
-
- `LAnA-v5`: This version
|
| 163 |
|
| 164 |
## Training Snapshot
|
| 165 |
|
|
|
|
| 109 |
| --- | --- | --- | --- | --- | --- | --- |
|
| 110 |
| Run status | `Completed` | `Completed` | `Completed` | `Completed` | `Completed` | `Model still training` |
|
| 111 |
| Number of studies | `3041` | `3041` | `3041` | `3041` | `3041` | `3041` |
|
| 112 |
+
| ROUGE-L | `0.1513` | `0.1653` | `0.1686` | `0.1670` | `0.1745` | `0.1668` |
|
| 113 |
+
| BLEU-1 | `0.1707` | `0.1916` | `0.2091` | `0.2174` | `0.2346` | `0.2381` |
|
| 114 |
+
| BLEU-4 | `0.0357` | `0.0386` | `0.0417` | `0.0417` | `0.0484` | `0.0420` |
|
| 115 |
+
| METEOR | `0.2079` | `0.2202` | `0.2298` | `0.2063` | `0.2129` | `0.2974` |
|
| 116 |
+
| RadGraph F1 | `0.0918` | `0.0921` | `0.1024` | `0.1057` | `0.0939` | `0.0800` |
|
| 117 |
+
| RadGraph entity F1 | `0.1399` | `0.1459` | `0.1587` | `0.1569` | `0.1441` | `0.1480` |
|
| 118 |
+
| RadGraph relation F1 | `0.1246` | `0.1322` | `0.1443` | `0.1474` | `0.1280` | `0.1290` |
|
| 119 |
+
| CheXpert F1 14-micro | `0.1829` | `0.1565` | `0.2116` | `0.1401` | `0.3116` | `0.3628` |
|
| 120 |
+
| CheXpert F1 5-micro | `0.2183` | `0.1530` | `0.2512` | `0.2506` | `0.2486` | `0.3576` |
|
| 121 |
+
| CheXpert F1 14-macro | `0.1095` | `0.0713` | `0.1095` | `0.0401` | `0.1363` | `0.2002` |
|
| 122 |
+
| CheXpert F1 5-macro | `0.1634` | `0.1007` | `0.1644` | `0.1004` | `0.1686` | `0.2817` |
|
| 123 |
|
| 124 |
### Cross-Model Comparison: Findings-Only Frontal Test Studies
|
| 125 |
|
|
|
|
| 127 |
| --- | --- | --- | --- | --- | --- | --- |
|
| 128 |
| Run status | `Completed` | `Completed` | `Completed` | `Completed` | `Completed` | `Model still training` |
|
| 129 |
| Number of studies | `2210` | `2210` | `2210` | `2210` | `2210` | `2210` |
|
| 130 |
+
| ROUGE-L | `0.1576` | `0.1720` | `0.1771` | `0.1771` | `0.1848` | `0.1737` |
|
| 131 |
+
| BLEU-1 | `0.1754` | `0.2003` | `0.2177` | `0.2263` | `0.2480` | `0.2413` |
|
| 132 |
+
| BLEU-4 | `0.0405` | `0.0449` | `0.0484` | `0.0487` | `0.0573` | `0.0475` |
|
| 133 |
+
| METEOR | `0.2207` | `0.2347` | `0.2466` | `0.2240` | `0.2310` | `0.3124` |
|
| 134 |
+
| RadGraph F1 | `0.1010` | `0.1000` | `0.1119` | `0.1181` | `0.1046` | `0.0862` |
|
| 135 |
+
| RadGraph entity F1 | `0.1517` | `0.1577` | `0.1713` | `0.1739` | `0.1584` | `0.1549` |
|
| 136 |
+
| RadGraph relation F1 | `0.1347` | `0.1413` | `0.1549` | `0.1628` | `0.1405` | `0.1350` |
|
| 137 |
+
| CheXpert F1 14-micro | `0.1651` | `0.1442` | `0.1907` | `0.1365` | `0.2921` | `0.3183` |
|
| 138 |
+
| CheXpert F1 5-micro | `0.2152` | `0.1716` | `0.2415` | `0.2455` | `0.2394` | `0.3163` |
|
| 139 |
+
| CheXpert F1 14-macro | `0.1047` | `0.0700` | `0.1039` | `0.0381` | `0.1326` | `0.1798` |
|
| 140 |
+
| CheXpert F1 5-macro | `0.1611` | `0.1112` | `0.1578` | `0.0952` | `0.1636` | `0.2480` |
|
| 141 |
|
| 142 |
## Data
|
| 143 |
|
|
|
|
| 159 |
- `LAnA-v2`: This version keeps the same training setup as `LAnA`, but increases the effective global batch size from `16` to `128`.
|
| 160 |
- `LAnA-v3`: This version keeps the same training setup as `LAnA`, including the effective global batch size of `16`, but changes how EOS is handled so training and generation follow the same behavior. The model no longer uses the EOS token during training, and generation remained greedy without stopping when an EOS token was produced. In the previous setup, decoding was also greedy, stopped at EOS, and used a maximum of `128` new tokens.
|
| 161 |
- `LAnA-v4`: This version keeps the same decoding behavior as `LAnA-v3`, but increases the effective global batch size from `16` to `128`.
|
| 162 |
+
- `LAnA-v5`: This version uses the training recipe from the original `LAnA` paper, while switching to the legacy [`CXR-Findings-AI`](https://huggingface.co/spaces/manu02/CXR-Findings-AI) generation behavior.
|
| 163 |
|
| 164 |
## Training Snapshot
|
| 165 |
|