Document the img2seq pair on the card
Browse files
README.md
CHANGED
|
@@ -19,7 +19,9 @@ Checkpoints behind the [CELL-FM CondenSeq demo](https://huggingface.co/spaces/Bo
|
|
| 19 |
| `condenseq/vae.bin` | Image VAE, 160x160, 3 down blocks, 4 latent channels | `pretrain_condenseq/vae/checkpoint-50000` |
|
| 20 |
| `condenseq/vit_cls.bin` | ViT condensed/diffuse classifier, 2-channel 160x160 input | `PT_CondenSeq_img_ViT_cls_R1/checkpoint-10000` |
|
| 21 |
| `hpa/cellfm_seq2img.bin` | CELL-FM virtual-staining generator for HPA, 256x256, 3-channel conditioning (includes the ESM-C 600M encoder) | `pretrain_hpa/cellfm_seq2img/checkpoint-50000` |
|
| 22 |
-
| `hpa/vae.bin` | Image VAE
|
|
|
|
|
|
|
| 23 |
| `hpa/anchor_cell.npy` | The fixed cell every NLS-screening image is conditioned on: `(3, 256, 256)` float32 in [-1, 1], channels nucleus, ER, microtubules. HPA gene H3C13, cell crop `1194_B2_2_4` | built |
|
| 24 |
| `hpa/anchor_masks.npz` | Two 256x256 boolean masks over that cell, `nucleus` and `cell`; cytoplasm is `cell & ~nucleus` | built |
|
| 25 |
|
|
@@ -27,4 +29,9 @@ Hyperparameters for the CondenSeq models are set in `pipeline.py` in the Space a
|
|
| 27 |
`scripts/cell_fm_cs/evaluate_seq2img.sh` and
|
| 28 |
`scripts/vit_cls_condenseq_img/pretrain.sh` in the CELL-FM repository. The HPA
|
| 29 |
hyperparameters are spelled out in `notebooks/nls_screening.ipynb` and mirror
|
| 30 |
-
`scripts/cell_fm/evaluate_virtual_staining_hpa_dict.sh`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
| `condenseq/vae.bin` | Image VAE, 160x160, 3 down blocks, 4 latent channels | `pretrain_condenseq/vae/checkpoint-50000` |
|
| 20 |
| `condenseq/vit_cls.bin` | ViT condensed/diffuse classifier, 2-channel 160x160 input | `PT_CondenSeq_img_ViT_cls_R1/checkpoint-10000` |
|
| 21 |
| `hpa/cellfm_seq2img.bin` | CELL-FM virtual-staining generator for HPA, 256x256, 3-channel conditioning (includes the ESM-C 600M encoder) | `pretrain_hpa/cellfm_seq2img/checkpoint-50000` |
|
| 22 |
+
| `hpa/vae.bin` | Image VAE at 256x256, the one `hpa/cellfm_seq2img.bin` was trained against | `pretrain_hpa/vae/checkpoint-50000` |
|
| 23 |
+
| `hpa/cellfm_img2seq.bin` | CELL-FM image-to-sequence model for HPA, 512x512, 3-channel conditioning (includes the ESM-C 600M encoder) | `pretrain_hpa/cellfm_img2seq/checkpoint-60000` |
|
| 24 |
+
| `hpa/vae_512.bin` | Image VAE at 512x512, the one `hpa/cellfm_img2seq.bin` was trained against — a different model from `hpa/vae.bin`, not a rename | `pretrain_hpa/vae_512/checkpoint-50000` |
|
| 25 |
| `hpa/anchor_cell.npy` | The fixed cell every NLS-screening image is conditioned on: `(3, 256, 256)` float32 in [-1, 1], channels nucleus, ER, microtubules. HPA gene H3C13, cell crop `1194_B2_2_4` | built |
|
| 26 |
| `hpa/anchor_masks.npz` | Two 256x256 boolean masks over that cell, `nucleus` and `cell`; cytoplasm is `cell & ~nucleus` | built |
|
| 27 |
|
|
|
|
| 29 |
`scripts/cell_fm_cs/evaluate_seq2img.sh` and
|
| 30 |
`scripts/vit_cls_condenseq_img/pretrain.sh` in the CELL-FM repository. The HPA
|
| 31 |
hyperparameters are spelled out in `notebooks/nls_screening.ipynb` and mirror
|
| 32 |
+
`scripts/cell_fm/evaluate_virtual_staining_hpa_dict.sh`. The img2seq pair mirrors
|
| 33 |
+
`scripts_local/cell_fm/evaluate_img2seq_hpa_v2.sh`: 512 px, `sample_size` 128,
|
| 34 |
+
`encoder_patch_size` 8, `img_generator_patch_size` 4, 8 attention heads.
|
| 35 |
+
|
| 36 |
+
Each generator must be loaded with the VAE it was trained against — pairing
|
| 37 |
+
`cellfm_img2seq.bin` with the 256 px `vae.bin` gives a latent-size mismatch.
|