BoHuangLab commited on
Commit
ad2602e
·
verified ·
1 Parent(s): d959800

Document the img2seq pair on the card

Browse files
Files changed (1) hide show
  1. README.md +9 -2
README.md CHANGED
@@ -19,7 +19,9 @@ Checkpoints behind the [CELL-FM CondenSeq demo](https://huggingface.co/spaces/Bo
19
  | `condenseq/vae.bin` | Image VAE, 160x160, 3 down blocks, 4 latent channels | `pretrain_condenseq/vae/checkpoint-50000` |
20
  | `condenseq/vit_cls.bin` | ViT condensed/diffuse classifier, 2-channel 160x160 input | `PT_CondenSeq_img_ViT_cls_R1/checkpoint-10000` |
21
  | `hpa/cellfm_seq2img.bin` | CELL-FM virtual-staining generator for HPA, 256x256, 3-channel conditioning (includes the ESM-C 600M encoder) | `pretrain_hpa/cellfm_seq2img/checkpoint-50000` |
22
- | `hpa/vae.bin` | Image VAE, 256x256, 3 down blocks, 4 latent channels | `pretrain_hpa/vae/checkpoint-50000` |
 
 
23
  | `hpa/anchor_cell.npy` | The fixed cell every NLS-screening image is conditioned on: `(3, 256, 256)` float32 in [-1, 1], channels nucleus, ER, microtubules. HPA gene H3C13, cell crop `1194_B2_2_4` | built |
24
  | `hpa/anchor_masks.npz` | Two 256x256 boolean masks over that cell, `nucleus` and `cell`; cytoplasm is `cell & ~nucleus` | built |
25
 
@@ -27,4 +29,9 @@ Hyperparameters for the CondenSeq models are set in `pipeline.py` in the Space a
27
  `scripts/cell_fm_cs/evaluate_seq2img.sh` and
28
  `scripts/vit_cls_condenseq_img/pretrain.sh` in the CELL-FM repository. The HPA
29
  hyperparameters are spelled out in `notebooks/nls_screening.ipynb` and mirror
30
- `scripts/cell_fm/evaluate_virtual_staining_hpa_dict.sh`.
 
 
 
 
 
 
19
  | `condenseq/vae.bin` | Image VAE, 160x160, 3 down blocks, 4 latent channels | `pretrain_condenseq/vae/checkpoint-50000` |
20
  | `condenseq/vit_cls.bin` | ViT condensed/diffuse classifier, 2-channel 160x160 input | `PT_CondenSeq_img_ViT_cls_R1/checkpoint-10000` |
21
  | `hpa/cellfm_seq2img.bin` | CELL-FM virtual-staining generator for HPA, 256x256, 3-channel conditioning (includes the ESM-C 600M encoder) | `pretrain_hpa/cellfm_seq2img/checkpoint-50000` |
22
+ | `hpa/vae.bin` | Image VAE at 256x256, the one `hpa/cellfm_seq2img.bin` was trained against | `pretrain_hpa/vae/checkpoint-50000` |
23
+ | `hpa/cellfm_img2seq.bin` | CELL-FM image-to-sequence model for HPA, 512x512, 3-channel conditioning (includes the ESM-C 600M encoder) | `pretrain_hpa/cellfm_img2seq/checkpoint-60000` |
24
+ | `hpa/vae_512.bin` | Image VAE at 512x512, the one `hpa/cellfm_img2seq.bin` was trained against — a different model from `hpa/vae.bin`, not a rename | `pretrain_hpa/vae_512/checkpoint-50000` |
25
  | `hpa/anchor_cell.npy` | The fixed cell every NLS-screening image is conditioned on: `(3, 256, 256)` float32 in [-1, 1], channels nucleus, ER, microtubules. HPA gene H3C13, cell crop `1194_B2_2_4` | built |
26
  | `hpa/anchor_masks.npz` | Two 256x256 boolean masks over that cell, `nucleus` and `cell`; cytoplasm is `cell & ~nucleus` | built |
27
 
 
29
  `scripts/cell_fm_cs/evaluate_seq2img.sh` and
30
  `scripts/vit_cls_condenseq_img/pretrain.sh` in the CELL-FM repository. The HPA
31
  hyperparameters are spelled out in `notebooks/nls_screening.ipynb` and mirror
32
+ `scripts/cell_fm/evaluate_virtual_staining_hpa_dict.sh`. The img2seq pair mirrors
33
+ `scripts_local/cell_fm/evaluate_img2seq_hpa_v2.sh`: 512 px, `sample_size` 128,
34
+ `encoder_patch_size` 8, `img_generator_patch_size` 4, 8 attention heads.
35
+
36
+ Each generator must be loaded with the VAE it was trained against — pairing
37
+ `cellfm_img2seq.bin` with the 256 px `vae.bin` gives a latent-size mismatch.