Rename release to VOICE
Browse files
README.md
CHANGED
|
@@ -5,13 +5,13 @@ tags:
|
|
| 5 |
- spatial-transcriptomics
|
| 6 |
- image-to-expression
|
| 7 |
---
|
| 8 |
-
#
|
| 9 |
|
| 10 |
Predict spatial single-cell gene expression from H&E images using an image encoder, a spatial decoder, and a reference bank of cells with measured expression.
|
| 11 |
|
| 12 |
## Resources
|
| 13 |
|
| 14 |
-
- **Code:** [GitHub](https://github.com/zchxhcz1/VOICE
|
| 15 |
- **Paper:** [arXiv:2608.08366](https://arxiv.org/abs/2608.08366)
|
| 16 |
|
| 17 |
## Installation
|
|
@@ -19,8 +19,8 @@ Predict spatial single-cell gene expression from H&E images using an image encod
|
|
| 19 |
Use Python 3.10 or later and install a PyTorch build suitable for your hardware.
|
| 20 |
|
| 21 |
```bash
|
| 22 |
-
git clone https://github.com/zchxhcz1/VOICE
|
| 23 |
-
cd VOICE
|
| 24 |
pip install -r requirements.txt
|
| 25 |
```
|
| 26 |
|
|
@@ -37,13 +37,13 @@ hf auth login
|
|
| 37 |
python - <<'PYTHON'
|
| 38 |
from huggingface_hub import snapshot_download, hf_hub_download
|
| 39 |
|
| 40 |
-
model_dir = "models/
|
| 41 |
-
snapshot_download("zchx/VOICE
|
| 42 |
hf_hub_download("MahmoodLab/UNI2-h", "pytorch_model.bin", local_dir=f"{model_dir}/uni2h")
|
| 43 |
PYTHON
|
| 44 |
```
|
| 45 |
|
| 46 |
-
See [model files](https://github.com/zchxhcz1/VOICE
|
| 47 |
|
| 48 |
## Prediction
|
| 49 |
|
|
@@ -52,7 +52,7 @@ Choose your own model, image and output locations in the commands below. Run pre
|
|
| 52 |
```bash
|
| 53 |
python predict/predict.py \
|
| 54 |
--image /path/to/slide.svs \
|
| 55 |
-
--release models/
|
| 56 |
--out results/prediction.h5ad
|
| 57 |
```
|
| 58 |
|
|
@@ -64,7 +64,7 @@ If the image does not contain physical resolution metadata, supply its actual mi
|
|
| 64 |
|
| 65 |
```bash
|
| 66 |
python predict/predict.py --image /path/to/image.png --mpp 0.25 \
|
| 67 |
-
--release models/
|
| 68 |
```
|
| 69 |
|
| 70 |
`0.25` is an example. Use the resolution of your image. Prediction requires no measured expression or precomputed image features for the target slide.
|
|
@@ -103,6 +103,6 @@ The combined score is `beta * A + (1 - beta) * R`. Genes without reference cover
|
|
| 103 |
|
| 104 |
## Training
|
| 105 |
|
| 106 |
-
[Training instructions](https://github.com/zchxhcz1/VOICE
|
| 107 |
|
| 108 |
-
[Input formats](https://github.com/zchxhcz1/VOICE
|
|
|
|
| 5 |
- spatial-transcriptomics
|
| 6 |
- image-to-expression
|
| 7 |
---
|
| 8 |
+
# Histology-Based Reconstruction of Single-Cell Transcriptomics through multimodal foundation models
|
| 9 |
|
| 10 |
Predict spatial single-cell gene expression from H&E images using an image encoder, a spatial decoder, and a reference bank of cells with measured expression.
|
| 11 |
|
| 12 |
## Resources
|
| 13 |
|
| 14 |
+
- **Code:** [GitHub](https://github.com/zchxhcz1/VOICE)
|
| 15 |
- **Paper:** [arXiv:2608.08366](https://arxiv.org/abs/2608.08366)
|
| 16 |
|
| 17 |
## Installation
|
|
|
|
| 19 |
Use Python 3.10 or later and install a PyTorch build suitable for your hardware.
|
| 20 |
|
| 21 |
```bash
|
| 22 |
+
git clone https://github.com/zchxhcz1/VOICE.git
|
| 23 |
+
cd VOICE
|
| 24 |
pip install -r requirements.txt
|
| 25 |
```
|
| 26 |
|
|
|
|
| 37 |
python - <<'PYTHON'
|
| 38 |
from huggingface_hub import snapshot_download, hf_hub_download
|
| 39 |
|
| 40 |
+
model_dir = "models/voice"
|
| 41 |
+
snapshot_download("zchx/VOICE", local_dir=model_dir)
|
| 42 |
hf_hub_download("MahmoodLab/UNI2-h", "pytorch_model.bin", local_dir=f"{model_dir}/uni2h")
|
| 43 |
PYTHON
|
| 44 |
```
|
| 45 |
|
| 46 |
+
See [model files](https://github.com/zchxhcz1/VOICE/blob/main/weights/README.md) for the directory structure.
|
| 47 |
|
| 48 |
## Prediction
|
| 49 |
|
|
|
|
| 52 |
```bash
|
| 53 |
python predict/predict.py \
|
| 54 |
--image /path/to/slide.svs \
|
| 55 |
+
--release models/voice \
|
| 56 |
--out results/prediction.h5ad
|
| 57 |
```
|
| 58 |
|
|
|
|
| 64 |
|
| 65 |
```bash
|
| 66 |
python predict/predict.py --image /path/to/image.png --mpp 0.25 \
|
| 67 |
+
--release models/voice --out results/prediction.h5ad
|
| 68 |
```
|
| 69 |
|
| 70 |
`0.25` is an example. Use the resolution of your image. Prediction requires no measured expression or precomputed image features for the target slide.
|
|
|
|
| 103 |
|
| 104 |
## Training
|
| 105 |
|
| 106 |
+
[Training instructions](https://github.com/zchxhcz1/VOICE/blob/main/docs/training.md) cover RNA embedding preparation, image–RNA alignment, expression training, reference-bank construction, and fitting fusion weights. Training requires paired H&E images and measured spatial expression.
|
| 107 |
|
| 108 |
+
[Input formats](https://github.com/zchxhcz1/VOICE/blob/main/docs/formats.md) describe image geometry, prepared-slide files, reference-bank inputs, and output coordinates.
|