SphereFlow: Missing Modality Imputation via Geometric Transport on Hypersphere

Pretrained weights and preprocessed data for our NeurIPS 2026 paper.

[Paper] [Code]

Contents

checkpoints/
β”œβ”€β”€ sphereflow/
β”‚   β”œβ”€β”€ brats/
β”‚   β”‚   β”œβ”€β”€ rae.pt      # shared DINOv2-B encoder + 4 ViT-G decoders
β”‚   β”‚   └── flow.pt     # DiT^DH-XXL flow
β”‚   └── mri_ct/
β”‚       β”œβ”€β”€ rae.pt      # shared DINOv2-B encoder + 2 ViT-G decoders
β”‚       └── flow.pt     # DiT^DH-XL flow
β”œβ”€β”€ baselines/
β”‚   β”œβ”€β”€ brats/{MMSyn,MMGAN,MMT,ModImp,M2DN,Zhang}.pt
β”‚   └── mri_ct/{MMSyn,MMGAN,MMT,ModImp,M2DN,Zhang}.pt
└── unet3d/brats.pt     # 3D U-Net segmenter
data/
β”œβ”€β”€ brats_{train_00,train_01,train_02,val,test}.tar
└── mri_ct_{train,val,test}.tar

Usage

Run from the root of the code repository.

hf download WTHH031230/SphereFlow --include "checkpoints/*" --local-dir .
hf download WTHH031230/SphereFlow --include "data/*" --local-dir .
for f in data/*.tar; do tar -xf "$f" -C /path/to/processed; done
DATA_ROOT=/path/to/processed bash scripts/preprocess/make_splits.sh --check

Data

The .npy slices were produced from the following datasets with the preprocessing scripts in scripts/preprocess/ of the code repository. They are released under CC BY-NC 4.0, for non-commercial use only.

  • BraTS 2023 adult glioma (BraTS-GLI), CC BY-NC 4.0. Data used in this publication were obtained as part of the Brain Tumor Segmentation (BraTS) Challenge project through Synapse ID: syn51156910. Please cite:
    • U. Baid, et al., The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classification, arXiv:2107.02314, 2021.
    • B. H. Menze, et al., The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS), IEEE TMI 34(10), 2015.
    • S. Bakas, et al., Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features, Scientific Data 4:170117, 2017.
    • A. Karargyris, et al., Federated benchmarking of medical artificial intelligence with MedPerf, Nature Machine Intelligence 5:799–810, 2023.
  • SynthRAD2023, Task 1 (brain MRI ↔ CT), CC BY-NC 4.0, Zenodo 10.5281/zenodo.7260705. Please cite:
    • A. Thummerer, et al., SynthRAD2023 Grand Challenge dataset: Generating synthetic CT for radiotherapy, Medical Physics 50(7), 2023.

Citation

@inproceedings{wang2026sphereflow,
    title     = {SphereFlow: Missing Modality Imputation via Geometric Transport on Hypersphere},
    author    = {Wang, Huihan and Wang, Juncheng and Feng, Yuxiang and Hou, Wenlong and Yu, Guoqi and Xu, Chao and Liu, Yang and Sun, Baigui and Wang, Shujun},
    booktitle = {Advances in Neural Information Processing Systems},
    year      = {2026}
}
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Papers for WTHH031230/SphereFlow