Instructions to use MingzhenL/vessa-2d-ssl-bundle with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sam2
How to use MingzhenL/vessa-2d-ssl-bundle with sam2:
# Use SAM2 with images import torch from sam2.sam2_image_predictor import SAM2ImagePredictor predictor = SAM2ImagePredictor.from_pretrained("MingzhenL/vessa-2d-ssl-bundle") with torch.inference_mode(), torch.autocast("cuda", dtype=torch.bfloat16): predictor.set_image(<your_image>) masks, _, _ = predictor.predict(<input_prompts>)# Use SAM2 with videos import torch from sam2.sam2_video_predictor import SAM2VideoPredictor predictor = SAM2VideoPredictor.from_pretrained("MingzhenL/vessa-2d-ssl-bundle") with torch.inference_mode(), torch.autocast("cuda", dtype=torch.bfloat16): state = predictor.init_state(<your_video>) # add new prompts and instantly get the output on the same frame frame_idx, object_ids, masks = predictor.add_new_points(state, <your_prompts>) # propagate the prompts to get masklets throughout the video for frame_idx, object_ids, masks in predictor.propagate_in_video(state): ... - Notebooks
- Google Colab
- Kaggle
VESSA 2D + semi-supervised baselines β handoff bundle
Working bundle for the chest X-ray heart + implanted-device segmentation project: the VESSA Stage-1 teacher checkpoint, the Stage-2 code for four semi-supervised frameworks (Mean Teacher, FixMatch, UniMatch v1, UniMatch v2) with and without VESSA pseudo-label supervision, the student-as-memory (studmem) extension for UniMatch v2, the canonical scorer, the dataset/template-bank builders, and a worked example dataset.
Start with HANDOFF.md β it is the task description for the agent that inherits this work.
| Path | What |
|---|---|
HANDOFF.md |
the task, setup, data prep, experiment matrix, scoring, traps |
code/VESSA_univ1/train_semi/ |
Stage-2 entrypoints: mt_, fixmatch_, unimatchv1_, unimatch_ (=v2) _vessa_multiclass.py, unimatch_vessa_multiclass_studmem.py, supervised_multiclass.py, studmem/ |
code/VESSA_univ1/train_vessa/ |
VESSA model + inference (vessa_prompt.py), vendored SAM2 (model/sam2_main/, weight NOT included) |
code/VESSA/metric_calculator/ |
canonical scorer (metric_master.py, miseval) |
code/VESSA/data_preprocessing/ |
prepare_percentage_dataset.py, build_template_bank.py β builds <NAME>_<PCT>percent_exact_processed banks |
checkpoints/vessa_stage1_17ds_10pct/ckpt_model/ |
VESSA Stage-1 teacher (DeepSpeed ZeRO-2 dir, 23 GB; both files are required) |
pretrained_dino/dinov2_base.pth |
DINOv2-base init for the UniMatch v2 / v1 students (331 MB) |
example_data/RL_dataset/CXR* |
public Shenzhen CXR lung set in the expected format + its 1/5/10 % banks β use it to validate the pipeline before the new data arrives |
configs_template/ |
config templates for the new dataset at 1 / 5 / 10 / 100 % |
envs/ |
requirements_portable.txt (curated) and vessa_rl_pip_freeze.txt (exact) |
docs/ |
VESSA_FRAMEWORK_HANDOFF.md (full framework manual, 17 traps), STUDMEM_README_PORTABLE.md, run instructions |
results/gate_p1_full_6516936.json |
the 2D studmem pseudo-label gate result on STS 1 % (template-only 0.794 β +student 0.841 Dice) |
Public assets to download separately (links in HANDOFF.md): SAM 2.1 Hiera-Large, Qwen3-VL-4B-Instruct (pinned revision), DINOv2 ViT-S/14 (torch.hub).
- Downloads last month
- 31
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support