Object Detection
Transformers
Safetensors
surgical-video
spatio-temporal-grounding
medical-vision-language-model
eccv-2026
Instructions to use linzher/RefineRank with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use linzher/RefineRank with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("object-detection", model="linzher/RefineRank")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("linzher/RefineRank", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload folder using huggingface_hub
Browse files- README.md +65 -0
- deployment_manifest.json +17 -0
- proposal_adapter_full.pt +3 -0
README.md
ADDED
|
@@ -0,0 +1,65 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc-by-4.0
|
| 3 |
+
library_name: transformers
|
| 4 |
+
tags:
|
| 5 |
+
- surgical-video
|
| 6 |
+
- spatio-temporal-grounding
|
| 7 |
+
- medical-vision-language-model
|
| 8 |
+
- eccv-2026
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# RefineRank: Joint Box Refinement and Ranking for Surgical Spatio-Temporal Grounding
|
| 12 |
+
|
| 13 |
+
Official RefineNet weights for the ECCV 2026 MedVidU Workshop paper
|
| 14 |
+
**RefineRank**.
|
| 15 |
+
|
| 16 |
+
RefineRank couples two **frozen** backbones — a MedVLM (Qwen2.5-VL
|
| 17 |
+
architecture) and GroundingDINO — with a compact **1.25M-parameter** trainable
|
| 18 |
+
module, **RefineNet** (`QueryConditionedProposalAdapter`). RefineNet uses
|
| 19 |
+
MedVLM language and regional features to predict coordinate corrections and
|
| 20 |
+
box-quality scores for GroundingDINO proposals; a parameter-free decoder then
|
| 21 |
+
returns the highest-scoring original or refined box.
|
| 22 |
+
|
| 23 |
+
- **Code, training & inference guide**: https://github.com/linzhe001/RefineRank
|
| 24 |
+
- **Headline result**: 0.421 STG mIoU on the archived MedVidBench Community
|
| 25 |
+
leaderboard snapshot (27 July 2026) — the best STG mIoU among the ten
|
| 26 |
+
ranking metrics on that snapshot.
|
| 27 |
+
- **Controlled evaluation** (video-separated split over CholecTrack20 /
|
| 28 |
+
CoPESD / EgoSurgery): STG mIoU 0.2719 → 0.4534 over the frozen
|
| 29 |
+
MedVLM + GroundingDINO baseline.
|
| 30 |
+
|
| 31 |
+
## Files
|
| 32 |
+
|
| 33 |
+
| File | Description |
|
| 34 |
+
|---|---|
|
| 35 |
+
| `proposal_adapter_full.pt` | Trained RefineNet checkpoint (`model_state`, `adapter_config`, `train_config`, `standardizer`, `source_feature_contract_hash`). SHA-256: `932e479b854c3d5fbafee25a3fcf9e6481e864fe98a6867502d6ebff39463d9b` |
|
| 36 |
+
| `deployment_manifest.json` | Deployment contract used by `interface.py predict` (model kind, feature-contract hash, decoder mode) |
|
| 37 |
+
|
| 38 |
+
This checkpoint is the exact `run_iter132_submission` run behind the paper's
|
| 39 |
+
MedVidBench submission. The frozen MedVLM and GroundingDINO weights are
|
| 40 |
+
third-party artifacts — see the GitHub README for where to obtain them.
|
| 41 |
+
|
| 42 |
+
## Usage
|
| 43 |
+
|
| 44 |
+
```bash
|
| 45 |
+
git clone https://github.com/linzhe001/RefineRank
|
| 46 |
+
cd RefineRank
|
| 47 |
+
pip install -r requirements.txt
|
| 48 |
+
# place proposal_adapter_full.pt + deployment_manifest.json under
|
| 49 |
+
# checkpoints/refinenet/run_iter132_submission/ (see checkpoints/README.md)
|
| 50 |
+
python interface.py predict --checkpoint checkpoints/refinenet/run_iter132_submission
|
| 51 |
+
```
|
| 52 |
+
|
| 53 |
+
## Citation
|
| 54 |
+
|
| 55 |
+
```bibtex
|
| 56 |
+
@inproceedings{jiang2026refinerank,
|
| 57 |
+
title = {RefineRank: Joint Box Refinement and Ranking for Surgical
|
| 58 |
+
Spatio-Temporal Grounding},
|
| 59 |
+
author = {Jiang, Linzhe and Huang, Jiayuan and Zhang, Changhao and
|
| 60 |
+
Jiang, Chunyang and Mao, Zhehua and
|
| 61 |
+
Garcia-Peraza-Herrera, Luis C. and Hoque, Mobarak I.},
|
| 62 |
+
booktitle = {ECCV Workshops (MedVidU)},
|
| 63 |
+
year = {2026}
|
| 64 |
+
}
|
| 65 |
+
```
|
deployment_manifest.json
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": 1,
|
| 3 |
+
"decision": "PROPOSAL_REPAIR_FULL_FIT_COMPLETE",
|
| 4 |
+
"model_kind": "proposal_repair_quality",
|
| 5 |
+
"selector_kind": "repair_quality",
|
| 6 |
+
"repair_variant": "full",
|
| 7 |
+
"query_mode": "q_last",
|
| 8 |
+
"decoder_mode": "fixed_current",
|
| 9 |
+
"operator_authorized": true,
|
| 10 |
+
"fit_protocol": "fixed_fold_selected_then_all_train_groups_full_fit",
|
| 11 |
+
"feature_contract_hash": "7fd672157bfa0174e802e66d1c37b5dd7996214edb191f9fba0c926f73d38748",
|
| 12 |
+
"proposal_checkpoint": "checkpoints/proposal_adapter_full.pt",
|
| 13 |
+
"proposal_checkpoint_sha256": "932e479b854c3d5fbafee25a3fcf9e6481e864fe98a6867502d6ebff39463d9b",
|
| 14 |
+
"frozen_inputs_unchanged": true,
|
| 15 |
+
"official_leaderboard_claim": false,
|
| 16 |
+
"release_note": "Camera-ready release manifest reconstructed from the checkpoint metadata (adapter_config, train_config, standardizer, source_feature_contract_hash). Original training run: runs/kept_wf10_final/iter132_submission in the SurgST-VLM research workspace."
|
| 17 |
+
}
|
proposal_adapter_full.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:932e479b854c3d5fbafee25a3fcf9e6481e864fe98a6867502d6ebff39463d9b
|
| 3 |
+
size 5013971
|