linzher commited on
Commit
ac55ccf
·
verified ·
1 Parent(s): 444805c

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. README.md +65 -0
  2. deployment_manifest.json +17 -0
  3. proposal_adapter_full.pt +3 -0
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ library_name: transformers
4
+ tags:
5
+ - surgical-video
6
+ - spatio-temporal-grounding
7
+ - medical-vision-language-model
8
+ - eccv-2026
9
+ ---
10
+
11
+ # RefineRank: Joint Box Refinement and Ranking for Surgical Spatio-Temporal Grounding
12
+
13
+ Official RefineNet weights for the ECCV 2026 MedVidU Workshop paper
14
+ **RefineRank**.
15
+
16
+ RefineRank couples two **frozen** backbones — a MedVLM (Qwen2.5-VL
17
+ architecture) and GroundingDINO — with a compact **1.25M-parameter** trainable
18
+ module, **RefineNet** (`QueryConditionedProposalAdapter`). RefineNet uses
19
+ MedVLM language and regional features to predict coordinate corrections and
20
+ box-quality scores for GroundingDINO proposals; a parameter-free decoder then
21
+ returns the highest-scoring original or refined box.
22
+
23
+ - **Code, training & inference guide**: https://github.com/linzhe001/RefineRank
24
+ - **Headline result**: 0.421 STG mIoU on the archived MedVidBench Community
25
+ leaderboard snapshot (27 July 2026) — the best STG mIoU among the ten
26
+ ranking metrics on that snapshot.
27
+ - **Controlled evaluation** (video-separated split over CholecTrack20 /
28
+ CoPESD / EgoSurgery): STG mIoU 0.2719 → 0.4534 over the frozen
29
+ MedVLM + GroundingDINO baseline.
30
+
31
+ ## Files
32
+
33
+ | File | Description |
34
+ |---|---|
35
+ | `proposal_adapter_full.pt` | Trained RefineNet checkpoint (`model_state`, `adapter_config`, `train_config`, `standardizer`, `source_feature_contract_hash`). SHA-256: `932e479b854c3d5fbafee25a3fcf9e6481e864fe98a6867502d6ebff39463d9b` |
36
+ | `deployment_manifest.json` | Deployment contract used by `interface.py predict` (model kind, feature-contract hash, decoder mode) |
37
+
38
+ This checkpoint is the exact `run_iter132_submission` run behind the paper's
39
+ MedVidBench submission. The frozen MedVLM and GroundingDINO weights are
40
+ third-party artifacts — see the GitHub README for where to obtain them.
41
+
42
+ ## Usage
43
+
44
+ ```bash
45
+ git clone https://github.com/linzhe001/RefineRank
46
+ cd RefineRank
47
+ pip install -r requirements.txt
48
+ # place proposal_adapter_full.pt + deployment_manifest.json under
49
+ # checkpoints/refinenet/run_iter132_submission/ (see checkpoints/README.md)
50
+ python interface.py predict --checkpoint checkpoints/refinenet/run_iter132_submission
51
+ ```
52
+
53
+ ## Citation
54
+
55
+ ```bibtex
56
+ @inproceedings{jiang2026refinerank,
57
+ title = {RefineRank: Joint Box Refinement and Ranking for Surgical
58
+ Spatio-Temporal Grounding},
59
+ author = {Jiang, Linzhe and Huang, Jiayuan and Zhang, Changhao and
60
+ Jiang, Chunyang and Mao, Zhehua and
61
+ Garcia-Peraza-Herrera, Luis C. and Hoque, Mobarak I.},
62
+ booktitle = {ECCV Workshops (MedVidU)},
63
+ year = {2026}
64
+ }
65
+ ```
deployment_manifest.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "schema_version": 1,
3
+ "decision": "PROPOSAL_REPAIR_FULL_FIT_COMPLETE",
4
+ "model_kind": "proposal_repair_quality",
5
+ "selector_kind": "repair_quality",
6
+ "repair_variant": "full",
7
+ "query_mode": "q_last",
8
+ "decoder_mode": "fixed_current",
9
+ "operator_authorized": true,
10
+ "fit_protocol": "fixed_fold_selected_then_all_train_groups_full_fit",
11
+ "feature_contract_hash": "7fd672157bfa0174e802e66d1c37b5dd7996214edb191f9fba0c926f73d38748",
12
+ "proposal_checkpoint": "checkpoints/proposal_adapter_full.pt",
13
+ "proposal_checkpoint_sha256": "932e479b854c3d5fbafee25a3fcf9e6481e864fe98a6867502d6ebff39463d9b",
14
+ "frozen_inputs_unchanged": true,
15
+ "official_leaderboard_claim": false,
16
+ "release_note": "Camera-ready release manifest reconstructed from the checkpoint metadata (adapter_config, train_config, standardizer, source_feature_contract_hash). Original training run: runs/kept_wf10_final/iter132_submission in the SurgST-VLM research workspace."
17
+ }
proposal_adapter_full.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:932e479b854c3d5fbafee25a3fcf9e6481e864fe98a6867502d6ebff39463d9b
3
+ size 5013971