CASE-8B-ABL-RLAIF / README.md
Vinyeh's picture
Update README.md
2dab375 verified
|
Raw History Blame Contribute Delete
1.09 kB
---
license: mit
language:
- en
base_model:
- Qwen/Qwen3-VL-8B-Instruct
---
# case-8b-rl-abl-rlaif (step 1912, 1 epoch)
**Ablation**: identical to `case-8b-rl` but **without the rubric-judge reward**
(the LLM-judge scoring term is removed; the format/outcome terms remain).
Paper: *From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning*.
- **Training**: GRPO + OPSD, rubric-judge reward disabled
- **Step**: 1912
- **Provenance**: `case/rl_ablate_no_judge/hf_step1912` (merged from FSDP shards)
- **Base model**: Qwen3-VL-8B-Instruct
- **Task**: longitudinal medical-imaging QA; the policy answers by calling tools
(view image, compare visits, organ segmentation, report retrieval, skill memory)
- **Format**: merged HF checkpoint (single `model.safetensors` + tokenizer/processor)
- **Usage**: `vllm serve <this_dir> --trust-remote-code` (add `--enforce-eager` when
serving in an environment without a full CUDA toolkit)
- **Data**: trained on UK Biobank-derived, access-controlled data; no UKB-derived
data is redistributed here. Research use only.