From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning
Abstract
Foundation models can serve as clinical agents through tool-use harnesses. However, conventional medical benchmarks assess reasoning over preselected evidence rather than the ability to seek it across clinical records and longitudinal imaging. We propose CASE: a series of role-specific Clinical Agents for Seeking Evidence, together with a tool-use harness and an agentic post-training framework for compact vision-language policy models. We further introduce a longitudinal multimodal benchmark built on UK Biobank, comprising 50,401 clinical questions derived from real-world ICD-10-coded diagnoses of 4,739 participants. Each question links to a patient-specific environment containing clinical context and multi-sequence MRI from baseline and follow-up visits, where agents autonomously select which visits, organs, modalities, slices, and specialist tools to inspect and compare. Supervised fine-tuning transfers evidence-seeking workflows from 14,734 frontier-model interaction trajectories, followed by agentic reinforcement learning on the learner's own environment interactions. Privileged on-policy self-distillation and rubric-based LLM feedback refine evidence-to-conclusion reasoning without prescribing tool sequences. Experiments show that CASE moves beyond question-answer imitation toward transferable investigation policies, strengthening evidence-grounded longitudinal reasoning. Under matched evaluation conditions, our Qwen3-VL-8B based agent achieves over 16% and 10% relative improvements in answer accuracy over GPT-5.4 and Claude Opus 4.8. Code will be available at https://github.com/VinyehShaw/CASE.
Community
CASE: From Given to Gathered Evidence
Clinical reasoning is not merely about interpreting evidence, but also about knowing what evidence to seek. Existing medical AI benchmarks primarily evaluate reasoning over preselected information, overlooking the ability to autonomously gather, compare, and synthesize evidence across clinical records and longitudinal imaging.
We introduce CASE (Clinical Agents for Seeking Evidence), shifting medical AI from passive question answering to active, evidence-grounded clinical investigation.
Key Contributions
Longitudinal Multimodal Benchmark. A UK Biobank-based benchmark comprising 50,401 clinical questions from 4,739 participants, integrating clinical records and multi-sequence MRI across baseline and follow-up visits.
Autonomous Evidence-Seeking Agents. A role-conditioned, multi-tool framework enabling compact vision-language models to autonomously select visits, modalities, anatomical structures, image slices, and specialist tools for evidence collection and cross-visit reasoning.
Beyond Teacher Imitation. An agentic post-training framework integrating Agentic RL, On-Policy Self-Distillation (OPSD), and RLAIF to improve evidence-to-conclusion reasoning while preserving autonomous tool-use decisions.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- MLToolBench: Learning Tool-Augmented Agents for Machine Learning Development (2026)
- BaT: Towards Self-Evolving Medical Research Agent with Stage Rubrics (2026)
- MedAgent-R1: Faithfulness-Aware Reinforcement Learning for Evidence-Grounded Medical Reasoning (2026)
- EviDx: Evidence-Aware Active Diagnosis with Scaffolded LLM Agents (2026)
- GLoC-EHR: Evidence-Cited Clinical Reasoning over Global Context and Local EHR Events (2026)
- Coverage-Aware Reasoning with Medical Tokens for Diagnosis Prediction (2026)
- InfiMed2: A Generalist Medical Multimodal Foundation Model from Contextual Evidence and Stability-Aware Supervision (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.39566 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper