用强化学习让医疗视觉模型会解释推理过程,提升可信度。
MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning
- 通过强化学习激励模型生成人类可读的推理路径,无需标注推理数据。
- 仅用600样本训练,准确率从55.11%提升至78.22%,超越百万样本大模型。
- 适合关注医疗AI可解释性与临床可信度的研究者和开发者。
推理是推动医学影像分析发展的关键方向,透明性与可信度在临床信任和监管审批中至关重要。尽管医学视觉语言模型(VLMs)在放射学任务中展现出潜力,但多数现有模型仅输出最终答案,缺乏底层推理过程。为弥补这一空白,我们提出MedVLM-R1,一种显式生成自然语言推理以增强透明性与可信度的医疗VLM。不同于依赖监督微调(SFT)且易过拟合的常规方法,MedVLM-R1采用强化学习框架,激励模型发现人类可理解的推理路径,无需任何推理参考。尽管训练数据有限(600个视觉问答样本)且参数量小(2B),MedVLM-R1在MRI、CT和X-ray基准测试中准确率从55.11%提升至78.22%,优于使用超百万样本训练的大模型。其在分布外任务下也表现出强泛化能力。通过将医学图像分析与显式推理统一,MedVLM-R1标志着迈向临床实践可信可解释AI的重要一步。推理模型已开源:https://huggingface.co/JZPeterPan/MedVLM-R1。
原文摘要 · Abstract (English)
Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise for radiological tasks, most existing VLMs merely produce final answers without revealing the underlying reasoning. To address this gap, we introduce MedVLM-R1, a medical VLM that explicitly generates natural language reasoning to enhance transparency and trustworthiness. Instead of relying on supervised fine-tuning (SFT), which often suffers from overfitting to training distributions and fails to foster genuine reasoning, MedVLM-R1 employs a reinforcement learning framework that incentivizes the model to discover human-interpretable reasoning paths without using any reasoning references. Despite limited training data (600 visual question answering samples) and model parameters (2B), MedVLM-R1 boosts accuracy from 55.11% to 78.22% across MRI, CT, and X-ray benchmarks, outperforming larger models trained on over a million samples. It also demonstrates robust domain generalization under out-of-distribution tasks. By unifying medical image analysis with explicit reasoning, MedVLM-R1 marks a pivotal step toward trustworthy and interpretable AI in clinical practice. Inference model is available at: https://huggingface.co/JZPeterPan/MedVLM-R1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。