arXiv:2512.06581cs.CV2025-12中稿 · CVPR被引 9

提出MedGRPO框架,解决医疗视频理解中多数据集奖励失衡问题。

MedGRPO: Multi-Task Reinforcement Learning for Heterogeneous Medical Video Understanding

  • 通过跨数据集奖励归一化实现公平训练
  • 在53万条医视频指令上提升定位与描述性能
  • 适合医疗视觉语言模型研究者参考

大型视觉语言模型在医疗视频理解中表现受限,因空间精度、时间推理和临床语义至关重要。为此,我们构建了包含531,850个视频-指令对的大型基准数据集MedVidBench,覆盖8个医学来源,涵盖视频、片段和帧级任务,通过专家引导提示与双模型验证确保质量。监督微调Qwen2.5-VL-7B在所有任务上优于GPT-4.1和Gemini-2.5-Flash。然而标准强化学习因数据集间奖励尺度不平衡而失效,导致训练崩溃。为此提出MedGRPO,采用两种创新:(1) 跨数据集奖励归一化,将各数据集的中位性能映射至统一奖励值,保证优化公平性;(2) 医疗大模型裁判,基于五项临床维度进行对比相似度评分以评估摘要质量。MedGRPO在定位与生成任务上进一步超越监督微调基线。本工作建立了医疗视频理解的基准与训练方法基础。

原文摘要 · Abstract (English)

Large vision-language models struggle with medical video understanding, where spatial precision, temporal reasoning, and clinical semantics are critical. To address this, we first introduce \textbf{MedVidBench}, a large-scale benchmark of 531,850 video-instruction pairs across 8 medical sources spanning video, segment, and frame-level tasks, curated through a rigorous quality assurance pipeline with expert-guided prompting and dual-model validation. While supervised fine-tuning on MedVidBench yields noticeable gains, standard Reinforcement Learning (RL) fails due to imbalanced reward scales across datasets, which destabilizes optimization and leads to training collapse. To overcome this, we introduce \textbf{MedGRPO}, a novel RL framework for balanced multi-dataset training with two key innovations: (1) \emph{cross-dataset reward normalization} that maps each dataset's median performance to a common reward value, ensuring fair optimization regardless of difficulty, and (2) a \emph{medical LLM judge} that evaluates caption quality on five clinical dimensions through comparative similarity scoring. Supervised fine-tuning Qwen2.5-VL-7B on MedVidBench outperforms GPT-4.1 and Gemini-2.5-Flash across all tasks, while MedGRPO further improves the SFT baseline on grounding and captioning. Our work establishes a foundational benchmark and training methodology for advancing medical video understanding with VLMs. Our project website is available at: https://uii-america.github.io/MedGRPO/.

医疗视觉强化学习多任务学习视频理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。