用强化学习让多个医生智能体动态协作,提升医疗多模态诊断准确率。
MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning
- 通过强化学习训练全科医生和主诊医生,实现患者分诊与多专科意见整合。
- 在5个医学VQA数据集上平均性能超越基线23.6%,显著提升诊断准确性。
- 动态熵调节策略让主诊医生学会判断并修正专科医生的错误,适合医疗推理研究者。
医学大视觉语言模型(Med-LVLMs)在多模态诊断任务中展现出巨大潜力。然而,现有单代理模型难以在不同医学专科间泛化,限制了其表现。近期工作引入受临床流程启发的多代理协作框架,但固定顺序的流水线缺乏灵活性。为此,我们提出 MMedAgent-RL,一种基于强化学习(RL)的多代理协作框架,实现医疗代理间的动态优化协作。具体地,我们基于 Qwen2.5-VL 训练两个全科医生代理:分诊医生学习将患者分配至合适专科,主诊医生整合多专科判断并结合自身知识做出最终决策。为应对专科输出不一致问题,我们引入课程学习(CL)引导的强化学习策略,配合动态熵调节,逐步教会主诊医生在模仿专科医生与纠正其错误之间取得平衡。在五个医学视觉问答(VQA)基准上的实验表明,MMedAgent-RL 在性能上优于开源与专有 Med-LVLMs,平均性能提升达 23.6%。
原文摘要 · Abstract (English)
Medical Large Vision-Language Models (Med-LVLMs) have shown strong potential in multimodal diagnostic tasks. However, existing single-agent models struggle to generalize across diverse medical specialties, limiting their performance. Recent efforts introduce multi-agent collaboration frameworks inspired by clinical workflows, where general practitioners (GPs) and specialists interact in a fixed sequence. Despite improvements, these static pipelines lack flexibility and adaptability in reasoning. To address this, we propose MMedAgent-RL, a reinforcement learning (RL)-based multi-agent framework that enables dynamic, optimized collaboration among medical agents. Specifically, we train two GP agents based on Qwen2.5-VL via RL: the triage doctor learns to assign patients to appropriate specialties, while the attending physician integrates the judgments from multi-specialists and its own knowledge to make final decisions. To address the inconsistency in specialist outputs, we introduce a curriculum learning (CL)-guided RL strategy with dynamic entropy regulation, progressively teaching the attending physician to balance between imitating specialists and correcting their mistakes. Experiments on five medical VQA benchmarks demonstrate that MMedAgent-RL outperforms both open-source and proprietary Med-LVLMs. Notably, it achieves an average performance gain of 23.6% over strong baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。