arXiv:2505.11404cs.CVcs.AI2025-05AAAI被引 40

用强化学习训练病理专家级推理模型,提升诊断准确性和推理逻辑。

Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner

  • 基于病理教材和专家经验构建高质量推理数据集
  • 三阶段训练:预训练+思维链微调+强化学习优化推理质量
  • 在零样本分类、跨模态检索等任务上表现优异

视觉语言模型(VLMs)在医学领域取得进展,但病理科仍具挑战性,现有病理专用VLM在诊断准确性和推理合理性方面存在不足。这主要源于病理数据集多为图像-描述对,缺乏真实病理医生使用的结构化诊断范式。本研究结合病理教材与真实专家经验,构建高质量、以推理为导向的数据集。在此基础上,提出Patho-R1,一种基于多模态强化学习的病理推理模型,采用三阶段训练流程:(1) 在350万张图像-文本对上持续预训练以注入知识;(2) 在50万条高质量思维链样本上进行监督微调以激励推理;(3) 采用分组相对策略优化与解耦剪辑及动态采样策略进行强化学习,优化多模态推理质量。为进一步评估数据集对齐质量,提出Patho-CLIP,使用相同图像-标题语料库训练。实验结果表明,Patho-CLIP与Patho-R1在多种病理任务中均表现稳健,包括零样本分类、跨模态检索、视觉问答和多项选择题。项目代码已开源:https://github.com/Wenchuan-Zhang/Patho-R1。

原文摘要 · Abstract (English)

Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both diagnostic accuracy and reasoning plausibility. Such shortcomings are largely attributable to the nature of current pathology datasets, which are primarily composed of image description pairs that lack the depth and structured diagnostic paradigms employed by real world pathologists. In this study, we leverage pathology textbooks and real world pathology experts to construct high-quality, reasoning-oriented datasets. Building on this, we introduce Patho-R1, a multimodal RL-based pathology Reasoner, trained through a three-stage pipeline: (1) continued pretraining on 3.5 million image-text pairs for knowledge infusion; (2) supervised fine-tuning on 500k high-quality Chain-of-Thought samples for reasoning incentivizing; (3) reinforcement learning using Group Relative Policy Optimization and Decoupled Clip and Dynamic sAmpling Policy Optimization strategies for multimodal reasoning quality refinement. To further assess the alignment quality of our dataset, we propose Patho-CLIP, trained on the same figure-caption corpus used for continued pretraining. Comprehensive experimental results demonstrate that both Patho-CLIP and Patho-R1 achieve robust performance across a wide range of pathology-related tasks, including zero-shot classification, cross-modal retrieval, Visual Question Answering, and Multiple Choice Question. Our project is available at the Patho-R1 repository: https://github.com/Wenchuan-Zhang/Patho-R1.

病理推理强化学习多模态VLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。