让病理视觉语言模型学会有逻辑的推理,提升诊断可信度。
PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimization
- 用医学知识图谱生成2万余条带结构化推理的病理图像样本。
- 通过强化学习优化,模型在多尺度数据上达到当前最佳表现。
- 适合临床辅助诊断与可解释医疗AI研究者使用。
视觉语言模型在计算病理学中展现出强大的视觉理解能力,但现有系统常直接输出结论而缺乏可验证的推理依据,严重制约临床信任与专家纠错。为此,我们构建了首个大规模全切片图像(WSI)推理数据集PathReasoner,不依赖未经验证的蒸馏方法,而是利用医学知识图谱,显式对齐病理发现与临床推理,生成超过2万条高质量教学样本。基于此数据集,提出PathReasoner-R1,结合轨迹掩码监督微调与面向推理的强化学习,注入结构化思维链能力。为确保医学严谨性,设计了融合实体奖励机制的知识感知多粒度奖励函数,严格对齐知识图谱,引导模型优化逻辑一致性而非仅匹配结果,显著提升鲁棒性。大量实验表明,PathReasoner-R1在PathReasoner及多个公开基准上均取得最优性能,使病理模型具备透明、临床可信赖的推理能力。数据集与代码已开源:https://github.com/cyclexfy/PathReasoner-R1。
原文摘要 · Abstract (English)
Vision-Language Models (VLMs) are advancing computational pathology with superior visual understanding capabilities. However, current systems often reduce diagnosis to directly output conclusions without verifiable evidence-linked reasoning, which severely limits clinical trust and hinders expert error rectification. To address these barriers, we construct PathReasoner, the first large-scale dataset of whole-slide image (WSI) reasoning. Unlike previous work reliant on unverified distillation, we develop a rigorous knowledge-guided generation pipeline. By leveraging medical knowledge graphs, we explicitly align structured pathological findings and clinical reasoning with diagnoses, generating over 20K high-quality instructional samples. Based on the database, we propose PathReasoner-R1, which synergizes trajectory-masked supervised fine-tuning with reasoning-oriented reinforcement learning to instill structured chain-of-thought capabilities. To ensure medical rigor, we engineer a knowledge-aware multi-granular reward function incorporating an Entity Reward mechanism strictly aligned with knowledge graphs. This effectively guides the model to optimize for logical consistency rather than mere outcome matching, thereby enhancing robustness. Extensive experiments demonstrate that PathReasoner-R1 achieves state-of-the-art performance on both PathReasoner and public benchmarks across various image scales, equipping pathology models with transparent, clinically grounded reasoning capabilities. Dataset and code are available at https://github.com/cyclexfy/PathReasoner-R1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。