用多模态大模型实现可解释的病理诊断,自动提炼诊断依据
Adaptive Diagnostic Reasoning Framework for Pathology with Multimodal Large Language Models
- 自学习两阶段流程:先扩展病理描述,再优化准确度
- 小样本标注下实现癌症诊断,准确率显著优于基线
- 适合临床医生审计AI决策,提升可信度
病理学中的AI工具提升了筛查效率、标准化量化并揭示预后模式,但因缺乏人类可读的推理过程而难以推广。本文提出RECAP-PATH,一种可解释框架,将多模态大语言模型从被动模式识别转向基于证据的诊断推理。其核心为两阶段自学习过程:第一阶段通过多样化生成病理风格解释,第二阶段优化解释以提高准确性。该方法仅需少量标注数据,无需白盒访问或权重更新即可生成癌症诊断。在乳腺和前列腺数据集上评估显示,RECAP-PATH生成的推理与专家判断一致,且诊断准确率显著优于基线。该框架结合视觉理解与逻辑推理,为构建可信赖的临床AI提供了通用路径。
原文摘要 · Abstract (English)
AI tools in pathology have improved screening throughput, standardized quantification, and revealed prognostic patterns that inform treatment. However, adoption remains limited because most systems still lack the human-readable reasoning needed to audit decisions and prevent errors. We present RECAP-PATH, an interpretable framework that establishes a self-learning paradigm, shifting off-the-shelf multimodal large language models from passive pattern recognition to evidence-linked diagnostic reasoning. At its core is a two-phase learning process that autonomously derives diagnostic criteria: diversification expands pathology-style explanations, while optimization refines them for accuracy. This self-learning approach requires only small labeled sets and no white-box access or weight updates to generate cancer diagnoses. Evaluated on breast and prostate datasets, RECAP-PATH produced rationales aligned with expert assessment and delivered substantial gains in diagnostic accuracy over baselines. By uniting visual understanding with reasoning, RECAP-PATH provides clinically trustworthy AI and demonstrates a generalizable path toward evidence-linked interpretation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。