arXiv:2604.23982cs.CV2026-04

用形态原型和位置编码提升病理图像诊断的可解释性与准确性

Hierarchical Prototype-based Domain Priors for Multiple Instance Learning in Multimodal Histopathology Analysis

论文配图:Hierarchical Prototype-based Domain Priors for Multiple Instance Learning in Multimodal Histopathology Analysis
图 1 · 摘自论文原文
  • 构建分层原型系统,结合形态聚类与位置编码,增强空间结构感知
  • 在7个癌症队列上达到顶尖性能,显著提升模型鲁棒性
  • 适合需要可解释病理分析的临床研究与医学AI开发者

数字病理学通过全切片图像(WSIs)的计算分析改变了诊断流程,但有效解析其复杂的肿瘤微环境仍具挑战。现有多重实例学习(MIL)框架通常将全切片图像视为无结构的图像块集合,忽略了关键的形态语义与空间几何信息,导致对背景噪声过拟合并难以与高级诊断知识对齐。为此,我们提出分层原型域先验(HPDP)框架,一种统一的多模态联合病理诊断与预后分析方法。该框架通过形态锚定原型系统(MAPS)将学习锚定在可解释的形态簇上,并引入正弦位置编码(SPE)显式建模组织架构。此外,通过大语言模型生成的描述桥接语义鸿沟,实现视觉表示的上下文优化。在七个癌症队列上的广泛实验表明,HPDP持续达到最先进性能,具备优异的鲁棒性与可解释性。

原文摘要 · Abstract (English)

Digital pathology has fundamentally altered diagnostic workflows by enabling the computational analysis of gigapixel Whole Slide Images (WSIs), yet effectively deciphering their complex tumor microenvironments remains a formidable challenge. Existing Multiple Instance Learning (MIL) frameworks typically treat Whole Slide Images as unstructured bags of patches, discarding critical morphological semantics and spatial geometry. This lack of inductive bias often leads to overfitting on background noise and fails to align visual features with high-level diagnostic knowledge. To overcome these limitations, we propose the Hierarchical Prototype-based Domain Priors (HPDP) framework, a unified multimodal approach for joint histopathology diagnosis and prognosis. HPDP mitigates the data-driven "black box" issue by introducing a Morphologically Anchored Prototype System (MAPS), which anchors learning to interpretable morphological clusters, and a Sinusoidal Positional Encoder (SPE) to explicitly model tissue architecture. Furthermore, we bridge the semantic gap via a Hierarchical Cross-Modal Alignment (HCMA) module, using Large Language Model (LLM)-generated descriptions to contextually refine visual representations. Extensive experiments across seven cancer cohorts demonstrate that HPDP consistently achieves state-of-the-art performance with superior robustness and interpretability.

病理分析多模态可解释性MIL

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。