arXiv:2506.16398cs.CV2025-06被引 3

用双语知识引导病理图像层次建模,提升癌症诊断准确率

HyperPath: Knowledge-Guided Hyperbolic Semantic Hierarchy Modeling for WSI Analysis

  • 将视觉与文本特征映射至双曲空间,构建病理图像语义层级
  • 在多个数据集上超越现有方法,最高提升4.2%分类准确率
  • 适合医学图像分析、双模态学习研究者参考

病理学对癌症诊断至关重要,多实例学习(MIL)广泛用于全切片图像(WSI)分析。WSI天然具有层级结构——切片、区域和整体图像,且存在显著语义关联。现有方法虽尝试利用该层级,但多依赖欧氏嵌入,难以充分捕捉语义层次。为此,我们提出HyperPath,一种新方法:通过文本描述知识引导,在双曲空间中建模WSI的语义层级,从而提升分类性能。该方法将病理视觉-语言基础模型提取的视觉与文本特征适配至双曲空间,设计角对齐损失以保证跨模态一致性,同时引入语义层级一致性损失,通过蕴含与矛盾关系优化特征层级,增强语义连贯性。分类基于测地线距离,衡量双曲语义层级中实体间的相似性,无需线性分类器,实现几何感知的WSI分析。大量实验表明,本方法在各项任务中均优于现有方法,凸显双曲嵌入在WSI分析中的潜力。

原文摘要 · Abstract (English)

Pathology is essential for cancer diagnosis, with multiple instance learning (MIL) widely used for whole slide image (WSI) analysis. WSIs exhibit a natural hierarchy -- patches, regions, and slides -- with distinct semantic associations. While some methods attempt to leverage this hierarchy for improved representation, they predominantly rely on Euclidean embeddings, which struggle to fully capture semantic hierarchies. To address this limitation, we propose HyperPath, a novel method that integrates knowledge from textual descriptions to guide the modeling of semantic hierarchies of WSIs in hyperbolic space, thereby enhancing WSI classification. Our approach adapts both visual and textual features extracted by pathology vision-language foundation models to the hyperbolic space. We design an Angular Modality Alignment Loss to ensure robust cross-modal alignment, while a Semantic Hierarchy Consistency Loss further refines feature hierarchies through entailment and contradiction relationships and thus enhance semantic coherence. The classification is performed with geodesic distance, which measures the similarity between entities in the hyperbolic semantic hierarchy. This eliminates the need for linear classifiers and enables a geometry-aware approach to WSI analysis. Extensive experiments show that our method achieves superior performance across tasks compared to existing methods, highlighting the potential of hyperbolic embeddings for WSI analysis.

病理图像双曲嵌入视觉语言医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。