通过自校准机制提升病理图像分析的全局与局部特征提取效率。
SEW: Self-calibration Enhanced Whole Slide Pathology Image Analysis
- 分三阶段:全局分类、关注区域预测、细节特征提取
- 准确率显著优于传统方法,支持快速可解释诊断
- 适合需要高精度肿瘤标记发现的研究者使用
病理图像被视为癌症诊断与治疗的“金标准”,其吉比特级图像包含丰富的组织与细胞信息。现有方法难以高效同时提取全局结构与局部细节特征以实现全面分析。为此,我们提出一种自校准增强的全切片病理图像分析框架,包含三个组件:全局分支、焦点预测器与细节分支。全局分支首先基于病理缩略图进行分类;焦点预测器根据全局分支最后一层特征识别相关区域;细节提取分支随后评估放大区域是否对应病灶。最后,全局与细节分支间的特征一致性约束确保全局分支聚焦于正确区域并提取充分判别特征,用于最终识别。这些聚焦的判别特征在特征簇独特性与组织空间分布视角下,对发现新型预后肿瘤标志物极具价值。大量实验表明,该框架能快速实现病理分级与预后任务的准确且可解释的结果。
原文摘要 · Abstract (English)
Pathology images are considered the ``gold standard" for cancer diagnosis and treatment, with gigapixel images providing extensive tissue and cellular information. Existing methods fail to simultaneously extract global structural and local detail features for comprehensive pathology image analysis efficiently. To address these limitations, we propose a self-calibration enhanced framework for whole slide pathology image analysis, comprising three components: a global branch, a focus predictor, and a detailed branch. The global branch initially classifies using the pathological thumbnail, while the focus predictor identifies relevant regions for classification based on the last layer features of the global branch. The detailed extraction branch then assesses whether the magnified regions correspond to the lesion area. Finally, a feature consistency constraint between the global and detail branches ensures that the global branch focuses on the appropriate region and extracts sufficient discriminative features for final identification. These focused discriminative features prove invaluable for uncovering novel prognostic tumor markers from the perspective of feature cluster uniqueness and tissue spatial distribution. Extensive experiment results demonstrate that the proposed framework can rapidly deliver accurate and explainable results for pathological grading and prognosis tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。