解决病理图像跨医院迁移失效问题,提升生存预测准确性
Graph Domain Adaptation with Dual-branch Encoder and Two-level Alignment for Whole Slide Image-based Survival Prediction
- 构建双分支图编码器,分别提取路径与消息特征
- 在类别和特征两级实现对齐,降低不同医院数据分布差异
- 首个针对病理图像域偏移的解决方案,适合医疗影像研究者
近年来,基于组织全切片图像(WSI)的生存分析在医学图像领域受到广泛关注。实际中,WSI常来自不同医院或实验室,形成不同数据域,因成像设备、处理流程和样本来源差异,导致各域间分布差异显著,使在某一域训练的生存分析模型难以迁移到另一域。为此,本文提出双分支编码器与两层级对齐(DETA)框架,通过图表示建模WSI的域自适应问题。设计双分支图编码器,包含消息传递分支与最短路径分支,显式与隐式提取语义信息。为实现图域自适应,提出两层级对齐策略:类别级通过双分支结构设计耦合机制,减小两类分布差异;特征级引入对抗扰动策略增强源域特征,改善特征分布对齐。据我们所知,这是首个针对WSI数据分析中域偏移问题的尝试。在四个TCGA数据集上的大量实验验证了DETA框架的有效性,其在基于WSI的生存分析中表现更优。
原文摘要 · Abstract (English)
In recent years, histopathological whole slide image (WSI)- based survival analysis has attracted much attention in medical image analysis. In practice, WSIs usually come from different hospitals or laboratories, which can be seen as different domains, and thus may have significant differences in imaging equipment, processing procedures, and sample sources. These differences generally result in large gaps in distribution between different WSI domains, and thus the survival analysis models trained on one domain may fail to transfer to another. To address this issue, we propose a Dual-branch Encoder and Two-level Alignment (DETA) framework to explore both feature and category-level alignment between different WSI domains. Specifically, we first formulate the concerned problem as graph domain adaptation (GDA) by virtue the graph representation of WSIs. Then we construct a dual-branch graph encoder, including the message passing branch and the shortest path branch, to explicitly and implicitly extract semantic information from the graph-represented WSIs. To realize GDA, we propose a two-level alignment approach: at the category level, we develop a coupling technique by virtue of the dual-branch structure, leading to reduced divergence between the category distributions of the two domains; at the feature level, we introduce an adversarial perturbation strategy to better augment source domain feature, resulting in improved alignment in feature distribution. To the best of our knowledge, our work is the first attempt to alleviate the domain shift issue for WSI data analysis. Extensive experiments on four TCGA datasets have validated the effectiveness of our proposed DETA framework and demonstrated its superior performance in WSI-based survival analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。