通过全局信息交互与几何先验,提升医学图像分割的半监督学习效果。
GIGP: A Global Information Interacting and Geometric Priors Focusing Framework for Semi-supervised Medical Image Segmentation
- 用Mamba建模全局上下文,缓解有标签与无标签数据分布差异。
- 引入几何矩注意力机制,捕捉器官体积等全局几何特征。
- 设计几何扰动一致性约束,模拟器官动态变化,增强泛化能力。
半监督学习通过利用未标注数据提升医学图像分割性能,减少对大量标注数据的依赖。一方面,有限的标注数据与海量未标注数据之间的分布差异会阻碍模型泛化,现有方法多依赖局部相似性匹配,可能引入偏差;而Mamba能以线性复杂度建模全局上下文,学习更全面的数据表征。另一方面,医学图像通常具有由几何特征定义的一致解剖结构,但现有方法未能充分挖掘全局几何先验(如体积、矩等)。本文提出全局信息交互与几何先验聚焦框架(GIGP):首先设计全局信息交互Mamba模块,降低标注与未标注数据间的分布差异;其次提出几何矩注意力机制,提取更丰富的全局几何特征;最后引入全局几何扰动一致性,模拟器官动态与几何变化,增强模型学习通用特征的能力。在NIH胰腺和左心房数据集上的优异表现验证了该方法的有效性。
原文摘要 · Abstract (English)
Semi-supervised learning enhances medical image segmentation by leveraging unlabeled data, reducing reliance on extensive labeled datasets. On the one hand, the distribution discrepancy between limited labeled data and abundant unlabeled data can hinder model generalization. Most existing methods rely on local similarity matching, which may introduce bias. In contrast, Mamba effectively models global context with linear complexity, learning more comprehensive data representations. On the other hand, medical images usually exhibit consistent anatomical structures defined by geometric features. Most existing methods fail to fully utilize global geometric priors, such as volumes, moments etc. In this work, we introduce a global information interaction and geometric priors focus framework (GIGP). Firstly, we present a Global Information Interaction Mamba module to reduce distribution discrepancy between labeled and unlabeled data. Secondly, we propose a Geometric Moment Attention Mechanism to extract richer global geometric features. Finally, we propose Global Geometric Perturbation Consistency to simulate organ dynamics and geometric variations, enhancing the ability of the model to learn generalized features. The superior performance on the NIH Pancreas and Left Atrium datasets demonstrates the effectiveness of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。