arXiv:2411.14883cs.CVcs.AI2024-11

提出跨域自适应特征融合与注意力机制,提升医学图像分割泛化能力。

Boundless Across Domains: A New Paradigm of Adaptive Feature and Cross-Attention for Domain Generalization in Medical Image Segmentation

  • 用跨域注意力重建特征,约束模型学习域不变表示。
  • 在两个标准基准上显著优于现有方法,提升分割精度。
  • 适合医学图像分割中数据分布差异大的场景使用。

域不变表示学习是领域泛化的重要方法。以往方法存在计算量大、训练不稳定及高维数据下效果有限等问题,易丢失关键特征。本文假设理想泛化表示应在跨域图像中同一通道呈现相似响应模式。基于此,以源域深层特征为查询,生成域特征为键值,通过跨通道注意力机制重构原始特征,形成显式约束以指导模型学习域不变表示。此外,风格增强常用于扩充数据,但现有方法多通过源域凸组合生成新风格,限制了样本多样性。为此,本文提出自适应特征融合(AFB)方法,在探索分布内空间的同时生成分布外样本,大幅扩展域范围。大量实验表明,所提方法在两个标准医学图像分割领域泛化基准上表现优异。

原文摘要 · Abstract (English)

Domain-invariant representation learning is a powerful method for domain generalization. Previous approaches face challenges such as high computational demands, training instability, and limited effectiveness with high-dimensional data, potentially leading to the loss of valuable features. To address these issues, we hypothesize that an ideal generalized representation should exhibit similar pattern responses within the same channel across cross-domain images. Based on this hypothesis, we use deep features from the source domain as queries, and deep features from the generated domain as keys and values. Through a cross-channel attention mechanism, the original deep features are reconstructed into robust regularization representations, forming an explicit constraint that guides the model to learn domain-invariant representations. Additionally, style augmentation is another common method. However, existing methods typically generate new styles through convex combinations of source domains, which limits the diversity of training samples by confining the generated styles to the original distribution. To overcome this limitation, we propose an Adaptive Feature Blending (AFB) method that generates out-of-distribution samples while exploring the in-distribution space, significantly expanding the domain range. Extensive experimental results demonstrate that our proposed methods achieve superior performance on two standard domain generalization benchmarks for medical image segmentation.

医学图像域泛化注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。