通过相位信息提升医学图像分割精度,尤其擅长边界定位。
Phi-SegNet: Phase-Integrated Supervision for Medical Image Segmentation
- 在模型架构与优化中融合相位感知信息,增强结构表征
- 跨模态数据集平均提升1.54% IoU,边界分割更精准
- 适合需要高精度定位的医学图像分析任务
深度学习显著推动了医学图像分割的发展,但在不同成像模态和解剖结构间实现稳健泛化仍是重大挑战。现有架构(从CNN到Transformer及其混合模型)主要编码空间信息,忽视了能捕捉丰富结构与纹理线索的频域表示。尽管近期研究开始探索特征层面的谱信息,但对频率线索的监督级整合——对细粒度目标定位至关重要——仍基本未被开发。为此,我们提出Phi-SegNet,一种基于CNN的架构,在架构与优化层面均引入相位感知信息。网络集成双特征掩码生成器(BFMF)模块,融合邻近编码器特征以减少语义差距;以及反傅里叶注意力(RFA)块,利用相位正则化特征优化解码器输出。一个专用的相位感知损失将这些特征与结构先验对齐,形成闭环反馈回路,强化边界精度。在涵盖X光、超声、组织病理学、MRI和结肠镜的五个公开数据集上评估,Phi-SegNet始终达到最先进性能,平均相对提升1.54±1.26% IoU 和0.98±0.71% F1-score。在涉及已知领域内未见数据集的跨数据集泛化场景中,也展现出稳健且优越的表现,凸显其适应性与模态无关设计。这些发现表明,利用谱先验于特征表示与监督层面具有潜力,为在细粒度目标定位中表现卓越的通用分割框架铺平道路。代码已开源。
原文摘要 · Abstract (English)
Deep learning has substantially advanced medical image segmentation, yet achieving robust generalization across diverse imaging modalities and anatomical structures remains a major challenge. A key contributor to this limitation lies in how existing architectures, ranging from CNNs to Transformers and their hybrids, primarily encode spatial information while overlooking frequency-domain representations that capture rich structural and textural cues. Although recent studies have begun exploring spectral information at the feature level, supervision-level integration of frequency cues-crucial for fine-grained object localization-remains largely untapped. To this end, we propose Phi-SegNet, a CNN-based architecture that incorporates phase-aware information at both architectural and optimization levels. The network integrates Bi-Feature Mask Former (BFMF) modules that blend neighboring encoder features to reduce semantic gaps, and Reverse Fourier Attention (RFA) blocks that refine decoder outputs using phase-regularized features. A dedicated phase-aware loss aligns these features with structural priors, forming a closed feedback loop that emphasizes boundary precision. Evaluated on five public datasets spanning X-ray, US, histopathology, MRI, and colonoscopy, Phi-SegNet consistently achieved state-of-the-art performance, with an average relative improvement of 1.54+/-1.26% in IoU and 0.98+/-0.71% in F1-score over the next best-performing model. In cross-dataset generalization scenarios involving unseen datasets from the known domain, it also exhibits robust and superior performance, highlighting its adaptability and modality-agnostic design. These findings demonstrate the potential of leveraging spectral priors in both feature representation and supervision, paving the way for generalized segmentation frameworks that excel in fine-grained object localization. Our code is available on GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。