S2M-Net用谱空间混合与自适应形态损失,高效精准分割医学图像。
S2M-Net: Spectral-Spatial Mixing for Medical Image Segmentation with Morphology-Aware Adaptive Loss
- 通过频域筛选与内容门控投影,实现线性复杂度全局感受野。
- 在16个数据集上提升3-18%,多项指标超现有方法。
- 自动调节损失权重,无需人工调参,适合临床小样本部署。
医学图像分割需兼顾边界精度、解剖一致性与计算效率,但现有架构难以平衡。卷积网络虽具局部精度且成本为 $/mathcal{O}(n)$,但感受野有限;视觉变换器虽能捕获全局上下文,却以 $/mathcal{O}(n^2)$ 自注意力带来高昂计算开销,导致小样本过拟合。本文提出 S2M-Net,一个仅4.7M参数的架构,通过两项创新实现 $/mathcal{O}(HW /log HW)$ 全局上下文:(i) 频谱选择性令牌混合器(SSTM),利用医学图像频谱集中特性,结合可学习频率滤波与内容门控空间投影,避免二次复杂度注意力,同时保持全局感受野;(ii) 形态感知自适应分割损失(MASL),自动分析结构特征(紧凑性、管状性、不规则性、尺度),通过受限可学习权重动态调节五种互补损失分量,消除对每数据集的手动调参。在16个涵盖8种模态的医学影像数据集上全面评估显示,性能达顶尖水平:息肉分割 Dice 96.12%,手术器械 83.77%(较前人提升17.85%),脑肿瘤 80.90%,相较专用基线持续提升3%-18%,且参数量仅为基于变换器方法的3.5–6倍。
原文摘要 · Abstract (English)
Medical image segmentation requires balancing local precision for boundary-critical clinical applications, global context for anatomical coherence, and computational efficiency for deployment on limited data and hardware a trilemma that existing architectures fail to resolve. Although convolutional networks provide local precision at $\mathcal{O}(n)$ cost but limited receptive fields, vision transformers achieve global context through $\mathcal{O}(n^2)$ self-attention at prohibitive computational expense, causing overfitting on small clinical datasets. We propose S2M-Net, a 4.7M-parameter architecture that achieves $\mathcal{O}(HW \log HW)$ global context through two synergistic innovations: (i) Spectral-Selective Token Mixer (SSTM), which exploits the spectral concentration of medical images via truncated 2D FFT with learnable frequency filtering and content-gated spatial projection, avoiding quadratic attention cost while maintaining global receptive fields; and (ii) Morphology-Aware Adaptive Segmentation Loss (MASL), which automatically analyzes structure characteristics (compactness, tubularity, irregularity, scale) to modulate five complementary loss components through constrained learnable weights, eliminating manual per-dataset tuning. Comprehensive evaluation in 16 medical imaging datasets that span 8 modalities demonstrates state-of-the-art performance: 96.12\% Dice on polyp segmentation, 83.77\% on surgical instruments (+17.85\% over the prior art) and 80.90\% on brain tumors, with consistent 3-18\% improvements over specialized baselines while using 3.5--6$\times$ fewer parameters than transformer-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。