arXiv:2508.01941eess.IVcs.AI2025-08

用频域操作替代注意力机制,实现高效3D医学图像分割

Less is More: AMBER-AFNO -- a New Benchmark for Lightweight 3D Medical Image Segmentation

  • 用自适应傅里叶神经算子替代自注意力,实现频域全局混合
  • 在ACDC/Synapse/BraTS上达最优或接近最优的Dice和HD95分数
  • 模型轻量且计算复杂度近线性,适合资源受限场景

我们将源自遥感的多波段图像分割模型AMBER迁移至3D医学数据立方体分割任务。为解决体素变换器的计算瓶颈,提出AMBER-AFNO架构:用自适应傅里叶神经算子(AFNO)替代多头自注意力机制。与令牌间的空间成对交互不同,频域中的全局令牌混合避免了$/mathcal{O}(N^2)$的关注权重计算,实现准线性计算复杂度与线性内存增长。该方法在减少对密集变换器依赖的同时保留全局上下文建模能力。通过无注意力的谱运算设计,模型具备紧凑参数化并保持竞争力的计算效率。我们在ACDC、Synapse和BraTS三个公开数据集上评估,结果在Dice(DSC)和HD95指标上达到当前最优或接近最优。相比近期紧凑型CNN与变换器架构,本方法在更小模型规模下取得更高Dice分数。整体表明,基于AFNO的频域令牌混合为3D医学图像分割提供了快速高效的自注意力替代方案。

原文摘要 · Abstract (English)

We adapt the remote sensing-inspired AMBER model from multi-band image segmentation to 3D medical datacube segmentation. To address the computational bottleneck of the volumetric transformer, we propose the AMBER-AFNO architecture. This approach uses Adaptive Fourier Neural Operators (AFNO) instead of the multi-head self-attention mechanism. Unlike spatial pairwise interactions between tokens, global token mixing in the frequency domain avoids $\mathcal{O}(N^2)$ attention-weight calculations. As a result, AMBER-AFNO achieves quasi-linear computational complexity and linear memory scaling. This new way to model global context reduces reliance on dense transformers while preserving global contextual modeling capability. By using attention-free spectral operations, our design offers a compact parameterization and maintains a competitive computational complexity. We evaluate AMBER-AFNO on three public datasets: ACDC, Synapse, and BraTS. On these datasets, the model achieves state-of-the-art or near-state-of-the-art results for DSC and HD95. Compared with recent compact CNN and Transformer architectures, our approach yields higher Dice scores while maintaining a compact model size. Overall, our results show that frequency-domain token mixing with AFNO provides a fast and efficient alternative to self-attention mechanisms for 3D medical image segmentation.

3D分割轻量化傅里叶网络医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。