arXiv:2411.18975eess.IVcs.CV2024-11被引 2

用傅里叶分析增强U-Net,更好分割医学影像中的长程依赖和周期性结构

FAN-Unet: Enhancing Unet with vision Fourier Analysis Block for Biomedical Image Segmentation

  • 引入傅里叶分析层,融合自注意力机制捕捉全局与局部特征
  • 在多个医学图像数据集上表现优于基准模型,平衡了性能与复杂度
  • 适合需要精确分割病灶或结构的医学影像任务,如肿瘤识别

医学图像分割是现代医学研究与临床实践的关键环节。尽管卷积神经网络(CNN)在此领域表现优异,但其固有缺陷在于难以捕捉图像中的长程依赖关系。而变压器(Transformers)虽擅长建模全局上下文,却常难以有效捕获局部特征。为此,本文提出FAN-UNet,一种结合基于傅里叶分析网络(FAN)视觉主干与U-Net架构的新模型,有效解决生物医学图像分割中长程依赖与周期性建模的挑战。所提出的视觉-FAN层融合了FAN层与自注意力机制,利用傅里叶分析使模型能够有效捕捉长程依赖与周期性关系。在多个医学影像数据集上的大量实验表明,FAN-UNet在模型复杂度与性能之间实现了良好平衡,验证了其在医学图像分割任务中的有效性与实用性。

原文摘要 · Abstract (English)

Medical image segmentation is a critical aspect of modern medical research and clinical practice. Despite the remarkable performance of Convolutional Neural Networks (CNNs) in this domain, they inherently struggle to capture long-range dependencies within images. Transformers, on the other hand, are naturally adept at modeling global context but often face challenges in capturing local features effectively. Therefore, we presents FAN-UNet, a novel architecture that combines the strengths of Fourier Analysis Network (FAN)-based vision backbones and the U-Net architecture, effectively addressing the challenges of long-range dependency and periodicity modeling in biomedical image segmentation tasks. The proposed Vision-FAN layer integrates the FAN layer and self-attention mechanisms, leveraging Fourier analysis to enable the model to effectively capture both long-range dependencies and periodic relationships. Extensive experiments on various medical imaging datasets demonstrate that FAN-UNet achieves a favorable balance between model complexity and performance, validating its effectiveness and practicality for medical image segmentation tasks.

医学图像分割傅里叶分析U-Net

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。