arXiv:2510.20933cs.CVcs.AI2025-10被引 1

融合卷积与注意力机制,提升医学图像分割边界精度和适应性。

Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation

  • 引入焦点调制注意力,精准捕捉上下文信息。
  • 双向特征融合模块增强多尺度编码解码交互,提升分割效果。
  • 在8个数据集上优于当前最优方法,适合复杂病变分割。

医学图像分割对疾病诊断、治疗规划及病情监测至关重要,可提供影响治疗决策的精确形态与空间信息。尽管卷积神经网络在分割中发挥重要作用,但其局部操作难以捕捉全局上下文与长程依赖,制约了对边界复杂、尺寸多样的结构的精确分割。由于变换器通过自注意力机制高效获取全局信息,将变换器架构与CNN结合成为克服上述挑战的有效途径。为此,本文提出用于医学图像分割的焦点调制与双向特征融合网络(FM-BFF-Net)。该网络融合卷积与变换器组件,采用焦点调制注意力机制强化上下文感知,并引入双向特征融合模块,实现编码器与解码器跨尺度表示的高效交互。此设计显著提升了边界精度与对病灶大小、形状、对比度变化的鲁棒性。在包含息肉检测、皮肤病变分割和超声成像在内的8个公开数据集上进行的大量实验表明,FM-BFF-Net在杰卡德指数与骰子系数上持续优于近期最先进方法,验证了其在多种医学影像场景下的有效性与适应性。

原文摘要 · Abstract (English)

Medical image segmentation is essential for clinical applications such as disease diagnosis, treatment planning, and disease development monitoring because it provides precise morphological and spatial information on anatomical structures that directly influence treatment decisions. Convolutional neural networks significantly impact image segmentation; however, since convolution operations are local, capturing global contextual information and long-range dependencies is still challenging. Their capacity to precisely segment structures with complicated borders and a variety of sizes is impacted by this restriction. Since transformers use self-attention methods to capture global context and long-range dependencies efficiently, integrating transformer-based architecture with CNNs is a feasible approach to overcoming these challenges. To address these challenges, we propose the Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation, referred to as FM-BFF-Net in the remainder of this paper. The network combines convolutional and transformer components, employs a focal modulation attention mechanism to refine context awareness, and introduces a bidirectional feature fusion module that enables efficient interaction between encoder and decoder representations across scales. Through this design, FM-BFF-Net enhances boundary precision and robustness to variations in lesion size, shape, and contrast. Extensive experiments on eight publicly available datasets, including polyp detection, skin lesion segmentation, and ultrasound imaging, show that FM-BFF-Net consistently surpasses recent state-of-the-art methods in Jaccard index and Dice coefficient, confirming its effectiveness and adaptability for diverse medical imaging scenarios.

医学图像分割注意力机制双向融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。