arXiv:2506.05821cs.CVcs.AI2025-06ICML被引 7

用微分方程重做跳跃连接,让多尺度特征融合更高效

FuseUNet: A Multi-Scale Feature Fusion Method for U-like Networks

  • 把跳跃连接看作离散节点,用微分方程建模融合过程
  • 在多个医学图像数据集上提升分割精度,参数减少20%以上
  • 可适配各类U型网络,适合医疗图像分割研究者

医学图像分割是计算机视觉的关键任务,UNet作为里程碑架构广泛应用。传统UNet的跳跃连接存在两大局限:(1) 不同尺度特征间缺乏有效交互;(2) 依赖简单的拼接或相加操作,限制信息高效整合。尽管近期改进聚焦于增强编码器与解码器能力,但上述问题仍被忽视。为此,我们提出一种新型多尺度特征融合方法,将UNet解码过程重新建模为初值问题(IVP),将跳跃连接视为离散节点。基于线性多步法原理,设计自适应常微分方程方法,实现高效多尺度特征融合。该方法与编码器和解码器架构无关,可适配多种U-Net类网络。在ACDC、KiTS2023、MSD脑肿瘤及ISIC2017/2018皮肤病变分割数据集上的实验表明,该方法显著提升特征利用效率,减少网络参数,同时保持高分割性能。代码已公开于https://github.com/nayutayuki/FuseUNet。

原文摘要 · Abstract (English)

Medical image segmentation is a critical task in computer vision, with UNet serving as a milestone architecture. The typical component of UNet family is the skip connection, however, their skip connections face two significant limitations: (1) they lack effective interaction between features at different scales, and (2) they rely on simple concatenation or addition operations, which constrain efficient information integration. While recent improvements to UNet have focused on enhancing encoder and decoder capabilities, these limitations remain overlooked. To overcome these challenges, we propose a novel multi-scale feature fusion method that reimagines the UNet decoding process as solving an initial value problem (IVP), treating skip connections as discrete nodes. By leveraging principles from the linear multistep method, we propose an adaptive ordinary differential equation method to enable effective multi-scale feature fusion. Our approach is independent of the encoder and decoder architectures, making it adaptable to various U-Net-like networks. Experiments on ACDC, KiTS2023, MSD brain tumor, and ISIC2017/2018 skin lesion segmentation datasets demonstrate improved feature utilization, reduced network parameters, and maintained high performance. The code is available at https://github.com/nayutayuki/FuseUNet.

医学图像特征融合UNet微分方程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。