arXiv:2607.11096cs.CVcs.SD2026-07

用特征差异自适应融合高低层信息,提升U-Net解码性能

Difference-Driven Gating: Adaptive Feature Fusion for U-Net Decoder

论文配图:Difference-Driven Gating: Adaptive Feature Fusion for U-Net Decoder
图 1 · 摘自论文原文
  • 基于高低层特征差异生成注意力权重,实现动态融合
  • 熵差门控在医学分割、遥感去云等任务中表现更优
  • 适合需要精细细节重建的图像生成与分割场景

U-Net类模型广泛应用于各类任务,其关键步骤是通过自顶向下的解码器重构低层特征。这需要精确融合高层语义与低层细节。现有基于注意力的融合方法通常仅从解码器特征(全局)或解码器与编码器特征相关性(局部)计算注意力权重,再调制编码器特征。本文提出新范式:从两路特征的差异中提取注意力权重。为此,提出两种基于差异的门控方法:特征差门控(FDG),直接使用全局与局部特征的绝对差生成自适应门控图;熵差门控(EDG),通过信息熵衡量每路特征的表征确定性,利用其有符号熵差生成注意力权重。两种方法均生成耦合门控图,同时调制全局与局部特征。在医学图像分割、遥感图像去云及语音分离等任务上的实验表明,两种方法均优于现有注意力融合方法,其中EDG表现更佳。结果揭示了U-Net结构中多尺度特征融合的新范式。

原文摘要 · Abstract (English)

The U-Net style models have been widely used in many applications. A critical step in these models is to reconstruct the lower-level features using a top-down decoder. This reconstruction requires precise fusion of high-level semantics and low-level details. Existing attention-based fusion methods typically derive attention weights from the top-down decoder features (global) alone or the correlation between the top-down decoder features and the bottom-up encoder features (local), then modulate the encoder features using these weights. In this work, we explore a different paradigm: deriving attention weights from the difference between the two feature streams. To this end, we propose two difference-based gating approaches: Feature-difference gating (FDG), which directly uses the absolute difference between global and local features to generate adaptive gating maps, and Entropy-difference gating (EDG), which measures the representational certainty of each stream via information entropy and uses their signed entropy difference to derive the attention weights. Both methods produce coupled gating maps that simultaneously modulate the global and local features. Experiments on different tasks including medical image segmentation, remote sensing image cloud removal and speech separation showed that both methods outperformed existing attention-based fusion methods, and EDG performed better. The results suggested a new paradigm for multi-scale feature fusion in the U-Net style structures.

特征融合U-Net注意力机制图像分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。