arXiv:2509.14610cs.CV2025-09被引 5

动态跳过连接提升医学图像分割特征融合效果

Enhancing Feature Fusion of U-like Networks with Dynamic Skip Connections

  • 引入动态跳接模块,推理时自适应调整特征传递路径
  • 在多个数据集上显著提升分割精度,最高增益达1.8%
  • 适用于各类U型网络,尤其适合医疗影像任务

U型网络通过跳接连接将高层语义与低层空间细节相融合,已成为医学图像分割的基础框架。然而,传统跳接存在两类局限:跨特征约束(信息传输路径固定)和内特征约束(多尺度特征交互建模不足)。为此,本文提出一种新型动态跳接(DSC)模块,通过自适应机制增强跨层连接。DSC包含两个互补组件:(1) 测试时训练(TTT)模块,解决跨特征约束,在推理阶段动态调整隐藏表示,实现内容感知的特征优化;(2) 动态多尺度核(DMSK)模块,根据全局上下文线索自适应选择卷积核大小,强化多尺度特征融合能力。DSC模块具有架构无关性,可无缝嵌入现有U型网络结构。大量实验表明,该模块在基于CNN、Transformer、混合型及基于Mamba的U型网络中均表现出即插即用的有效性。

原文摘要 · Abstract (English)

U-like networks have become fundamental frameworks in medical image segmentation through skip connections that bridge high-level semantics and low-level spatial details. Despite their success, conventional skip connections exhibit two key limitations: inter-feature constraints and intra-feature constraints. The inter-feature constraint refers to the static nature of feature fusion in traditional skip connections, where information is transmitted along fixed pathways regardless of feature content. The intra-feature constraint arises from the insufficient modeling of multi-scale feature interactions, thereby hindering the effective aggregation of global contextual information. To overcome these limitations, we propose a novel Dynamic Skip Connection (DSC) block that fundamentally enhances cross-layer connectivity through adaptive mechanisms. The DSC block integrates two complementary components. (1) Test-Time Training (TTT) module. This module addresses the inter-feature constraint by enabling dynamic adaptation of hidden representations during inference, facilitating content-aware feature refinement. (2) Dynamic Multi-Scale Kernel (DMSK) module. To mitigate the intra-feature constraint, this module adaptively selects kernel sizes based on global contextual cues, enhancing the network capacity for multi-scale feature integration. The DSC block is architecture-agnostic and can be seamlessly incorporated into existing U-like network structures. Extensive experiments demonstrate the plug-and-play effectiveness of the proposed DSC block across CNN-based, Transformer-based, hybrid CNN-Transformer, and Mamba-based U-like networks.

医学图像特征融合动态连接U型网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。