用提示引导的通道注意力,让分割模型更懂解剖结构。
Prompt-Conditioned Channel Attention for Hierarchical Feature Modulation toward Anatomy-Agnostic Segmentation

- 通过提示生成通道权重,动态调节多层级特征
- 在四个医学图像数据集上提升分割精度,最高增益23%
- 适合需要交互式引导的医疗影像分割场景
解剖结构合理的分割仍具挑战,源于对比度低、边界模糊及模态特异性伪影。交互式分割能有效引导特征提取,尤其在结构不明确区域。但现有方法多采用晚期融合方式整合提示,缺乏对分层特征表示中通道级调控的显式机制,难以捕捉深层上下文与模态特异性变化。为此,我们提出提示条件通道注意力(PCCA),一种新型调制机制,实现语义提示在编码器-解码器网络中的深层、分层融合。PCCA通过池化提取紧凑通道描述符,投影至共享空间,并经门控激励机制融合,计算出提示感知的通道注意力权重。这些权重自适应地重校准多个网络阶段的特征响应,生成提示驱动、语义丰富的分层表示。基于此,我们构建PROMISE-Net,包含卷积变体(PROMISE-CNN)和基于Transformer的变体(PROMISE-Txformer)。在ISIC-Lesion、Kvasir-Polyp、CAMUS-Cardiac和Kvasir-Instrument数据集上,将PCCA融入PROMISE-CNN后,相对基线U-Net的IoU提升分别为10.4%、8.7%、0.8%和3.4%;而PROMISE-Txformer相比基线UNETR分别提升7.6%、23.0%、2.1%和1.1%。结果表明,该框架在不同架构、成像模态和解剖目标下均具一致性改进,可推广为医学图像分割中提示感知分层特征调制的通用方案。
原文摘要 · Abstract (English)
Anatomically plausible segmentation remains challenging because of low contrast, ambiguous boundaries, and modality-specific artifacts. Interactive segmentation has emerged as a promising strategy to guide feature extraction and improve localization, particularly in structurally ambiguous regions. However, existing methods integrate prompts through late-stage fusion and lack explicit mechanisms for prompt-driven channel-wise modulation across hierarchical feature representations, limiting their ability to capture deeper contextual and modality-specific variations. To address these limitations, we introduce Prompt-Conditioned Channel Attention (PCCA), a novel modulation mechanism that enables deep, hierarchical integration of semantic prompts within encoder-decoder networks. PCCA extracts compact channel descriptors via pooling, projects them into a shared space, and fuses them through a gated excitation mechanism to compute prompt-aware channel attention weights. These weights adaptively recalibrate feature responses across multiple network stages, enabling prompt-conditioned, semantically enriched hierarchical representations. Building on this, we propose PROMISE-Net, instantiated in two network variants: a convolutional model (PROMISE-CNN) and a transformer-based model (PROMISE-Txformer). Across the ISIC-Lesion, Kvasir-Polyp, CAMUS-Cardiac, and Kvasir-Instrument benchmarks, integrating PCCA into PROMISE-CNN yielded relative IoU gains of 10.4%, 8.7%, 0.8%, and 3.4%, respectively, over the baseline U-Net, while PROMISE-Txformer achieved corresponding gains of 7.6%, 23.0%, 2.1%, and 1.1%, respectively, over the baseline UNETR. These results show consistent improvements across architectures, imaging modalities, and anatomical targets, establishing PCCA and PROMISE-Net as a scalable, generalizable framework for prompt-aware hierarchical feature modulation in medical image segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。