arXiv:2412.02983cs.CV2024-12

针对医学图像少样本分割,提出融合背景信息的原型方法

Prototypical Few-Shot Medical Image Semantic Segmentation with Background Fusion

  • 用特征交叉注意力减少支持图噪声,再分层融合背景到原型
  • 在标准数据集上提升现有少样本分割模型性能,最高增益达6.2%
  • 适合医疗影像领域少样本学习,尤其前景与背景相似场景

少样本语义分割(FSS)旨在仅用每类一个标注样本的情况下,将预训练模型适配到新类别。现有原型方法在自然图像中侧重捕捉前景区分性,对背景采用简化表示,基于前景与背景视觉分离的假设。然而频率谱熵分析表明,该范式不适用于医学图像——因前景与背景共享大量视觉特征,需更精细的背景描述。本文提出一种面向医学图像的背景融合原型(Bro)方法。Bro 不直接提取支持图中背景共性,而是将其融合至判别性原型,包含两个核心设计:特征相似性校准(FeaC)通过支持图与查询图的特征交叉注意力初步抑制噪声;分层通道对抗注意力(HiCA)则利用基于通道组的注意力机制,结合对抗性均值偏移结构实现由粗到精的背景融合。该方法为通用插件式设计,可无缝集成至现有FSS模型。大量实验验证了医学图像中背景特异性,并证明Bro能显著提升原有模型在标准基准上的性能。

原文摘要 · Abstract (English)

Few-shot Semantic Segmentation (FSS) aims to adapt a pre-trained model to new classes with as few as a single labeled training sample per class. The existing prototypical work used in natural image scenarios biasedly focus on capturing foreground's discrimination while employing a simplistic representation for background, grounded on the inherent observation separation between foreground and background. However, a frequency spectrum entropy analysis suggests that this paradigm is not applicable to medical images where the foreground and background share numerous visual features, necessitating a more detailed description for the background. In this paper, we present a new Background-fused prototype (Bro) approach for FSS in medical images. Instead of identifying a commonality of background subjects in the support image, Bro fuses this background to discriminative prototypes, with two pivot designs. Specifically, Feature Similarity Calibration (FeaC) initially reduces noise in the support image by employing feature cross-attention with the query image. Subsequently, Hierarchical Channel-Adversarial Attention (HiCA) merges the background into comprehensive prototypes. We achieve this by a channel groups-based attention mechanism, where an adversarial Mean-Offset structure encourages a coarse-to-fine fusion. Designed as a generic plug-in, our Bro can be seamlessly integrated with existing FSS models. Extensive experiments validate the specificity of the background in medical images and the efficacy of Bro in enhancing the performance of previous FSS models on standard benchmarks.

少样本分割医学图像原型学习背景融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。