arXiv:2507.19140cs.CV2025-07ICCV被引 3

融合原型与关联学习,提升少样本分割精度

Balancing Conservatism and Aggressiveness: Prototype-Affinity Hybrid Network for Few-Shot Segmentation

  • 设计混合网络,用原型预测指导关联学习的特征增强与注意力校准
  • 在PASCAL-5i和COCO-20i上1-shot和5-shot均超越多数现有方法
  • 适合需要高精度少样本分割的应用场景

本文研究少样本分割(FSS)任务,旨在仅用少量标注支持样本训练模型,对查询图像中未见类别的物体进行分割。分析发现,原型学习方法预测偏保守,而关联学习方法更激进。为此提出原型-关联混合网络(PAHNet),在关联学习模型的每个注意力模块中引入原型引导特征增强(PFE)和注意力分数校准(ASC)模块。这两个模块利用预训练原型学习模型的预测结果,增强支持与查询图像中的前景信息,并抑制不匹配的前景-背景关系,从而有效缓解关联学习的过度激进问题,提升分割精度。实验表明,PAHNet在PASCAL-5$^i$和COCO-20$^i$数据集的1-shot与5-shot设置下均优于多数近期方法。

原文摘要 · Abstract (English)

This paper studies the few-shot segmentation (FSS) task, which aims to segment objects belonging to unseen categories in a query image by learning a model on a small number of well-annotated support samples. Our analysis of two mainstream FSS paradigms reveals that the predictions made by prototype learning methods are usually conservative, while those of affinity learning methods tend to be more aggressive. This observation motivates us to balance the conservative and aggressive information captured by these two types of FSS frameworks so as to improve the segmentation performance. To achieve this, we propose a **P**rototype-**A**ffinity **H**ybrid **Net**work (PAHNet), which introduces a Prototype-guided Feature Enhancement (PFE) module and an Attention Score Calibration (ASC) module in each attention block of an affinity learning model (called affinity learner). These two modules utilize the predictions generated by a pre-trained prototype learning model (called prototype predictor) to enhance the foreground information in support and query image representations and suppress the mismatched foreground-background (FG-BG) relationships between them, respectively. In this way, the aggressiveness of the affinity learner can be effectively mitigated, thereby eventually increasing the segmentation accuracy of our PAHNet method. Experimental results show that PAHNet outperforms most recently proposed methods across 1-shot and 5-shot settings on both PASCAL-5$^i$ and COCO-20$^i$ datasets, suggesting its effectiveness. The code is available at: [GitHub - tianyu-zou/PAHNet: Balancing Conservatism and Aggressiveness: Prototype-Affinity Hybrid Network for Few-Shot Segmentation (ICCV'25)](https://github.com/tianyu-zou/PAHNet)

少样本分割原型学习关联学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。