通过物体级关联提升少样本分割精度,有效抑制背景噪声干扰。
Object-level Correlation for Few-Shot Segmentation
- 在支持图像与查询图像的物体层面建立关联,而非整图层面。
- 在PASCAL-5i和COCO-20i上达到当前最优性能,显著降低背景过拟合。
- 适合低数据量场景下的目标分割任务,尤其适用于复杂背景环境。
少样本语义分割(FSS)旨在仅提供少量标注的支持样本时,对查询图像中新型类别的物体进行分割。现有方法主要构建支持图像中目标物体与整个查询图像之间的图像级关联,但该关联包含难以追踪和抑制的硬像素噪声(如无关背景物体),导致背景过拟合。为解决此问题,我们借鉴生物视觉机制,从物体级信息出发识别新类别物体。在数据稀缺情况下,物体级识别比全图级更可靠。为此,我们提出物体级关联网络(OCNet),其由通用物体挖掘模块(GOMM)和关联构建模块(CCM)组成。GOMM通过学习显著性与高层相似性线索,构建查询图像中通用物体特征(包括无关背景与目标前景)。随后,CCM将目标原型分配至匹配这些通用物体特征,建立物体级关联。该关联可有效挖掘目标特征并抑制硬像素噪声,提升最终预测准确性。在PASCAL-5i和COCO-20i上的大量实验表明,本模型性能达到当前最优水平。
原文摘要 · Abstract (English)
Few-shot semantic segmentation (FSS) aims to segment objects of novel categories in the query images given only a few annotated support samples. Existing methods primarily build the image-level correlation between the support target object and the entire query image. However, this correlation contains the hard pixel noise, \textit{i.e.}, irrelevant background objects, that is intractable to trace and suppress, leading to the overfitting of the background. To address the limitation of this correlation, we imitate the biological vision process to identify novel objects in the object-level information. Target identification in the general objects is more valid than in the entire image, especially in the low-data regime. Inspired by this, we design an Object-level Correlation Network (OCNet) by establishing the object-level correlation between the support target object and query general objects, which is mainly composed of the General Object Mining Module (GOMM) and Correlation Construction Module (CCM). Specifically, GOMM constructs the query general object feature by learning saliency and high-level similarity cues, where the general objects include the irrelevant background objects and the target foreground object. Then, CCM establishes the object-level correlation by allocating the target prototypes to match the general object feature. The generated object-level correlation can mine the query target feature and suppress the hard pixel noise for the final prediction. Extensive experiments on PASCAL-${5}^{i}$ and COCO-${20}^{i}$ show that our model achieves the state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。