arXiv:2412.10943cs.CV2024-12ICCV被引 8

构建新数据集与模型,精准区分复杂场景中显著与伪装物体。

Rethinking Detecting Salient and Camouflaged Objects in Unconstrained Scenes

  • 提出USCNet模型,用双提示机制建模物体间与物体内的属性关系。
  • 在12000张图像的USC12K数据集上实现最佳性能,跨场景泛化能力强。
  • 适合研究视觉感知、目标检测与数据标注的科研人员参考。

人类视觉系统能区分显著与伪装物体,但现有模型难以分离这两类任务:显著物体检测(SOD)模型常将伪装物体误判为显著,而伪装物体检测(COD)模型则反向误判显著物体。我们提出两个原因:一是当前SOD/COD数据集采用互斥标注范式,假设场景仅含显著或伪装物体,与真实世界不符;二是现有模型缺乏对两类物体间关系的显式建模。为此,本文构建大规模数据集USC12K,包含12000张图像,覆盖四种场景,涵盖显著与伪装物体的所有逻辑存在组合。提出USCNet模型,引入两种独立提示查询机制,分别建模样本间与样本内属性关系。设计评估指标CSCS以衡量模型区分能力。实验表明,该方法在所有场景下均达到最优表现。代码与数据集将公开于https://github.com/ssecv/USCNet。

原文摘要 · Abstract (English)

While the human visual system employs distinct mechanisms to perceive salient and camouflaged objects, existing models struggle to disentangle these tasks. Specifically, salient object detection (SOD) models frequently misclassify camouflaged objects as salient, while camouflaged object detection (COD) models conversely misinterpret salient objects as camouflaged. We hypothesize that this can be attributed to two factors: (i) the specific annotation paradigm of current SOD and COD datasets, and (ii) the lack of explicit attribute relationship modeling in current models. Prevalent SOD/COD datasets enforce a mutual exclusivity constraint, assuming scenes contain either salient or camouflaged objects, which poorly aligns with the real world. Furthermore, current SOD/COD methods are primarily designed for these highly constrained datasets and lack explicit modeling of the relationship between salient and camouflaged objects. In this paper, to promote the development of unconstrained salient and camouflaged object detection, we construct a large-scale dataset, USC12K, which features comprehensive labels and four different scenes that cover all possible logical existence scenarios of both salient and camouflaged objects. To explicitly model the relationship between salient and camouflaged objects, we propose a model called USCNet, which introduces two distinct prompt query mechanisms for modeling inter-sample and intra-sample attribute relationships. Additionally, to assess the model's ability to distinguish between salient and camouflaged objects, we design an evaluation metric called CSCS. The proposed method achieves state-of-the-art performance across all scenes in various metrics. The code and dataset will be available at https://github.com/ssecv/USCNet.

目标检测数据集视觉感知多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。