arXiv:2409.01021cs.CV2024-09ECCV被引 10

通过深度网络将原始图像关联转化为深层特征,提升共显著目标检测性能。

CONDA: Condensed Deep Association Learning for Co-Salient Object Detection

  • 用深度网络显式转换原始图像关联为深层特征
  • 在三个基准数据集上达到领先效果,训练设置灵活
  • 适合需要高精度图像关联建模的视觉任务研究者

跨图像关联建模对共显著目标检测至关重要。现有方法虽表现良好,但在充分建模跨图像关联方面仍存局限:多数方法依赖启发式计算的原始关联进行图像特征优化,而原始关联在复杂场景中不可靠,且特征优化过程对关联建模不明确。为此,本文提出一种深度关联学习策略,将深度网络应用于原始关联,显式将其转换为深层关联特征。具体而言,首先构建超关联以收集密集的像素对级原始关联,随后在其上部署深度聚合网络;设计渐进式关联生成模块,并增强超关联计算。更重要的是,提出对应诱导的关联压缩模块,引入语义对应估计这一预训练任务,实现超关联压缩,降低计算开销并消除噪声。同时设计对象感知循环一致性损失,确保高质量对应估计。三个基准数据集上的实验结果表明,该方法在多种训练设置下均表现出显著有效性。

原文摘要 · Abstract (English)

Inter-image association modeling is crucial for co-salient object detection. Despite satisfactory performance, previous methods still have limitations on sufficient inter-image association modeling. Because most of them focus on image feature optimization under the guidance of heuristically calculated raw inter-image associations. They directly rely on raw associations which are not reliable in complex scenarios, and their image feature optimization approach is not explicit for inter-image association modeling. To alleviate these limitations, this paper proposes a deep association learning strategy that deploys deep networks on raw associations to explicitly transform them into deep association features. Specifically, we first create hyperassociations to collect dense pixel-pair-wise raw associations and then deploys deep aggregation networks on them. We design a progressive association generation module for this purpose with additional enhancement of the hyperassociation calculation. More importantly, we propose a correspondence-induced association condensation module that introduces a pretext task, i.e. semantic correspondence estimation, to condense the hyperassociations for computational burden reduction and noise elimination. We also design an object-aware cycle consistency loss for high-quality correspondence estimations. Experimental results in three benchmark datasets demonstrate the remarkable effectiveness of our proposed method with various training settings.

目标检测深度学习图像关联共显著性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。