通过环境信息增强特征,提升隐蔽物体检测精度
SurANet: Surrounding-Aware Network for Concealed Object Detection via Highly-Efficient Interactive Contrastive Learning Strategy
- 融合周围环境特征,强化隐蔽物体的语义表示
- 提出对比损失函数,有效区分物体与背景差异
- 高效训练策略支持端到端学习,适合复杂场景应用
在杂乱场景中进行隐蔽物体检测(COD)对图像处理应用至关重要。由于隐蔽物体与背景高度相似,现有方法难以准确区分。主要难点在于物体边界内外区域的特征差异极小。为此,本文提出一种新型深度周围感知网络(SurANet),通过引入周围环境信息来增强特征提取与损失函数,提升判别能力。首先,利用周围特征的差异性融合增强特征图语义,突出隐蔽物体;其次,设计周围感知对比损失,通过对比学习识别隐蔽物体;最后,基于对特征动态的分析,提出空间压缩相关性传输策略,实现高效端到端训练,确保关键特征有效保留。大量实验表明,该方法在多个真实数据集上优于当前最优的COD方法。代码将开源。
原文摘要 · Abstract (English)
Concealed object detection (COD) in cluttered scenes is significant for various image processing applications. However, due to that concealed objects are always similar to their background, it is extremely hard to distinguish them. Here, the major obstacle is the tiny feature differences between the inside and outside object boundary region, which makes it trouble for existing COD methods to achieve accurate results. In this paper, considering that the surrounding environment information can be well utilized to identify the concealed objects, and thus, we propose a novel deep Surrounding-Aware Network, namely SurANet, for COD tasks, which introduces surrounding information into feature extraction and loss function to improve the discrimination. First, we enhance the semantics of feature maps using differential fusion of surrounding features to highlight concealed objects. Next, a Surrounding-Aware Contrastive Loss is applied to identify the concealed object via learning surrounding feature maps contrastively. Then, SurANet can be trained end-to-end with high efficiency via our proposed Spatial-Compressed Correlation Transmission strategy after our investigation of feature dynamics, and extensive experiments improve that such features can be well reserved respectively. Finally, experimental results demonstrate that the proposed SurANet outperforms state-of-the-art COD methods on multiple real datasets. Our source code will be available at https://github.com/kyh433/SurANet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。