通过频域与空间域联合建模,提升伪装目标检测精度
Frequency-Spatial Entanglement Learning for Camouflaged Object Detection

- 设计频-空纠缠模块,融合频率与空间特征
- 在三个数据集上超越21种主流方法,最高提升6.8%
- 适合研究伪装目标检测或跨域特征学习的读者
伪装目标检测在计算机视觉中备受关注。主要挑战在于伪装物体与其背景在空间域具有高度相似性,导致识别困难。现有方法通过复杂设计增强空间特征的区分能力以降低像素相似性的影响,但常忽视空间域特征的敏感性和局部性,导致性能受限。本文提出一种新方法,通过联合探索频率域与空间域表示,引入频-空纠缠学习(FSEL)框架。该框架包含一系列精心设计的纠缠变压器块(ETB),用于表征学习;联合域感知模块,用于语义增强;以及双域逆解析器,实现频率与空间域特征的融合。具体而言,ETB利用频率自注意力有效刻画不同频带间的关联,而纠缠前馈网络则通过纠缠学习促进不同域特征间的信息交互。大量实验表明,所提FSEL方法在三个常用数据集上全面优于21种先进方法,经定量与定性对比验证其优越性。代码已开源:https://github.com/CSYSI/FSEL。
原文摘要 · Abstract (English)
Camouflaged object detection has attracted a lot of attention in computer vision. The main challenge lies in the high degree of similarity between camouflaged objects and their surroundings in the spatial domain, making identification difficult. Existing methods attempt to reduce the impact of pixel similarity by maximizing the distinguishing ability of spatial features with complicated design, but often ignore the sensitivity and locality of features in the spatial domain, leading to sub-optimal results. In this paper, we propose a new approach to address this issue by jointly exploring the representation in the frequency and spatial domains, introducing the Frequency-Spatial Entanglement Learning (FSEL) method. This method consists of a series of well-designed Entanglement Transformer Blocks (ETB) for representation learning, a Joint Domain Perception Module for semantic enhancement, and a Dual-domain Reverse Parser for feature integration in the frequency and spatial domains. Specifically, the ETB utilizes frequency self-attention to effectively characterize the relationship between different frequency bands, while the entanglement feed-forward network facilitates information interaction between features of different domains through entanglement learning. Our extensive experiments demonstrate the superiority of our FSEL over 21 state-of-the-art methods, through comprehensive quantitative and qualitative comparisons in three widely-used datasets. The source code is available at: https://github.com/CSYSI/FSEL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。