通过频域引导空间适配,显著提升伪装目标检测效果。
Frequency-Guided Spatial Adaptation for Camouflaged Object Detection
- 将适配器输入特征转至频域,按频段分组动态调节
- 在四个数据集上超越26种先进方法,性能提升明显
- 适合关注伪装目标检测与视觉模型适配的研究者
伪装目标检测(COD)旨在分割与背景模式高度相似的物体。近期研究发现,利用频率信息增强特征表示可有效缓解前景与背景的混淆问题。随着InternImage、Segment Anything Model等视觉基础模型的兴起,通过轻量级适配模块在COD任务上微调预训练模型成为新方向。现有适配模块多聚焦空间域特征调整。本文提出一种新颖的频域引导空间适配方法:将适配器输入特征转换至频域,通过在频谱图中非重叠圆环区域内的频率成分分组交互,动态增强或抑制不同频段,自适应调节图像细节与轮廓强度。同时突出有助于区分物体与背景的特征,间接揭示伪装物体的位置与形状。在四个主流基准数据集上进行广泛实验,所提方法显著优于26种先进方法。代码将公开。
原文摘要 · Abstract (English)
Camouflaged object detection (COD) aims to segment camouflaged objects which exhibit very similar patterns with the surrounding environment. Recent research works have shown that enhancing the feature representation via the frequency information can greatly alleviate the ambiguity problem between the foreground objects and the background.With the emergence of vision foundation models, like InternImage, Segment Anything Model etc, adapting the pretrained model on COD tasks with a lightweight adapter module shows a novel and promising research direction. Existing adapter modules mainly care about the feature adaptation in the spatial domain. In this paper, we propose a novel frequency-guided spatial adaptation method for COD task. Specifically, we transform the input features of the adapter into frequency domain. By grouping and interacting with frequency components located within non overlapping circles in the spectrogram, different frequency components are dynamically enhanced or weakened, making the intensity of image details and contour features adaptively adjusted. At the same time, the features that are conducive to distinguishing object and background are highlighted, indirectly implying the position and shape of camouflaged object. We conduct extensive experiments on four widely adopted benchmark datasets and the proposed method outperforms 26 state-of-the-art methods with large margins. Code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。