提出新方法与基准,提升真实场景伪装目标检测精度
Toward Realistic Camouflaged Object Detection: Benchmarks and Method
- 设计自适应梯度传播与稀疏特征精炼模块,强化检测模型对伪装特征的区分能力
- 在三个现有数据集上构建新检测基准,推动真实伪装目标检测评估标准化
- 适合关注视觉感知、目标检测优化及伪装物体识别的研究者
伪装目标检测(COD)主要依赖语义或实例分割方法。尽管这些方法在识别伪装目标轮廓方面取得显著进展,但对于仅需定位目标的任务而言,效率较低或成本较高。目标检测算法为真实伪装目标检测(RCOD)提供了更优解。然而,由于目标与背景特征高度相似,检测仍具挑战性。不同于分割方法进行像素级对比,检测器省略此类分析,加剧了困难。为此,本文提出伪装感知特征精炼(CAFR)策略。鉴于伪装目标非罕见类别,CAFR充分利用大模型先验知识中对当前目标的清晰感知,辅助检测器深入理解前景与背景差异。具体地,引入自适应梯度传播(AGP)模块,精细调优大型检测模型所有特征提取层,以全面精炼伪装情境下的类别特异性特征;设计稀疏特征精炼(SFR)模块,优化基于Transformer的特征提取器,使其聚焦于捕捉伪装场景中的类别特异性特征。为促进RCOD任务评估,我们在三个现有分割型COD数据集上手动标注检测所需标签,构建新的RCOD基准。代码与数据集已公开:https://github.com/zhimengXin/RCOD。
原文摘要 · Abstract (English)
Camouflaged object detection (COD) primarily relies on semantic or instance segmentation methods. While these methods have made significant advancements in identifying the contours of camouflaged objects, they may be inefficient or cost-effective for tasks that only require the specific location of the object. Object detection algorithms offer an optimized solution for Realistic Camouflaged Object Detection (RCOD) in such cases. However, detecting camouflaged objects remains a formidable challenge due to the high degree of similarity between the features of the objects and their backgrounds. Unlike segmentation methods that perform pixel-wise comparisons to differentiate between foreground and background, object detectors omit this analysis, further aggravating the challenge. To solve this problem, we propose a camouflage-aware feature refinement (CAFR) strategy. Since camouflaged objects are not rare categories, CAFR fully utilizes a clear perception of the current object within the prior knowledge of large models to assist detectors in deeply understanding the distinctions between background and foreground. Specifically, in CAFR, we introduce the Adaptive Gradient Propagation (AGP) module that fine-tunes all feature extractor layers in large detection models to fully refine class-specific features from camouflaged contexts. We then design the Sparse Feature Refinement (SFR) module that optimizes the transformer-based feature extractor to focus primarily on capturing class-specific features in camouflaged scenarios. To facilitate the assessment of RCOD tasks, we manually annotate the labels required for detection on three existing segmentation COD datasets, creating a new benchmark for RCOD tasks. Code and datasets are available at: https://github.com/zhimengXin/RCOD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。