用粗略标注+SAM生成伪标签,提升隐蔽目标检测精度
Weakly Supervised Camouflaged Object Detection Based on the SAM Model and Mask Guidance

- 用自研级联掩码解码器生成初始掩码,引导分割与边缘预测
- 在COD-108数据集上达到76.2% F-measure,优于现有弱监督方法
- 适合标注资源少但需高精度检测的场景,如医学影像分析
单图隐蔽目标检测因目标与背景高度相似而极具挑战。现有全监督方法依赖耗时的像素级标注,弱监督方法虽缓解标注负担,却常因粗略标注导致性能下降。本文提出一种新弱监督方法,设计MGNet网络:通过自研级联掩码解码器(CMD)生成初始掩码,引导分割并增强边缘预测;引入上下文增强模块(CEM)减少漏检;设计掩码引导特征聚合模块(MFAM)实现有效特征融合。针对弱监督难题,提出BoxSAM,利用分割一切模型(SAM)结合边界框提示生成伪标签,并采用冗余处理策略,输出高质量像素级伪标签用于训练MGNet。大量实验表明,本方法在COD-108数据集上达到76.2% F-measure,性能媲美当前最先进方法。
原文摘要 · Abstract (English)
Camouflaged object detection (COD) from a single image is a challenging task due to the high similarity between objects and their surroundings. Existing fully supervised methods require labor-intensive pixel-level annotations, making weakly supervised methods a viable compromise that balances accuracy and annotation efficiency. However, weakly supervised methods often experience performance degradation due to the use of coarse annotations. In this paper, we introduce a new weakly supervised approach for camouflaged object detection to overcome these limitations. Specifically, we propose a novel network, MGNet, which tackles edge ambiguity and missed detections by utilizing initial masks generated by our custom-designed Cascaded Mask Decoder (CMD) to guide the segmentation process and enhance edge predictions. We introduce a Context Enhancement Module(CEM) to reduce the missing detection, and a Mask-guided Feature Aggregation Module (MFAM) for effective feature aggregation. For the weak supervision challenge, we propose BoxSAM, which leverages the Segment Anything Model (SAM) with bounding-box prompts to generate pseudo-labels. By employing a redundant processing strategy, high quality pixel-level pseudo-labels are provided for training MGNet. Extensive experiments demonstrate that our method delivers competitive performance against current state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。