用单模型自训练提升伪装目标检测效率,1%标注数据达顶尖水平
ST-SAM: SAM-Driven Self-Training Framework for Semi-Supervised Camouflaged Object Detection
- 单模型自训练动态筛选高置信伪标签,避免多模型偏差
- 仅用1%标注数据即超越现有方法,接近全监督性能
- 无需特定模型或损失函数,适合资源受限场景
半监督伪装目标检测(SSCOD)旨在减少对昂贵像素级标注的依赖,利用少量标注数据和大量未标注数据。然而,现有基于教师-学生框架的方法在标注稀缺时存在严重预测偏差和错误传播问题,且多网络结构计算开销大、扩展性差。为此,本文提出ST-SAM,一种高效注释的简洁框架,突破传统约束。ST-SAM采用自训练策略,动态过滤并扩展高置信伪标签,增强单模型架构,从根本上规避模型间预测偏差。同时,将伪标签转化为包含领域知识的混合提示,有效激发通用分割模型(SAM)在专项任务中的潜力,缓解自训练中的误差累积。在多个伪装目标检测基准数据集上的实验表明,ST-SAM仅使用1%标注数据即可达到当前最优性能,甚至媲美全监督方法。值得注意的是,该框架仅需训练一个网络,不依赖特定模型或损失函数。本工作为高效注释的半监督伪装目标检测建立了新范式。
原文摘要 · Abstract (English)
Semi-supervised Camouflaged Object Detection (SSCOD) aims to reduce reliance on costly pixel-level annotations by leveraging limited annotated data and abundant unlabeled data. However, existing SSCOD methods based on Teacher-Student frameworks suffer from severe prediction bias and error propagation under scarce supervision, while their multi-network architectures incur high computational overhead and limited scalability. To overcome these limitations, we propose ST-SAM, a highly annotation-efficient yet concise framework that breaks away from conventional SSCOD constraints. Specifically, ST-SAM employs Self-Training strategy that dynamically filters and expands high-confidence pseudo-labels to enhance a single-model architecture, thereby fundamentally circumventing inter-model prediction bias. Furthermore, by transforming pseudo-labels into hybrid prompts containing domain-specific knowledge, ST-SAM effectively harnesses the Segment Anything Model's potential for specialized tasks to mitigate error accumulation in self-training. Experiments on COD benchmark datasets demonstrate that ST-SAM achieves state-of-the-art performance with only 1\% labeled data, outperforming existing SSCOD methods and even matching fully supervised methods. Remarkably, ST-SAM requires training only a single network, without relying on specific models or loss functions. This work establishes a new paradigm for annotation-efficient SSCOD. Codes will be available at https://github.com/hu-xh/ST-SAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。