arXiv:2607.03754cs.CV2026-07

用SAM3生成伪标签,解决无人机小目标分割缺数据难题

Exploring SAM Supervision for Fine-Grained UAV Target Segmentation under Data Scarcity

论文配图:Exploring SAM Supervision for Fine-Grained UAV Target Segmentation under Data Scarcity
图 1 · 摘自论文原文
  • 用SAM3先粗后精生成伪标签,提升小目标边界精度
  • 轻量模型IPS-Seg在低标注数据下实现高准确率与高效计算
  • 适合无人机、遥感等小目标分割场景的少样本学习

无人机目标分割因目标尺寸小、外观变化大、背景杂乱及密集标注数据稀缺而面临挑战,制约了轻量级分割模型在真实场景中的性能与部署。本文探索将SAM3作为伪标签生成器,训练紧凑分割网络。提出两种监督范式:(i) 直接使用未修改的SAM3生成掩码;(ii) 对局部图像块重应用SAM3以提升掩码质量。据此构建两阶段SAM3引导的伪标签生成框架:第一阶段用SAM3生成粗略掩码进行目标定位;第二阶段将定位区域裁剪为图像块,再次使用SAM3生成边界精确的细掩码并剔除误检。最终,粗细掩码作为伪标签优化轻量模型IPS-Seg,其由IdentityFormer主干、空洞空间金字塔池化模块和基于PixelShuffle的解码器组成。多监督设置下的实验表明,该框架显著提升分割精度与计算效率,且模型性能持续受益于伪标签策略。结果表明,大规模基础模型可作为低标注视觉任务中紧凑专用网络的标注来源。

原文摘要 · Abstract (English)

Unmanned aerial vehicle (UAV) target segmentation remains challenging due to the small size of objects, appearance variations, cluttered backgrounds, and the scarcity of densely annotated data. These factors hinder the performance and practical deployment of lightweight segmentation models in real-world UAV applications. To address this problem, this paper investigates the use of SAM3 (Segment Anything Model 3) as a pseudo-label generator for training compact segmentation networks. Specifically, two supervision paradigms are explored: (i) direct pseudo-supervision using unaltered SAM3-generated masks, and (ii) a refinement strategy that re-applies SAM3 to localized image patches for improved mask quality. Based on these paradigms, a two-stage SAM3-guided pseudo-label generation framework is proposed. In the first stage, SAM3 generates coarse masks for initial object localization. The localized regions are subsequently cropped into patches and processed by SAM3 again to generate fine masks with accurate object boundaries and discard false positives. The resulting coarse and fine masks are then used as pseudo-labels to optimize a lightweight network, termed IPS-Seg, which consists of three components: an IdentityFormer backbone for feature extraction, an Atrous Spatial Pyramid Pooling module for multi-scale context aggregation, and a PixelShuffle-based decoder for spatial resolution recovery. Extensive experiments under multiple supervision settings demonstrate the effectiveness of the proposed framework. The results show that IPS-Seg achieves a favorable trade-off between segmentation accuracy and computational efficiency while benefiting consistently from the proposed pseudo-label generation strategy. These findings highlight the potential of large-scale foundation models as annotation sources for training compact task-specific segmentation networks in low-label vision domains.

无人机分割伪标签SAM3少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。