arXiv:2601.09110cs.CV2026-01被引 2

用SAM生成先验掩码,提升遥感图像少样本分割效果

SAM-Aug: Leveraging SAM Priors for Few-Shot Parcel Segmentation in Satellite Time Series

  • 利用SAM无监督生成几何先验掩码,指导少样本训练
  • 在5%标注数据下达到36.21% mIoU,比基线高2.33个百分点
  • 无需微调或额外标注,适合缺乏标签的遥感监测场景

少样本语义分割在时序遥感图像中仍是关键挑战,尤其在标注数据稀缺或获取成本高的区域。尽管先进模型在全监督下表现良好,但在标注受限时性能显著下降。本文提出SAM-Aug框架,利用分割一切模型(SAM)的几何感知能力,提升少样本地表覆盖制图。通过构建无云合成图像并以无监督方式应用SAM,生成几何感知的掩码先验,并通过提出的区域平滑损失(RegionSmoothLoss)将其融入训练,强制同一时空区域内预测保持一致,有效正则化模型以尊重语义连贯结构。在PASTIS-R基准上,5%标注设置下三次随机种子(42, 2025, 4090)平均测试mIoU达36.21%,优于基线2.33个百分点(相对提升6.89%)。在最优划分(种子=42)下,测试mIoU达40.28%,相对提升11.2%,且未增加标注数据。各种子结果一致,验证了基础模型先验在标注稀缺下的泛化能力。结果表明,像SAM这样的视觉模型可作为有效的正则化器,为无需人工标注或微调的遥感土地覆盖监测提供可扩展、即插即用的解决方案。

原文摘要 · Abstract (English)

Few-shot semantic segmentation of time-series remote sensing images remains a critical challenge, particularly in regions where labeled data is scarce or costly to obtain. While state-of-the-art models perform well under full supervision, their performance degrades significantly under limited labeling, limiting their real-world applicability. In this work, we propose SAM-Aug, a new annotation-efficient framework that leverages the geometry-aware segmentation capability of the Segment Anything Model (SAM) to improve few-shot land cover mapping. Our approach constructs cloud-free composite images from temporal sequences and applies SAM in a fully unsupervised manner to generate geometry-aware mask priors. These priors are then integrated into training through a proposed loss function called RegionSmoothLoss, which enforces prediction consistency within each SAM-derived region across temporal frames, effectively regularizing the model to respect semantically coherent structures. Extensive experiments on the PASTIS-R benchmark under a 5 percent labeled setting demonstrate the effectiveness and robustness of SAM-Aug. Averaged over three random seeds (42, 2025, 4090), our method achieves a mean test mIoU of 36.21 percent, outperforming the state-of-the-art baseline by +2.33 percentage points, a relative improvement of 6.89 percent. Notably, on the most favorable split (seed=42), SAM-Aug reaches a test mIoU of 40.28 percent, representing an 11.2 percent relative gain with no additional labeled data. The consistent improvement across all seeds confirms the generalization power of leveraging foundation model priors under annotation scarcity. Our results highlight that vision models like SAM can serve as useful regularizers in few-shot remote sensing learning, offering a scalable and plug-and-play solution for land cover monitoring without requiring manual annotations or model fine-tuning.

少样本分割遥感图像SAM地表覆盖

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。