arXiv:2511.21606cs.CV2025-11被引 2

用少量点标注让分割模型在遥感图像上表现更好。

ReSAM: Refine, Requery, and Reinforce: Self-Prompting Point-Supervised Segmentation for Remote Sensing Images

  • 通过自引导提示循环优化分割结果
  • 仅用1个点标注,性能差距缩小至8.5%以内
  • 适合遥感图像的轻量级模型适配

交互式分割模型如段落任意模型(SAM)在自然图像上表现出色,但在遥感图像(RSI)上因领域差异大且密集标注稀缺而表现不佳。为此,我们提出一种仅需稀疏点标注的点监督自提示框架,将SAM适配于遥感图像。方法采用精炼-重查询-强化循环:初始点生成粗伪掩码(精炼),通过自构建框提示改进(重查询),并利用软语义对齐(SSA)减少误差传播(强化)。无需完整掩码监督,该方法通过自引导提示适应逐步提升分割质量与域鲁棒性。在WHU、HRSID和NWPU VHR-10三个遥感基准数据集上评估,始终优于预训练SAM及近期点监督方法。相比全监督模型,性能差距分别缩小至1.3%(WHU)、4.9%(HRSID)和8.5%(NWPU),仅依赖1点标注。结果表明,自提示与语义对齐为遥感应用中基础分割模型的可扩展点级适配提供了高效路径。

原文摘要 · Abstract (English)

Interactive segmentation models such as the Segment Anything Model (SAM) have demonstrated remarkable generalization on natural images, but they perform suboptimally on remote sensing imagery (RSI) due to severe domain shifts and the scarcity of dense annotations. To address this limitation, we propose a point-supervised, self-prompting framework that adapts SAM to RSI using only sparse point annotations. Our method employs a Refine-Requery-Reinforce loop, in which coarse pseudo-masks are generated from initial points (Refine), improved with self-constructed box prompts (Requery), and embeddings are aligned with Soft Semantic Alignment (SSA) to mitigate error propagation. (Reinforce). Without relying on full-mask supervision, our approach progressively enhances SAM's segmentation quality and domain robustness through self-guided prompt adaptation. We evaluate our proposed method on three RSI benchmark datasets, WHU, HRSID, and NWPU VHR-10, demonstrating that it consistently outperforms pretrained SAM and recent point-supervised segmentation methods. Compared to the fully supervised model, our approach reduces the performance gap to 1.3% (WHU), 4.9% (HRSID), and 8.5% (NWPU) while relying only on 1-point annotations. Our results demonstrate that self-prompting and semantic alignment provide an efficient path towards scalable, point-level adaptation of foundation segmentation models for remote sensing applications.

遥感分割自提示点标注语义对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。