arXiv:2512.15564cs.CV2025-12被引 5

轻量微调下文本提示能有效提升遥感图像分割性能

On the Effectiveness of Textual Prompting with Lightweight Fine-Tuning for SAM3 Remote Sensing Segmentation

  • 结合语义与几何提示,显著提升分割效果
  • 少量几何标注即可实现良好适应,边际效益递减
  • 适合规则形状且视觉显著的目标,对不规则目标仍存局限

遥感图像分割受限于标注数据稀缺,以及航拍图像与基础模型训练所用自然图像之间的差异。为在有限监督下实现有效适配,本文评估了SAM3框架在四种目标类型上的表现,比较了纯文本、几何及混合提示策略,在不同轻量微调规模下,并与零样本推理对比。结果表明,融合语义与几何线索的混合提示在各类目标和指标上均表现最佳;纯文本提示性能最低,尤其对不规则目标存在显著分数差距,反映其文本表征与航拍外观间语义对齐不足。然而,文本提示配合轻量微调,对几何规则且视觉显著的目标提供了实用的性能-努力权衡。从零样本到微调,性能持续提升,但随着标注量增加,收益递减,说明少量几何标注即足以实现有效适配。精度与交并比间的持续差距表明,欠分割和边界不准确仍是遥感任务中的主要误差模式,尤其在不规则或低频目标上。

原文摘要 · Abstract (English)

Remote sensing (RS) image segmentation is constrained by the limited availability of annotated data and a gap between overhead imagery and natural images used to train foundational models. This motivates effective adaptation under limited supervision. SAM3 concept-driven framework generates masks from textual prompts without requiring task-specific modifications, which may enable this adaptation. We evaluate SAM3 for RS imagery across four target types, comparing textual, geometric, and hybrid prompting strategies, under lightweight fine-tuning scales with increasing supervision, alongside zero-shot inference. Results show that combining semantic and geometric cues yields the highest performance across targets and metrics. Text-only prompting exhibits the lowest performance, with marked score gaps for irregularly shaped targets, reflecting limited semantic alignment between SAM3 textual representations and their overhead appearances. Nevertheless, textual prompting with light fine-tuning offers a practical performance-effort trade-off for geometrically regular and visually salient targets. Across targets, performance improves between zero-shot inference and fine-tuning, followed by diminishing returns as the supervision scale increases. Namely, a modest geometric annotation effort is sufficient for effective adaptation. A persistent gap between Precision and IoU further indicates that under-segmentation and boundary inaccuracies remain prevalent error patterns in RS tasks, particularly for irregular and less prevalent targets.

遥感分割文本提示轻量微调SAM3

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。