arXiv:2510.22760eess.IVcs.CV2025-10被引 1

用类别名当弱表达式,让遥感图像分割在少标注下仍能精准定位。

Understanding What Is Not Said:Referring Remote Sensing Image Segmentation with Scarce Expressions

  • 用类别名做弱表达式,结合少量真标注,实现低资源训练。
  • 在30%弱标注下性能接近全标注模型,最大差距仅2.1% mIoU。
  • 适合遥感数据标注稀缺、需低成本部署的场景。

遥感图像指代分割(RRSIS)旨在根据指代表达分割遥感图像中的目标实例。与通用图像不同,遥感领域因小目标密集分布和复杂背景,获取高质量指代表达尤为困难。本文提出弱指代表达学习(WREL)新范式,利用大量类别名称作为弱指代表达,结合少量精确表达,在有限标注条件下实现高效训练。理论分析表明,混合指代训练可保证性能差距的上界,验证该设定有效性。进一步提出LRB-WREL,引入可学习参考库(LRB),通过样本特定提示嵌入增强粗粒度类别名输入。结合动态调度EMA更新的师生优化框架,稳定训练并提升跨模态泛化能力。在新构建基准上,不同弱标注比例的实验验证了理论洞见与方法有效性,结果表明其性能可逼近甚至超越全标注模型训练的模型。

原文摘要 · Abstract (English)

Referring Remote Sensing Image Segmentation (RRSIS) aims to segment instances in remote sensing images according to referring expressions. Unlike Referring Image Segmentation on general images, acquiring high-quality referring expressions in the remote sensing domain is particularly challenging due to the prevalence of small, densely distributed objects and complex backgrounds. This paper introduces a new learning paradigm, Weakly Referring Expression Learning (WREL) for RRSIS, which leverages abundant class names as weakly referring expressions together with a small set of accurate ones to enable efficient training under limited annotation conditions. Furthermore, we provide a theoretical analysis showing that mixed-referring training yields a provable upper bound on the performance gap relative to training with fully annotated referring expressions, thereby establishing the validity of this new setting. We also propose LRB-WREL, which integrates a Learnable Reference Bank (LRB) to refine weakly referring expressions through sample-specific prompt embeddings that enrich coarse class-name inputs. Combined with a teacher-student optimization framework using dynamically scheduled EMA updates, LRB-WREL stabilizes training and enhances cross-modal generalization under noisy weakly referring supervision. Extensive experiments on our newly constructed benchmark with varying weakly referring data ratios validate both the theoretical insights and the practical effectiveness of WREL and LRB-WREL, demonstrating that they can approach or even surpass models trained with fully annotated referring expressions.

遥感分割弱监督指代表达

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。