arXiv:2606.10136cs.CV2026-06

用专家点击精准修正模型错误,仅需极少标注即可达到全量标注效果。

iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision

论文配图:iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision
图 1 · 摘自论文原文
  • 专家聚焦模型误判区域点击,不依赖额外推导机制
  • 每帧仅需1个像素标注,实现97.2%的全标注性能(mIoU 74.79%)
  • 适用于遥感图像分割,尤其适合小目标和非规则区域

遥感语义分割需大量像素级标注,且模型难以跨传感器、平台或地理区域迁移。现有交互式框架通过伪标签、传播、CRF等辅助机制将稀疏点击扩展为稠密监督,均基于模型预测分布,无法区分高置信度错与对。本文提出iSAGE(迭代稀疏标注,由专家引导),假设专家针对模型错误点击即可达成稠密监督,无需扩展机制。在开源平台中,误差加权损失强化点击位置梯度,标注记录即为可扩展、可修正、可审计的数据集。实验采用极低投入:每类每帧最多1个标注像素。在BsB Aerial上,iSAGE以0.040%标注率恢复97.2%稠密监督效果(mIoU 74.79%),形态类饱和于初代,小目标类需后期迭代;在ISPRS Vaihingen(外部基准)上,0.011%标注率达mIoU 76.78%,媲美稠密基线(76.65%)并超越所有已发表方法。对比四种输出读取机制(熵阈值、伪标签、CRF传播、随机采样),均落后7.4至14.5个百分点。31种方法中,iSAGE是唯一无辅助机制的迭代式人机交互框架。

原文摘要 · Abstract (English)

Semantic segmentation in remote sensing requires costly pixel-level annotations, and nearly every problem demands a new dataset since models rarely transfer across sensors, platforms, or geographies. Existing human-in-the-loop frameworks expand sparse clicks into dense supervision via auxiliary machinery (pseudo-labels, propagation, CRFs, foundation-model prompts, auxiliary heads), all operating on the model's predictive distribution. A confidently wrong pixel is indistinguishable from a confidently correct one in that distribution by construction, so no rule reading it can separate the two; the distinguishing signal is external to the model. This paper hypothesizes that expert clicks targeting confident model errors, not arbitrary pixels, suffice to match dense supervision, with no expansion machinery. iSAGE (Iterative Sparse Annotation Guided by Expert) realizes this hypothesis on an integrated open-source platform, where an error-weighted loss amplifies the gradient at each click and the annotation record itself is the dataset, extensible, correctable, and auditable. Experiments use a minimum-effort regime: at most one labeled pixel per class per frame. On BsB Aerial, iSAGE recovers 97.2% of dense supervision (74.79% mIoU on 0.040% of pixels) with contrasting class dynamics: amorphous classes (permeable areas) saturate from the seed, while small classes (cars) require late-iteration effort. On ISPRS Vaihingen (external benchmark), iSAGE reaches 76.78% mIoU with 0.011% of pixels, matching the dense baseline (76.65%) and exceeding all published methods. Under the same pipeline, four output-reading mechanisms (oracle entropy across budgets 1--100x, pseudo-labels across thresholds 0.90--0.99, CRF-based propagation, uniform random) plateau 7.4 to 14.5 pp below iSAGE. Across 31 surveyed methods, iSAGE is the only iterative human-in-the-loop framework operating without auxiliary machinery.

遥感分割稀疏标注人机协同误差引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。