arXiv:2603.10828cs.CVcs.AI2026-03

用不确定性评估自动选最优标注位置,提升交互分割效率。

BALD-SAM: Disagreement-based Active Prompting in Interactive Segmentation

  • 基于模型不确定性选择最需标注的区域,实现智能提示
  • 跨16个领域测试中14项排名第一或第二,性能超越人类
  • 适合需要高效标注的医学、遥感等复杂图像场景

Segment Anything Model(SAM)通过空间提示革新了交互式分割。现有方法多关注自动化提示生成,但真实标注流程依赖迭代优化:标注者观察模型输出后,主动在关键区域添加提示以消除模糊。当前流程依赖人工视觉判断掩码质量。本文提出主动提示机制:将图像区域视为未标注池,提示作为查询,优先选择信息量最大的区域,提升每次交互价值。进一步提出BALD-SAM框架,将贝叶斯主动学习中的分歧度(BALD)应用于空间提示选择,量化认知不确定性。为此,冻结整个模型,仅对小型可学习预测头应用贝叶斯建模,使大规模基础模型的不可行不确定性估计变得可行。在涵盖自然、医学、水下及地震领域的16个数据集上,BALD-SAM在14个基准中位列第一或第二。通过包含3种SAM骨干网络和35种拉普拉斯后验配置的全面消融实验(共38种设置)验证其优势。除平均性能优异外,该方法还超越人类提示,部分任务甚至优于理想提示(oracle),且在最终分割质量上显著优于单次提示基线,尤其对细长与结构复杂的物体表现突出。

原文摘要 · Abstract (English)

The Segment Anything Model (SAM) has revolutionized interactive segmentation through spatial prompting. While existing work primarily focuses on automating prompts in various settings, real-world annotation workflows involve iterative refinement where annotators observe model outputs and strategically place prompts to resolve ambiguities. Current pipelines typically rely on the annotator's visual assessment of the predicted mask quality. We postulate that a principled approach for automated interactive prompting is to use a model-derived criterion to identify the most informative region for the next prompt. In this work, we establish active prompting: a spatial active learning approach where locations within images constitute an unlabeled pool and prompts serve as queries to prioritize information-rich regions, increasing the utility of each interaction. We further present BALD-SAM: a principled framework adapting Bayesian Active Learning by Disagreement (BALD) to spatial prompt selection by quantifying epistemic uncertainty. To do so, we freeze the entire model and apply Bayesian uncertainty modeling only to a small learned prediction head, making intractable uncertainty estimation practical for large multi-million parameter foundation models. Across 16 datasets spanning natural, medical, underwater, and seismic domains, BALD-SAM demonstrates strong cross-domain performance, ranking first or second on 14 of 16 benchmarks. We validate these gains through a comprehensive ablation suite covering 3 SAM backbones and 35 Laplace posterior configurations, amounting to 38 distinct ablation settings. Beyond strong average performance, BALD-SAM surpasses human prompting and, in several categories, even oracle prompting, while consistently outperforming one-shot baselines in final segmentation quality, particularly on thin and structurally complex objects.

交互分割主动学习不确定性提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。