用主动采样和混合传播,让稀疏标注也能实现高精度语义分割。
SSeg: Active Sparse Point-Label Augmentation for Semantic Segmentation
- 主动选择最有价值的标注点,减少人工工作量
- 融合SAM2与超像素方法,提升稀疏标签传播效果
- 适合生态遥感等需要高效标注的科研场景
语义分割在生态学等遥感分析中至关重要,但复杂空域或水下图像的细粒度分析仍具挑战性,尤其受限于密集专家标注的成本。尽管稀疏点标注更易获取,却面临标注点选择与信息传播难题。本文提出SSeg框架,首先采用主动采样策略指导标注者,最大化点标注价值;随后通过结合SAM2与超像素方法的混合传播机制,有效扩展稀疏标签。在两个多样化的监测数据集上的实验表明,该方法优于现有先进方法。核心贡献是集成算法的交互式标注工具,使生态研究者能借助基础模型与计算机视觉技术,高效生成高质量分割掩码以处理数据。
原文摘要 · Abstract (English)
Semantic segmentation is essential for automating remote sensing analysis in fields like ecology. However, fine-grained analysis of complex aerial or underwater imagery remains an open challenge, even for state-of-the-art models. Progress is frequently hindered by the high cost of obtaining the dense, expert-annotated labels required for model supervision. While sparse point-labels are easier to obtain, they introduce challenges regarding which points to annotate and how to propagate the sparse information. We present SSeg, a novel framework that addresses both issues. SSeg first employs an active sampling strategy to guide annotators, maximizing the value of their point labels. Then, it propagates these sparse labels with a hybrid approach leveraging both the best of SAM2 and superpixel-based methods. Experiments on two diverse monitoring datasets demonstrate SSeg's benefits over state-of-the-art approaches. Our main contribution is a simple but effective interactive annotation tool integrating our algorithms. It enables ecology researchers to leverage foundation models and computer vision to efficiently generate high-quality segmentation masks to process their data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。