arXiv:2409.13687cs.CV2024-09ECCV

不依赖类别信息,直接从特征聚类实现图像分割

A Bottom-Up Approach to Class-Agnostic Image Segmentation

  • 从特征空间出发,通过聚类直接生成分割结果
  • 在未标注类别的数据上训练仍表现优异
  • 适合细胞、细胞核等难以定义类别的分割任务

类无关图像分割是自动化图像编辑流程的关键,尤其在传统对象选择依赖交互工具的场景中。现有方法多采用自顶向下的范式,遵循基于类别的方法,先检测物体再进行逐个分割。本文提出一种新的自底向上方法解决类无关分割问题,直接在特征空间的投影球面上监督网络,采用受度量学习启发的损失函数及一种新型分割空间表示的损失函数。分割结果通过简单的均值漂移聚类获得。该自底向上方法展现出卓越的泛化能力,即使在专为类别分割设计的数据集上训练也能表现良好。我们进一步展示了该通用方法在细胞与细胞核分割这一挑战性任务中的有效性。我们认为该自底向上范式将为文献中多种分割难题提供重要启示。

原文摘要 · Abstract (English)

Class-agnostic image segmentation is a crucial component in automating image editing workflows, especially in contexts where object selection traditionally involves interactive tools. Existing methods in the literature often adhere to top-down formulations, following the paradigm of class-based approaches, where object detection precedes per-object segmentation. In this work, we present a novel bottom-up formulation for addressing the class-agnostic segmentation problem. We supervise our network directly on the projective sphere of its feature space, employing losses inspired by metric learning literature as well as losses defined in a novel segmentation-space representation. The segmentation results are obtained through a straightforward mean-shift clustering of the estimated features. Our bottom-up formulation exhibits exceptional generalization capability, even when trained on datasets designed for class-based segmentation. We further showcase the effectiveness of our generic approach by addressing the challenging task of cell and nucleus segmentation. We believe that our bottom-up formulation will offer valuable insights into diverse segmentation challenges in the literature.

图像分割无监督聚类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。