arXiv:2501.07069cs.CV2025-01中稿 · SDM 2025被引 12

用结构信息理论提升超像素分割质量,兼顾全局与局部细节。

Hierarchical Superpixel Segmentation via Structural Information Theory

  • 基于一维结构熵构建动态图,逐步扩展邻域关系。
  • 通过二维结构熵引导分层聚类,实现多尺度分割。
  • 在三个基准数据集上优于现有无监督方法,适合图像理解任务。

超像素分割是图像分割、目标识别和场景理解等高级视觉任务的基础。现有基于图的超像素分割方法通常只关注像素与其直接相邻像素的关系,忽略了非相邻像素的影响,未能充分挖掘图中的全局信息,导致分割效果受限。为此,本文提出基于结构信息理论的分层超像素分割方法(SIT-HSS)。首先设计一种新型图构建策略,通过一维结构熵(1D SE)逐步探索像素邻域并添加边,以最大化保留图信息的同时避免结构过于复杂。随后提出一种2D SE引导的分层图划分方法,逐层合并像素簇,直至降低图的二维结构熵至预设分割尺度。在三个基准数据集上的实验表明,SIT-HSS优于当前最先进的无监督超像素分割算法。源代码已公开于https://github.com/SELGroup/SIT-HSS。

原文摘要 · Abstract (English)

Superpixel segmentation is a foundation for many higher-level computer vision tasks, such as image segmentation, object recognition, and scene understanding. Existing graph-based superpixel segmentation methods typically concentrate on the relationships between a given pixel and its directly adjacent pixels while overlooking the influence of non-adjacent pixels. These approaches do not fully leverage the global information in the graph, leading to suboptimal segmentation quality. To address this limitation, we present SIT-HSS, a hierarchical superpixel segmentation method based on structural information theory. Specifically, we first design a novel graph construction strategy that incrementally explores the pixel neighborhood to add edges based on 1-dimensional structural entropy (1D SE). This strategy maximizes the retention of graph information while avoiding an overly complex graph structure. Then, we design a new 2D SE-guided hierarchical graph partitioning method, which iteratively merges pixel clusters layer by layer to reduce the graph's 2D SE until a predefined segmentation scale is achieved. Experimental results on three benchmark datasets demonstrate that the SIT-HSS performs better than state-of-the-art unsupervised superpixel segmentation algorithms. The source code is available at \url{https://github.com/SELGroup/SIT-HSS}.

超像素分割结构熵图神经网络图像理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。