提出新型相似性度量,提升图像交互分割的精度与效率
PSSI-MaxST: An Efficient Pixel-Segment Similarity Index Using Intensity and Smoothness Features for Maximum Spanning Tree Based Segmentation
- 用强度与平滑度特征的调和平均设计像素-区域相似性指标
- 在GrabCut和Images250上均优于AMOE等方法,IoU和F1更高
- 适合需要快速准确分割且对用户输入鲁棒的应用场景
交互式图分割方法依赖用户输入将图像分为前景和背景。现有方法常存在计算成本高、对用户输入敏感,以及前景与背景颜色相近时性能下降的问题。分割效果的关键在于图中边权重所用的相似性度量。本文提出一种新型像素-区域相似性指数(PSSI),通过融合像素强度与空间平滑度特征,并采用通道间相似性的调和平均,有效惩罚任一通道的不匹配,增强鲁棒性。PSSI计算复杂度为$\mathcal{O}(B)$,其中$B$为直方图分箱数。分割框架首先使用MeanShift进行低层分割,捕捉颜色、纹理与区域形状。基于生成的像素段构建像素-区域图,边权由PSSI决定。划分采用最大生成树(MaxST),可捕获强连接的局部邻域,利于精准分割。PSSI、MeanShift与MaxST的结合,协同捕捉颜色相似性、平滑性、纹理、形状与强局部连通性。在GrabCut与Images250数据集上的实验表明,本方法在交并比(IoU)、F1分数、执行时间与平均误差(ME)上均优于当前主流方法如AMOE、OneCut与SSNCut。代码已公开:https://github.com/KaustubhShejole/PSSI-MaxST。
原文摘要 · Abstract (English)
Interactive graph-based segmentation methods partition an image into foreground and background regions with the aid of user inputs. However, existing approaches often suffer from high computational costs, sensitivity to user interactions, and degraded performance when the foreground and background share similar color distributions. A key factor influencing segmentation performance is the similarity measure used for assigning edge weights in the graph. To address these challenges, we propose a novel Pixel Segment Similarity Index (PSSI), which leverages the harmonic mean of inter-channel similarities by incorporating both pixel intensity and spatial smoothness features. The harmonic mean effectively penalizes dissimilarities in any individual channel, enhancing robustness. The computational complexity of PSSI is $\mathcal{O}(B)$, where $B$ denotes the number of histogram bins. Our segmentation framework begins with low-level segmentation using MeanShift, which effectively captures color, texture, and segment shape. Based on the resulting pixel segments, we construct a pixel-segment graph with edge weights determined by PSSI. For partitioning, we employ the Maximum Spanning Tree (MaxST), which captures strongly connected local neighborhoods beneficial for precise segmentation. The integration of the proposed PSSI, MeanShift, and MaxST allows our method to jointly capture color similarity, smoothness, texture, shape, and strong local connectivity. Experimental evaluations on the GrabCut and Images250 datasets demonstrate that our method consistently outperforms current graph-based interactive segmentation methods such as AMOE, OneCut, and SSNCut in terms of segmentation quality, as measured by Jaccard Index (IoU), $F_1$ score, execution time and Mean Error (ME). Code is publicly available at: https://github.com/KaustubhShejole/PSSI-MaxST.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。