超像素分割是病态问题,需重新定义评估标准
Superpixel Segmentation: A Long-Lasting Ill-Posed Problem
- 指出超像素分割本质是病态问题,因形状大小约束隐含
- 发现文献评估不全面,常使用不当指标
- 证明SAM模型无需专门训练即可达竞争力
多年来,图像过分割生成超像素对计算机视觉流程至关重要,可创建均质且可识别的相似尺寸区域。但此类受约束的分割问题需要明确的定义和特定的评估标准。然而,超像素方法的验证框架通常被视为标准对象分割,很少被深入研究。本文首次指出,由于超像素形状和大小的隐含正则化约束,超像素分割本质上是一个病态问题。通过一项全新的综合研究,我们还发现文献仅评估某些方面,有时错误地使用不合适的度量。同时,近期基于深度学习的超像素方法主要关注对象分割任务,忽视了规则性。在这一病态背景下,我们展示了即使使用像Segment Anything Model(SAM)这样的最新架构,无需为超像素分割任务专门训练,也能获得有竞争力的结果。这促使我们重新思考超像素分割及其针对下游任务所需属性。
原文摘要 · Abstract (English)
For many years, image over-segmentation into superpixels has been essential to computer vision pipelines, by creating homogeneous and identifiable regions of similar sizes. Such constrained segmentation problem would require a clear definition and specific evaluation criteria. However, the validation framework for superpixel methods, typically viewed as standard object segmentation, has rarely been thoroughly studied. In this work, we first take a step back to show that superpixel segmentation is fundamentally an ill-posed problem, due to the implicit regularity constraint on the shape and size of superpixels. We also demonstrate through a novel comprehensive study that the literature suffers from only evaluating certain aspects, sometimes incorrectly and with inappropriate metrics. Concurrently, recent deep learning-based superpixel methods mainly focus on the object segmentation task at the expense of regularity. In this ill-posed context, we show that we can achieve competitive results using a recent architecture like the Segment Anything Model (SAM), without dedicated training for the superpixel segmentation task. This leads to rethinking superpixel segmentation and the necessary properties depending on the targeted downstream task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。