Falcon通过非递归图割优化,显著提升无监督分割速度与精度。
Falcon: Fractional Alternating Cut with Overcoming Minima in Unsupervised Segmentation
- 采用分数二次变换与交替迭代,避免局部极小值,实现快速多路归一化割。
- 在6个基准上平均提升2.5%,最高达4.3%(Cityscapes),运行时间减少约30%。
- 适合追求高效高精度无监督分割的视觉预训练与实际应用开发者。
当前无监督图像分割方法常表现不佳。主流基于图割的方法依赖于Transformer基础模型生成的高维注意力图,通常通过费德尔向量递归求解松弛化归一化割,导致掩码生成速度慢、分割精度不足。本文提出正则化分数交替割(Falcon),一种无需递归特征向量计算的优化型K路归一化割方法,显著提升速度与精度。Falcon分两阶段:(1) 通过扩展至分数二次变换,以交替迭代与正则化避免局部极小值,快速求解K路归一化割;(2) 利用互补低层信息细化结果掩码,生成高质量像素级分割。实验表明,Falcon在六个广泛认可的基准上平均超越现有最先进方法2.5%(在Cityscapes上最高提升4.3%),同时相比先前图基方法降低约30%运行时间。结果证明,基础模型注意力中的语义信息可通过高度可并行化的图割框架有效利用,从而缩小无监督与有监督分割差距,增强真实场景下的可扩展性,并为多种下游任务的密集预测视觉预训练铺平道路。代码已开源:https://github.com/KordingLab/Falcon。
原文摘要 · Abstract (English)
Today's unsupervised image segmentation algorithms often segment suboptimally. Modern graph-cut based approaches rely on high-dimensional attention maps from Transformer-based foundation models, typically employing a relaxed Normalized Cut solved recursively via the Fiedler vector (the eigenvector of the second smallest eigenvalue). Consequently, they still lag behind supervised methods in both mask generation speed and segmentation accuracy. We present a regularized fractional alternating cut (Falcon), an optimization-based K-way Normalized Cut without relying on recursive eigenvector computations, achieving substantially improved speed and accuracy. Falcon operates in two stages: (1) a fast K-way Normalized Cut solved by extending into a fractional quadratic transformation, with an alternating iterative procedure and regularization to avoid local minima; and (2) refinement of the resulting masks using complementary low-level information, producing high-quality pixel-level segmentations. Experiments show that Falcon not only surpasses existing state-of-the-art methods by an average of 2.5% across six widely recognized benchmarks (reaching up to 4.3\% improvement on Cityscapes), but also reduces runtime by around 30% compared to prior graph-based approaches. These findings demonstrate that the semantic information within foundation-model attention can be effectively harnessed by a highly parallelizable graph cut framework. Consequently, Falcon can narrow the gap between unsupervised and supervised segmentation, enhancing scalability in real-world applications and paving the way for dense prediction-based vision pre-training in various downstream tasks. The code is released in https://github.com/KordingLab/Falcon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。