arXiv:2602.00516cs.CV2026-02

用随机游走模拟标签传播,实现无需训练的高精度语义分割

SPARK: Stochastic Propagation via Affinity-guided Random walK for training-free unsupervised segmentation

  • 基于扩散图上的随机游走与自适应剪枝,融合全局与局部结构
  • 在7个基准上达顶尖零样本性能,边界更清晰、区域更连贯
  • 适合追求高效无训练分割的视觉研究者与工程师

现有免训练分割方法依赖于扩散生成亲和图上的谱图划分假设,存在需预设聚类数、边界过度平滑及对噪声敏感等根本缺陷。此类方法忽视局部邻域结构,难以稳定传播亲和性并保留细粒度轮廓。为此,本文将免训练分割重新建模为扩散亲和图上的随机流平衡问题,通过集成全局扩散注意力与稳定扩散提取的局部邻域,构建稀疏而丰富的亲和结构。在此基础上,提出一种马尔可夫传播机制,采用基于随机游走的标签扩散,并结合自适应剪枝策略抑制不可靠转移、强化可信亲和路径。在七个广泛使用的语义分割基准上的实验表明,该方法实现顶尖零样本性能,显著提升边界锐度、区域一致性与掩码稳定性。

原文摘要 · Abstract (English)

We argue that existing training-free segmentation methods rely on an implicit and limiting assumption, that segmentation is a spectral graph partitioning problem over diffusion-derived affinities. Such approaches, based on global graph partitioning and eigenvector-based formulations of affinity matrices, suffer from several fundamental drawbacks, they require pre-selecting the number of clusters, induce boundary oversmoothing due to spectral relaxation, and remain highly sensitive to noisy or multi-modal affinity distributions. Moreover, many prior works neglect the importance of local neighborhood structure, which plays a crucial role in stabilizing affinity propagation and preserving fine-grained contours. To address these limitations, we reformulate training-free segmentation as a stochastic flow equilibrium problem over diffusion-induced affinity graphs, where segmentation emerges from a stochastic propagation process that integrates global diffusion attention with local neighborhoods extracted from stable diffusion, yielding a sparse yet expressive affinity structure. Building on this formulation, we introduce a Markov propagation scheme that performs random-walk-based label diffusion with an adaptive pruning strategy that suppresses unreliable transitions while reinforcing confident affinity paths. Experiments across seven widely used semantic segmentation benchmarks demonstrate that our method achieves state-of-the-art zero-shot performance, producing sharper boundaries, more coherent regions, and significantly more stable masks compared to prior spectral-clustering-based approaches.

免训练分割随机游走亲和图语义分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。