arXiv:2602.11662cs.LG2026-02被引 1

揭示UMAP本质是模糊近邻图上的谱聚类

UMAP Is Spectral Clustering on the Fuzzy Nearest-Neighbor Graph

  • 将UMAP的负采样优化视为相似性图上的对比学习
  • 证明其等价于在模糊近邻图上进行谱聚类
  • 为UMAP的性能提供理论解释,适合算法研究者

UMAP(统一流形逼近与投影)是应用最广泛的非线性降维与数据可视化算法之一。尽管广受欢迎,且以代数拓扑为视角提出,但其与经典谱方法的确切关系始终不明确。本文证明:UMAP 实际上是在模糊 k 近邻图上执行谱聚类。证明分三步:(1) 证明 UMAP 的负采样随机优化是相似性图上的对比学习目标;(2) 引用 HaoChen 等人 [8] 的结论,说明相似性图上的对比学习等价于谱聚类;(3) 验证 UMAP 的谱初始化恰好求解该谱问题的线性解。该等价关系在高斯核下完全成立,在默认柯西型核下为一阶近似。本结果将 UMAP、对比学习与谱聚类统一于同一框架,为 UMAP 的多项经验行为提供了理论依据。

原文摘要 · Abstract (English)

UMAP (Uniform Manifold Approximation and Projection) is among the most widely used algorithms for non linear dimensionality reduction and data visualisation. Despite its popularity, and despite being presented through the lens of algebraic topology, the exact relationship between UMAP and classical spectral methods has remained informal. In this work, we prove that UMAP performs spectral clustering on the fuzzy k nearest neighbour graph. Our proof proceeds in three steps: (1) we show that UMAP's stochastic optimisation with negative sampling is a contrastive learning objective on the similarity graph; (2) we invoke the result of HaoChen et al. [8], establishing that contrastive learning on a similarity graph is equivalent to spectral clustering; and (3) we verify that UMAP's spectral initialisation computes the exact linear solution to this spectral problem. The equivalence is exact for Gaussian kernels, and holds as a first order approximation for UMAP's default Cauchy type kernel. Our result unifies UMAP, contrastive learning, and spectral clustering under a single framework, and provides theoretical grounding for several empirical observations about UMAP's behaviour.

降维谱聚类对比学习理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。