arXiv:2602.23023math.STcs.LG2026-02

揭示中等维度下聚类的计算极限,提出新算法突破瓶颈。

Low-degree Lower bounds for clustering in moderate dimension

  • 构建低度多项式下界,揭示中等维度聚类难题
  • 发现非参数率新规律,理论阈值与实际算法差距缩小
  • 适合关注聚类计算复杂性的研究人员

我们研究在 $\mathbb{R}^d$ 中从各向同性高斯混合分布中对 $n$ 个点进行 $K$ 群聚类的基本问题。重点分析均值向量间最小距离 $Δ$ 的要求,以实现对原始分组的部分恢复。尽管 $Δ$ 的极小极大最优阈值已明确,但现有多项式时间方法的性能与该理论极限之间仍存在显著差距。此前该差距已在高维情形($n \leq dK$)被刻画,但在中等维情形($n \geq dK$)尚无系统研究。本文针对 $d \geq K$ 的中等维情形,建立新的低度多项式下界。结果表明,当 $n \leq dK$ 时聚类困难主要源于降维与谱方法;而中等维情形涉及更精细的机制,导致“非参数率”现象。我们提出一种新型非谱算法,可达到该速率,为中等维聚类的计算极限提供了新理解。

原文摘要 · Abstract (English)

We study the fundamental problem of clustering $n$ points into $K$ groups drawn from a mixture of isotropic Gaussians in $\mathbb{R}^d$. Specifically, we investigate the requisite minimal distance $Δ$ between mean vectors to partially recover the underlying partition. While the minimax-optimal threshold for $Δ$ is well-established, a significant gap exists between this information-theoretic limit and the performance of known polynomial-time procedures. Although this gap was recently characterized in the high-dimensional regime ($n \leq dK$), it remains largely unexplored in the moderate-dimensional regime ($n \geq dK$). In this manuscript, we address this regime by establishing a new low-degree polynomial lower bound for the moderate-dimensional case when $d \geq K$. We show that while the difficulty of clustering for $n \leq dK$ is primarily driven by dimension reduction and spectral methods, the moderate-dimensional regime involves more delicate phenomena leading to a "non-parametric rate". We provide a novel non-spectral algorithm matching this rate, shedding new light on the computational limits of the clustering problem in moderate dimension.

聚类计算极限高维统计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。