arXiv:2412.14315stat.MLcs.DS2024-12NeurIPS被引 3

研究谱聚类在半随机模型下的鲁棒性,发现未归一化方法更可靠。

On the Robustness of Spectral Algorithms for Semirandom Stochastic Block Models

  • 用半随机对抗者模拟真实世界偏差,测试谱聚类鲁棒性
  • 未归一化拉普拉斯矩阵可完全恢复社区结构,而归一化版本有恒定错误率
  • 适用于关注算法对模型假设敏感性的研究人员

图二分问题中,给定一个包含两个等大小无标签社区的图 $G$,目标是恢复这些社区中的顶点。一种常用启发式方法是基于图拉普拉斯矩阵第二小特征值对应的特征向量进行谱聚类。对于随机生成的图(如随机块模型,SBM),谱算法可证明能恢复社区结构。但谱聚类对模型误设不鲁棒。虽然基于半定规划的方法更鲁棒,但计算开销大。本文研究谱算法在半随机对抗者下的鲁棒性。半随机对抗者可“善意”地添加簇内边或提高簇内边出现概率,但仍保持真实解一致。正面结果:某些半随机对抗者下,使用未归一化拉普拉斯矩阵的谱二分法可实现强一致性,即完全恢复原始划分。负面结果:同一类对抗下,使用归一化拉普拉斯矩阵的谱二分法会在常数比例的顶点上出错。数值实验验证了理论发现。

原文摘要 · Abstract (English)

In a graph bisection problem, we are given a graph $G$ with two equally-sized unlabeled communities, and the goal is to recover the vertices in these communities. A popular heuristic, known as spectral clustering, is to output an estimated community assignment based on the eigenvector corresponding to the second smallest eigenvalue of the Laplacian of $G$. Spectral algorithms can be shown to provably recover the cluster structure for graphs generated from certain probabilistic models, such as the Stochastic Block Model (SBM). However, spectral clustering is known to be non-robust to model mis-specification. Techniques based on semidefinite programming have been shown to be more robust, but they incur significant computational overheads. In this work, we study the robustness of spectral algorithms against semirandom adversaries. Informally, a semirandom adversary is allowed to ``helpfully'' change the specification of the model in a way that is consistent with the ground-truth solution. Our semirandom adversaries in particular are allowed to add edges inside clusters or increase the probability that an edge appears inside a cluster. Semirandom adversaries are a useful tool to determine the extent to which an algorithm has overfit to statistical assumptions on the input. On the positive side, we identify classes of semirandom adversaries under which spectral bisection using the _unnormalized_ Laplacian is strongly consistent, i.e., it exactly recovers the planted partitioning. On the negative side, we show that in these classes spectral bisection with the _normalized_ Laplacian outputs a partitioning that makes a classification mistake on a constant fraction of the vertices. Finally, we demonstrate numerical experiments that complement our theoretical findings.

谱聚类随机模型鲁棒性图学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。