用图结构提升矩阵补全精度,理论证明可线性收敛
Matrix Completion with Graph Information: A Provable Nonconvex Optimization Approach
- 基于预条件投影梯度下降,捕捉图中高阶关联
- 在真实和合成数据上恢复误差更低,且对错误边不敏感
- 首个非凸优化框架下具有理论保证的图正则化补全方法
我们研究了利用图作为辅助信息进行矩阵补全的问题,该图刻画了变量间的相互关系。核心挑战在于如何有效利用图的相似性结构来提升矩阵恢复性能。现有方法主要依赖图拉普拉斯正则化,存在三方面局限:(1)仅关注邻近变量间的相似性,忽略远距离相关性;(2)对图中虚假边高度敏感;(3)缺乏关于统计与计算复杂度的理论保障。为此,本文提出一种新型图正则化矩阵补全算法GSGD,基于预条件投影梯度下降。我们证明GSGD能有效捕捉图背后的高阶相关性,对虚假边表现出更强鲁棒性与稳定性。理论上,我们首次证明了GSGD在非凸优化视角下可实现线性收敛至全局最优,并具备近似最优样本复杂度。数值实验在合成与真实数据上均验证,GSGD相比多个主流方法在恢复精度与可扩展性上均有显著优势。
原文摘要 · Abstract (English)
We consider the problem of matrix completion with graphs as side information depicting the interrelations between variables. The key challenge lies in leveraging the similarity structure of the graph to enhance matrix recovery. Existing approaches, primarily based on graph Laplacian regularization, suffer from several limitations: (1) they focus only on the similarity between neighboring variables, while overlooking long-range correlations; (2) they are highly sensitive to false edges in the graphs and (3) they lack theoretical guarantees regarding statistical and computational complexities. To address these issues, we propose in this paper a novel graph regularized matrix completion algorithm called GSGD, based on preconditioned projected gradient descent approach. We demonstrate that GSGD effectively captures the higher-order correlation information behind the graphs, and achieves superior robustness and stability against the false edges. Theoretically, we prove that GSGD achieves linear convergence to the global optimum with near-optimal sample complexity, providing the first theoretical guarantees for both recovery accuracy and efficacy in the perspective of nonconvex optimization. Our numerical experiments on both synthetic and real-world data further validate that GSGD achieves superior recovery accuracy and scalability compared with several popular alternatives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。