提出新方法联合分解多个对称矩阵,提升网络分析中聚类与链接预测效果。
On solving symmetric multi-type orthogonal non-negative matrix tri-factorization problem
- 基于KKT条件与正则化设计固定点算法,结合ADAM三阶段优化求解
- 在合成数据和引用网络上均接近最优解,噪声下仍稳定,性能优于SVD等基线
- 适合需要可解释性聚类的网络分析场景,如社交网络、学术引用研究
我们研究对称多类型正交非负矩阵三因子分解问题,即通过共享的非负正交因子 $G$,将多个对称非负矩阵同时近似为 $GS_{i}G^{ op}$ 形式。该模型源于聚类与网络分析,非负性增强可解释性,正交性赋予潜在因子自然分配结构。由于优化问题高度非凸,本文提出两种启发式算法:一是基于添加正则项后KKT条件的定点法;二是结合非负保持优化、正交化与可行集上受限ADAM精调的三阶段方法。在含噪声的合成数据及引文网络基准测试中,两种算法均能恢复接近最优的分解,且在噪声下表现稳定。真实网络实验表明,所学嵌入在链接预测、节点聚类与节点分类任务中,性能优于或媲美SVD、node2vec及经典链接预测启发式方法。
原文摘要 · Abstract (English)
We study the symmetric multi-type orthogonal non-negative matrix tri-factorization problem, where several symmetric non-negative matrices are simultaneously approximated by factors of the form $GS_{i}G^{\top}$, with a shared non-negative and orthogonal factor $G$. This model is motivated by clustering and network analysis, where non-negativity improves interpretability and orthogonality gives a natural assignment-type structure to the latent factor. Since the resulting optimization problem is highly non-convex, we develop two heuristic algorithms for computing high-quality local solutions. The first one is a fixed point method derived from the Karush-Kuhn-Tucker conditions after adding a penalty term for the orthogonality constraint. The second one is a three-stage ADAM-based method that combines non-negativity-preserving optimization, orthogonalization, and restricted ADAM refinement on the feasible set. We evaluate both methods on synthetic data, including noisy instances, and on citation network benchmarks. The synthetic experiments show that both algorithms recover factorizations close to the optimum and remain stable under noise. On real networks, the learned embeddings are competitive with or better than standard baselines such as SVD, node2vec, and classical link prediction heuristics in link prediction, node clustering, and node classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。