arXiv:2410.20318stat.MLcs.LG2024-10被引 1

基于测地线哈密顿蒙特卡洛的低秩矩阵补全,可高效量化不确定性

Low-rank Bayesian matrix completion via geodesic Hamiltonian Monte Carlo on Stiefel manifolds

  • 以SVD参数化构建正则化先验,约束因子矩阵在Stiefel流形上保持正交
  • 相比传统吉布斯采样,收敛更快、混合更优,支持非高斯似然与先验
  • 适用于蛋白质数据和电影推荐等真实场景,提升补全准确率

我们提出一种新的基于采样的低秩贝叶斯矩阵补全方法,用于高效计算并量化不确定性。首先,基于低秩矩阵的奇异值分解(SVD)参数化设计了一种新先验模型,该先验类似于非贝叶斯设置中的核范数正则化,并通过将因子矩阵约束在Stiefel流形上来强制正交性。随后,设计了一种测地线哈密顿蒙特卡洛(geodesic Hamiltonian Monte Carlo)算法,用于生成SVD因子矩阵的后验样本。该方法解决了标准吉布斯采样在常用双因子分解中遇到的采样困难问题。更重要的是,测地线哈密顿采样器能够处理比典型高斯似然与先验更广泛的一般似然形式。我们在小鼠蛋白分类数据集和MovieLens推荐系统上验证了该方法的有效性。数值实验表明,该方法在采样性能上表现更优,包括更好的混合性和更快的收敛速度,并在两个真实世界基准问题上取得了更高的补全准确率。

原文摘要 · Abstract (English)

We present a new sampling-based approach for enabling efficient computation of low-rank Bayesian matrix completion and quantifying the associated uncertainty. Firstly, we design a new prior model based on the singular-value-decomposition (SVD) parametrization of low-rank matrices. Our prior is analogous to the seminal nuclear-norm regularization used in non-Bayesian setting and enforces orthogonality in the factor matrices by constraining them to Stiefel manifolds. Then, we design a geodesic Hamiltonian Monte Carlo (-within-Gibbs) algorithm for generating posterior samples of the SVD factor matrices. We demonstrate that our approach resolves the sampling difficulties encountered by standard Gibbs samplers for the common two-matrix factorization used in matrix completion. More importantly, the geodesic Hamiltonian sampler allows for sampling in cases with more general likelihoods than the typical Gaussian likelihood and Gaussian prior assumptions adopted in most of the existing Bayesian matrix completion literature. We demonstrate an applications of our approach to fit the categorical data of a mice protein dataset and the MovieLens recommendation problem. Numerical examples demonstrate superior sampling performance, including better mixing and faster convergence to a stationary distribution. Moreover, they demonstrate improved accuracy on the two real-world benchmark problems we considered.

矩阵补全贝叶斯推断马尔可夫链流形优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。