通过体积约束与正则化提升低秩矩阵分解的可解释性与唯一性
Low-Rank Matrix Factorizations with Volume-based Constraints and Regularizations
- 引入基于体积的约束,确保因子在可行集内充分分散
- 提出两种新模型,分别处理有界数据与凸多面体约束情形
- 算法高效,适用于盲源分离与缺失数据补全等场景
低秩矩阵分解是一类广泛应用于机器学习、信号处理和数据分析的线性模型,将矩阵近似为两个较小矩阵的乘积,左矩阵捕捉潜在特征,右矩阵基于这些特征线性分解数据。传统方法如截断奇异值分解仅关注原矩阵与低秩近似之间的距离最小化。本文将‘重要性’与可解释性和唯一性紧密关联,提出基于体积的约束与正则化以增强这两项属性。首先设计两种体积约束型低秩矩阵分解模型:其一假设数据点自然有界(如1至5星评分),可通过特征的凸组合解释,保持与数据一致的语义;其二更一般,约束因子属于凸多面体。随后提出两种体积正则化变体:其一最小化潜在特征的体积,促使特征聚集;其二最大化分解结果的体积,促进稀疏表示。所有模型均在因子于可行集内‘足够分散’的核心原则下实现唯一性。针对盲源分离和缺失数据补全等应用,本文还设计了高效算法,使模型具备实际可用性。
原文摘要 · Abstract (English)
Low-rank matrix factorizations are a class of linear models widely used in various fields such as machine learning, signal processing, and data analysis. These models approximate a matrix as the product of two smaller matrices, where the left matrix captures latent features while the right matrix linearly decomposes the data based on these features. There are many ways to define what makes a component "important." Standard LRMFs, such as the truncated singular value decomposition, focus on minimizing the distance between the original matrix and its low-rank approximation. In this thesis, the notion of "importance" is closely linked to interpretability and uniqueness, which are key to obtaining reliable and meaningful results. This thesis thus focuses on volume-based constraints and regularizations designed to enhance interpretability and uniqueness. We first introduce two new volume-constrained LRMFs designed to enhance these properties. The first assumes that data points are naturally bounded (e.g., movie ratings between 1 and 5 stars) and can be explained by convex combinations of features within the same bounds, allowing them to be interpreted in the same way as the data. The second model is more general, constraining the factors to belong to convex polytopes. Then, two variants of volume-regularized LRMFs are proposed. The first minimizes the volume of the latent features, encouraging them to cluster closely together, while the second maximizes the volume of the decompositions, promoting sparse representations. Across all these models, uniqueness is achieved under the core principle that the factors must be "sufficiently scattered" within their respective feasible sets. Motivated by applications such as blind source separation and missing data imputation, this thesis also proposes efficient algorithms that make these models practical for real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。