无需预设结构,用神经网络学习张量与因子的兼容性。
Score-Based Model for Low-Rank Tensor Recovery
- 设计神经网络学习能量函数,通过得分匹配捕捉联合概率梯度。
- 在稀疏、连续时间张量及视觉数据上显著提升补全与去噪性能。
- 适合需要灵活建模张量结构的多维数据分析场景。
低秩张量分解为多维数据分析提供了有效框架。传统方法依赖预定义的结构假设(如CP或Tucker分解),从概率角度可视为使用狄拉克δ分布建模共享因子与低秩张量间的关系。然而,实际中往往缺乏关于最优秩结构和收缩规则的先验知识,基于固定收缩规则的优化过程复杂,且近似导致精度损失。为此,我们提出一种基于得分的模型,无需预设结构或分布假设,可学习张量与共享因子间的兼容性。具体地,设计神经网络学习能量函数,并通过得分匹配优化,以捕捉张量元素与共享因子联合对数概率的梯度。该方法可建模超越狄拉克δ假设的结构与分布。此外,将块坐标下降(BCD)算法与所提平滑正则化结合,使模型同时实现张量补全与去噪。实验结果表明,在多种张量类型(包括稀疏、连续时间张量及视觉数据)上均取得显著性能提升。
原文摘要 · Abstract (English)
Low-rank tensor decompositions (TDs) provide an effective framework for multiway data analysis. Traditional TD methods rely on predefined structural assumptions, such as CP or Tucker decompositions. From a probabilistic perspective, these can be viewed as using Dirac delta distributions to model the relationships between shared factors and the low-rank tensor. However, such prior knowledge is rarely available in practical scenarios, particularly regarding the optimal rank structure and contraction rules. The optimization procedures based on fixed contraction rules are complex, and approximations made during these processes often lead to accuracy loss. To address this issue, we propose a score-based model that eliminates the need for predefined structural or distributional assumptions, enabling the learning of compatibility between tensors and shared factors. Specifically, a neural network is designed to learn the energy function, which is optimized via score matching to capture the gradient of the joint log-probability of tensor entries and shared factors. Our method allows for modeling structures and distributions beyond the Dirac delta assumption. Moreover, integrating the block coordinate descent (BCD) algorithm with the proposed smooth regularization enables the model to perform both tensor completion and denoising. Experimental results demonstrate significant performance improvements across various tensor types, including sparse and continuous-time tensors, as well as visual data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。