超稀疏采样下,用无偏估计和梯度下降恢复矩阵关键结构。
One-Sided Matrix Completion from Ultra-Sparse Samples
- 通过频率归一化构造无偏估计,修正稀疏缺失的偏差。
- 在低秩模型下,仅需线性量级样本即可高精度恢复矩阵结构。
- 适合处理海量稀疏面板数据,如用户评分、商品评价等场景。
矩阵补全是一个经典问题,在各类领域持续受到关注。本文研究超稀疏采样情形下的矩阵补全:未知 $n imes d$ 矩阵 $M$($n \≥ d$)的每个元素以概率 $p = C / d$ 独立观测,其中固定整数 $C \ge 2$。该设定源于大规模稀疏面板数据应用,当每行仅含 $C$ 个非零项(少于 $M$ 的秩)时,无法准确重构 $M$。我们转而估计 $M$ 的行空间或平均二阶矩矩阵 $T = M^{ op} M / n$。从观测值计算的二阶矩矩阵存在非随机且稀疏的缺失模式。我们提出一种无偏估计器,将每个非零项按其观测频率归一化,再使用梯度下降补全 $T$ 的缺失项。该归一化操作相当于将 $n$ 个二项分布随机变量的加权和除以其总和。理论证明该估计对任意 $p$ 无偏且方差低。当 $M$ 的行向量服从满足一致性的秩-$r$ 因子模型时,若 $n \ge O({d r^5 ε^{-2} C^{-2} \log d})$,则梯度下降目标函数的任意局部极小值近似全局极小,并以不超过 $ε^2$ 的误差恢复 $T$。合成与真实数据实验验证了方法有效性:在三个 MovieLens 数据集上,相对基线降低 88% 偏差;在 $10^{-7}$ 稀疏度的 Amazon 评论数据集上,$T$ 和 $M$ 的恢复误差分别降低 59% 和 38%。同时实证验证了 $n$ 与 $d$ 的线性采样复杂度。
原文摘要 · Abstract (English)
Matrix completion is a classical problem that has received recurring interest across a wide range of fields. In this paper, we revisit this problem in an ultra-sparse sampling regime, where each entry of an unknown, $n\times d$ matrix $M$ (with $n \ge d$) is observed independently with probability $p = C / d$, for a fixed integer $C \ge 2$. This setting is motivated by applications involving large, sparse panel datasets, where the number of rows far exceeds the number of columns. When each row contains only $C$ entries -- fewer than the rank of $M$ -- accurate imputation of $M$ is impossible. Instead, we estimate the row span of $M$ or the averaged second-moment matrix $T = M^{\top} M / n$. The empirical second-moment matrix computed from observed entries exhibits non-random and sparse missingness. We propose an unbiased estimator that normalizes each nonzero entry of the second moment by its observed frequency, followed by gradient descent to impute the missing entries of $T$. The normalization divides a weighted sum of $n$ binomial random variables by the total number of ones. We show that the estimator is unbiased for any $p$ and enjoys low variance. When the row vectors of $M$ are drawn uniformly from a rank-$r$ factor model satisfying an incoherence condition, we prove that if $n \ge O({d r^5 ε^{-2} C^{-2} \log d})$, any local minimum of the gradient-descent objective is approximately global and recovers $T$ with error at most $ε^2$. Experiments on both synthetic and real-world data validate our approach. On three MovieLens datasets, our algorithm reduces bias by $88\%$ relative to baseline estimators. We also empirically validate the linear sampling complexity of $n$ relative to $d$ on synthetic data. On an Amazon reviews dataset with sparsity $10^{-7}$, our method reduces the recovery error of $T$ by $59\%$ and $M$ by $38\%$ compared to baseline methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。