arXiv:2511.13049cs.LGstat.ML2025-11AAAI

利用隐式与显式反馈数据,提升推荐系统矩阵补全的泛化能力。

Generalization Bounds for Semi-supervised Matrix Completion with Distributional Side Information

  • 基于低秩共享子空间假设,结合隐式与显式反馈数据进行矩阵补全。
  • 理论误差界由两部分构成:分别与未标记数据量M和标记数据量N相关。
  • 实验证明该方法在移除大部分评分后仍优于仅用显式反馈的基线。

我们研究一种矩阵补全问题,其中真实矩阵 $R$ 和未知观测分布 $P$ 均为低秩矩阵,且共享同一子空间。假设存在大量 $M$ 个从分布 $P$ 中采样的未标记数据,以及少量 $N$ 个从相同分布采样的已标记数据和对应的真实值噪声估计。该设定源于推荐系统场景:未标记数据对应‘隐式反馈’(如购买、点击等行为),已标记数据对应‘显式反馈’(用户对物品的评分)。通过利用低秩子空间恢复理论及经典矩阵补全泛化界,我们推导出误差界,包含两项:$ ilde{O}ig( rac{ ext{nd}}{M}ig)$ 和 $ ilde{O}ig( rac{dr}{N}ig)$,其中 $d$ 为 $P$ 的秩,$r$ 为 $R$ 的秩。在合成实验中,真实泛化误差自然分解为估计 $P$ 与估计 $R$ 的独立误差项。在 Douban 与 MovieLens 数据集上,移除大部分显式评分后,本方法仍优于仅依赖显式评分的基线,验证了该理论模型对隐式与显式反馈交互的有效刻画。

原文摘要 · Abstract (English)

We study a matrix completion problem where both the ground truth $R$ matrix and the unknown sampling distribution $P$ over observed entries are low-rank matrices, and \textit{share a common subspace}. We assume that a large amount $M$ of \textit{unlabeled} data drawn from the sampling distribution $P$ is available, together with a small amount $N$ of labeled data drawn from the same distribution and noisy estimates of the corresponding ground truth entries. This setting is inspired by recommender systems scenarios where the unlabeled data corresponds to `implicit feedback' (consisting in interactions such as purchase, click, etc. ) and the labeled data corresponds to the `explicit feedback', consisting of interactions where the user has given an explicit rating to the item. Leveraging powerful results from the theory of low-rank subspace recovery, together with classic generalization bounds for matrix completion models, we show error bounds consisting of a sum of two error terms scaling as $\widetilde{O}\left(\sqrt{\frac{nd}{M}}\right)$ and $\widetilde{O}\left(\sqrt{\frac{dr}{N}}\right)$ respectively, where $d$ is the rank of $P$ and $r$ is the rank of $M$. In synthetic experiments, we confirm that the true generalization error naturally splits into independent error terms corresponding to the estimations of $P$ and and the ground truth matrix $\ground$ respectively. In real-life experiments on Douban and MovieLens with most explicit ratings removed, we demonstrate that the method can outperform baselines relying only on the explicit ratings, demonstrating that our assumptions provide a valid toy theoretical setting to study the interaction between explicit and implicit feedbacks in recommender systems.

矩阵补全推荐系统半监督泛化界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。