arXiv:2511.06781cs.LGcs.AI2025-11被引 2

揭示了VAE推荐系统中用户协作的机制,提出稳定全局协同的新方法。

On the Mechanisms of Collaborative Learning in VAE Recommenders

  • 基于隐空间水氏距离定义协作半径,量化用户间影响范围。
  • 发现现有方法过度依赖局部相似用户,忽略远距离但相关用户。
  • 提出锚定正则化,在保持用户身份的同时实现跨项目信号共享。

变分自编码器(VAE)是推荐系统中矩阵分解的有力替代方案。在基于VAE的协同过滤中,常对用户交互向量施加二值掩码以提升性能,但其理论机制尚未充分探索。本文分析了VAE推荐中协作的形成机制,发现其由隐空间邻近性主导:我们推导出一个隐空间共享半径,可判断某用户的一次SGD更新是否严格降低另一用户的损失,且影响随隐空间水氏距离增加而衰减。进一步研究显示,在干净输入下,该方法主要利用输入相似用户的局部协作,而低估了远距离但相关用户的全局协作。我们对比了两种促进全局混合的机制:1)β-KL正则化直接收紧信息瓶颈,促进后验重叠,但过强时易引发表示崩溃;2)输入掩码引入随机几何收缩与扩张,可将远距离用户拉入同一隐空间邻域,但也导致邻域漂移。为在保持用户身份的同时实现全局一致性,我们提出锚定正则化,使用户后验与物品嵌入对齐,稳定掩码下的用户表征,并促进相关物品间的信号共享。分析在Netflix、MovieLens-20M和Million Song数据集上得到验证,且所提算法已在亚马逊流媒体平台成功部署并完成在线实验。

原文摘要 · Abstract (English)

Variational Autoencoders (VAEs) are a powerful alternative to matrix factorization for recommendation. A common technique in VAE-based collaborative filtering (CF) consists in applying binary input masking to user interaction vectors, which improves performance but remains underexplored theoretically. In this work, we analyze how collaboration arises in VAE-based CF and show it is governed by \emph{latent proximity}: we derive a latent sharing radius that informs when an SGD update on one user strictly reduces the loss on another user, with influence decaying as the latent Wasserstein distance increases. We further study the induced geometry: with clean inputs, VAE-based CF primarily exploits \emph{local} collaboration between input-similar users and under-utilizes \emph{global} collaboration between far-but-related users. We compare two mechanisms that encourage \emph{global} mixing and characterize their trade-offs: \ding{172} $β$-KL regularization directly tightens the information bottleneck, promoting posterior overlap but risking representational collapse if too large; \ding{173} input masking induces stochastic \emph{geometric} contractions and expansions, which can bring distant users onto the same latent neighborhood but also introduce neighborhood drift. To preserve user identity while enabling global consistency, we propose an anchor regularizer that aligns user posteriors with item embeddings, stabilizing users under masking and facilitating signal sharing across related items. Our analyses are validated on the Netflix, MovieLens-20M, and Million Song datasets. We also successfully deployed our proposed algorithm on an Amazon streaming platform following a successful online experiment.

推荐系统变分自编码器协同学习隐空间建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。