arXiv:2501.15555cs.LGcs.AI2025-01中稿 · WWW'25被引 18

用扩散模型和熵正则化提升推荐系统在分布外数据上的鲁棒性

Distributionally Robust Graph Out-of-Distribution Recommendation via Diffusion Model

  • 引入扩散模型降低潜在空间噪声影响
  • 通过熵正则化避免极端样本权重,提升泛化能力
  • 理论证明框架有效性,适合关注推荐系统鲁棒性的研究者

基于分布鲁棒优化(DRO)的图神经网络方法通过优化最差情况下的性能来提升推荐系统的分布外(OOD)泛化能力。然而,这些方法未考虑训练数据中噪声样本的影响,导致泛化能力下降、准确率降低。实验与理论分析表明,现有DRO方法会赋予噪声分布更大权重,使模型参数学习被噪声主导。当模型过度拟合训练数据中的噪声样本时,可能学习到无关或无意义特征,无法推广至OOD数据。为此,我们提出用于分布外推荐的分布鲁棒图模型(DRGO)。首先,采用简单有效的扩散范式缓解潜在空间中的噪声影响;其次,在DRO目标函数中引入熵正则化项,避免最差分布中样本权重过极化;最后,提供DRGO泛化误差界的理论证明及噪声样本影响的理论分析,从理论上深化对所提框架的理解。我们在四个数据集上进行大量实验,评估框架在三种典型分布偏移下的表现,结果表明其在独立同分布(IID)和分布外场景下均具有优越性。

原文摘要 · Abstract (English)

The distributionally robust optimization (DRO)-based graph neural network methods improve recommendation systems' out-of-distribution (OOD) generalization by optimizing the model's worst-case performance. However, these studies fail to consider the impact of noisy samples in the training data, which results in diminished generalization capabilities and lower accuracy. Through experimental and theoretical analysis, this paper reveals that current DRO-based graph recommendation methods assign greater weight to noise distribution, leading to model parameter learning being dominated by it. When the model overly focuses on fitting noise samples in the training data, it may learn irrelevant or meaningless features that cannot be generalized to OOD data. To address this challenge, we design a Distributionally Robust Graph model for OOD recommendation (DRGO). Specifically, our method first employs a simple and effective diffusion paradigm to alleviate the noisy effect in the latent space. Additionally, an entropy regularization term is introduced in the DRO objective function to avoid extreme sample weights in the worst-case distribution. Finally, we provide a theoretical proof of the generalization error bound of DRGO as well as a theoretical analysis of how our approach mitigates noisy sample effects, which helps to better understand the proposed framework from a theoretical perspective. We conduct extensive experiments on four datasets to evaluate the effectiveness of our framework against three typical distribution shifts, and the results demonstrate its superiority in both independently and identically distributed distributions (IID) and OOD.

推荐系统图神经网络分布外泛化扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。