用大模型提升推荐系统在分布外场景的泛化能力。
Large Language Model Enhanced Graph Invariant Contrastive Learning for Out-of-Distribution Recommendation
- 结合大模型与图结构,通过因果置信度引导图优化
- 在四个数据集上显著优于现有方法,提升分布外推荐效果
- 适合研究推荐系统鲁棒性与大模型融合的学者
分布外(OOD)泛化已成为图推荐系统中的关键挑战。传统图神经网络因学习虚假环境关联而非稳定因果关系,导致分布偏移时性能严重下降。尽管大型语言模型(LLM)凭借其广泛世界知识和推理能力提供了新路径,但如何有效融合其知识与特定图的细粒度拓扑仍面临挑战。为此,我们提出一种创新的因果学习框架 InvGCLLM,协同利用数据驱动模型与知识驱动的LLM优势。该框架首先通过数据驱动的不变学习模型为每个用户-物品交互生成因果置信度评分;这些评分用于指导LLM进行针对性图重构,借助其世界知识剔除虚假连接、补充缺失因果边;最终,经过结构净化的图为因果引导的对比学习目标提供强监督信号,使模型学习到对虚假关联鲁棒的表示。在四个公开数据集上的实验表明,InvGCLLM在分布外推荐任务中取得显著提升,持续优于当前最优基线。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) generalization has emerged as a significant challenge in graph recommender systems. Traditional graph neural network algorithms often fail because they learn spurious environmental correlations instead of stable causal relationships, leading to substantial performance degradation under distribution shifts. While recent advancements in Large Language Models (LLMs) offer a promising avenue due to their vast world knowledge and reasoning capabilities, effectively integrating this knowledge with the fine-grained topology of specific graphs to solve the OOD problem remains a significant challenge. To address these issues, we propose {$\textbf{Inv}$ariant $\textbf{G}$raph $\textbf{C}$ontrastive Learning with $\textbf{LLM}$s for Out-of-Distribution Recommendation (InvGCLLM)}, an innovative causal learning framework that synergistically integrates the strengths of data-driven models and knowledge-driven LLMs. Our framework first employs a data-driven invariant learning model to generate causal confidence scores for each user-item interaction. These scores then guide an LLM to perform targeted graph refinement, leveraging its world knowledge to prune spurious connections and augment missing causal links. Finally, the structurally purified graphs provide robust supervision for a causality-guided contrastive learning objective, enabling the model to learn representations that are resilient to spurious correlations. Experiments conducted on four public datasets demonstrate that InvGCLLM achieves significant improvements in out-of-distribution recommendation, consistently outperforming state-of-the-art baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。