arXiv:2506.21579cs.IRcs.AI2025-06KDD被引 39

用大模型融合语义与协同信号,提升推荐系统泛化能力

LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential Recommendation

  • 用协同监督微调让大模型理解用户行为中的物品关联
  • 在真实数据集上显著提升域内与跨域推荐效果
  • 适合需要强泛化能力的推荐场景研究者

序列推荐旨在通过建模相似用户或物品的历史行为中的协同过滤(CF)信号来预测用户未来交互。传统序列推荐器主要依赖基于ID的嵌入,仅通过高阶共现模式捕捉CF信号,但此类嵌入仅依赖历史交互,难以迁移到未见领域。近期大语言模型(LLMs)的发展推动了基于文本的推荐方法,从物品描述中提取表示,虽增强泛化能力,却无法编码关键的协同信号——即潜在的物品关联和偏好模式。我们主张理想嵌入模型应无缝融合协同信号与丰富语义表示,以提升域内与域外推荐性能。为此,提出LLM2Rec,一种专为序列推荐设计的嵌入模型,将大模型的语义理解与协同感知相结合。该方法采用两阶段训练框架:(1) 协同监督微调,使大模型基于历史交互推断物品关系;(2) 物品级嵌入建模,将微调后的模型转化为结构化的物品嵌入模型,同时编码语义与协同信息。在真实世界数据集上的大量实验表明,LLM2Rec在域内与跨域设置下均有效提升推荐质量。研究结果凸显了利用大模型构建更鲁棒、可泛化的嵌入模型在序列推荐中的潜力。代码已开源。

原文摘要 · Abstract (English)

Sequential recommendation aims to predict users' future interactions by modeling collaborative filtering (CF) signals from historical behaviors of similar users or items. Traditional sequential recommenders predominantly rely on ID-based embeddings, which capture CF signals through high-order co-occurrence patterns. However, these embeddings depend solely on past interactions, lacking transferable knowledge to generalize to unseen domains. Recent advances in large language models (LLMs) have motivated text-based recommendation approaches that derive item representations from textual descriptions. While these methods enhance generalization, they fail to encode CF signals-i.e., latent item correlations and preference patterns-crucial for effective recommendation. We argue that an ideal embedding model should seamlessly integrate CF signals with rich semantic representations to improve both in-domain and out-of-domain recommendation performance. To this end, we propose LLM2Rec, a novel embedding model tailored for sequential recommendation, integrating the rich semantic understanding of LLMs with CF awareness. Our approach follows a two-stage training framework: (1) Collaborative Supervised Fine-tuning, which adapts LLMs to infer item relationships based on historical interactions, and (2) Item-level Embedding Modeling, which refines these specialized LLMs into structured item embedding models that encode both semantic and collaborative information. Extensive experiments on real-world datasets demonstrate that LLM2Rec effectively improves recommendation quality across both in-domain and out-of-domain settings. Our findings highlight the potential of leveraging LLMs to build more robust, generalizable embedding models for sequential recommendation. Our codes are available at https://github.com/HappyPointer/LLM2Rec.

序列推荐大模型协同过滤嵌入模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。