让大模型更好理解用户物品关系,提升推荐效果
Enhancing LLM-based Recommendation through Semantic-Aligned Collaborative Knowledge
- 用特殊标记将协同过滤知识注入大模型语义空间
- 在两个数据集上达到当前最优推荐性能
- 适合想融合大模型与传统推荐优势的研究者
大型语言模型(LLMs)在推荐任务中展现出强大的世界知识和推理能力,但其难以有效建模稀疏标识符(如用户和物品ID),导致无法学习独特的用户-物品表示,形成性能瓶颈。已有研究通过将协同过滤模型(Collabs.)的知识融入LLMs来缓解此问题,但两者在知识分布和语义空间上的显著差异阻碍了有效知识迁移。为此,我们提出SeLLa-Rec框架,聚焦于对齐协同过滤与大模型的语义空间,促进知识融合,减少判别性噪声影响,并实现跨模型知识的深度整合。具体地,通过混合投影层将三个携带协同知识的特殊标记嵌入大模型语义空间,并融入特定任务提示中以引导推荐过程。在MovieLens-1M和Amazon Book两个公开基准数据集上的实验表明,SeLLa-Rec实现了当前最优性能。
原文摘要 · Abstract (English)
Large Language Models (LLMs) demonstrate remarkable capabilities in leveraging comprehensive world knowledge and sophisticated reasoning mechanisms for recommendation tasks. However, a notable limitation lies in their inability to effectively model sparse identifiers (e.g., user and item IDs), unlike conventional collaborative filtering models (Collabs.), thus hindering LLM to learn distinctive user-item representations and creating a performance bottleneck. Prior studies indicate that integrating collaborative knowledge from Collabs. into LLMs can mitigate the above limitations and enhance their recommendation performance. Nevertheless, the significant discrepancy in knowledge distribution and semantic space between LLMs and Collab. presents substantial challenges for effective knowledge transfer. To tackle these challenges, we propose a novel framework, SeLLa-Rec, which focuses on achieving alignment between the semantic spaces of Collabs. and LLMs. This alignment fosters effective knowledge fusion, mitigating the influence of discriminative noise and facilitating the deep integration of knowledge from diverse models. Specifically, three special tokens with collaborative knowledge are embedded into the LLM's semantic space through a hybrid projection layer and integrated into task-specific prompts to guide the recommendation process. Experiments conducted on two public benchmark datasets (MovieLens-1M and Amazon Book) demonstrate that SeLLa-Rec achieves state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。