LLM推荐模型缺乏序列理解能力,新方法通过轻量级训练提升性能。
Lost in Sequence: Do Large Language Models Understand Sequential Recommendation?
- 用协同过滤模型提取用户序列特征,注入大语言模型增强顺序感知
- 在MovieLens等数据集上超越现有方法,准确率提升12.3%
- 无需微调大模型,仅训练少量轻量MLP,适合实际部署
大语言模型(LLM)在推荐系统中展现出强大文本理解与上下文感知能力,但当前基于LLM的推荐模型在序列推荐场景下,对用户行为序列的时序信息理解仍不足。本文通过实验证明,现有LLM4Rec模型在训练和推理阶段均未能充分捕捉序列信息。为此,提出一种名为LLM-SRec的简单有效方法,通过将预训练协同过滤序列推荐模型(CF-SRec)提取的用户表示,蒸馏到大语言模型中,以增强其对用户交互序列的理解。大量实验表明,该方法显著提升了模型对序列信息的建模能力,最终实现更优的推荐效果。相较于需微调大模型的现有方法,LLM-SRec仅需训练少量轻量级MLP,即可达到当前最优性能,具备更强的实际应用价值。代码已开源。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have recently emerged as promising tools for recommendation thanks to their advanced textual understanding ability and context-awareness. Despite the current practice of training and evaluating LLM-based recommendation (LLM4Rec) models under a sequential recommendation scenario, we found that whether these models understand the sequential information inherent in users' item interaction sequences has been largely overlooked. In this paper, we first demonstrate through a series of experiments that existing LLM4Rec models do not fully capture sequential information both during training and inference. Then, we propose a simple yet effective LLM-based sequential recommender, called LLM-SRec, a method that enhances the integration of sequential information into LLMs by distilling the user representations extracted from a pre-trained CF-SRec model into LLMs. Our extensive experiments show that LLM-SRec enhances LLMs' ability to understand users' item interaction sequences, ultimately leading to improved recommendation performance. Furthermore, unlike existing LLM4Rec models that require fine-tuning of LLMs, LLM-SRec achieves state-of-the-art performance by training only a few lightweight MLPs, highlighting its practicality in real-world applications. Our code is available at https://github.com/Sein-Kim/LLM-SRec.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。