arXiv:2507.03047cs.CLcs.AI2025-07

用反事实训练提升大模型对用户行为时间顺序的感知能力

Enhancing Temporal Sensitivity of Large Language Model for Recommendation with Counterfactual Tuning

  • 基于因果推断设计反事实调优任务,增强大模型对时间顺序的理解
  • 在多个真实数据集上显著提升推荐准确率,尤其改善长期偏好建模
  • 适合需要精准捕捉用户兴趣演化的个性化推荐系统开发者

近期研究将大语言模型(LLMs)应用于序列推荐,利用其预训练知识与推理能力提供更个性化的用户体验。然而,现有方法未能充分挖掘用户历史交互序列中蕴含的丰富时间信息,根源在于架构限制:LLMs通过自注意力机制处理信息,缺乏固有的序列顺序感知能力,且依赖主要为自然语言设计的位置嵌入。这一局限严重影响了其对用户偏好随时间演变的捕捉能力及未来兴趣预测的准确性。为此,我们提出反事实增强的时间框架CETRec,该方法基于因果推断原理,能够分离并度量时间信息对推荐结果的特定影响。结合从因果分析中衍生的反事实调优任务,CETRec有效提升了大模型对绝对顺序(如最近交互时间)和相对顺序(项目间序列关系)的感知能力。在真实世界数据集上的大量实验验证了CETRec的有效性。代码已公开于https://anonymous.4open.science/r/CETRec-B9CE/。

原文摘要 · Abstract (English)

Recent advances have applied large language models (LLMs) to sequential recommendation, leveraging their pre-training knowledge and reasoning capabilities to provide more personalized user experiences. However, existing LLM-based methods fail to sufficiently leverage the rich temporal information inherent in users' historical interaction sequences, stemming from fundamental architectural constraints: LLMs process information through self-attention mechanisms that lack inherent sequence ordering and rely on position embeddings designed primarily for natural language rather than user interaction sequences. This limitation significantly impairs their ability to capture the evolution of user preferences over time and predict future interests accurately. To address this critical gap, we propose \underline{C}ounterfactual \underline{E}nhanced \underline{T}emporal Framework for LLM-Based \underline{Rec}ommendation (CETRec). CETRec is grounded in causal inference principles, which allow it to isolate and measure the specific impact of temporal information on recommendation outcomes. Combined with our counterfactual tuning task derived from causal analysis, CETRec effectively enhances LLMs' awareness of both absolute order (how recently items were interacted with) and relative order (the sequential relationships between items). Extensive experiments on real-world datasets demonstrate the effectiveness of our CETRec. Our code is available at https://anonymous.4open.science/r/CETRec-B9CE/.

序列推荐大模型时间建模因果推断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。