用大模型生成用户行为描述,区分短期与长期偏好提升推荐效果
Temporal User Profiling with LLMs: Balancing Short-Term and Long-Term Preferences for Recommendations
- 用大模型将用户历史转化为自然语言描述,结合时间戳建模偏好动态
- 在真实数据集上推荐准确率显著优于基线方法
- 适合需要理解用户长期兴趣演变的个性化推荐场景
精准建模用户偏好对提升基于内容的推荐系统性能至关重要。现有方法多采用简单平均或拼接物品嵌入的用户画像方式,难以捕捉用户偏好动态,尤其是长期与短期偏好的交互。本文提出基于大模型的时间感知用户画像(LLM-TUP),通过利用交互时间戳并借助大语言模型生成用户历史的自然语言表示,再经预训练BERT编码为高维嵌入,并通过注意力机制动态融合短期与长期嵌入,构建完整用户画像。在真实数据集上的实验表明,LLM-TUP显著优于多个基线模型,验证了时间感知用户画像及大模型生成语义丰富用户表示在个性化推荐中的有效性。
原文摘要 · Abstract (English)
Accurately modeling user preferences is crucial for improving the performance of content-based recommender systems. Existing approaches often rely on simplistic user profiling methods, such as averaging or concatenating item embeddings, which fail to capture the nuanced nature of user preference dynamics, particularly the interactions between long-term and short-term preferences. In this work, we propose LLM-driven Temporal User Profiling (LLM-TUP), a novel method for user profiling that explicitly models short-term and long-term preferences by leveraging interaction timestamps and generating natural language representations of user histories using a large language model (LLM). These representations are encoded into high-dimensional embeddings using a pre-trained BERT model, and an attention mechanism is applied to dynamically fuse the short-term and long-term embeddings into a comprehensive user profile. Experimental results on real-world datasets demonstrate that LLM-TUP achieves substantial improvements over several baselines, underscoring the effectiveness of our temporally aware user-profiling approach and the use of semantically rich user profiles, generated by LLMs, for personalized content-based recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。