用大模型动态建模用户长期行为,提升推荐精准度。
LIBER: Lifelong User Behavior Modeling Based on Large Language Models
- 将用户行为流分段压缩,分层调用大模型提取兴趣
- 在华为音乐推荐中提升播放量3.01%、时长7.69%
- 适合需持续更新用户兴趣的推荐场景
点击率预测在推荐系统中至关重要。近年来,大语言模型(LLMs)因其强大的语义理解能力被引入推荐系统,但现有方法仍存在两大瓶颈:一是难以从长期用户行为序列中有效提取文本上下文中的关键信息;二是人类行为具有持续变化和兴趣波动的特性,导致现有模型难以捕捉动态兴趣变化,且频繁调用大模型带来显著计算开销。为此,本文提出基于大语言模型的终身用户行为建模框架LIBER,包含三个模块:用户行为流分段(UBSP)、用户兴趣学习(UIL)和用户兴趣融合(UIF)。UBSP以增量方式将长序列压缩为短片段,提高处理效率;UIL通过级联式调用大模型分析各片段;UIF整合生成的文本表示,形成综合用户表征,可嵌入任意推荐模型。该方案已部署于华为音乐推荐服务,在用户播放次数和播放时长上分别提升3.01%和7.69%。
原文摘要 · Abstract (English)
CTR prediction plays a vital role in recommender systems. Recently, large language models (LLMs) have been applied in recommender systems due to their emergence abilities. While leveraging semantic information from LLMs has shown some improvements in the performance of recommender systems, two notable limitations persist in these studies. First, LLM-enhanced recommender systems encounter challenges in extracting valuable information from lifelong user behavior sequences within textual contexts for recommendation tasks. Second, the inherent variability in human behaviors leads to a constant stream of new behaviors and irregularly fluctuating user interests. This characteristic imposes two significant challenges on existing models. On the one hand, it presents difficulties for LLMs in effectively capturing the dynamic shifts in user interests within these sequences, and on the other hand, there exists the issue of substantial computational overhead if the LLMs necessitate recurrent calls upon each update to the user sequences. In this work, we propose Lifelong User Behavior Modeling (LIBER) based on large language models, which includes three modules: (1) User Behavior Streaming Partition (UBSP), (2) User Interest Learning (UIL), and (3) User Interest Fusion (UIF). Initially, UBSP is employed to condense lengthy user behavior sequences into shorter partitions in an incremental paradigm, facilitating more efficient processing. Subsequently, UIL leverages LLMs in a cascading way to infer insights from these partitions. Finally, UIF integrates the textual outputs generated by the aforementioned processes to construct a comprehensive representation, which can be incorporated by any recommendation model to enhance performance. LIBER has been deployed on Huawei's music recommendation service and achieved substantial improvements in users' play count and play time by 3.01% and 7.69%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。