用分层树搜索建模用户长期行为,提升推荐系统兴趣理解能力
Hierarchical Tree Search-based User Lifelong Behavior Modeling on Large Language Model
- 分块提取用户行为,逐级学习兴趣与演变
- 分层搜索候选兴趣,用评分模型选出最优兴趣组合
- 适合需要长期用户行为建模的推荐系统研究者
大型语言模型(LLM)因其丰富的世界知识和强大的推理能力,在推荐系统中备受关注。然而,如何让LLM有效理解并从海量用户行为中提取洞察,仍是关键挑战。现有方法在处理长序列行为、高效提取兴趣以及实际应用方面存在局限。为此,我们提出一种基于分层树搜索的用户长期行为建模框架(HiT-LBM)。该框架结合分块用户行为提取(CUBE)与分层树搜索兴趣生成(HTS),捕捉用户多样化兴趣及其演化过程。CUBE将用户长期行为划分为多个行为块,以级联方式学习每一块内的兴趣及演变;HTS通过层级扩展生成候选兴趣,并利用过程评分模型筛选出最优兴趣,确保每个行为块的信息增益。此外,设计时序感知的兴趣融合(TIF)机制,整合多块兴趣,构建用户长期兴趣的完整表征,可嵌入任意推荐模型以提升性能。大量实验表明,该方法优于现有最先进方法。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have garnered significant attention in Recommendation Systems (RS) due to their extensive world knowledge and robust reasoning capabilities. However, a critical challenge lies in enabling LLMs to effectively comprehend and extract insights from massive user behaviors. Current approaches that directly leverage LLMs for user interest learning face limitations in handling long sequential behaviors, effectively extracting interest, and applying interest in practical scenarios. To address these issues, we propose a Hierarchical Tree Search-based User Lifelong Behavior Modeling framework (HiT-LBM). HiT-LBM integrates Chunked User Behavior Extraction (CUBE) and Hierarchical Tree Search for Interest (HTS) to capture diverse interests and interest evolution of user. CUBE divides user lifelong behaviors into multiple chunks and learns the interest and interest evolution within each chunk in a cascading manner. HTS generates candidate interests through hierarchical expansion and searches for the optimal interest with process rating model to ensure information gain for each behavior chunk. Additionally, we design Temporal-Ware Interest Fusion (TIF) to integrate interests from multiple behavior chunks, constructing a comprehensive representation of user lifelong interests. The representation can be embedded into any recommendation model to enhance performance. Extensive experiments demonstrate the effectiveness of our approach, showing that it surpasses state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。