用大模型动态划分用户兴趣,兼顾个体与群体行为洞察。
LLM-Driven Dual-Level Multi-Interest Modeling for Recommendation
- 双层建模:个体级用LLM分组兴趣,群体级合成行为丰富的虚拟用户
- 自适应调整兴趣粒度,解决大模型生成粗细不当问题
- 适合推荐系统研究者,尤其关注兴趣建模与大模型融合
近期研究致力于基于用户行为或辅助信号建模多兴趣,但现有方法常依赖启发式假设(如共现物品代表同一兴趣),难以反映真实场景。尽管大语言模型(LLMs)在多兴趣分析中展现潜力,仍面临两大挑战:一是其兴趣粒度无明确控制,易导致兴趣分组过细或过粗;二是个体用户数据稀疏,分析局限。本文提出一种基于大模型的双层多兴趣建模框架。在用户个体层面,利用LLM将用户交互物品灵活划分为不同语义簇,表示其多样化兴趣;为缓解粒度不固定问题,通过对齐模块将语义簇与全局用户-物品交互学习得到的协同兴趣进行自适应匹配,实现粒度自动调整。在用户群体层面,提出将用户群集聚合成行为丰富的合成用户,以增强分析深度;通过最大覆盖问题保证合成用户行为的紧凑性与代表性,并基于其多兴趣表示进行对比学习,解耦不同兴趣下的物品表征。在真实数据集上的实验表明,该方法优于当前最优基线。
原文摘要 · Abstract (English)
Recently, much effort has been devoted to modeling users' multi-interests based on their behaviors or auxiliary signals. However, existing methods often rely on heuristic assumptions, e.g., co-occurring items indicate the same interest of users, failing to capture user multi-interests aligning with real-world scenarios. While large language models (LLMs) show significant potential for multi-interest analysis due to their extensive knowledge and powerful reasoning capabilities, two key challenges remain. First, the granularity of LLM-driven multi-interests is agnostic, possibly leading to overly fine or coarse interest grouping. Second, individual user analysis provides limited insights due to the data sparsity issue. In this paper, we propose an LLM-driven dual-level multi-interest modeling framework for more effective recommendation. At the user-individual level, we exploit LLMs to flexibly allocate items engaged by users into different semantic clusters, indicating their diverse and distinct interests. To alleviate the agnostic generation of LLMs, we adaptively assign these semantic clusters to users' collaborative multi-interests learned from global user-item interactions, allowing the granularity to be automatically adjusted according to the user's behaviors using an alignment module. To alleviate the limited insights derived from individual users' behaviors, at the user-crowd level, we propose aggregating user cliques into synthesized users with rich behaviors for more comprehensive LLM-driven multi-interest analysis. We formulate a max covering problem to ensure the compactness and representativeness of synthesized users' behaviors, and then conduct contrastive learning based on their LLM-driven multi-interests to disentangle item representations among different interests. Experiments on real-world datasets show the superiority of our approach against state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。