用大模型融合协同信号,提升多任务推荐效果
Collaborative Knowledge Fusion: A Novel Approach for Multi-task Recommender Systems via LLMs
- 通过协同过滤生成用户嵌入,构建个性化映射桥接大模型
- 在四个数据集上多任务表现优于基线,显著提升推荐精度
- 适合需要多任务协同优化的推荐系统研究者
由于大语言模型(LLMs)具备出色的通用智能,将其融入推荐系统以深入理解人类兴趣与意图成为趋势。现有方法主要利用物品属性和用户交互文本,仅针对单一任务如评分预测或可解释推荐进行优化,忽视了传统协同信号在揭示深层意图中的作用,以及任务间的关联性。为此,本文提出一种新框架CKF,通过将传统协同过滤模型生成的协同嵌入,经由元网络构建个性化映射桥梁,再注入精心设计的提示模板输入先进大模型,以表征用户兴趣。为挖掘不同推荐任务间的内在联系,提出Multi-Lora方法,实现参数高效多任务优化,能有效分离共享与特定任务信息。该方法建立大模型与推荐场景的连接,并通过任务间知识迁移增强监督信号。在四个公开数据集上,涵盖四种常见推荐任务的大量实验及鲁棒性分析验证了框架的有效性与优越性。
原文摘要 · Abstract (English)
Owing to the impressive general intelligence of large language models (LLMs), there has been a growing trend to integrate them into recommender systems to gain a more profound insight into human interests and intentions. Existing LLMs-based recommender systems primarily leverage item attributes and user interaction histories in textual format, improving the single task like rating prediction or explainable recommendation. Nevertheless, these approaches overlook the crucial contribution of traditional collaborative signals in discerning users' profound intentions and disregard the interrelatedness among tasks. To address these limitations, we introduce a novel framework known as CKF, specifically developed to boost multi-task recommendations via personalized collaborative knowledge fusion into LLMs. Specifically, our method synergizes traditional collaborative filtering models to produce collaborative embeddings, subsequently employing the meta-network to construct personalized mapping bridges tailored for each user. Upon mapped, the embeddings are incorporated into meticulously designed prompt templates and then fed into an advanced LLM to represent user interests. To investigate the intrinsic relationship among diverse recommendation tasks, we develop Multi-Lora, a new parameter-efficient approach for multi-task optimization, adept at distinctly segregating task-shared and task-specific information. This method forges a connection between LLMs and recommendation scenarios, while simultaneously enriching the supervisory signal through mutual knowledge transfer among various tasks. Extensive experiments and in-depth robustness analyses across four common recommendation tasks on four large public data sets substantiate the effectiveness and superiority of our framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。