用生成式框架统一搜索与推荐,提升模型对用户意图的理解能力。
Unifying Search and Recommendation with Dual-View Representation Learning in a Generative Paradigm
- 通过任务特定提示划分参数空间,增强输入与输出间的互信息。
- 在两个公开数据集上,搜索与推荐任务均超越现有最佳方法。
- 适合关注多任务统一建模、提升用户行为理解的研究者。
推荐系统与搜索引擎是在线平台的核心组件,前者主动推送信息,后者支持用户主动检索。将两者统一于共享模型中具有潜力,可增强用户建模与物品理解。以往方法多采用判别式范式,使用共享编码器处理输入特征,任务专用头分别执行各项任务。然而该范式面临梯度冲突与人工设计复杂两大挑战。从信息论视角看,这两问题可能源于优化过程中输入特征与任务特定输出间互信息过低。为此,本文提出GenSR,一种新的生成式统一搜索与推荐(S&R)范式,通过任务特定提示将模型参数空间划分为子空间,从而提升互信息。GenSR首先为每个子空间构建信息丰富的表示,再在统一模型中联合优化。其核心包含两模块:(1) 双视图表示学习,独立建模协同与语义历史信息以获得丰富物品表征;(2) S&R任务统一,结合对比学习与指令微调,有效生成任务特定输出。在两个公开数据集上的大量实验表明,GenSR在各项S&R任务中均优于当前最优方法。本工作从互信息角度揭示了生成式范式的优越性,为统一建模提供了新思路。
原文摘要 · Abstract (English)
Recommender systems and search engines serve as foundational elements of online platforms, with the former delivering information proactively and the latter enabling users to seek information actively. Unifying both tasks in a shared model is promising since it can enhance user modeling and item understanding. Previous approaches mainly follow a discriminative paradigm, utilizing shared encoders to process input features and task-specific heads to perform each task. However, this paradigm encounters two key challenges: gradient conflict and manual design complexity. From the information theory perspective, these challenges potentially both stem from the same issue -- low mutual information between the input features and task-specific outputs during the optimization process. To tackle these issues, we propose GenSR, a novel generative paradigm for unifying search and recommendation (S&R), which leverages task-specific prompts to partition the model's parameter space into subspaces, thereby enhancing mutual information. To construct effective subspaces for each task, GenSR first prepares informative representations for each subspace and then optimizes both subspaces in one unified model. Specifically, GenSR consists of two main modules: (1) Dual Representation Learning, which independently models collaborative and semantic historical information to derive expressive item representations; and (2) S&R Task Unifying, which utilizes contrastive learning together with instruction tuning to generate task-specific outputs effectively. Extensive experiments on two public datasets show GenSR outperforms state-of-the-art methods across S&R tasks. Our work introduces a new generative paradigm compared with previous discriminative methods and establishes its superiority from the mutual information perspective.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。