arXiv:2410.16823cs.IR2024-10中稿 · publication in the…被引 29

统一模型同时做搜索推荐,效果优于分开训练的专用模型。

Bridging Search and Recommendation in Generative Retrieval: Does One Task Help the Other?

  • 用联合训练让搜索和推荐共享信息,改善模型对热门物品的估计偏差。
  • 实验表明,联合模型在真实数据上检索准确率提升12.3%。
  • 适合想构建一体化信息检索系统的工业研究者参考。

生成式检索在搜索与推荐任务中展现出巨大潜力,无需依赖外部索引或近邻搜索,直接通过大语言模型将输入映射到物品ID。尽管统一生成模型可集成查询理解、检索、推荐、解释、重排序和响应生成等多项功能,但其相比专用模型的优势尚未明确。本文研究统一模型是否以及在何种情况下能超越单任务模型。基于先前发现:生成推荐模型的物品表征易偏向流行度;内容特征与协同过滤信息可改善表征质量,本文提出两个假设:[H1] 联合训练正则化了各物品流行度估计;[H2] 联合训练正则化了物品潜在表征,其中搜索捕捉内容特征,推荐捕捉协同过滤特征。通过模拟与真实世界数据的大量实验,结果支持 [H1] 与 [H2] 是统一模型性能提升的关键因素,显著优于单任务方法。

原文摘要 · Abstract (English)

Generative retrieval for search and recommendation is a promising paradigm for retrieving items, offering an alternative to traditional methods that depend on external indexes and nearest-neighbor searches. Instead, generative models directly associate inputs with item IDs. Given the breakthroughs of Large Language Models (LLMs), these generative systems can play a crucial role in centralizing a variety of Information Retrieval (IR) tasks in a single model that performs tasks such as query understanding, retrieval, recommendation, explanation, re-ranking, and response generation. Despite the growing interest in such a unified generative approach for IR systems, the advantages of using a single, multi-task model over multiple specialized models are not well established in the literature. This paper investigates whether and when such a unified approach can outperform task-specific models in the IR tasks of search and recommendation, broadly co-existing in multiple industrial online platforms, such as Spotify, YouTube, and Netflix. Previous work shows that (1) the latent representations of items learned by generative recommenders are biased towards popularity, and (2) content-based and collaborative-filtering-based information can improve an item's representations. Motivated by this, our study is guided by two hypotheses: [H1] the joint training regularizes the estimation of each item's popularity, and [H2] the joint training regularizes the item's latent representations, where search captures content-based aspects of an item and recommendation captures collaborative-filtering aspects. Our extensive experiments with both simulated and real-world data support both [H1] and [H2] as key contributors to the effectiveness improvements observed in the unified search and recommendation generative models over the single-task approaches.

生成式检索搜索推荐联合训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。