一个模型搞定搜索与推荐,提升精准度且省去繁琐工程。
SynerGen: Contextualized Generative Recommender for Unified Search and Recommendation
- 用统一生成框架替代传统分步流程,端到端优化
- 在多个基准上超越现有方法,搜索推荐双优
- 适合需要一体化信息检索的工业级应用
大规模推荐系统中主流的检索-排序流水线因架构分离和目标不一致,存在校准偏差与工程开销问题。尽管生成式序列模型有望通过自回归生成排序结果来统一检索与排序,但现有方案通常只覆盖个性化搜索或无查询推荐,试图融合两者时常出现性能折衷。本文提出SynerGen,一种新型生成式推荐模型,以单一生成主干同时支持个性化搜索与推荐,且在检索与排序任务中均表现优异。基于行为序列训练的解码器仅Transformer,采用InfoNCE联合优化检索,结合点对点与成对损失优化排序,使搜索的语义信号反哺推荐,反之亦然。我们还引入新颖的时间感知旋转位置嵌入,有效将时间信息融入注意力机制。实验表明,SynerGen在广泛采用的推荐与搜索基准上显著优于强基线生成推荐模型及联合搜索推荐模型。该工作验证了单个生成基础模型在工业级统一信息访问中的可行性。
原文摘要 · Abstract (English)
The dominant retrieve-then-rank pipeline in large-scale recommender systems suffers from mis-calibration and engineering overhead due to its architectural split and differing optimization objectives. While recent generative sequence models have shown promise in unifying retrieval and ranking by auto-regressively generating ranked items, existing solutions typically address either personalized search or query-free recommendation, often exhibiting performance trade-offs when attempting to unify both. We introduce \textit{SynerGen}, a novel generative recommender model that bridges this critical gap by providing a single generative backbone for both personalized search and recommendation, while simultaneously excelling at retrieval and ranking tasks. Trained on behavioral sequences, our decoder-only Transformer leverages joint optimization with InfoNCE for retrieval and a hybrid pointwise-pairwise loss for ranking, allowing semantic signals from search to improve recommendation and vice versa. We also propose a novel time-aware rotary positional embedding to effectively incorporate time information into the attention mechanism. \textit{SynerGen} achieves significant improvements on widely adopted recommendation and search benchmarks compared to strong generative recommender and joint search and recommendation baselines. This work demonstrates the viability of a single generative foundation model for industrial-scale unified information access.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。