Gryphon统一生成语义ID并直接打分,提升工业推荐精准度。
Gryphon: A Unified Architecture for Semantic-ID Generation and Item-Level Scoring in Industrial Recommendations

- 用联合训练的打分模块替代传统序列似然评分,直接对物品打分
- 在音乐推荐数据上召回率提升3.7%(相比基础生成检索)
- 可替换15个候选生成模块,简化系统且不降低用户时长
生成式检索(GR)通过为每个物品分配一个短的层级标记序列(语义ID,SID)实现可扩展的候选生成:下一个物品的SID通过自回归解码生成。但实际中,解码器的束搜索优化的是标记序列的似然性,而非底层物品的相关性。当序列似然性因束搜索误差累积而校准不佳,或多个物品共用同一SID导致评分相同,二者目标便出现偏差。本文提出Gryphon,一种编码器-解码器结构的生成式推荐架构,在生成语义ID的同时引入联合训练的物品级打分组件,复用单次前向传播中编码器生成的用户表示。不再依据累积的标记似然对语义ID排序,而是将生成的每个SID映射回具体物品并直接重打分,从而避免校准错误,区分同标识的物品。在某工业级音乐服务平台上,基于下一步物品预测目标训练物品级打分后,Gryphon在参数量和延迟相近的情况下,达到最高的物品级召回率@1000,优于最强基线(+3.7% 超越基础GR,+2.5% 超越去重版GR)。其物品级排序性能也显著超越同一候选集的束搜索似然排序(+4.2%)。7天A/B测试中,作为唯一候选源部署,总听歌时长无统计显著差异(+0.25%),同时替代了超过15个候选生成模块和独立预排序阶段,大幅简化系统。
原文摘要 · Abstract (English)
Generative retrieval (GR) has become a scalable approach to candidate generation: each item is assigned a short hierarchical token sequence called a Semantic ID (SID), and the next item's SID is decoded autoregressively. A practical limitation is that the decoder's beam search optimizes the likelihood of token sequences, not the relevance of the underlying items. These objectives diverge when sequence likelihood is poorly calibrated due to beam search error accumulation, and when several items collapse onto a single SID and receive identical scores. We introduce Gryphon, an encoder-decoder generative recommendation architecture that adds a jointly trained item-level scoring component alongside SID generation, reusing the encoder's user representation computed in a single forward pass. Instead of ranking SIDs by accumulated token likelihood, Gryphon resolves each generated SID to its concrete items and re-scores those items directly, which sidesteps miscalibrated sequence scores and separates items that collide on the same identifier. On an industrial music service, with item-level scoring trained under a next-item-prediction objective, Gryphon attains the highest item-level Recall@1000, above the strongest baselines (+3.7% over vanilla GR and +2.5% over collision-resolved GR) at comparable parameter count and latency. Gryphon's item-level ranking also surpasses its beam-likelihood ranking of the same candidates (+4.2% gain), demonstrating the benefit of item-level scoring in GR. Deployed as the sole candidate source in a 7-day A/B test, Gryphon produced no statistically significant change in total listening time (+0.25%) while replacing a pipeline of more than 15 candidate generators and a separate preranking stage, substantially simplifying the candidate-generation system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。