多目标推荐中实现共享建模与目标可控生成
Multi-Decoder OneRec: Controllable Generative Retrieval for Multi-Objective Industrial Recommendation

- 用共享编码+独立专家解码,分离通用与目标专用能力
- 在512候选预算下,召回率提升1.69%-5.62%
- 适合需要多目标平衡的工业级推荐系统
工业推荐系统通过为不同目标分配显式配额构建候选池,虽可控制配额但随路径增多导致建模、训练与推理日益割裂。基于语义ID的生成式检索提供统一方案,但单解码器会纠缠目标策略并限制候选互补性。本文提出多解码器一体推荐框架(Multi-Decoder OneRec),融合共享表征、目标隔离适配与协同解码。所有目标共享用户上下文模块和通用解码器,每项目标附加参数高效的LoRA专家。训练时,曝光样本下一步词预测更新共享基座,目标过滤的下一步词预测更新事件型专家,KL正则化策略优化更新观看时长专家;梯度路由隔离更新,通用解码器提供停止梯度参考。推理时,显式路径配额分配固定预算,多解码器约束束搜索减少跨路径重叠。公开发布Kwai26数据集,包含13.1亿条原始物品级记录、3185万项物品ID条目及2503万具有有效语义ID的物品,附带预定义划分与评估协议。在相同512候选预算下,相较单解码器基线,多解码器一体推荐在四个Recall@512指标上提升1.69%-5.62%。生产环境A/B测试显示,应用时长提升0.37%,第7日留存率提升0.19%,至少分享一次设备占比提升0.19%,新内容冷启动转化率提升2.09%。结果表明,生成式检索可在共享建模与目标控制间取得平衡,并实现互补候选生成。
原文摘要 · Abstract (English)
Industrial recommender systems build candidate pools by assigning explicit quotas to objective-specific retrieval routes. This design offers quota control but increasingly fragments modeling, training, and serving as the route set grows. Semantic-ID-based generative retrieval provides a unified alternative, yet a single decoder entangles objective policies and limits candidate complementarity. We propose Multi-Decoder OneRec, a controllable framework that combines shared representations, isolated objective adaptation, and coordinated decoding. All objectives share a user-context module and the General Decoder, while each objective adds an isolated, parameter-efficient LoRA expert. During training, exposure-sample next-token prediction (NTP) updates the shared base, target-filtered NTP updates the event-based experts, and Kullback-Leibler (KL)-regularized policy optimization updates the Watch-time expert; gradient routing isolates these updates, and the General Decoder supplies a stop-gradient reference. At inference, explicit route quotas allocate the fixed budget and Multi-Decoder Constrained Beam Search reduces cross-route overlap. We publicly release Kwai26, a large-scale multi-objective benchmark with 1.31 billion raw item-level records, 31.85 million Item-ID entries, and 25.03 million items with valid Semantic IDs, together with predefined splits and an evaluation protocol. Under the same 512-item retrieval budget, Multi-Decoder OneRec improves over the single-decoder OneRec baseline by 1.69%-5.62% across four Recall@512 metrics. In a production A/B test, it yields relative gains of 0.37% in app usage time per device, 0.19% in Day-7 retained users, 0.19% in devices with at least one share, and 2.09% in new-content Cold-Start. These results show that generative retrieval can combine shared modeling with objective-specific control and complementary candidate generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。