为大规模广告设计的生成式推荐系统,提升收入且高效推理。
Generative Recommendation for Large-Scale Advertising
- 用统一广告语义ID和懒加载自回归解码,降低推理开销。
- 在线测试显示广告收入最高提升4.2%,支持模型与推理扩展。
- 适合工业界做广告推荐系统升级,尤其关注实时性与收益优化。
生成式推荐因具备扩展潜力和更强模型能力,近年来在工业界受到广泛关注。然而,在大规模广告场景中实现实时生成推荐需超越传统大语言模型的训练与服务范式。本文提出面向生产环境的生成式推荐系统GR4AD(Generative Recommendation for ADdvertising),从架构、学习到服务协同设计。在分词层面,提出UA-SID(Unified Advertisement Semantic ID)以捕捉复杂业务信息;引入LazyAR懒加载自回归解码器,打破层间依赖,实现短序列多候选生成,兼顾效果并降低推理成本,支持在固定服务预算下扩展。为对齐优化目标与业务价值,采用VSL(Value-Aware Supervised Learning),并提出RSPO(Ranking-Guided Softmax Preference Optimization),一种基于排名感知的列表级强化学习算法,可在列表级指标下持续优化价值奖励。在线推理方面,提出动态束宽服务机制,根据生成层级与负载自适应调整束宽以控制计算资源。大规模线上A/B测试表明,相比现有DLRM基线系统,广告收入最高提升4.2%,且模型扩展与推理扩展均带来稳定增益。GR4AD已在快手广告系统全面部署,服务超4亿用户,实现高吞吐实时推理。
原文摘要 · Abstract (English)
Generative recommendation has recently attracted widespread attention in industry due to its potential for scaling and stronger model capacity. However, deploying real-time generative recommendation in large-scale advertising requires designs beyond large-language-model (LLM)-style training and serving recipes. We present a production-oriented generative recommender co-designed across architecture, learning, and serving, named GR4AD (Generative Recommendation for ADdvertising). As for tokenization, GR4AD proposes UA-SID (Unified Advertisement Semantic ID) to capture complicated business information. Furthermore, GR4AD introduces LazyAR, a lazy autoregressive decoder that relaxes layer-wise dependencies for short, multi-candidate generation, preserving effectiveness while reducing inference cost, which facilitates scaling under fixed serving budgets. To align optimization with business value, GR4AD employs VSL (Value-Aware Supervised Learning) and proposes RSPO (Ranking-Guided Softmax Preference Optimization), a ranking-aware, list-wise reinforcement learning algorithm that optimizes value-based rewards under list-level metrics for continual online updates. For online inference, we further propose dynamic beam serving, which adapts beam width across generation levels and online load to control compute. Large-scale online A/B tests show up to 4.2% ad revenue improvement over an existing DLRM-based stack, with consistent gains from both model scaling and inference-time scaling. GR4AD has been fully deployed in Kuaishou advertising system with over 400 million users and achieves high-throughput real-time serving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。