arXiv:2605.23312cs.IR2026-05被引 1

超大规模生成式推荐模型在生产中需平衡扩展性与效率,兼顾冷启动和延迟问题。

Towards Generalizable and Efficient Large-Scale Generative Recommenders

  • 用多令牌预测对齐服务延迟,提升推理效率
  • 10亿参数模型在100万用户测试中全任务优于200万参数基线
  • 适配冷启动的语义塔结构,解决新物品评分难题

生成式推荐模型可将用户行为建模为事件序列,并支持多个推荐任务共享主干网络。但在实际应用中,预训练收益不会自动转化为下游性能提升:任务潜力、重复训练成本、服务延迟和物品新鲜度均影响迁移效果。我们介绍了将生成式推荐主干从200万扩展至10亿参数(不含嵌入和解码层)的经验,应用于大规模标题推荐场景。在多个下游任务中观察到任务依赖的缩放行为:部分任务在当前规模内已接近经验上限,而其他任务仍能从更大容量中获益。这促使采用偏移缩放律拟合作为判断额外扩展是否有效的诊断工具。随后研究了实际应用中的生产约束:在万亿级行为令牌上频繁重训练要求高效训练与解码;缓存服务可能导致下一个令牌目标过时;新上线标题需依赖语义元数据评分,直到协同嵌入可靠为止。为此,我们提出多令牌预测以对齐服务延迟,使用采样Softmax和投影解码头实现高效重复训练,并引入带协同嵌入掩码的语义物品塔应对冷启动。在覆盖100万用户的为期一周的生产影子评估中,10亿参数模型在所有报告任务上的MRR均优于200万参数基线。整体结果表明,模型规模应作为生产迁移问题的一部分,与其他因素如任务潜力、解码成本、服务延迟对齐和物品泛化能力共同考量。

原文摘要 · Abstract (English)

Generative recommendation models can model user behavior as sequences of events and provide a shared backbone for multiple recommendation tasks. In production, however, pre-training gains do not automatically translate into downstream application improvements: task headroom, repeated-training cost, serving latency, and item freshness all affect transfer. We describe our experience scaling a generative recommender from 2M to 1B backbone parameters, excluding embedding and decoding layers, in a production-scale title recommendation setting. Across multiple downstream tasks, we observe task-dependent scaling behavior: some tasks approach an empirical ceiling within the observed scale range, while others continue to benefit from additional capacity. This motivates using offset scaling-law fits as a diagnostic for where additional model scale may be more or less useful. We then study production constraints that arise when applying the model in practice. Frequent retraining over trillions of behavior tokens makes training and decoding efficiency important; cached serving can make the immediate next-token target stale; and newly launched titles may need to be scored from semantic metadata before collaborative ID embeddings are reliable. We address these issues with multi-token prediction for serving-latency alignment, sampled softmax and a projected decoding head for efficient repeated training, and semantic item towers with collaborative-embedding masking for cold-start adaptation. In a one-week production-shadow evaluation over 1M users, the 1B-backbone model achieves higher MRR than the 2M-backbone baseline across all reported tasks. Overall, the results support treating model scale as one component of a production transfer problem, alongside task headroom, decoding cost, serving-latency alignment, and item generalization.

生成推荐大模型冷启动服务延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。