arXiv:2502.08309cs.IR2025-02被引 28

提出三步法大用户模型,让推荐系统突破工业场景下的可扩展性瓶颈。

Unlocking Scaling Law in Industrial Recommendation Systems with a Three-step Paradigm based Large User Model

  • 构建三步范式的大用户模型,兼顾工业需求与模型扩展性。
  • 模型规模达70亿参数时性能持续提升,优于主流深度学习和生成式推荐方法。
  • 已在工业场景落地,A/B测试验证显著收益,适合大规模推荐系统优化。

近年来自回归大语言模型(LLMs)的进展主要得益于其可扩展性,即所谓的“缩放定律”。受此启发,研究者尝试将推荐系统(RecSys)任务重构为生成问题,以应用大语言模型。然而,这类端到端生成推荐(E2E-GR)方法往往追求理想化目标,牺牲了传统深度学习推荐模型(DLRMs)在特征、架构和实践上的实际优势。这种理想与现实的脱节限制了工业推荐系统中缩放定律的发挥。本文提出一种大用户模型(LUM),通过三步范式解决上述问题,在满足工业严苛要求的同时释放推荐系统的可扩展潜力。大量实验表明,LUM显著优于当前最先进的DLRM与E2E-GR方法。尤其值得注意的是,当模型规模扩大至70亿参数时,性能仍持续提升。此外,我们已在工业应用中成功部署该模型,并在A/B测试中取得显著增长,进一步验证其有效性和实用性。

原文摘要 · Abstract (English)

Recent advancements in autoregressive Large Language Models (LLMs) have achieved significant milestones, largely attributed to their scalability, often referred to as the "scaling law". Inspired by these achievements, there has been a growing interest in adapting LLMs for Recommendation Systems (RecSys) by reformulating RecSys tasks into generative problems. However, these End-to-End Generative Recommendation (E2E-GR) methods tend to prioritize idealized goals, often at the expense of the practical advantages offered by traditional Deep Learning based Recommendation Models (DLRMs) in terms of in features, architecture, and practices. This disparity between idealized goals and practical needs introduces several challenges and limitations, locking the scaling law in industrial RecSys. In this paper, we introduce a large user model (LUM) that addresses these limitations through a three-step paradigm, designed to meet the stringent requirements of industrial settings while unlocking the potential for scalable recommendations. Our extensive experimental evaluations demonstrate that LUM outperforms both state-of-the-art DLRMs and E2E-GR approaches. Notably, LUM exhibits excellent scalability, with performance improvements observed as the model scales up to 7 billion parameters. Additionally, we have successfully deployed LUM in an industrial application, where it achieved significant gains in an A/B test, further validating its effectiveness and practicality.

推荐系统大模型可扩展性工业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。