用端到端生成模型重构推荐系统,显著提升效率与效果
OneRec Technical Report
- 采用端到端生成架构替代传统多阶段流程
- 训练与推理时模型算力利用率分别达23.7%和28.8%
- 已在快手应用落地,降低运营成本至原来的10.6%
推荐系统在各大用户平台已广泛应用多年,但相较于人工智能领域的快速进展,近年来未取得突破性进展。例如,仍依赖多阶段级联架构而非端到端方案,导致计算碎片化与优化不一致,阻碍了人工智能关键成果在推荐场景中的有效应用。为此,我们提出OneRec,通过端到端生成方法重构推荐系统,并取得显著成效。首先,将当前推荐模型的计算量(FLOPs)提升10倍,并在一定范围内识别出推荐系统的缩放规律;其次,强化学习技术在此框架下展现出巨大潜力,此前难以应用于推荐优化;最后,通过基础设施优化,训练与推理阶段在旗舰GPU上的模型浮点运算利用率(MFU)分别达到23.7%和28.8%,接近大语言模型(LLM)社区水平。该架构大幅减少通信与存储开销,使运营成本仅为传统推荐流水线的10.6%。部署于快手/快手极速版应用后,处理了25%的每秒查询量,分别提升整体应用停留时长0.54%和1.24%,并显著改善7日生命周期等关键体验指标。我们还总结了构建、优化与维护大规模生产级推荐系统所获得的实践经验。
原文摘要 · Abstract (English)
Recommender systems have been widely used in various large-scale user-oriented platforms for many years. However, compared to the rapid developments in the AI community, recommendation systems have not achieved a breakthrough in recent years. For instance, they still rely on a multi-stage cascaded architecture rather than an end-to-end approach, leading to computational fragmentation and optimization inconsistencies, and hindering the effective application of key breakthrough technologies from the AI community in recommendation scenarios. To address these issues, we propose OneRec, which reshapes the recommendation system through an end-to-end generative approach and achieves promising results. Firstly, we have enhanced the computational FLOPs of the current recommendation model by 10 $\times$ and have identified the scaling laws for recommendations within certain boundaries. Secondly, reinforcement learning techniques, previously difficult to apply for optimizing recommendations, show significant potential in this framework. Lastly, through infrastructure optimizations, we have achieved 23.7% and 28.8% Model FLOPs Utilization (MFU) on flagship GPUs during training and inference, respectively, aligning closely with the LLM community. This architecture significantly reduces communication and storage overhead, resulting in operating expense that is only 10.6% of traditional recommendation pipelines. Deployed in Kuaishou/Kuaishou Lite APP, it handles 25% of total queries per second, enhancing overall App Stay Time by 0.54% and 1.24%, respectively. Additionally, we have observed significant increases in metrics such as 7-day Lifetime, which is a crucial indicator of recommendation experience. We also provide practical lessons and insights derived from developing, optimizing, and maintaining a production-scale recommendation system with significant real-world impact.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。