将大模型推荐性能迁移到轻量级模型,解决工业部署效率难题。
Rec-Distill: An Industrial Distillation Pipeline for Large-Scale Recommendation Models

- 分阶段训练+黑盒蒸馏,实现大模型到轻量模型的高效迁移
- 蒸馏转移率超60%,在真实平台上线后显著提升业务指标
- 适配动态推荐场景,支持高并发低延迟部署
大规模推荐模型在扩展定律下展现出显著性能提升,但实际工业部署受限于轻量化模型对服务效率和延迟的严格要求,导致离线扩展与在线部署间存在根本差距。本文提出 Rec-Distill,一个工业级蒸馏流水线,将大规模推荐模型的性能优势迁移至可高效部署的轻量模型。该方法结合大教师模型扩展与学生端的解耦训练、黑盒蒸馏、去偏机制及混合批处理-流式管道,以适应动态推荐环境。在多个真实平台的推荐与广告场景中,教师模型规模达240亿参数、行为序列长度达2万,而轻量学生模型成功恢复了超过60%的教师性能增益。大量离线与在线实验表明,这些迁移收益在工业约束下持续转化为可衡量的业务增长。结果证明,Rec-Distill为将大规模推荐模型蒸馏为可部署、低成本的服务系统提供了实用框架,并为未来进一步扩展推荐模型规模铺平道路。
原文摘要 · Abstract (English)
Large recommendation models have demonstrated substantial potential gains under scaling laws, yet these gains are difficult to realize in industrial recommendation systems because real-world deployment requires lightweight models with strict serving efficiency and latency guarantees. This creates a fundamental gap between offline model scaling and online deployment. In this work, we present Rec-Distill, an industrial distillation pipeline that transfers the performance gains of large-scale recommendation modeling to efficient serving models. Rec-Distill combines large-teacher scaling with student-side transfer optimization through decoupled training, black-box distillation, debiasing mechanism, and a hybrid batch-streaming pipeline for dynamic recommendation environments. Across multiple recommendation and advertising scenarios on real-world platforms, our framework scales teacher models up to 24B dense parameters and 20K behavior sequence length, while enabling lightweight students to recover a substantial portion of teacher gains, with distillation transferability exceeding 60% in the best setting. Extensive offline and online experiments further show that these transferred gains consistently translate into measurable business improvements under industrial constraints. These results demonstrate that Rec-Distill provides a practical framework for distilling large-scale recommendation models into deployable, cost-efficient serving systems, while also establishing a reliable path toward scaling recommendation models to even larger regimes in the future.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。