Netflix用大模型重构推荐系统,用自然语言理解用户和内容,效果优于传统方法。
GenRec: An LLM-Backed Recommendation Ranker at Netflix

- 用自然语言描述用户历史和上下文,替代复杂特征工程
- 少量标注数据训练后,在线实验显著提升推荐效果
- 适合关注大模型应用与系统落地的推荐算法研究者
大型语言模型正重塑推荐系统,使用户、内容和上下文能以自然语言形式进行更丰富的建模。在Netflix,我们通过GenRec探索这一方向——一个基于内部基础大模型构建的生成式推荐排序器。该系统采用两阶段框架:第一阶段将开源大模型适配Netflix数据,深入理解内容库与用户行为;第二阶段使用推荐排序专用数据、标签和奖励信号对模型进行微调,使其对齐业务目标与长期用户满意度。本文聚焦第二阶段,阐述输入语义化、上下文工程、微调数据构建、奖励融合、模型架构及成本受限的仅预填充推理服务设计。大规模A/B测试显示,相较于现有生产模型,GenRec仅需更少的标注样本和输入信号,即可在离线与在线指标上取得统计显著提升。本研究揭示了推荐范式转变:从特征工程转向上下文工程,从定制架构转向共享基础模型。同时总结了实际部署中的关键经验。
原文摘要 · Abstract (English)
Large language models (LLMs) are reshaping recommender systems by enabling richer modeling of users, content, and context directly in natural language. At Netflix, we are exploring this direction through GenRec, an LLM-backed recommendation ranker built on top of an in-house foundational LLM. GenRec follows a two-phase framework: Phase 1 adapts an open-source LLM to Netflix data, developing deep understanding of the catalog and member behavior while balancing capabilities such as content understanding and instruction following. Phase 2 post-trains this foundation model with recommendation-ranking specific data, labels, and reward signals, aiming to align the ranker with business requirements and long-term member satisfaction. This paper focuses on Phase 2 and the transition from a traditional discriminative ranker with thousands of engineered features to an LLM-backed ranker driven by verbalized user histories and context. We describe our design for input verbalization and context engineering, post-training data construction, reward integration, model architecture, and a cost-constrained serving design based on a prefill-only inference approach. We report results from a large-scale A/B test comparing GenRec against the current production ranker model, where we show that a GenRec model trained with substantially fewer Phase-2 labeled training examples and input signals can achieve statistically significant gains in offline and online metrics. We discuss how LLM-backed recommenders could shift the recommendation paradigm: from feature engineering to context engineering, and from bespoke architectures to shared foundation backbones. We also outline practical lessons for serving such systems under real-world resource constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。