用大模型生成视频推荐标识,提升Snapchat用户观看时长。
LLM-Based Generative Retrieval for Snapchat Content Recommendation

- 用多模态嵌入生成语义编码,结合协同信号增强检索精度。
- 通过持续预训练和微调,让模型在低延迟下稳定生成有效标识。
- 系统上线后观看时长提升0.37%,适合大规模推荐系统研发者参考。
预训练大语言模型具备丰富的语义先验、强大的序列建模能力与良好的可扩展性,是理想的检索引擎。但将其部署为生成式检索系统面临挑战:需学习预训练中不存在的物品词汇,并在严苛的延迟与成本约束下生成有效物品标识。本文提出SnapLGR,一个用于Snapchat短视频推荐的基于大模型的生成式检索系统。系统包含三大设计:首先,从多模态物品嵌入构建语义标识符(SIDs),并利用基于个性化页排名(PPR)的共互动对比学习,提升码本利用率,减少冲突,融入协同信号;其次,在监督微调前通过持续预训练(CPT)对引入的SID token进行语义锚定;第三,通过TensorRT-LLM CUDA加速的束搜索与去中心化工作线程架构,实现高效服务。在线A/B测试显示,相比现有TIGER风格基线,系统使观看时长提升0.37%,停留时长提升0.09%,深度会话数提升0.18%,深度会话独立用户数提升0.11%。进一步在固定分词器下分解离线差距,量化了模型架构、规模与预训练带来的增益。结果表明,生产级成功部署需在表示学习、词汇锚定与高效训练推理间协同设计。
原文摘要 · Abstract (English)
Pretrained large language models (LLMs) are promising retrieval engines because they combine rich semantic priors, strong sequence modeling capabilities, and favorable scaling behavior. However, turning a pretrained LLM into a generative retriever in production deployment raises several challenges: the model must learn an internal item vocabulary that was absent from pretraining, and generate valid item identifiers under strict latency and cost constraints. We address these challenges through the design and launch of SnapLGR, an LLM-based generative retrieval system for short-video recommendation at Snapchat. The system is built around three main designs. First, we construct semantic identifiers (SIDs) from multimodal item embeddings and enhance them with Personalized PageRank (PPR)-based co-engagement contrastive learning, resulting in improved codebook utilization, reduced collisions, and infused collaborative signal. Second, we use continued pretraining (CPT) to ground the introduced SID tokens before supervised fine-tuning (SFT) on user interaction sequences. Third, we make SnapLGR serving practical through TensorRT-LLM CUDA-backed beam search and a decentralized worker-loop architecture. In a live A/B test, the launched system increased View Time by 0.37%, Time Spent by 0.09%, Deep Sessions by 0.18%, and Deep Sessions Unique User by 0.11% relative to the existing TIGER-style generative retrieval baseline. We then decompose this offline gap under a fixed tokenizer and quantify the gains due to model architecture, scaling, and pretraining. Overall, our deployment shows that successful production SnapLGR requires joint design across representation learning, vocabulary grounding, and efficient training and serving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。