让检索索引与排序目标对齐,提升大规模推荐系统效率与效果
OneShot: Index-in-Ranking with Neural Scoring for Large-Scale Retrieval

- 将索引学习与排序目标联合优化,实现端到端对齐
- 在同等召回率下效率提升10倍,召回率提升20%
- 已在Instagram工业系统落地,显著提升用户时长与活跃度
现代推荐系统中,检索阶段需从数十亿候选物品中快速筛选出数千个供后续精排。传统方法中,排序精度与索引效率目标常相冲突:前者关注预测与用户行为的对齐,后者依赖结构化分组实现高效搜索。尽管持续优化交互建模,仍受限于排序目标与近邻索引结构之间的错位。本文提出OneShot框架,一种端到端、模型内索引学习的新范式,天然对齐索引学习与排序目标。基于此联合学习结构,OneShot突破了传统点积瓶颈,通过神经评分大幅扩展交互建模能力。该方案已全量部署于Instagram短视频推荐系统,显著提升用户日均会话时长、互动与停留时间;同时在实际运营规模下实现20%召回率提升,同等召回水平下效率提升10倍。
原文摘要 · Abstract (English)
In modern recommendation systems, retrieval serves as a primary stage responsible for filtering billions of candidate items down to thousands prior to refined ranking. To make this massive search effective and efficient, the system relies on ranking accuracy and indexing efficiency. However, these two objectives are traditionally misaligned: while the former optimizes for the alignment between ranking predictions and user behavior, the latter optimizes for a structural grouping of item representations which enables fast search among billions of candidates. Thus, despite extensive efforts to scale up interaction modeling for retrieval, they remain fundamentally limited by the structural misalignment between the ranking objectives and the proximity-learned index. In this work, we address this long-standing dichotomy by proposing a new holistic retrieval framework, OneShot. It is an end-to-end, in-model index learning framework that natively aligns index learning with ranking objectives. Using this joint learning as a structural foundation, OneShot pushes the boundaries of retrieval expressiveness by scaling interaction modeling with neural scoring beyond the persistent dot-product bottleneck. OneShot is fully deployed in Instagram's industrial short-video recommendation system, driving significant wins in user daily sessions, engagement, and time-spent. Additionally, OneShot achieves a $20\%$ recall gain at the operational ranking volume and a 10x efficiency improvement at an equivalent recall level.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。