用视觉语言模型推理用户看完视频后可能想看什么,推荐更精准的后续内容。
NEXT: Reasoning-Driven Video Recommendation via a Vision-Language Model

- 通过视频理解推断用户潜在观看意图,生成查询并匹配下一视频。
- 在真实系统中提升观看时长0.53%、新视频曝光0.51%,显著优于基线。
- 仅80亿参数模型即可实现高效推理,适合大规模部署。
我们提出NEXT(Next-interest EXploration Transformer),一种基于推理的视频推荐框架,能够分析用户刚观看的视频,推断其下一兴趣意图,并检索具体后续视频。显式延续(如剧集)直接关联;隐式场景通过生成意图查询并搜索匹配候选。该物品-意图-物品范式超越了共互动相关性或语义相似性。为实现规模化可靠运行,我们训练了专用于此任务的80亿参数视觉语言模型NEXT-8B,采用三阶段策略:感知增强的无查询强化学习用于证据提取,基于真实与合成视觉问答混合数据的分布对齐监督微调,以及组相对策略优化进行最终对齐。NEXT-8B在DocVQA任务中表现最佳,仅次于多智能体系统,且优于规模达2000亿以上的模型;在任务特定的LLM评分中,意图逻辑质量比基线提升3.3%。我们将NEXT部署于大规模社交媒体推荐系统,作为额外召回路径,观察到统计显著的生产收益:观看时长提升0.53%,新视频曝光提升0.51%。总体表明,经过精心训练的小型视觉语言模型可在生产级规模上充当有效的推理引擎。
原文摘要 · Abstract (English)
We present NEXT (Next-interest EXploration Transformer), a reasoning-driven video recommendation framework that reasons over the video a user has just watched, infers the viewer's next intent, and retrieves concrete follow-up videos. Explicit continuations such as episodes are linked directly; implicit cases are handled by generating intent queries and searching for matching candidates. This Item-to-Intent-to-Item formulation produces directed recommendations beyond co-engagement correlation or semantic similarity. To make this framework reliable at scale, we train NEXT-8B, a purpose-trained 8B vision-language model with a three-stage recipe: Perception-Enhanced Reinforcement Learning for query-agnostic evidence extraction, Distribution-Aligned Supervised Fine-Tuning over real and synthetic visual QA mixtures, and Group Relative Policy Optimization for last-mile alignment. NEXT-8B achieves the best single-model DocVQA performance, ranking second overall only behind a multi-agent system while surpassing a substantially larger 200B+ scale model, and improves next-intent logic-wise quality by 3.3% over the base model in a task-specific LLM-as-a-judge evaluation. We deploy NEXT as an additional retrieval path in a large-scale social media recommendation system and observe statistically significant production gains, including +0.53% watch time and +0.51% distinct video exposure. Overall, NEXT shows that a carefully trained compact vision-language model can serve as a practical reasoning engine for next-interest exploration at production scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。