用大模型推理增强短视频到直播的推荐,提升冷启动表现
Bridging Short Videos and Live Streams: Reasoning-Guided Multimodal LLMs for Cross-Domain Representation Learning

- 用冻结大模型生成跨域推理知识,轻量化蒸馏到小模型
- 分离可迁移与领域特有表征,提升跨场景推荐效果
- 已在快手日均服务4亿用户,显著提升核心业务指标
随着直播服务发展,平台同时提供短视频和直播以满足多样化需求。短视频流量大、行为信号丰富,而直播转化关键但行为数据稀疏,冷启动问题严重。将短视频用户兴趣迁移到直播推荐可缓解此问题。由于短视频与直播均为复杂多模态内容,融合多模态信号有助于提升推荐性能。尽管多模态大语言模型(MLLM)具备强大理解与推理能力,其在跨域推荐中的应用仍较少。为此,本文提出基于推理引导的跨域表征学习框架RGCD-Rep,实现从短视频到直播的跨域推荐。该框架通过两阶段训练:第一阶段,利用冻结的教师MLLM生成结构化跨域推理知识,并高效蒸馏至轻量学生MLLM;第二阶段,通过可迁移性引导的跨域表征学习,将物品表征分解为可迁移部分与领域残差部分。表征离线计算后集成至下游召回任务,支持低成本工业部署。大量离线实验验证了该方法优越性。在快手直播推荐系统中上线后,A/B测试显示多个核心业务指标显著提升,证实其在真实工业场景中的有效性与实用性。目前,该系统已全面部署,日均服务超4亿用户。
原文摘要 · Abstract (English)
As live streaming services grow, many platforms offer short videos and live streams to meet diverse needs. Short videos carry substantial traffic and rich behavior signals, whereas live streaming is a core conversion scenario with sparse behavior data, making cold start severe. Transferring user interests from short videos to live streaming recommendation can alleviate these issues. Meanwhile, short videos and live streams are complex multimodal items, and integrating multimodal signals improves recommendation performance. Although Multimodal Large Language Models (MLLMs) show strong multimodal understanding and reasoning, their application to cross-domain recommendation remains underexplored. To this end, we propose Reasoning-Guided Cross-Domain Representation Learning (RGCD-Rep), a reasoning-guided framework for cross-domain recommendation from short videos to live streams. RGCD-Rep introduces MLLM reasoning resource-efficiently and learns transferable item representations guided by behavioral collaboration via two-stage training. First, reasoning-aware distillation lets a frozen teacher MLLM generate structured cross-domain reasoning knowledge and distills it into a lightweight student MLLM. Second, transferability-guided cross-domain representation learning decomposes item representations into transferable and domain residual representations. The resulting representations are computed offline and integrated into downstream retrieval tasks, enabling low-cost industrial deployment. Extensive offline experiments demonstrate RGCD-Rep's superiority. After deployment in Kuaishou's live streaming recommendation system, A/B tests show significant gains across multiple core business metrics, confirming its effectiveness and practicality in real industrial scenarios. RGCD-Rep is fully deployed and serves over 400 million users daily.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。