新视频冷启动难题,用多模态模型实现零样本推荐
VCG: A Multimodal Retrieval Framework for E-Commerce Video Feeds under Extreme Cold-Start Conditions

- 用CLIP适配电商的视觉语言模型,把视频和用户映射到统一语义空间
- 线上测试显示深度观看完成率提升50%,有效缓解位置和时长偏差
- 支持商品找视频、视频找商品等零样本搜索,适合新内容快速分发
电商正从静态搜索目录转向动态沉浸式视频流。这一转变带来极端冷启动问题:新短视频缺乏协作过滤所需的密集交互历史。同时,沉浸式推荐流中的位置和时长偏差会扭曲传统点击信号。本文提出视频候选生成(VCG)系统,一个可扩展的多模态检索引擎,专为大规模电商环境设计。通过采用领域适配的视觉-语言模型(基于CLIP),将用户与视频映射至共享语义空间,实现基于视觉内容的零样本检索,而非依赖行为历史。我们详细阐述系统架构,并对比生成式(LLM)与判别式(CLIP)嵌入在检索任务中的表现。结果表明,尽管生成式模型在属性预测上更优,但在检索任务中易出现嵌入空间坍塌。在线A/B测试显示,VCG有效缓解了互动偏差,使深度视频完成率提升50%。为展示系统能力,我们呈现三个双向检索场景:商品→视频、视频→商品、零样本语义搜索。
原文摘要 · Abstract (English)
The digital commerce landscape is shifting from static, search-driven catalogs to dynamic, immersive video feeds. This transition introduces an ``extreme cold-start'' problem: unlike traditional items, new short-form videos lack the dense interaction history required for collaborative filtering. Furthermore, immersive feeds introduce strong position and duration biases that distort standard engagement signals. In this paper, we demonstrate the Video Candidate Generation (VCG) system, a scalable multimodal retrieval engine designed to solve these challenges in a large-scale e-commerce environment. By leveraging a domain-adapted vision-language model (based on CLIP), we map users and videos into a shared semantic space, enabling zero-shot retrieval based on visual content rather than behavioral history. We detail the system's architecture and present a rigorous evaluation comparing generative (LLM) vs. discriminative (CLIP) embeddings. Our results show that while generative models excel at attribute prediction, they suffer from embedding space collapse in retrieval tasks. Online A/B testing demonstrates that VCG effectively mitigates engagement biases, yielding a 50\% uplift in deep video completion. To showcase the system's capabilities, we present an interactive demonstration featuring three bi-directional retrieval scenarios: Product-to-Video, Video-to-Product, and Zero-Shot Semantic Search.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。