arXiv:2511.15443cs.IRcs.CL2025-11AAAI

通过多视角正样本提升短视频搜索召回效果

CroPS: Improving Dense Retrieval with Cross-Perspective Positive Samples in Short-Video Search

  • 引入查询重写、系统推荐和大模型知识三类正样本
  • 在快手搜索上使检索效果显著优于基线,降低37%查询重写率
  • 适合关注推荐系统去偏与数据增强的工程师

密集检索已成为现代搜索系统的基础范式,尤其在短视频平台。然而,多数工业系统依赖历史用户交互进行自强化训练,导致信息茧房效应,使潜在相关但未被见过的内容无法进入训练信号,使模型趋向保守。本文提出CroPS(跨视角正样本),一种新型检索数据引擎,通过引入来自多视角的多样且语义有意义的正样本缓解此问题:包括用户查询重写行为(查询级)、推荐流中的互动数据(系统级)以及大语言模型生成的世界知识(知识级)。为有效利用这些异构信号,提出分层标签分配(HLA)策略与对应的H-InfoNCE损失,实现细粒度、相关性感知的优化。在快手搜索这一大规模商用短视频搜索平台上的实验表明,CroPS在离线与线上A/B测试中均显著优于强基线,检索性能更优,且查询重写率下降37%。CroPS已全面部署于快手搜索,日均服务数亿用户。

原文摘要 · Abstract (English)

Dense retrieval has become a foundational paradigm in modern search systems, especially on short-video platforms. However, most industrial systems adopt a self-reinforcing training pipeline that relies on historically exposed user interactions for supervision. This paradigm inevitably leads to a filter bubble effect, where potentially relevant but previously unseen content is excluded from the training signal, biasing the model toward narrow and conservative retrieval. In this paper, we present CroPS (Cross-Perspective Positive Samples), a novel retrieval data engine designed to alleviate this problem by introducing diverse and semantically meaningful positive examples from multiple perspectives. CroPS enhances training with positive signals derived from user query reformulation behavior (query-level), engagement data in recommendation streams (system-level), and world knowledge synthesized by large language models (knowledge-level). To effectively utilize these heterogeneous signals, we introduce a Hierarchical Label Assignment (HLA) strategy and a corresponding H-InfoNCE loss that together enable fine-grained, relevance-aware optimization. Extensive experiments conducted on Kuaishou Search, a large-scale commercial short-video search platform, demonstrate that CroPS significantly outperforms strong baselines both offline and in live A/B tests, achieving superior retrieval performance and reducing query reformulation rates. CroPS is now fully deployed in Kuaishou Search, serving hundreds of millions of users daily.

检索增强短视频搜索去偏多视角学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。