arXiv:2509.06887cs.IR2025-09被引 11

用统一生成框架替代传统搜索流水线,提升推荐精准度。

UniSearch: Rethinking Search System with a Unified Generative Architecture

  • 构建生成式搜索架构,端到端联合优化生成器与视频编码器。
  • 在直播搜索中实现产品史上最大单次实验提升,效果显著。
  • 适合需要高精度实时搜索的工业级应用,如短视频平台。

现代搜索系统在信息获取中扮演关键角色。传统搜索引擎通常采用分阶段架构,包括召回、预排序和排序,设计维护多个模块复杂且难以实现整体性能提升。近年来生成式推荐的发展推动了统一生成式搜索的探索,但现有方法并非真正端到端:通常先训练物品编码器对候选进行标记化,再单独优化生成器,导致目标不一致且泛化能力有限。为此,我们提出UniSearch,一种面向快手搜索的统一生成式搜索框架。UniSearch用端到端架构替代分阶段流程,整合了搜索生成器与视频编码器。生成器根据用户查询生成相关项的语义标识,视频编码器学习物品潜在嵌入并提供其标记化表示。统一训练框架联合优化两者,实现相互增强,提升表示质量和生成准确率。此外,引入搜索偏好优化(SPO),利用奖励模型和真实用户反馈,使生成更贴合用户偏好。在工业规模数据集上的大量实验及短视屏和直播搜索场景的在线A/B测试均验证了UniSearch的强大有效性与部署潜力。尤其在直播搜索中的部署,创造了该产品近年来最大单次实验提升,凸显其在实际应用中的价值。

原文摘要 · Abstract (English)

Modern search systems play a crucial role in facilitating information acquisition. Traditional search engines typically rely on a cascaded architecture, where results are retrieved through recall, pre-ranking, and ranking stages. The complexity of designing and maintaining multiple modules makes it difficult to achieve holistic performance gains. Recent advances in generative recommendation have motivated the exploration of unified generative search as an alternative. However, existing approaches are not genuinely end-to-end: they typically train an item encoder to tokenize candidates first and then optimize a generator separately, leading to objective inconsistency and limited generalization. To address these limitations, we propose UniSearch, a unified generative search framework for Kuaishou Search. UniSearch replaces the cascaded pipeline with an end-to-end architecture that integrates a Search Generator and a Video Encoder. The Generator produces semantic identifiers of relevant items given a user query, while the Video Encoder learns latent item embeddings and provides their tokenized representations. A unified training framework jointly optimizes both components, enabling mutual enhancement and improving representation quality and generation accuracy. Furthermore, we introduce Search Preference Optimization (SPO), which leverages a reward model and real user feedback to better align generation with user preferences. Extensive experiments on industrial-scale datasets, together with online A/B testing in both short-video and live search scenarios, demonstrate the strong effectiveness and deployment potential of UniSearch. Notably, its deployment in live search yields the largest single-experiment improvement in recent years of our product's history, highlighting its practical value for real-world applications.

搜索系统生成模型端到端工业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。