用合成数据提升电商长尾知识型搜索的召回率
Synthetic Data Powers Product Retrieval for Long-tail Knowledge-Intensive Queries in E-commerce Search
- 用大模型生成高质量查询重写数据,增强检索模型能力
- 在真实电商数据上验证,召回率显著提升且无额外优化
- 适合解决缺乏用户行为数据的长尾知识类查询问题
商品检索是电商搜索的核心:针对每个用户查询,从数十亿商品中识别高召回候选集,为优质排序和用户体验奠定基础。尽管主流查询已得到充分优化,现有系统仍难以处理长尾知识型查询。这类查询语言形式多样,通常无明确购买意图,需领域知识推理才能准确理解,且缺乏可靠的用户行为日志,成为检索优化的长期难题。为此,我们提出一种面向长尾、知识密集型查询检索的高效数据合成框架。核心思想是将强大离线查询重写模型的能力隐式迁移到高效在线检索系统中。利用大模型的语言理解能力,通过多奖励信号训练多候选查询重写模型,并借助精心构建的查询-商品对及强大离线检索管道捕捉其重写能力。该设计缓解了重写后查询的分布偏移问题,避免增量召回下降或引入无关商品。实验表明,仅将此合成数据用于检索模型训练,无需额外技巧即带来显著提升。线上对比测试(SBS)的人工评估结果表明用户搜索体验明显改善。
原文摘要 · Abstract (English)
Product retrieval is the backbone of e-commerce search: for each user query, it identifies a high-recall candidate set from billions of items, laying the foundation for high-quality ranking and user experience. Despite extensive optimization for mainstream queries, existing systems still struggle with long-tail queries, especially knowledge-intensive ones. These queries exhibit diverse linguistic patterns, often lack explicit purchase intent, and require domain-specific knowledge reasoning for accurate interpretation. They also suffer from a shortage of reliable behavioral logs, which makes such queries a persistent challenge for retrieval optimization. To address these issues, we propose an efficient data synthesis framework tailored to retrieval involving long-tail, knowledge-intensive queries. The key idea is to implicitly distill the capabilities of a powerful offline query-rewriting model into an efficient online retrieval system. Leveraging the strong language understanding of LLMs, we train a multi-candidate query rewriting model with multiple reward signals and capture its rewriting capability in well-curated query-product pairs through a powerful offline retrieval pipeline. This design mitigates distributional shift in rewritten queries, which might otherwise limit incremental recall or introduce irrelevant products. Experiments demonstrate that without any additional tricks, simply incorporating this synthetic data into retrieval model training leads to significant improvements. Online Side-By-Side (SBS) human evaluation results indicate a notable enhancement in user search experience.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。