arXiv:2504.01403cs.IRcs.AI2025-04中稿 · WWW2025被引 28

用生成式对齐模型提升电商搜索召回率,让查询与商品更好匹配。

Generative Retrieval and Alignment Model: A New Paradigm for E-commerce Retrieval

  • 联合训练查询和商品文本,生成共享语义编码
  • 相比传统方法,线上测试召回率显著提升
  • 适合需要精准匹配的电商搜索场景

传统稀疏和稠密检索方法难以利用通用世界知识,且难以捕捉查询与商品的细微特征。随着大语言模型(LLMs)的发展,工业搜索系统开始使用LLM生成商品标识符,常见方式包括静态/语义ID和商品词集。前者需从零构建标识体系,忽略LLM中的世界知识;后者虽利用了通用知识,但查询与商品间词分布差异大,导致标识符与查询对齐不佳,造成漏召回。当查询含大量属性时,生成的标识符过多,难以评估质量,整体召回效率低。为此,本文提出一种新范式:生成式检索与对齐模型(GRAM)。GRAM通过联合训练查询与商品文本,生成共享文本标识码,有效弥合查询与商品之间的差距。该方法不仅增强查询与商品的关联性,还提升推理效率。模型采用共对齐策略生成最优检索编码,并引入查询-商品评分机制,比较不同编码下的商品价值,进一步提升检索效率。大量离线与线上A/B测试表明,GRAM显著优于传统模型及最新生成式检索模型,验证了其有效性与实用性。

原文摘要 · Abstract (English)

Traditional sparse and dense retrieval methods struggle to leverage general world knowledge and often fail to capture the nuanced features of queries and products. With the advent of large language models (LLMs), industrial search systems have started to employ LLMs to generate identifiers for product retrieval. Commonly used identifiers include (1) static/semantic IDs and (2) product term sets. The first approach requires creating a product ID system from scratch, missing out on the world knowledge embedded within LLMs. While the second approach leverages this general knowledge, the significant difference in word distribution between queries and products means that product-based identifiers often do not align well with user search queries, leading to missed product recalls. Furthermore, when queries contain numerous attributes, these algorithms generate a large number of identifiers, making it difficult to assess their quality, which results in low overall recall efficiency. To address these challenges, this paper introduces a novel e-commerce retrieval paradigm: the Generative Retrieval and Alignment Model (GRAM). GRAM employs joint training on text information from both queries and products to generate shared text identifier codes, effectively bridging the gap between queries and products. This approach not only enhances the connection between queries and products but also improves inference efficiency. The model uses a co-alignment strategy to generate codes optimized for maximizing retrieval efficiency. Additionally, it introduces a query-product scoring mechanism to compare product values across different codes, further boosting retrieval efficiency. Extensive offline and online A/B testing demonstrates that GRAM significantly outperforms traditional models and the latest generative retrieval models, confirming its effectiveness and practicality.

电商搜索生成式检索对齐模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。