用大模型提升商品搜索召回率,解决关键词匹配难题
LLMs as Sparse Retrievers:A Framework for First-Stage Product Search
- 引入残差网络强化关键词,减少大模型幻觉
- 通过分步稀疏化策略,有效训练高维稀疏表示
- 线上实验提升搜索效果,带来实际营收增长
商品搜索是现代电商平台的核心功能,日均处理数十亿用户查询。一阶段检索需在保证高效部署的前提下实现高召回率。稀疏检索因其可解释性和存储效率备受青睐,但存在严重词汇不匹配问题,影响商品搜索效果。大语言模型(LLMs)具备语义理解能力,有望缓解该问题。然而直接应用于商品搜索时面临两大挑战:(1) 查询和商品标题普遍短小,易引发大模型幻觉,如生成无关扩展词或弱化品牌名、型号等关键实体;(2) 大模型的超大词汇空间导致训练初始化困难,难以学习有意义的稀疏表示。为此,我们提出 PROSPER 框架,利用大模型作为稀疏检索器进行商品搜索。该框架包含:(1) 一个字面残差网络,通过残差补偿机制强化被低估的关键字词;(2) 一个词汇聚焦窗口,采用粗到精的稀疏化策略促进有效训练初始化。大量离线与在线实验表明,PROSPER 显著优于传统稀疏基线,在召回性能上接近先进稠密检索器,同时在线上带来显著营收提升。
原文摘要 · Abstract (English)
Product search is a crucial component of modern e-commerce platforms, with billions of user queries every day. In product search systems, first-stage retrieval should achieve high recall while ensuring efficient online deployment. Sparse retrieval is particularly attractive in this context due to its interpretability and storage efficiency. However, sparse retrieval methods suffer from severe vocabulary mismatch issues, leading to suboptimal performance in product search scenarios. With their potential for semantic analysis, large language models (LLMs) offer a promising avenue for mitigating vocabulary mismatch issues and thereby improving retrieval quality. Directly applying LLMs to sparse retrieval in product search exposes two key challenges:(1)Queries and product titles are typically short and highly susceptible to LLM-induced hallucinations, such as generating irrelevant expansion terms or underweighting critical literal terms like brand names and model numbers;(2)The large vocabulary space of LLMs leads to difficulty in initializing training effectively, making it challenging to learn meaningful sparse representations in such ultra-high-dimensional spaces.To address these challenges, we propose PROSPER, a framework for PROduct search leveraging LLMs as SParsE Retrievers. PROSPER incorporates: (1)A literal residual network that alleviates hallucination in lexical expansion by reinforcing underweighted literal terms through a residual compensation mechanism; and (2)A lexical focusing window that facilitates effective training initialization via a coarse-to-fine sparsification strategy.Extensive offline and online experiments show that PROSPER significantly outperforms sparse baselines and achieves recall performance comparable to advanced dense retrievers, while also achieving revenue increments online.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。