用语义检索结果引导关键词扩展,解决查询词与文档用词不一致导致的漏检问题。
CeQe: Grounding Lexical Retrieval in Semantic Evidence
- 从交叉编码器对语义检索结果的注意力中提取关键术语,扩充原始查询。
- 在7个BEIR数据集上显著提升词汇召回率,如NQ Recall@100从0.32升至0.47。
- 无需修改原有索引,适合希望增强现有检索系统而不想重训的开发者。
词汇检索(如BM25)依赖精确关键词匹配并基于语料库全局重要性加权,但对语义词汇差异无能为力:当相关文档用不同措辞表达答案时,即使再好的重排序也无法找回。我们提出交叉编码器查询扩展(CE-QE),读取交叉编码器对前若干语义检索结果的逐词相关性归因,选取被视作决定性的术语,并将其追加到原始BM25查询中。与传统伪相关反馈不同,它不使用可能错误的初始结果;与生成式查询扩展(如HyDE)不同,所有扩展项均来自实际检索到的文本片段,不会引入语料库外词汇。其额外开销仅为交叉编码器归因提取——这已是重排序管道中的已有步骤。在七个BEIR数据集上,当查询与答案词汇存在差异时,CE-QE大幅提高词汇召回率(如NQ Recall@100从0.32提升至0.47);其得分融合变体SESF在Recall@100上比交叉编码器融合高2.5%,在nDCG@10上分别优于SPLADEv2和ColBERTv2 5.3%和4.6%,且完全保持原始BM25索引不变。
原文摘要 · Abstract (English)
Lexical retrieval (BM25) captures exact keyword matches and weights terms by corpus-wide significance, but it is blind to the semantic vocabulary gap: when a relevant document phrases an answer differently from the query, BM25 never retrieves it, and no amount of downstream reranking or fusion can recover a document that was never in the candidate set. We present Cross-Encoder Query Expansion (CE-QE), which reads the per-token relevance attributions of a cross-encoder applied to top semantic search results, selects the terms the cross-encoder treats as decisive, and appends them to the BM25 query. Unlike classical pseudo-relevance feedback, which reuses BM25's own (possibly wrong) top results, CE-QE seeds expansion from the semantic retriever's results, avoiding self-reinforcing query drift. Unlike recent generative query expansion (HyDE, Query2doc), which prompts a large language model to hallucinate text from its parametric knowledge, every CE-QE expansion term is copied verbatim from a retrieved passage, so it cannot introduce vocabulary the corpus does not contain, and its only added cost is attribution extraction on a cross-encoder a hybrid pipeline already runs for reranking. On seven BEIR datasets, CE-QE improves lexical recall substantially where query and answer vocabulary diverge (e.g., NQ Recall@100 from 0.32 to 0.47), and its score-fusion variant (SESF) beats cross-encoder score fusion by 2.5% on Recall@100 and beats SPLADEv2 and ColBERTv2 by 5.3% and 4.6% on nDCG@10, while leaving the underlying BM25 index completely unmodified.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。