通过生成式增强检索,同时提升全局与细粒度匹配效果
GeAR: Generation Augmented Retrieval
- 用生成式模块融合查询与文档,捕捉局部语义关联
- 对比学习提升全局相似度,零额外计算开销
- 适合需要可解释检索结果的研究者与应用开发
文档检索技术对构建大规模信息系系统至关重要。传统方法使用双编码器计算查询与文档间的语义相似度,但标量相似度难以反映充分信息,且仅关注全局语义,忽视查询与文档内容间的细粒度关联。本文提出一种新方法——生成式增强检索(GeAR),不仅通过对比学习提升查询与文档的全局相似度,还引入精心设计的融合与解码模块,能够基于给定查询生成文档中的相关上下文,从而辅助学习局部细粒度信息。此外,作为检索器使用时,GeAR 的计算开销与双编码器相当。在多种场景和任务中,GeAR 表现出竞争力的检索性能。定性分析及生成结果为检索结果的可解释性提供了新视角。代码、数据与模型将发布于 https://github.com/microsoft/LMOps。
原文摘要 · Abstract (English)
Document retrieval techniques are essential for developing large-scale information systems. The common approach involves using a bi-encoder to compute the semantic similarity between a query and documents. However, the scalar similarity often fail to reflect enough information, hindering the interpretation of retrieval results. In addition, this process primarily focuses on global semantics, overlooking the finer-grained semantic relationships between the query and the document's content. In this paper, we introduce a novel method, $\textbf{Ge}$neration $\textbf{A}$ugmented $\textbf{R}$etrieval ($\textbf{GeAR}$), which not only improves the global document-query similarity through contrastive learning, but also integrates well-designed fusion and decoding modules. This enables GeAR to generate relevant context within the documents based on a given query, facilitating learning to retrieve local fine-grained information. Furthermore, when used as a retriever, GeAR does not incur any additional computational cost over bi-encoders. GeAR exhibits competitive retrieval performance across diverse scenarios and tasks. Moreover, qualitative analysis and the results generated by GeAR provide novel insights into the interpretation of retrieval results. The code, data, and models will be released at \href{https://github.com/microsoft/LMOps}{https://github.com/microsoft/LMOps}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。