用零样本大模型扩写查询,间接提升稀疏检索效果
Exp4Fuse: A Rank Fusion Framework for Enhanced Sparse Retrieval using Large Language Model-based Query Expansion
- 通过原查询与大模型扩写查询并行检索,再融合结果
- 在三个MS MARCO和七个低资源数据集上超越现有方法
- 适合想低成本提升检索性能的研究者或工程师
大语言模型(LLM)在生成假设文档以扩展查询方面展现出潜力,从而提升信息检索性能。然而,该方法的有效性高度依赖生成文档的质量,通常需要复杂的提示策略及先进密集检索技术的集成,成本高且计算开销大。为缓解这些限制,我们探索使用零样本LLM进行查询扩展,以改进稀疏检索,特别是针对学习型稀疏检索器。提出新型融合排序框架Exp4Fuse,通过间接应用零样本LLM查询扩展,增强稀疏检索器性能。Exp4Fuse同时考虑原始查询和LLM扩写查询两条检索路径,利用稀疏检索器生成两个排序列表,并采用改进的倒数排名融合方法进行融合。我们在三个MS MARCO相关数据集和七个低资源数据集上对Exp4Fuse进行了广泛评估,结果表明,Exp4Fuse不仅优于现有的基于LLM的查询扩展方法,而且在与先进稀疏检索器结合时,在多个基准测试中达到最新水平(SOTA),凸显其在提升稀疏检索查询扩展方面的优越性和有效性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have shown potential in generating hypothetical documents for query expansion, thereby enhancing information retrieval performance. However, the efficacy of this method is highly dependent on the quality of the generated documents, which often requires complex prompt strategies and the integration of advanced dense retrieval techniques. This can be both costly and computationally intensive. To mitigate these limitations, we explore the use of zero-shot LLM-based query expansion to improve sparse retrieval, particularly for learned sparse retrievers. We introduce a novel fusion ranking framework, Exp4Fuse, which enhances the performance of sparse retrievers through an indirect application of zero-shot LLM-based query expansion. Exp4Fuse operates by simultaneously considering two retrieval routes-one based on the original query and the other on the LLM-augmented query. It then generates two ranked lists using a sparse retriever and fuses them using a modified reciprocal rank fusion method. We conduct extensive evaluations of Exp4Fuse against leading LLM-based query expansion methods and advanced retrieval techniques on three MS MARCO-related datasets and seven low-resource datasets. Experimental results reveal that Exp4Fuse not only surpasses existing LLM-based query expansion methods in enhancing sparse retrievers but also, when combined with advanced sparse retrievers, achieves SOTA results on several benchmarks. This highlights the superior performance and effectiveness of Exp4Fuse in improving query expansion for sparse retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。