arXiv:2507.11042cs.IR2025-07被引 5

用LLM对齐优化查询扩展,提升检索效果并降低计算开销。

Aligned Query Expansion: Efficient Query Expansion for Information Retrieval through LLM Alignment

  • 通过大模型对齐技术直接训练生成有效查询扩展
  • 在域内与域外场景下均显著提升检索效果
  • 无需额外过滤步骤,节省计算资源,适合高效检索系统

随着大语言模型(LLMs)的突破,通过相关词扩展文档和查询的检索技术日益流行,可缓解词汇不匹配问题。以往研究发现贪婪解码生成的查询存在幻觉等问题,需采用‘生成后过滤’策略,但该方法成本高且无法教会模型哪些查询更有效。为此,本文提出对齐查询扩展(AQE),利用大模型对齐技术微调模型,使其生成的查询扩展直接优化检索任务表现,避免额外过滤步骤。实验表明,AQE在领域内与领域外设置下均优于基线模型,显著提升检索有效性,同时降低计算开销。

原文摘要 · Abstract (English)

With the breakthroughs in large language models (LLMs), query generation techniques that expand documents and queries with related terms are becoming increasingly popular in the information retrieval field. Such techniques have been shown to improve the effectiveness of traditional lexical retrieval methods by dealing with the vocabulary mismatch problem. Recent work has found that generating queries with a greedy decoding strategy can produce sub-optimal queries, including hallucinations, and proposed to filter out queries before expansion. This `generate-then-filter' approach is costly, as it requires generating multiple queries and applying a relevance model to all of them and does not teach the LLM which of the generated queries is more effective for expansion. To overcome such limitations, we propose Aligned Query Expansion (AQE), a novel approach to enhance query expansion for passage retrieval in open-domain question answering. AQE leverages recent techniques in LLM alignment to fine-tune models for generating query expansions that directly optimize the effectiveness of the retrieval task, eliminating the need for additional filtering steps. This alignment ensures that queries are more relevant, reducing computational costs while improving retrieval effectiveness. Empirical evaluations show that AQE outperforms baseline models for query expansion in both in-domain and out-of-domain settings, demonstrating significant improvements in retrieval effectiveness.

查询扩展LLM对齐信息检索高效检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。