arXiv:2409.10909cs.IRcs.AI2024-09

用生成聚类提升搜索意图多样性,显著改善检索效果。

GenCRF: Generative Clustering and Reformulation Framework for Enhanced Intent-Driven Information Retrieval

  • 生成多组不同查询后聚类,自动识别多样意图
  • 在BEIR上比现有最优方法高12%的nDCG@10
  • 适合需要精准理解用户复杂意图的检索系统

查询重写是信息检索中的经典问题,旨在通过自动修改用户输入查询以提高单次搜索的成功率。近年来的方法利用大语言模型(LLMs)改进查询重写,但常生成有限且重复的扩展,可能限制其捕捉多样化意图的能力。本文提出GenCRF:一种生成聚类与重写框架,首次在检索阶段基于多个差异化、高质量生成的查询,自适应地捕获多样意图。GenCRF利用定制提示词引导LLM从初始查询生成多样查询,再通过聚类将它们分组以明确表示不同意图。此外,框架探索将不同意图查询结合,并采用创新加权聚合策略优化检索性能,关键还集成了新型查询评估奖励模型(QERM),通过反馈循环持续优化。在BEIR基准上的实验证明,GenCRF达到当前最优水平,在nDCG@10上超越先前SOTA高达12%。该方法可适配多种LLM,显著提升检索器表现,推动信息检索领域发展。

原文摘要 · Abstract (English)

Query reformulation is a well-known problem in Information Retrieval (IR) aimed at enhancing single search successful completion rate by automatically modifying user's input query. Recent methods leverage Large Language Models (LLMs) to improve query reformulation, but often generate limited and redundant expansions, potentially constraining their effectiveness in capturing diverse intents. In this paper, we propose GenCRF: a Generative Clustering and Reformulation Framework to capture diverse intentions adaptively based on multiple differentiated, well-generated queries in the retrieval phase for the first time. GenCRF leverages LLMs to generate variable queries from the initial query using customized prompts, then clusters them into groups to distinctly represent diverse intents. Furthermore, the framework explores to combine diverse intents query with innovative weighted aggregation strategies to optimize retrieval performance and crucially integrates a novel Query Evaluation Rewarding Model (QERM) to refine the process through feedback loops. Empirical experiments on the BEIR benchmark demonstrate that GenCRF achieves state-of-the-art performance, surpassing previous query reformulation SOTAs by up to 12% on nDCG@10. These techniques can be adapted to various LLMs, significantly boosting retriever performance and advancing the field of Information Retrieval.

信息检索查询重写大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。