arXiv:2410.20286cs.IR2024-10被引 16

通过查询亲和力模型提升检索召回率,尤其适用于资源有限的场景。

Quam: Adaptive Retrieval through Query Affinity Modelling

  • 构建查询亲和力模型,利用相关性感知文档图优化检索
  • 在低重排预算下召回率最高提升26%
  • 可插入任意自适应检索方法,通用性强

构建基于用户信息需求的相关性模型是信息检索与自然语言处理的核心任务。除了直接的即兴搜索外,许多知识密集型任务依赖第一阶段的检索进行上下文选择,再由特定任务模型处理。然而,当前第一阶段排序常受限于初始文档池的召回能力。近期提出的自适应重排技术通过持续从全语料库中选择文档来克服此问题,但现有方法多依赖启发式设计,尤其在文档选择标准上缺乏系统性。本文提出统一视角下的自适应检索框架Quam,其核心为查询亲和力模型,利用相关性感知文档相似性图提升召回率,尤其在低重排预算下表现优异。大量实验表明,Quam相比标准重排基线召回率最高提升26%。此外,查询亲和力建模与相关性感知文档图模块可无缝注入任意自适应检索方法,使现有方法召回率最高提升12%。代码已开源。

原文摘要 · Abstract (English)

Building relevance models to rank documents based on user information needs is a central task in information retrieval and the NLP community. Beyond the direct ad-hoc search setting, many knowledge-intense tasks are powered by a first-stage retrieval stage for context selection, followed by a more involved task-specific model. However, most first-stage ranking stages are inherently limited by the recall of the initial ranking documents. Recently, adaptive re-ranking techniques have been proposed to overcome this issue by continually selecting documents from the whole corpus, rather than only considering an initial pool of documents. However, so far these approaches have been limited to heuristic design choices, particularly in terms of the criteria for document selection. In this work, we propose a unifying view of the nascent area of adaptive retrieval by proposing, Quam, a \textit{query-affinity model} that exploits the relevance-aware document similarity graph to improve recall, especially for low re-ranking budgets. Our extensive experimental evidence shows that our proposed approach, Quam improves the recall performance by up to 26\% over the standard re-ranking baselines. Further, the query affinity modelling and relevance-aware document graph modules can be injected into any adaptive retrieval approach. The experimental results show the existing adaptive retrieval approach improves recall by up to 12\%. The code of our work is available at \url{https://github.com/Mandeep-Rathee/quam}.

信息检索自适应检索召回率提升图模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。