arXiv:2604.11092cs.IR2026-04中稿 · SIGIR 2026

用开源大模型重标难负例,提升密集检索的训练效果

ARHN: Answer-Centric Relabeling of Hard Negatives with Open-Source LLMs for Dense Retrieval

论文配图:ARHN: Answer-Centric Relabeling of Hard Negatives with Open-Source LLMs for Dense Retrieval
图 1 · 摘自论文原文
  • 用大模型判断负例是否含答案,精准识别应重标为正例的样本
  • 联合重标与过滤后,在BEIR多个数据集上均超越单一策略
  • 仅依赖开源模型,适合大规模检索模型的低成本训练

神经检索器通常在包含查询、正例段落和一组难负例的三元组数据上训练。实际中,难负例挖掘可能引入错误负例和模糊负例,包括与查询相关或包含部分答案的段落。此类标签噪声导致监督信号不一致,降低检索效果。我们提出ARHN(答案中心的难负例重标),一个两阶段框架,利用开源大模型通过答案中心的相关性信号优化难负例。第一阶段,对每个查询-段落对,提示大模型生成基于段落的答案片段,或判断段落不支持答案;第二阶段,使用大模型进行列表级排序,按直接回答能力对候选集排序。排名高于原正例的段落被重标为额外正例;排名低于正例且含答案片段的段落则从负例集中移除,避免模糊监督。我们在BEIR基准上以三种配置评估:仅重标、仅过滤、两者结合。跨数据集,组合策略始终优于单一步骤,表明联合重标错误负例与过滤模糊负例可提供更干净的训练监督。因严格依赖开源模型,ARHN构建了一个低成本、可扩展的精细化训练流水线。

原文摘要 · Abstract (English)

Neural retrievers are often trained on large-scale triplet data comprising a query, a positive passage, and a set of hard negatives. In practice, hard-negative mining can introduce false negatives and other ambiguous negatives, including passages that are relevant or contain partial answers to the query. Such label noise yields inconsistent supervision and can degrade retrieval effectiveness. We propose ARHN (Answer-centric Relabeling of Hard Negatives), a two-stage framework that leverages open-source LLMs to refine hard negative samples using answer-centric relevance signals. In the first stage, for each query-passage pair, ARHN prompts the LLM to generate a passage-grounded answer snippet or to indicate that the passage does not support an answer. In the second stage, ARHN applies an LLM-based listwise ranking over the candidate set to order passages by direct answerability to the query. Passages ranked above the original positive are relabeled to additional positives. Among passages ranked below the positive, ARHN excludes any that contain an answer snippet from the negative set to avoid ambiguous supervision. We evaluated ARHN on the BEIR benchmark under three configurations: relabeling only, filtering only, and their combination. Across datasets, the combined strategy consistently improves over either step in isolation, indicating that jointly relabeling false negatives and filtering ambiguous negatives yields cleaner supervision for training neural retrieval models. By relying strictly on open-source models, ARHN establishes a cost-effective and scalable refinement pipeline suitable for large-scale training.

密集检索大模型负例优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。