arXiv:2604.18845cs.IR2026-04

通过双向指令生成,让模型学会区分符合指令的文档。

Dual-View Training for Instruction-Following Information Retrieval

  • 用大模型生成互补指令,使相关文档标签互换
  • 在FollowIR上提升45%性能,超越同规模通用模型
  • 适合需要精准遵循用户指令的检索系统研发

指令遵循信息检索(IF-IR)要求检索系统不仅找到主题相关的文档,还需遵守用户的显式约束,如属性要求、排除项或输出偏好。然而,大多数检索器主要针对语义相关性训练,难以区分仅匹配主题但不符合指令的文档。本文提出基于极性反转的双视角数据合成策略:给定一个查询、一个符合指令的相关文档,以及一个匹配查询但违反指令的难负样本,我们利用大语言模型生成一个互补指令,使得这两个文档的相关性标签互换。通过在互补指令下呈现相同的文档对,训练信号迫使检索器重新审视同一候选集的指令含义,而非依赖固定的主题线索。在305M参数编码器上,该方法在FollowIR基准上性能提升45%,超过同等或更大规模的通用嵌入模型。在相同数据预算下的对比实验表明,数据多样性与指令监督相辅相成:前者保持通用检索质量,后者增强指令敏感性。结果表明,针对性的数据合成对构建兼具广泛能力与指令感知性的检索系统具有重要价值。

原文摘要 · Abstract (English)

Instruction-following information retrieval (IF-IR) studies retrieval systems that must not only find documents relevant to a query, but also obey explicit user constraints such as required attributes, exclusions, or output preferences. However, most retrievers are trained primarily for semantic relevance and often fail to distinguish documents that match the topic from those that satisfy the instruction. We propose a dual-view data synthesis strategy based on polarity reversal: given a query, a document that is relevant under the instruction, and a hard negative that matches the query but violates the instruction, we prompt an LLM to generate a complementary instruction under which the two documents swap relevance labels. By presenting the same document pair under complementary instructions that invert their relevance labels, the training signal forces the retriever to reconsider the same candidate set through the instruction, rather than relying on fixed topical cues. On a 305M-parameter encoder, our method improves performance on the FollowIR benchmark by 45%, surpassing general-purpose embedding models of comparable or larger scale. Through head-to-head comparisons at matched data budgets, we further show that data diversity and instruction supervision play complementary roles: the former preserves general retrieval quality, while the latter improves instruction sensitivity. These results highlight the value of targeted data synthesis for building retrieval systems that are both broadly capable and instruction-aware.

信息检索指令遵循数据合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。