arXiv:2603.20990cs.IRcs.AI2026-03

提出无需训练的语义残差对比方法,精准评估难负样本质量

$\mathrm{ECI}_{\mathrm{sem}}$: Semantic Residual Effective Contrastive Information for Evaluating Hard Negatives

  • 基于冻结编码器嵌入,融合语义一致性、局部性和词法残差性加权评分
  • 在MS MARCO上恢复了不同模型间的迁移排序,关键指标为均值词法残差
  • 适合需要高效筛选难负样本的研究者,尤其关注检索系统可解释性

密集检索中的难负样本选择通常需在微调和下游评估后才能确定。我们提出ECIsem,一种无需训练的诊断方法,通过冻结目标编码器嵌入对候选难负样本进行排序。ECIsem非无标签:每个待评分样本需包含查询、已标注正例及显式候选负例。每个负例根据目标一致性、语义局部性和词法残差性加权,来源得分通过对加权残差方向的对数行列式聚合。在研究规模下,对数行列式处于线性区域,因此得分简化为平均有效性权重;我们报告此简化结果,并通过消融实验发现,单一词法标量——平均词法残差性——在所有模块中均能复现迁移排序。在MS MARCO负样本数据集上,同族ECIsem恢复了DistilBERT、E5-base和Contriever之间的整体BEIR迁移排序。构造对照组揭示可识别性极限:一个合理的假负例未被反转、靠近正例且词法新颖,恰好是门控机制所奖励的特征;在十二种权重组合与三种主干模型下,仅三十六分之一单元安全且不具迁移对齐性,该限制同样适用于基于相同统计量构建的边际型过滤器。但当这些门控统计量用作审计特征而非奖励时,能清晰区分对照组,因此我们建议将得分与报告的审计轮廓结合使用,而非重新加权。

原文摘要 · Abstract (English)

Hard-negative source selection for dense retrieval is usually decided only after fine-tuning and downstream evaluation. We propose ECIsem, a validity-weighted diagnostic that ranks candidate hard-negative sources using frozen target-encoder embeddings. ECIsem is training-free, not label-free: each scored example requires a query, a labeled positive, and an explicit candidate negative. Each negative is weighted by target consistency, semantic locality, and lexical residuality, and the source score aggregates weighted residual directions through a log-determinant. At the scale we study, the log-determinant operates in its linear regime, so the score reduces to the mean validity weight; we report this reduction as a finding, and gate ablations show that a single lexical scalar, mean lexical residuality, reproduces the transfer ordering in every block. On MS MARCO negative sources, in-family ECIsem recovers the aggregate BEIR transfer ordering across DistilBERT, E5-base, and Contriever. Constructed controls expose an identifiability limit: a plausible false negative is non-inverted, near the positive, and lexically novel, exactly the profile the gates reward, and across twelve weightings of the three gates and three backbones only one of thirty-six cells is safe, and it is not transfer aligned, a limit that extends to margin-style filters built from the same statistics. The same gate statistics separate the controls sharply when used as audit features rather than as rewards, so we pair the score with a reported audit profile instead of a reweighting.

信息检索难负样本对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。