用多正例提升检索模型性能,发现新损失函数更鲁棒有效
Training Dense Retrievers with Multiple Positive Passages
- 统一多种多正例损失函数到对比学习框架
- LSEPair在多数据场景下表现最优且稳定
- 适合需要高质量检索的生成系统研发者
现代知识密集型系统(如RAG)依赖高效检索器决定下游模块性能上限。但检索器训练受限于稀疏、单正例标注,导致假负噪声和次优监督。尽管大语言模型(LLMs)可规模化生成全面的多正例相关性标签,如何最优利用这些密集信号仍不明确。本文系统研究了多正例优化目标,将联合似然(JointLH)、求和边际似然(SumMargLH)与对数-求和-指数成对损失(LSEPair)统一至对比学习框架。理论分析揭示各方法在正例文档集上的概率分配差异。实证在Natural Questions、MS MARCO及BEIR基准上评估两种场景:同质LLM标注数据与异质的人工+LLM混合标注。结果表明,LSEPair在所有设置中表现最优且最鲁棒,而JointLH与SumMargLH对正例质量敏感;随机采样(Rand1LH)作为可靠基线。结合理论与实证,提出利用密集LLM增强监督提升检索器效能的设计原则。
原文摘要 · Abstract (English)
Modern knowledge-intensive systems, such as retrieval-augmented generation (RAG), rely on effective retrievers to establish the performance ceiling for downstream modules. However, retriever training has been bottlenecked by sparse, single-positive annotations, which lead to false-negative noise and suboptimal supervision. While the advent of large language models (LLMs) makes it feasible to collect comprehensive multi-positive relevance labels at scale, the optimal strategy for incorporating these dense signals into training remains poorly understood. In this paper, we present a systematic study of multi-positive optimization objectives for retriever training. We unify representative objectives, including Joint Likelihood (JointLH), Summed Marginal Likelihood (SumMargLH), and Log-Sum-Exp Pairwise (LSEPair) loss, under a shared contrastive learning framework. Our theoretical analysis characterizes their distinct gradient behaviors, revealing how each allocates probability mass across positive document sets. Empirically, we conduct extensive evaluations on Natural Questions, MS MARCO, and the BEIR benchmark across two realistic regimes: homogeneous LLM-annotated data and heterogeneous mixtures of human and LLM labels. Our results show that LSEPair consistently achieves superior robustness and performance across settings, while JointLH and SumMargLH exhibit high sensitivity to the quality of positives. Furthermore, we find that the simple strategy of random sampling (Rand1LH) serves as a reliable baseline. By aligning theoretical insights with empirical findings, we provide practical design principles for leveraging dense, LLM-augmented supervision to enhance retriever effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。