PLM检索器因低困惑度偏好生成文本,导致信息推荐失真。
Perplexity Trap: PLM-Based Retrievers Overrate Low Perplexity Documents
- 发现PLM检索器通过困惑度特征判断相关性,误判低困惑度文本更相关。
- 在三个领域实验中,新方法将源偏见降低30%以上,显著提升公平性。
- 适合关注大模型检索公正性的研究人员与系统设计者。
以往研究发现,基于PLM的检索模型对大语言模型生成内容存在偏好,即使其语义质量与人工撰写相当,仍赋予更高相关性评分。这种来源偏见威胁信息获取生态的可持续发展。本文通过因果图分析信息检索过程,揭示PLM检索器学习困惑度特征用于相关性估计,导致对低困惑度文档排名过高。理论分析表明,语言建模任务与检索任务损失函数梯度间存在正相关性,是该现象的根源。基于此,提出因果启发式的推理时去偏方法CDC:先诊断困惑度偏见影响,再将其从总相关性得分中分离。跨三个领域的实验验证了CDC的优越去偏效果,证实了所提解释框架的有效性。源码已开源。
原文摘要 · Abstract (English)
Previous studies have found that PLM-based retrieval models exhibit a preference for LLM-generated content, assigning higher relevance scores to these documents even when their semantic quality is comparable to human-written ones. This phenomenon, known as source bias, threatens the sustainable development of the information access ecosystem. However, the underlying causes of source bias remain unexplored. In this paper, we explain the process of information retrieval with a causal graph and discover that PLM-based retrievers learn perplexity features for relevance estimation, causing source bias by ranking the documents with low perplexity higher. Theoretical analysis further reveals that the phenomenon stems from the positive correlation between the gradients of the loss functions in language modeling task and retrieval task. Based on the analysis, a causal-inspired inference-time debiasing method is proposed, called Causal Diagnosis and Correction (CDC). CDC first diagnoses the bias effect of the perplexity and then separates the bias effect from the overall estimated relevance score. Experimental results across three domains demonstrate the superior debiasing effectiveness of CDC, emphasizing the validity of our proposed explanatory framework. Source codes are available at https://github.com/WhyDwelledOnAi/Perplexity-Trap.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。