大模型在事实检索生成中不偏爱自动生成内容,反而更看重准确性。
LLMs are Biased Evaluators But Not Biased for Retrieval Augmented Generation
- 通过模拟RAG的重排序和生成阶段,测试模型对真实内容的评价倾向。
- 在NQ、MARCO、TriviaQA等数据集上均未发现模型偏好自生成文本。
- 结果表明事实准确性主导模型输出,适合关注RAG系统可靠性的研究者参考。
近期研究表明,大型语言模型(LLMs)在评估任务中存在显著偏差,尤其倾向于偏好自我生成的内容。然而,这种偏差在以事实为导向的任务中,特别是在检索增强生成(RAG)框架下——关键词提取和事实准确性优先于风格因素——是否依然存在仍不明确。本研究通过模拟RAG框架的两个关键阶段来填补这一知识空白:第一阶段,让模型评估人类撰写与模型生成的段落,模拟点对点重排序阶段;第二阶段,进行成对阅读理解测试,模拟生成阶段。与以往显示自我偏好现象的研究结果相反,我们的实验结果表明,在RAG框架中不存在显著的自我偏好效应。相反,我们观察到即使在缺乏先验知识的情况下,事实准确性仍显著影响模型输出。该结论在三个常见问答数据集(NQ、MARCO、TriviaQA)及五种主流语言模型(GPT-3.5、GPT-4o-mini、Gemini、LLaMA3、Mistral)中保持一致。本研究为理解大模型偏差及其对RAG系统的影响提供了新见解,有助于构建更鲁棒、更无偏的LLM系统。
原文摘要 · Abstract (English)
Recent studies have demonstrated that large language models (LLMs) exhibit significant biases in evaluation tasks, particularly in preferentially rating and favoring self-generated content. However, the extent to which this bias manifests in fact-oriented tasks, especially within retrieval-augmented generation (RAG) frameworks, where keyword extraction and factual accuracy take precedence over stylistic elements, remains unclear. Our study addresses this knowledge gap by simulating two critical phases of the RAG framework. In the first phase, LLMs evaluated human-authored and model-generated passages, emulating the \textit{pointwise reranking phase}. The second phase involves conducting pairwise reading comprehension tests to simulate the \textit{generation phase}. Contrary to previous findings indicating a self-preference in rating tasks, our results reveal no significant self-preference effect in RAG frameworks. Instead, we observe that factual accuracy significantly influences LLMs' output, even in the absence of prior knowledge. These findings are consistent among three common QA datasets (NQ, MARCO, TriviaQA Datasets) and 5 widely adopted language models (GPT-3.5, GPT-4o-mini, Gemini, LLaMA3, and Mistral). Our research contributes to the ongoing discourse on LLM biases and their implications for RAG-based system, offering insights that may inform the development of more robust and unbiased LLM systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。