现代检索模型事实准确性远低于其基础大模型,存在严重知识丢失。
Fact or Facsimile? Evaluating the Factual Robustness of Modern Retrievers
- 用嵌入模型替代生成模型进行事实检索,但准确率大幅下降
- 最强检索器在千个干扰项下准确率从33%降至26%,对干扰项敏感
- 改写正确答案后三分之二预测出错,说明依赖表面语义而非真实事实
密集检索器和重排序器是检索增强生成(RAG)系统的核心组件,准确获取事实信息对系统可信度及防御RAG poisoning至关重要。然而,这些组件从其基于的大语言模型(LLMs)中继承了多少事实能力仍不清楚。我们对比了12个公开发布的嵌入检查点及其原始基线LLM在事实性基准上的表现。所有模型中,嵌入版本的准确率显著低于其基线,绝对下降12至43个百分点(中位数28),典型检索器准确率集中在25-35%区间,而生成模型达到60-70%。当每题候选池从4个扩大到1000个时,最强检索器的top-1准确率从33%降至26%,显示对干扰项高度敏感。统计检验表明,每个嵌入模型中,查询与正确完成项的余弦相似度显著高于错误项(p < 0.01),说明决策主要依赖表面语义相近性而非事实推理。为进一步探测此弱点,我们使用GPT-4.1改写每个正确完成项,生成保留事实但隐藏词汇线索的新测试集,发现超过三分之二原本正确的预测变为错误,整体准确率降至原水平的约三分之一。这些结果揭示了对比学习为检索器带来的系统性权衡:语义检索能力提升以损失参数化事实知识为代价。
原文摘要 · Abstract (English)
Dense retrievers and rerankers are central to retrieval-augmented generation (RAG) pipelines, where accurately retrieving factual information is crucial for maintaining system trustworthiness and defending against RAG poisoning. However, little is known about how much factual competence these components inherit or lose from the large language models (LLMs) they are based on. We pair 12 publicly released embedding checkpoints with their original base LLMs and evaluate both sets on a factuality benchmark. Across every model evaluated, the embedding variants achieve markedly lower accuracy than their bases, with absolute drops ranging from 12 to 43 percentage points (median 28 pts) and typical retriever accuracies collapsing into the 25-35 % band versus the 60-70 % attained by the generative models. This degradation intensifies under a more demanding condition: when the candidate pool per question is expanded from four options to one thousand, the strongest retriever's top-1 accuracy falls from 33 % to 26 %, revealing acute sensitivity to distractor volume. Statistical tests further show that, for every embedding model, cosine-similarity scores between queries and correct completions are significantly higher than those for incorrect ones (p < 0.01), indicating decisions driven largely by surface-level semantic proximity rather than factual reasoning. To probe this weakness, we employed GPT-4.1 to paraphrase each correct completion, creating a rewritten test set that preserved factual truth while masking lexical cues, and observed that over two-thirds of previously correct predictions flipped to wrong, reducing overall accuracy to roughly one-third of its original level. Taken together, these findings reveal a systematic trade-off introduced by contrastive learning for retrievers: gains in semantic retrieval are paid for with losses in parametric factual knowledge......
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。