arXiv:2504.05324cs.IRcs.AI2025-04被引 14

混合检索有效降低大模型幻觉,提升回答准确率与可靠性。

Hybrid Retrieval for Hallucination Mitigation in Large Language Models: A Comparative Analysis

  • 融合关键词与语义检索,动态加权融合结果以增强相关性。
  • 在HaluBench上,混合检索使幻觉率最低,准确率最高。
  • 适合关注大模型可信生成、知识增强系统的研究者使用。

大语言模型(LLMs)在语言理解与生成方面表现优异,但易产生幻觉,输出不实或无依据的内容。检索增强生成(RAG)通过引入外部知识缓解此问题。本研究对比了三种检索方法:基于BM25的稀疏检索、使用Sentence Transformers的稠密检索,以及提出的混合检索模块。该模块结合查询扩展与动态加权的倒数排名融合(RRF)策略,融合稀疏与稠密检索结果。基于HaluBench基准数据集评估显示,混合检索在前三个文档的相关性指标(MAP、nDCG)上优于其他两种方法。进一步评估发现,采用混合检索的LLM在问答任务中准确率最高,幻觉率最低,拒答率也最低。结果表明,先进检索技术能显著提升检索相关性、降低幻觉率,增强大模型的可靠性。

原文摘要 · Abstract (English)

Large Language Models (LLMs) excel in language comprehension and generation but are prone to hallucinations, producing factually incorrect or unsupported outputs. Retrieval Augmented Generation (RAG) systems address this issue by grounding LLM responses with external knowledge. This study evaluates the relationship between retriever effectiveness and hallucination reduction in LLMs using three retrieval approaches: sparse retrieval based on BM25 keyword search, dense retrieval using semantic search with Sentence Transformers, and a proposed hybrid retrieval module. The hybrid module incorporates query expansion and combines the results of sparse and dense retrievers through a dynamically weighted Reciprocal Rank Fusion score. Using the HaluBench dataset, a benchmark for hallucinations in question answering tasks, we assess retrieval performance with metrics such as mean average precision and normalised discounted cumulative gain, focusing on the relevance of the top three retrieved documents. Results show that the hybrid retriever achieves better relevance scores, outperforming both sparse and dense retrievers. Further evaluation of LLM-generated answers against ground truth using metrics such as accuracy, hallucination rate, and rejection rate reveals that the hybrid retriever achieves the highest accuracy on fails, the lowest hallucination rate, and the lowest rejection rate. These findings highlight the hybrid retriever's ability to enhance retrieval relevance, reduce hallucination rates, and improve LLM reliability, emphasising the importance of advanced retrieval techniques in mitigating hallucinations and improving response accuracy.

大模型幻觉抑制检索增强RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。