解决指代模糊问题,让RAG系统更准更可靠
From Ambiguity to Accuracy: The Transformative Effect of Coreference Resolution on Retrieval-Augmented Generation systems
- 用指代消解技术消除文档中的指代歧义
- 核心消解后检索准确率提升,问答性能显著改善
- 小模型受益更大,适合知识密集型AI应用
检索增强生成(RAG)通过结合外部文档检索与大语言模型,在提升事实一致性、减少幻觉方面发挥重要作用。然而,检索文档中的实体指代复杂性常引发歧义,影响上下文学习效果。本文系统研究了指代关系对RAG中检索与生成性能的影响,聚焦检索相关性、上下文理解与回答质量。结果表明,指代消解能有效提升检索效果,并改善问答表现。在检索任务中,经指代消解后,均值池化策略展现出更强的上下文捕捉能力。在问答任务中,较小模型从消歧过程中获益更明显,可能因其自身处理指代歧义的能力有限。本研究为理解指代复杂性带来的挑战提供了深入见解,为知识密集型AI系统的检索与生成优化提供指导。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) has emerged as a crucial framework in natural language processing (NLP), improving factual consistency and reducing hallucinations by integrating external document retrieval with large language models (LLMs). However, the effectiveness of RAG is often hindered by coreferential complexity in retrieved documents, introducing ambiguity that disrupts in-context learning. In this study, we systematically investigate how entity coreference affects both document retrieval and generative performance in RAG-based systems, focusing on retrieval relevance, contextual understanding, and overall response quality. We demonstrate that coreference resolution enhances retrieval effectiveness and improves question-answering (QA) performance. Through comparative analysis of different pooling strategies in retrieval tasks, we find that mean pooling demonstrates superior context capturing ability after applying coreference resolution. In QA tasks, we discover that smaller models benefit more from the disambiguation process, likely due to their limited inherent capacity for handling referential ambiguity. With these findings, this study aims to provide a deeper understanding of the challenges posed by coreferential complexity in RAG, providing guidance for improving retrieval and generation in knowledge-intensive AI applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。