arXiv:2511.06668cs.IRcs.LG2025-11被引 1

医疗问答中,检索到的矛盾信息会降低大模型准确性,需引入冲突感知过滤。

Contradictions in Context: Challenges for Retrieval-Augmented Generation in Healthcare

  • 构建包含澳大利亚药监局文档的基准数据集,用标题生成自然语言问题。
  • 从PubMed检索不同年份文献,评估过时证据对回答的影响。
  • 发现相似但矛盾的文献会引发模型输出不一致,需针对性过滤冲突内容。

在医疗等高风险领域,大语言模型(LLMs)易产生幻觉或错误信息,检索增强生成(RAG)通过引用外部专业文档缓解此问题。然而,若源文档存在过时或矛盾内容,仍会引入误差。本研究评估五种LLM在药物相关问题上的RAG表现:首先,基于澳大利亚治疗用品管理局(TGA)的消费者用药信息文档,将标题转为自然语言问题,构建基准数据集;其次,利用TGA标题检索PubMed摘要,并按发表年份分层,实现对过时证据的可控时间评估;最后,对比分析过时或矛盾内容对模型生成回答的频率与影响,考察LLMs如何整合和调和时间上不一致的信息。结果表明,高度相似但相互矛盾的摘要确实会降低模型性能,导致回答不一致和事实性错误。这说明仅靠检索相似性不足以保证医疗RAG的可靠性,亟需引入冲突感知过滤机制以确保高风险场景下的可信响应。

原文摘要 · Abstract (English)

In high-stakes information domains such as healthcare, where large language models (LLMs) can produce hallucinations or misinformation, retrieval-augmented generation (RAG) has been proposed as a mitigation strategy, grounding model outputs in external, domain-specific documents. Yet, this approach can introduce errors when source documents contain outdated or contradictory information. This work investigates the performance of five LLMs in generating RAG-based responses to medicine-related queries. Our contributions are three-fold: i) the creation of a benchmark dataset using consumer medicine information documents from the Australian Therapeutic Goods Administration (TGA), where headings are repurposed as natural language questions, ii) the retrieval of PubMed abstracts using TGA headings, stratified across multiple publication years, to enable controlled temporal evaluation of outdated evidence, and iii) a comparative analysis of the frequency and impact of outdated or contradictory content on model-generated responses, assessing how LLMs integrate and reconcile temporally inconsistent information. Our findings show that contradictions between highly similar abstracts do, in fact, degrade performance, leading to inconsistencies and reduced factual accuracy in model answers. These results highlight that retrieval similarity alone is insufficient for reliable medical RAG and underscore the need for contradiction-aware filtering strategies to ensure trustworthy responses in high-stakes domains.

医疗AIRAG矛盾检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。