医学问答中融合多视角判断,提升检索增强生成的可靠性。
POLYRAG: Integrating Polyviews into Retrieval-Augmented Generation for Medical Applications
- 引入多视角评判机制,综合评估检索文档的时效性、权威性等
- 在真实医疗场景数据集上,性能优于传统检索方法
- 适合医疗AI系统开发与评测,尤其关注可信生成
大语言模型(LLMs)在自然语言处理、逻辑推理等方面展现出强大能力,但在医疗领域因知识更新滞后和幻觉问题受限。检索增强生成(RAG)可提供帮助,但现有方法通常简单整合检索内容,未考虑信息的时效性、权威性和一致性。我们提出PolyRAG,通过多视角判别器融合不同来源的评估观点,实现更可靠的医学RAG。为填补真实世界评估基准的空白,我们构建了PolyEVAL,包含来自医疗政策、医院与医生咨询、健康服务等场景的真实查询与文档,并标注了时效性、权威性等属性。在PolyEVAL上的大量实验表明,PolyRAG显著优于基线方法。
原文摘要 · Abstract (English)
Large language models (LLMs) have become a disruptive force in the industry, introducing unprecedented capabilities in natural language processing, logical reasoning and so on. However, the challenges of knowledge updates and hallucination issues have limited the application of LLMs in medical scenarios, where retrieval-augmented generation (RAG) can offer significant assistance. Nevertheless, existing retrieve-then-read approaches generally digest the retrieved documents, without considering the timeliness, authoritativeness and commonality of retrieval. We argue that these approaches can be suboptimal, especially in real-world applications where information from different sources might conflict with each other and even information from the same source in different time scale might be different, and totally relying on this would deteriorate the performance of RAG approaches. We propose PolyRAG that carefully incorporate judges from different perspectives and finally integrate the polyviews for retrieval augmented generation in medical applications. Due to the scarcity of real-world benchmarks for evaluation, to bridge the gap we propose PolyEVAL, a benchmark consists of queries and documents collected from real-world medical scenarios (including medical policy, hospital & doctor inquiry and healthcare) with multiple tagging (e.g., timeliness, authoritativeness) on them. Extensive experiments and analysis on PolyEVAL have demonstrated the superiority of PolyRAG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。