用超图结构增强医学问答,显著减少大模型幻觉。
Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generation
- 构建超图捕捉知识间多对多关系,提升信息关联性。
- 在神经科数据集上平均准确率提升12.3%,优于现有方法。
- 轻量版速度翻倍,适合医疗等高可靠场景部署。
大型语言模型(LLMs)在教育、金融、医疗等领域推动内容生成与决策进步,但其在医疗领域的应用受限于幻觉问题——生成内容偏离事实,可能引发严重后果。为此,本文提出超图驱动的检索增强生成方法Hyper-RAG,全面捕捉领域知识中的成对及非成对关联,有效缓解幻觉。在NeurologyCrop数据集上,六种主流LLM测试显示,Hyper-RAG相比直接使用LLM平均准确率提升12.3%,较Graph RAG和Light RAG分别提升6.3%和6.0%。且随着查询复杂度增加,性能保持稳定,而现有方法下降明显。跨九个数据集验证表明,基于选择性评估,其性能较Light RAG提升35.5%。轻量版Hyper-RAG-Lite实现检索速度翻倍,并带来3.3%的性能提升。结果证实Hyper-RAG能显著提升LLM可靠性,适用于医疗诊断等高风险应用。
原文摘要 · Abstract (English)
Large language models (LLMs) have transformed various sectors, including education, finance, and medicine, by enhancing content generation and decision-making processes. However, their integration into the medical field is cautious due to hallucinations, instances where generated content deviates from factual accuracy, potentially leading to adverse outcomes. To address this, we introduce Hyper-RAG, a hypergraph-driven Retrieval-Augmented Generation method that comprehensively captures both pairwise and beyond-pairwise correlations in domain-specific knowledge, thereby mitigating hallucinations. Experiments on the NeurologyCrop dataset with six prominent LLMs demonstrated that Hyper-RAG improves accuracy by an average of 12.3% over direct LLM use and outperforms Graph RAG and Light RAG by 6.3% and 6.0%, respectively. Additionally, Hyper-RAG maintained stable performance with increasing query complexity, unlike existing methods which declined. Further validation across nine diverse datasets showed a 35.5% performance improvement over Light RAG using a selection-based assessment. The lightweight variant, Hyper-RAG-Lite, achieved twice the retrieval speed and a 3.3% performance boost compared with Light RAG. These results confirm Hyper-RAG's effectiveness in enhancing LLM reliability and reducing hallucinations, making it a robust solution for high-stakes applications like medical diagnostics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。