基于知识图谱的AI助手,提升医学问答准确性与泛化能力。
KGARevion: An AI Agent for Knowledge-Intensive Biomedical QA
- 利用大模型生成候选三元组,再通过知识图谱验证过滤错误信息。
- 在复杂医学问答中比15个基线模型平均高5.2%准确率,新数据集上提升10.4%。
- 适用于多场景医学推理,对非洲医疗等弱势群体数据有强零样本泛化能力。
生物医学推理融合结构化知识与经验性洞察。根据证据的数量、性质和上下文,研究人员和临床医生采用规则、原型或案例为基础的推理策略。有效的医疗AI模型需应对这种复杂性,同时保证可靠性与适应性。我们提出KGARevion,一种基于知识图谱的AI代理,用于回答知识密集型医学问题。接收到查询后,KGARevion借助大语言模型中的隐含知识生成相关三元组,并在底座知识图谱上进行验证,剔除错误信息,仅保留准确且上下文相关的数据用于最终回答。该多步流程增强推理能力,适配不同医学推理模式,优于缺乏有效验证机制的检索增强生成方法。在医学问答基准测试中,KGARevion相比15种模型平均提升超过5.2%的准确率。为进一步评估效果,我们构建了三个具有不同语义复杂度的新医学问答数据集,其中准确率提升达10.4%。该代理可集成多种大模型与生物医学知识图谱,适用于广泛的知识密集型任务。我们在新发布的AfriMed-QA(聚焦非洲医疗)数据集上评估,证明其在代表性不足的医疗情境下具备出色的零样本泛化能力。
原文摘要 · Abstract (English)
Biomedical reasoning integrates structured, codified knowledge with tacit, experience-driven insights. Depending on the context, quantity, and nature of available evidence, researchers and clinicians use diverse strategies, including rule-based, prototype-based, and case-based reasoning. Effective medical AI models must handle this complexity while ensuring reliability and adaptability. We introduce KGARevion, a knowledge graph-based agent that answers knowledge-intensive questions. Upon receiving a query, KGARevion generates relevant triplets by leveraging the latent knowledge embedded in a large language model. It then verifies these triplets against a grounded knowledge graph, filtering out errors and retaining only accurate, contextually relevant information for the final answer. This multi-step process strengthens reasoning, adapts to different models of medical inference, and outperforms retrieval-augmented generation-based approaches that lack effective verification mechanisms. Evaluations on medical QA benchmarks show that KGARevion improves accuracy by over 5.2% over 15 models in handling complex medical queries. To further assess its effectiveness, we curated three new medical QA datasets with varying levels of semantic complexity, where KGARevion improved accuracy by 10.4%. The agent integrates with different LLMs and biomedical knowledge graphs for broad applicability across knowledge-intensive tasks. We evaluated KGARevion on AfriMed-QA, a newly introduced dataset focused on African healthcare, demonstrating its strong zero-shot generalization to underrepresented medical contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。