用大模型将癌症指南转为可问答的结构化知识图谱
Comprehensive Modeling and Question Answering of Cancer Clinical Practice Guidelines using LLMs
- 通过自动化提取与分类,构建带上下文的癌症指南知识图谱
- 零样本与少样本学习下节点分类准确率达80.86%和88.47%
- 结合子图检索与语义推理,实现医疗问答的精准回答
癌症临床实践指南(CPGs)以图形流程形式记录诊断与治疗建议。为有效支持临床决策,需完整捕捉指南中的知识及其上下文关系。现有工作多用于构建临床决策支持系统的规则库,但对指南中完整医学知识的直接建模仍不足。本文提出一种方法,利用自动化提取与节点/关系分类,构建国家综合癌症网络(NCCN)癌症指南的上下文丰富、忠实的图表示。通过大语言模型(LLMs)进行语义增强,在零样本和少样本学习下,节点分类准确率分别达到80.86%和88.47%。同时,提出一种基于约束的自然语言问题问答方法,借助LLMs从知识库中提取相关子图,结合子图路径与语义信息生成答案,有效降低错误与幻觉风险,保障医疗问答的事实准确性。
原文摘要 · Abstract (English)
The updated recommendations on diagnostic procedures and treatment pathways for a medical condition are documented as graphical flows in Clinical Practice Guidelines (CPGs). For effective use of the CPGs in helping medical professionals in the treatment decision process, it is necessary to fully capture the guideline knowledge, particularly the contexts and their relationships in the graph. While several existing works have utilized these guidelines to create rule bases for Clinical Decision Support Systems, limited work has been done toward directly capturing the full medical knowledge contained in CPGs. This work proposes an approach to create a contextually enriched, faithful digital representation of National Comprehensive Cancer Network (NCCN) Cancer CPGs in the form of graphs using automated extraction and node & relationship classification. We also implement semantic enrichment of the model by using Large Language Models (LLMs) for node classification, achieving an accuracy of 80.86% and 88.47% with zero-shot learning and few-shot learning, respectively. Additionally, we introduce a methodology for answering natural language questions with constraints to guideline text by leveraging LLMs to extract the relevant subgraph from the guideline knowledge base. By generating natural language answers based on subgraph paths and semantic information, we mitigate the risk of incorrect answers and hallucination associated with LLMs, ensuring factual accuracy in medical domain Question Answering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。