arXiv:2604.26048cs.CL2026-04被引 1

用知识图谱子图生成有事实依据的复杂医学问答数据

BioGraphletQA: Knowledge-Anchored Generation of Complex QA Datasets

论文配图:BioGraphletQA: Knowledge-Anchored Generation of Complex QA Datasets
图 1 · 摘自论文原文
  • 用知识图谱小片段作为提示锚点,控制问题复杂度与事实准确性
  • 生成11.9万组医学问答对,使PubMedQA准确率提升至68.5%
  • 适合需要高质量医学问答数据的研究者和低资源场景应用

本文提出一种系统化生成复杂问答数据的可扩展框架。核心是图谱片段(graphlet)锚定生成机制,利用知识图谱中最多五个节点的小子图,通过结构化提示引导大模型生成具有事实依据的问题。该框架首个实例为BioGraphletQA,一个包含119,856个问答对的生物医学知识图谱问答数据集,每条数据基于OREGANO KG中的图谱片段生成,并多数附带来自PubMed的相关文献片段。通过领域专家评估106组问答,验证了数据的科学有效性与复杂性。进一步实验表明,在低资源下用该数据增强下游任务,可使PubMedQA准确率从49.2%提升至68.5%;在全资源下,MedQA准确率从41.4%提升至44.8%。所有资源(数据集:https://zenodo.org/records/17381119,代码:https://github.com/ieeta-pt/BioGraphletQA)均公开可用,支持复现与拓展。

原文摘要 · Abstract (English)

This paper presents a principled and scalable framework for systematically generating complex Question Answering (QA) data. In the core of this framework is a graphlet-anchored generation process, where small subgraphs from a Knowledge Graph (KG) are used in a structured prompt to control the complexity and ensure the factual grounding of questions generated by Large Language Models. The first instantiation of this framework is BioGraphletQA, a new biomedical KGQA dataset of 119,856 QA pairs. Each entry is grounded in a graphlet of up to five nodes from the OREGANO KG, with most of the pairs being enriched with relevant document snippets from PubMed. We start by demonstrating the framework's value and the dataset's quality through evaluation by a domain expert on 106 QA pairs, confirming the high scientific validity and complexity of the generated data. Secondly, we establish its practical utility by showing that augmenting downstream benchmarks with our data improves accuracy on PubMedQA from 49.2% to 68.5% in a low-resource setting, and on MedQA from a 41.4% baseline to 44.8% in a full-resource setting. Our framework provides a robust and generalizable solution for creating critical resources to advance complex QA tasks, including MCQA and KGQA. All resources supporting this work, including the dataset (https://zenodo.org/records/17381119) and framework code (https://github.com/ieeta-pt/BioGraphletQA), are publicly available to facilitate use, reproducibility and extension.

知识图谱问答生成医学AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。