构建越南医疗法规多跳问答数据集,支持跨文本法律推理。
ViHERMES: A Graph-Grounded Multihop Question Answering Benchmark and System for Vietnamese Healthcare Regulations
- 基于语义聚类与图挖掘生成多跳问题,确保逻辑依赖真实
- 提出图感知检索框架,显著提升法规问答准确率
- 专为低资源语言设计,适合法律与医疗AI研究者使用
由于医疗法规具有层级结构且频繁通过修订和交叉引用更新,对监管文档进行问答需跨文本的多跳推理,挑战极大。现有检索增强与图方法在该领域缺乏系统评估,尤其针对低资源语言如越南语。本文提出越南医疗法规多跳问答数据集(ViHERMES),包含需跨多部法规推理的高质量问答对,涵盖修订追踪、跨文档对比与流程合成等多样依赖模式。通过语义聚类与图启发式数据挖掘构建生成管道,并利用大模型生成带结构证据与推理标注的答案。进一步提出图感知检索框架,建模法律单元间的正式关系,支持合法且连贯的上下文扩展。实验表明,ViHERMES构成具有挑战性的评估基准,所提方法优于强基线。数据集与系统开源:https://github.com/ura-hcmut/ViHERMES。
原文摘要 · Abstract (English)
Question Answering (QA) over regulatory documents is inherently challenging due to the need for multihop reasoning across legally interdependent texts, a requirement that is particularly pronounced in the healthcare domain where regulations are hierarchically structured and frequently revised through amendments and cross-references. Despite recent progress in retrieval-augmented and graph-based QA methods, systematic evaluation in this setting remains limited, especially for low-resource languages such as Vietnamese, due to the lack of benchmark datasets that explicitly support multihop reasoning over healthcare regulations. In this work, we introduce the Vietnamese Healthcare Regulations-Multihop Reasoning Dataset (ViHERMES), a benchmark designed for multihop QA over Vietnamese healthcare regulatory documents. ViHERMES consists of high-quality question-answer pairs that require reasoning across multiple regulations and capture diverse dependency patterns, including amendment tracing, cross-document comparison, and procedural synthesis. To construct the dataset, we propose a controlled multihop QA generation pipeline based on semantic clustering and graph-inspired data mining, followed by large language model-based generation with structured evidence and reasoning annotations. We further present a graph-aware retrieval framework that models formal legal relations at the level of legal units and supports principled context expansion for legally valid and coherent answers. Experimental results demonstrate that ViHERMES provides a challenging benchmark for evaluating multihop regulatory QA systems and that the proposed graph-aware approach consistently outperforms strong retrieval-based baselines. The ViHERMES dataset and system implementation are publicly available at https://github.com/ura-hcmut/ViHERMES.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。