首个兼顾时间约束与路径长度的时序知识图谱问答生成基准
ChronoQG: Towards a Temporally Expressive and Hop-Bounded Benchmark for Temporal Knowledge Graph Question Generation

- 构建基于时间约束分类与拓扑-时间子图采样的生成框架
- 产出1.6万条经验证的时序问答数据,覆盖多类型时间约束
- 揭示现有模型在复杂时间约束下生成失效,适合时序推理研究者
知识图谱问答生成(KGQG)旨在从结构化图数据生成自然语言问题。现有基准多基于静态知识图谱,未编码事实的时间范围,无法评估生成问题是否忠实于时间有效性、事件顺序及答案决定性时间约束。本文研究时序知识图谱问答生成(TKGQG),要求生成问题同时符合支持子图与目标答案所需的时间约束。提出ChronoQG,首个兼具时间表达力与路径长度限制的基准构建框架,整合全面的时间约束分类体系、拓扑-时间子图采样与轨迹引导生成,从异构时序知识图谱构建四个基准数据集,共产生16,011条经验证的问题。在多种TKGQG设置下评估主流大模型与提示基线,结果表明现有方法在多约束场景及高阶时间约束下表现不佳。研究揭示静态与时序KGQG间显著差距,确立ChronoQG作为时序忠实问答生成的挑战性测试平台。
原文摘要 · Abstract (English)
Knowledge graph question generation (KGQG) aims to generate natural-language questions from structured graph evidence. Existing KGQG benchmarks, however, are mostly built on static knowledge graphs and do not encode the temporal scopes of graph facts. As a result, they cannot evaluate whether generated questions faithfully preserve temporal validity, event ordering, and answer-determining temporal constraints. In this paper, we study temporal knowledge graph question generation (TKGQG), where a generated question must be faithful to both the support subgraph and the temporal constraints required to identify the target answer. We propose ChronoQG, the first temporally expressive and hop-bounded benchmark construction framework for TKGQG. ChronoQG integrates a comprehensive temporal-constraint taxonomy, topology-temporal subgraph sampling, and trace-grounded question generation to construct temporally faithful questions. The framework produces four benchmark datasets from heterogeneous temporal knowledge graphs, totaling 16,011 verified questions. We evaluate representative LLM-based KGQG methods and prompting baselines across diverse TKGQG settings, including temporal-constraint counts, topological templates, and temporal-constraint types. The results show that existing methods struggle to preserve temporal constraints, especially under multi-constraint settings and harder temporal-constraint types. These findings reveal a clear gap between static KGQG and TKGQG, and establish ChronoQG as a challenging testbed for temporally faithful question generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。