用自回归方法生成语义连贯的知识图谱,无需规则监督。
Autoregressive Models for Knowledge Graph Generation
- 将知识图谱视为三元组序列,逐个生成并保持语义一致性。
- 在IntelliGraphs上生成图谱的语义有效率达89.2%至100%。
- 适合需要可控生成或补全部分图谱的应用场景。
知识图谱生成需学习三元组间的复杂语义依赖,并满足领域有效性约束。与独立打分的链接预测不同,生成模型必须捕捉整个子图中的相互依赖关系,以生成语义连贯的结构。我们提出ARK(自回归知识图谱生成),一类将图谱视为(头实体,关系,尾实体)三元组序列的自回归模型。ARK通过数据直接学习隐式语义约束,包括类型一致性、时间有效性及关系模式,无需显式规则监督。在IntelliGraphs基准上,我们的模型在多种数据集上实现89.2%至100.0%的语义有效性,同时生成训练中未见的新图谱。我们还引入SAIL,ARK的变分扩展,通过学习的潜在表示实现可控生成,支持无条件采样和从部分图谱的条件补全。分析表明,模型容量(隐藏维度≥64)比架构深度更关键,循环架构在达到与基于Transformer的模型相当的有效性的同时,显著提升计算效率。这些结果证明自回归模型为知识图谱生成提供了有效框架,具有知识库补全和查询回答等实际应用价值。
原文摘要 · Abstract (English)
Knowledge Graph (KG) generation requires models to learn complex semantic dependencies between triples while maintaining domain validity constraints. Unlike link prediction, which scores triples independently, generative models must capture interdependencies across entire subgraphs to produce semantically coherent structures. We present ARK (Auto-Regressive Knowledge Graph Generation), a family of autoregressive models that generate KGs by treating graphs as sequences of (head, relation, tail) triples. ARK learns implicit semantic constraints directly from data, including type consistency, temporal validity, and relational patterns, without explicit rule supervision. On the IntelliGraphs benchmark, our models achieve 89.2% to 100.0% semantic validity across diverse datasets while generating novel graphs not seen during training. We also introduce SAIL, a variational extension of ARK that enables controlled generation through learned latent representations, supporting both unconditional sampling and conditional completion from partial graphs. Our analysis reveals that model capacity (hidden dimensionality >= 64) is more critical than architectural depth for KG generation, with recurrent architectures achieving comparable validity to transformer-based alternatives while offering substantial computational efficiency. These results demonstrate that autoregressive models provide an effective framework for KG generation, with practical applications in knowledge base completion and query answering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。