arXiv:2606.01747cs.CLcs.AI2026-06

用BERT与图神经网络从古籍中自动构建知识图谱

Construction of Historical Knowledge Graphs Based on BERT and Graph Neural Networks

  • 结合BERT与GNN提取历史文本中的实体和关系
  • 在市志、议会文件等数据上实现更高准确率
  • 适合历史学者与数字人文研究者使用

通过数字人文研究与大规模历史数据分析,大量传统历史文本被转化为结构化知识图谱。本文提出一种融合双向编码器表示模型(BERT)与图神经网络(GNN)的高层架构,用于从多种类型的历史文本中提取实体与关系。该方法系统性地解决了古籍中的语言歧义、上下文依赖指代及缺乏规范语法等问题。实验基于地方志、议会文件与历史书信等综合性语料库展开,相较于传统规则方法与其他主流深度学习基线模型,联合的BERT-GNN系统在精度、召回率与F1分数上均表现更优(见表2)。该结构能够以较高准确度与全面性处理复杂的嵌套结构与隐含指代问题。实验表明,将关系图学习算法与上下文敏感的语义表示技术结合,可实现历史数据的自动化抽取,为知识库持续积累历史智慧。

原文摘要 · Abstract (English)

Through digital humanities research and scale-up historical data analysis, a significant amount of traditional historical text is converted into structured knowledge graphs. This paper provides a high-level architecture that combines bidirectional encoder representations of transformers (BERT) and graph neural networks (GNN) to extract the entities and relationships from various types of historical texts. The texts of traditional history resolve linguistic ambiguities, references limited by context, and a lack of established grammatical norms in a systematic way. This study develops a new image retrieval system based on FastRQNet and pre-trained vision-language model Vilt-qaformer+RoBInet in accordance with the aforementioned recommendations. The experiments make full use of a comprehensive collection of municipal records, parliamentary documents, and historical correspondence. When compared to conventional rule-based techniques and other popular deep-learning baselines, the joint BERT-GNN system obtains greater Precision, Recall, and F1-score (Table 2). Complex nested structures and implicit reference issues can be handled by this structure with sufficient accuracy and thoroughness when creating knowledge graphs. The aforementioned experiments show that combining relational graph learning algorithms with context-sensitive semantic representation techniques can automatically extract historical data to add accumulated wisdom to the knowledge repository.

知识图谱历史文献BERT图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。