将手写档案表格转为可追溯的知识图谱,支持人机协作。
From Historical Tabular Image to Knowledge Graphs: A Provenance-Aware Modular Pipeline

- 分三阶段处理:表格重建、信息抽取、知识图谱构建。
- 不同重建方案下准确率差异显著,证明模块化重要性。
- 每步保留数据来源痕迹,便于人工检查与修正。
手写档案表格蕴含丰富历史信息,但将其转化为知识图谱需融合表格结构识别、手写文字识别与语义理解,属于复杂的多模态过程。端到端的AI方法常掩盖中间步骤,导致算法不透明,影响人工监督与可信度。为此,我们提出一种模块化、可溯源的流程,将手写表格图像转换为知识图谱,支持人机协作。流程分为三个阶段:表格重建、信息提取与知识图谱构建,并暴露中间结果供审查、评估与修正。关键贡献在于在每个阶段系统性集成数据溯源机制,确保所有实体和属性值均可回溯至原始视觉与文本来源。实验基于真实军事职业档案材料,三种表格重建方案的结果表明模块化设计对性能有显著影响。结合模块化与溯源机制,本工作推动了复杂历史数据从图像到知识图谱的透明、可控转化。
原文摘要 · Abstract (English)
Handwritten archival tables contain rich historical information, yet transforming them into structured representations, such as Knowledge Graphs, requires integrating table structure recognition, handwriting recognition, and semantic interpretation - a complex multimodal process. End-to-end AI implementations can obscure these steps, resulting in opaque algorithmic operations that hinder human oversight, critical assessment, and trust. To address this, we present a modular, provenance-aware pipeline to convert handwritten tabular images into KGs supporting human-AI collaboration. The pipeline decomposes the workflow into three stages - table reconstruction, information extraction, and KG construction - while exposing intermediate representations for inspection, evaluation, and correction. A key contribution of our approach is the systematic integration of data provenance at every stage, ensuring that all extracted entities and literals remain traceable to their visual and textual origins. The proposed pipeline is demonstrated through a number of experiments on real-world archival material concerning military careers. The results across three different table reconstruction variants highlight the importance of modularisation. By coupling modularity with data provenance, our work advances transparent and collaboratively controllable image-to-KG pipelines for complex historical data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。