用AI从芬兰教会手写迁移记录中提取600万条数据,重建1800-1920年人口流动图景
Creating a Historical Migration Dataset from Finnish Church Records, 1800-1920
- 通过深度学习自动识别手写教会记录中的迁移信息
- 构建包含600万条记录的结构化数据集,覆盖20万张历史影像
- 适用于研究前工业化时代人口迁移、城市化与疾病传播
本文介绍一项大规模工作,利用数字化的芬兰教会迁移记录,构建1800至1920年间芬兰国内人口迁移的结构化数据集。这些由路德会教区保存的手写记录记载了个人与家庭的迁移情况,是研究历史人口模式的重要资料。数据集共包含超过六百万条记录,来源于约二十万张手写迁移记录的图像。数据提取采用深度学习流水线,包括版面分析、表格检测、单元格分类和手写识别。整个流程应用于所有图像,生成可用于研究的结构化数据。该数据集可支持内部迁移、城市化、家庭迁移及疾病传播等研究。以埃利马基教区为例,展示了如何重构地方性迁移历史。本工作表明,大量手写档案材料可通过自动化手段转化为支持历史与人口学研究的结构化数据。
原文摘要 · Abstract (English)
This article presents a large-scale effort to create a structured dataset of internal migration in Finland between 1800 and 1920 using digitized church moving records. These records, maintained by Evangelical-Lutheran parishes, document the migration of individuals and families and offer a valuable source for studying historical demographic patterns. The dataset includes over six million entries extracted from approximately 200,000 images of handwritten migration records. The data extraction process was automated using a deep learning pipeline that included layout analysis, table detection, cell classification, and handwriting recognition. The complete pipeline was applied to all images, resulting in a structured dataset suitable for research. The dataset can be used to study internal migration, urbanization, and family migration, and the spread of disease in preindustrial Finland. A case study from the Elimäki parish shows how local migration histories can be reconstructed. The work demonstrates how large volumes of handwritten archival material can be transformed into structured data to support historical and demographic research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。