提出两种方法解析报纸图像的层级结构,提升历史文献数字化效率。
Towards Hierarchical Structure Understanding of Newspaper Images

- 分步式流程结合现成模型,灵活可解释
- 端到端模型Tiramisu用迭代注意力建模层级结构
- 新数据集支持历史报纸信息检索评估
由于报纸图像具有复杂嵌套的层级结构和密集异构的版面布局,理解其内容仍具挑战。本文探索两种互补方法:一是基于模块化自下而上流程,融合YOLO进行版面检测、LayoutReader预测阅读顺序,并采用自研算法完成文章分割;二是提出Tiramisu(分层变压器),一种端到端的Transformer架构,通过迭代分层过程显式建模文档层级,实现章节与文章分离、区块定位、语义分类及阅读顺序预测,依赖高度并行化的注意力机制。最后,我们发布了专门用于评估历史报纸中层级信息检索的全新数据集Finlam La Liberté。实验表明,两种方法均能有效重构复杂报纸层级结构,对比分析揭示了各自在可扩展文档数字化中的优势。Tiramisu训练代码(含合成报纸生成器)已开源。
原文摘要 · Abstract (English)
Understanding newspaper images remains a challenging task due to their complex, nested hierarchical structures and dense, heterogeneous layouts. In this paper, we explore two complementary approaches for newspaper structure understanding. First, we present a modular bottom-up pipeline that combines state-of-the-art open-source models: YOLO for layout detection, LayoutReader for reading order prediction, and a custom algorithm for article segmentation. This approach leverages existing robust components while maintaining flexibility and interpretability. Second, we introduce Tiramisu (Tiered Transformers for Hierarchical Structure Understanding), a novel end-to-end transformer-based architecture that explicitly models document hierarchy through an iterative tiered process. Tiramisu performs section and article separation, block localization, semantic categorization, and reading order prediction using highly parallelized attention mechanisms. Finally, we release Finlam La Liberté, a new dataset designed specifically for evaluating hierarchical information retrieval in historical newspapers. Experimental results demonstrate the effectiveness of both approaches in reconstructing complex newspaper hierarchies, with comparative analysis highlighting their respective strengths for scalable document digitization. The Tiramisu training code, including the synthetic newspaper generator, is available at https://git.litislab.fr/tiramisu/tiramisu-newspaper-articles-extractor.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。