实时端到端分析文档布局与阅读顺序,高效精准。
RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wild

- 单模型统一处理检测、分割、分类和阅读顺序预测
- 132.1 FPS 实时推理,在多个数据集上达顶尖性能
- 适合需要快速准确文档解析的工业级应用
准确的文档布局分析仍是文档解析系统的关键瓶颈,因异构布局元素间的复杂耦合、几何畸变(如纸张弯曲、透视变化)以及多样布局结构中的阅读顺序问题。现有方法多依赖分阶段流水线或计算量大的生成式Transformer,导致误差传播且效率低。本文提出RT-DocLayout,一种高效端到端文档布局分析框架,作为文档解析的前端。该模型在仅3300万参数的架构中,统一完成布局元素的分类、检测、像素级分割和阅读顺序预测。基于RT-DETR,核心贡献是在单一查询解码器中构建联合多任务公式,同时实现分类、边界框回归、掩码生成及关系建模以推理阅读顺序。通过联合学习几何与结构表征,多任务优化显著提升对真实世界文档畸变的鲁棒性。在多个公开基准上的大量实验表明,该方法在保持132.1 FPS实时推理速度的同时,达到当前最优性能。结合下游OCR引擎后,显著提升全文档重建质量,为实际文档智能系统提供可扩展、实用的基础。
原文摘要 · Abstract (English)
Accurate document layout analysis remains a critical bottleneck for document parsing systems, due to the intricate coupling among heterogeneous document layout elements, geometric distortions (\eg, paper warping and bending, perspective variations), and reading order within diverse layout structures. Existing approaches typically rely on fragmented multi-stage pipelines or computationally heavy generative Transformer architectures, leading to error propagation and limited efficiency. In this paper, we present RT-DocLayout, a highly efficient end-to-end framework for document layout analysis, designed as a front-end for document parsing tasks. The proposed model unifies classification, detection, pixel-level segmentation, and reading order prediction for layout elements within a single 33M-parameter architecture. Built upon the RT-DETR, our key contribution is a unified multi-task formulation within a single query-based decoder that simultaneously classifies, regresses bounding box, generates masks, and constructs relationship to reason reading order. By jointly learning geometric and structural representations, RT-DocLayout introduces multi-task optimization that substantially improves robustness under real-world document distortions. Extensive experiments on public benchmarks demonstrate state-of-the-art performance in document layout analysis while maintaining real-time inference speed(132.1 FPS). When coupled with downstream OCR engines, RT-DocLayout significantly improves full-document reconstruction quality, providing a scalable and practical foundation for real-world document intelligence systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。