HybriDLA用混合生成法提升复杂文档布局分析精度
HybriDLA: Hybrid Generation for Document Layout Analysis
- 融合扩散与自回归机制,分层优化文本框预测
- 在DocLayNet和M^6Doc上达到83.5% mAP,领先现有方法
- 适合处理元素多样、布局复杂的现代文档分析任务
传统文档布局分析依赖经验先验或固定可学习查询,在单次前向传播中完成。尽管对早期文档中区域数较少的情况足够有效,但面对现代文档中多样的元素数量和日益复杂的版式时表现不佳。为应对这一挑战,我们提出HybriDLA,一种新颖的生成式框架,将扩散模型与自回归解码统一于单一网络层中。扩散组件通过迭代方式精炼边界框假设,自回归组件则注入语义与上下文信息,实现对高度多样化布局的精准区域预测。为进一步提升检测质量,设计了多尺度特征融合编码器,捕捉细粒度与高层视觉线索。该架构在文档布局分析任务上达到83.5%的平均精度均值(mAP)。在DocLayNet与M^6Doc基准上的大量实验表明,HybriDLA达到当前最优性能。所有数据与模型将公开于https://yufanchen96.github.io/projects/HybriDLA。
原文摘要 · Abstract (English)
Conventional document layout analysis (DLA) traditionally depends on empirical priors or a fixed set of learnable queries executed in a single forward pass. While sufficient for early-generation documents with a small, predetermined number of regions, this paradigm struggles with contemporary documents, which exhibit diverse element counts and increasingly complex layouts. To address challenges posed by modern documents, we present HybriDLA, a novel generative framework that unifies diffusion and autoregressive decoding within a single layer. The diffusion component iteratively refines bounding-box hypotheses, whereas the autoregressive component injects semantic and contextual awareness, enabling precise region prediction even in highly varied layouts. To further enhance detection quality, we design a multi-scale feature-fusion encoder that captures both fine-grained and high-level visual cues. This architecture elevates performance to 83.5% mean Average Precision (mAP). Extensive experiments on the DocLayNet and M$^6$Doc benchmarks demonstrate that HybriDLA sets a state-of-the-art performance, outperforming previous approaches. All data and models will be made publicly available at https://yufanchen96.github.io/projects/HybriDLA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。