arXiv:2510.26213cs.CV2025-10被引 2

构建百万级多样文档布局数据集,实现复杂文档的分阶段生成。

OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learning

  • 采用粗到细两阶段学习,先学通用布局规律,再微调特定领域。
  • 在多类型文档上超越现有专家模型和主流大模型,显著提升生成质量。
  • 适合需要生成报纸、杂志等多样化文档布局的研究与应用。

文档智能快速发展,但文档布局生成仍受关注不足。与传统图形或房间布局不同,文档布局元素多、结构复杂且类型多样。当前主要依赖学术论文等曼哈顿风格布局,而报纸、杂志等开放领域严重缺失。为此,我们构建了首个百万规模的OmniDocLayout-1M数据集,涵盖六类常见文档,收录自多个来源的现代布局。针对现有方法在复杂场景下难以协调长序列的问题,提出OmniDocLayout-LLM(0.5B参数),通过两阶段学习:1)基于粗粒度类别在数据集上学习通用布局原则;2)仅用少量细粒度标注样本即可迁移至特定领域。大量实验表明,该方法在M$^6$Doc数据集上多领域表现优异,显著优于现有布局生成专家及多个最新通用大模型。代码、数据集与模型将公开发布。

原文摘要 · Abstract (English)

Document AI has advanced rapidly and is attracting increasing attention. Yet, while most efforts have focused on document layout analysis (DLA), its generative counterpart, layout generation, remains underexplored. Distinct from traditional graphic layout design and room layout planning, document layout generation typically involves a larger number of elements per page and exhibits greater structural diversity and complexity. Currently, a major obstacle lies in the scarcity of diverse document layouts: academic papers with Manhattan-style structures dominate existing studies, while open-world genres such as newspapers and magazines remain severely underrepresented. To address this gap, we curate OmniDocLayout-1M, the first million-scale dataset of diverse document layouts, covering six common document types and comprising contemporary layouts collected from multiple sources. Moreover, since existing methods struggle in complex domains and often fail to arrange long sequences coherently, we introduce OmniDocLayout-LLM, a 0.5B model with designed two-stage Coarse-to-Fine learning paradigm:1) learning universal layout principles from our dataset with coarse category definitions, and 2) transferring the knowledge to a specific domain with few fine-grained annotated samples. Extensive experiments demonstrate that our approach achieves strong performance on multiple domains in M$^6$Doc dataset, substantially surpassing both existing layout generation experts and several latest general-purpose LLMs. Our code, dataset, and models will be publicly released.

文档布局生成模型大模型数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。