arXiv:2607.13639cs.CVcs.AI2026-07被引 1

0.8B模型端到端解析文档,生成自然顺序的Markdown。

OvisOCR2 Technical Report

论文配图:OvisOCR2 Technical Report
图 1 · 摘自论文原文
  • 端到端设计,直接从图像输出包含文本、公式、表格的Markdown。
  • 在OmniDocBench上达96.58分,超越传统流水线方法。
  • 支持长尾和复杂场景,适合实际文档处理应用。

我们提出OvisOCR2,一个0.8B参数的文档解析模型。该模型为端到端设计:输入文档图像后,生成按自然阅读顺序排列的Markdown内容,涵盖文本、公式、表格和视觉区域。我们构建了一个数据引擎,结合真实文档标注与基于同一HTML源生成的合成页面图像及目标Markdown。训练流程包括监督微调、4B模型上的强化学习(多组件奖励设计)、对0.8B模型的在线蒸馏及模型融合。在OmniDocBench v1.6上,OvisOCR2取得96.58的领先综合得分,使端到端模型首次超越以往以流水线方法为主导的榜单,凸显其潜力。在PureDocBench上,获得75.06的最高Avg3得分。此外,在内部设计的长尾与挑战性场景基准测试中,也表现最佳,验证了其泛化与鲁棒性。OvisOCR2已开源,地址:https://huggingface.co/ATH-MaaS/OvisOCR2。

原文摘要 · Abstract (English)

We introduce OvisOCR2, a 0.8B document parsing model. OvisOCR2 is designed as an end-to-end parser: given a document page image, it generates a Markdown representation in natural reading order, covering text, formulas, tables, and visual regions. We build a data engine that combines filtered real-document annotations with synthetic pages whose rendered images and Markdown targets are derived from the same HTML source. The training recipe includes supervised fine-tuning, reinforcement learning on a 4B branch with a multi-component reward design, on-policy distillation into the 0.8B model, and model fusion. On OmniDocBench v1.6, OvisOCR2 achieves a state-of-the-art overall score of 96.58, placing an end-to-end model at the top of this leaderboard previously dominated by pipeline methods and highlighting the potential of end-to-end document parsing. On PureDocBench, OvisOCR2 also achieves the highest Avg3 score of 75.06. Beyond these two public benchmarks, we evaluate OvisOCR2 on an in-house benchmark designed to cover a broader set of long-tail and challenging scenarios. OvisOCR2 obtains the best overall performance among the compared methods, providing further evidence of its generalization and robustness. OvisOCR2 is available at https://huggingface.co/ATH-MaaS/OvisOCR2.

文档解析端到端Markdown生成0.8B模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。