arXiv:2512.21095cs.CV2025-12中稿 · ECCV被引 10

0.1B参数模型实现多层级文本公式统一识别,速度快且精度高。

UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameters

  • 采用分层监督与语义解耦分词器,解决结构多样性和内容混杂问题。
  • 在4000万样本数据上训练,多语言多领域测试均优于大模型。
  • 适合移动端或实时文档解析场景,兼顾速度与准确率。

文本和公式是众多文档的核心信息组件。准确高效地识别二者对构建鲁棒、通用的文档解析系统至关重要。近年来,视觉-语言模型(VLMs)在统一识别文本和公式方面取得了显著进展,但其模型庞大、计算开销高,限制了实际应用。本文提出UniRec-0.1B,一个仅含0.1B参数的统一识别模型,可实现字符、单词、行、段落及文档等多层级识别。为支持该轻量级模型的训练,我们构建了包含4000万条文本、公式及混合样本的UniRec40M大规模数据集。针对轻量级统一模型面临的两大挑战——多层级结构差异与文本/公式语义纠缠,我们引入分层监督训练机制以显式引导结构理解,并设计语义解耦分词器分离文本与公式表征。最后,我们建立覆盖中英文多领域多层级的综合评估基准。实验结果表明,UniRec-0.1B在自建及公开基准上均超越通用VLMs与领先文档解析专家模型,同时实现2-9倍加速,验证了其有效性与高效性。代码与数据集:https://github.com/Topdu/OpenOCR。

原文摘要 · Abstract (English)

Text and formulas constitute the core informational components of many documents. Accurately and efficiently recognizing both is crucial for developing robust and generalizable document parsing systems. Recently, vision-language models (VLMs) have achieved impressive unified recognition of text and formulas. However, they are large-sized and computationally demanding, restricting their usage in many applications. In this paper, we propose UniRec-0.1B, a unified recognition model with only 0.1B parameters. It is capable of performing text and formula recognition at multiple levels, including characters, words, lines, paragraphs, and documents. To implement this task, we first establish UniRec40M, a large-scale dataset comprises 40 million text, formula and mixed samples, enabling the training of a powerful yet lightweight model. Secondly, we identify two challenges when building such a lightweight but unified expert model. They are: structural variability across levels and semantic entanglement between textual and formulaic content. To tackle these, we introduce a hierarchical supervision training that explicitly guides structural comprehension, and a semantic-decoupled tokenizer that separates text and formula representations. Finally, we develop a comprehensive evaluation benchmark covering Chinese and English documents from multiple domains and with multiple levels. Experimental results on this and public benchmarks demonstrate that UniRec-0.1B outperforms both general-purpose VLMs and leading document parsing expert models, while achieving 2-9x speedup, validating its effectiveness and efficiency. Codebase and Dataset: https://github.com/Topdu/OpenOCR.

文档识别轻量模型公式识别多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。