用三问框架解析文档,性能超越Gemini且能在单张显卡运行
MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigm
- 通过结构-识别-关系三问设计,拆解文档解析任务
- 在450万条双语数据上训练30亿参数模型,性能领先
- 提出参数压缩方法,0.6B~1.2B小模型仍高效可用
我们提出MonkeyOCR,一种基于结构-识别-关系(SRR)三元组范式的文档解析模型。该设计将复杂多工具流程简化为三个核心问题:'它在哪里?'(结构)、'它是啥?'(识别)、'它们怎么关联?'(关系),分别对应结构检测、内容识别与关系预测。为此构建了包含450万条双语实例的MonkeyDoc数据集,覆盖十余种文档类型,弥补现有数据集任务单一、语言或类型局限的问题。基于SRR范式与MonkeyDoc,训练出一个30亿参数的文档基础模型。进一步发现参数冗余,提出连续参数退化(CPD)方法,可构建0.6B至1.2B参数的小型模型,在性能微降前提下显著提升推理速度。MonkeyOCR达到当前最优水平,超越此前开源及闭源方法,包括Gemini 2.5-Pro。模型可在单张RTX 3090 GPU上高效部署。代码与模型将公开于https://github.com/Yuliang-Liu/MonkeyOCR。
原文摘要 · Abstract (English)
We introduce MonkeyOCR, a document parsing model that advances the state of the art by leveraging a Structure-Recognition-Relation (SRR) triplet paradigm. This design simplifies what would otherwise be a complex multi-tool pipeline and avoids the inefficiencies of processing full pages with giant end-to-end models. In SRR, document parsing is abstracted into three fundamental questions - ``Where is it?'' (structure), ``What is it?'' (recognition), and ``How is it organized?'' (relation) - corresponding to structure detection, content recognition, and relation prediction. To support this paradigm, we present MonkeyDoc, a comprehensive dataset with 4.5 million bilingual instances spanning over ten document types, which addresses the limitations of existing datasets that often focus on a single task, language, or document type. Leveraging the SRR paradigm and MonkeyDoc, we trained a 3B-parameter document foundation model. We further identify parameter redundancy in this model and propose contiguous parameter degradation (CPD), enabling the construction of models from 0.6B to 1.2B parameters that run faster with acceptable performance drop. MonkeyOCR achieves state-of-the-art performance, surpassing previous open-source and closed-source methods, including Gemini 2.5-Pro. Additionally, the model can be efficiently deployed for inference on a single RTX 3090 GPU. Code and models will be released at https://github.com/Yuliang-Liu/MonkeyOCR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。