arXiv:2511.19575cs.CVcs.AI2025-11被引 13

轻量级视觉语言模型,专攻文字识别,性能超商用接口。

HunyuanOCR Technical Report

  • 用轻量LLM+ViT结构,通过MLP适配器统一处理多种OCR任务。
  • 在ICDAR 2025挑战赛中1B参数模型夺冠,超越多数大模型。
  • 支持端到端无预处理,且首次证明强化学习提升OCR效果。

本文介绍HunyuanOCR,一个面向OCR任务的商用级、开源、轻量(1B参数)视觉语言模型。其架构由原生视觉变压器(ViT)与轻量级大语言模型(LLM)通过MLP适配器连接。该模型在感知任务(文本定位、解析)和语义任务(信息抽取、图文翻译)上表现卓越,优于商业API、传统流水线及更大模型(如Qwen3-VL-4B),在ICDAR 2025 DIMT挑战赛小模型赛道中排名第一,并在少于30亿参数的VLM中取得OCRBench上的最先进结果。其突破体现在三方面:1)兼顾通用性与效率,在轻量框架内支持定位、解析、信息抽取、视觉问答与翻译;2)采用纯端到端设计,消除对布局分析等预处理模块依赖,解决误差传播问题;3)验证高质量数据关键作用,并首次在工业界证明强化学习(RL)策略可显著提升OCR性能。模型已正式在HuggingFace开源,配套基于vLLM的高性能部署方案,生产效率居行业前列。期望推动前沿研究并为产业应用提供基础支撑。

原文摘要 · Abstract (English)

This paper presents HunyuanOCR, a commercial-grade, open-source, and lightweight (1B parameters) Vision-Language Model (VLM) dedicated to OCR tasks. The architecture comprises a Native Vision Transformer (ViT) and a lightweight LLM connected via an MLP adapter. HunyuanOCR demonstrates superior performance, outperforming commercial APIs, traditional pipelines, and larger models (e.g., Qwen3-VL-4B). Specifically, it surpasses current public solutions in perception tasks (Text Spotting, Parsing) and excels in semantic tasks (IE, Text Image Translation), securing first place in the ICDAR 2025 DIMT Challenge (Small Model Track). Furthermore, it achieves state-of-the-art (SOTA) results on OCRBench among VLMs with fewer than 3B parameters. HunyuanOCR achieves breakthroughs in three key aspects: 1) Unifying Versatility and Efficiency: We implement comprehensive support for core capabilities including spotting, parsing, IE, VQA, and translation within a lightweight framework. This addresses the limitations of narrow "OCR expert models" and inefficient "General VLMs". 2) Streamlined End-to-End Architecture: Adopting a pure end-to-end paradigm eliminates dependencies on pre-processing modules (e.g., layout analysis). This fundamentally resolves error propagation common in traditional pipelines and simplifies system deployment. 3) Data-Driven and RL Strategies: We confirm the critical role of high-quality data and, for the first time in the industry, demonstrate that Reinforcement Learning (RL) strategies yield significant performance gains in OCR tasks. HunyuanOCR is officially open-sourced on HuggingFace. We also provide a high-performance deployment solution based on vLLM, placing its production efficiency in the top tier. We hope this model will advance frontier research and provide a solid foundation for industrial applications.

OCR轻量模型端到端强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。