arXiv:2512.01422cs.CV2025-12AAAI被引 3

用扩散模型提升文本识别精度与速度,首次实现超越自回归模型。

MDiff4STR: Mask Diffusion Model for Scene Text Recognition

  • 设计新型掩码扩散框架,解决训练与推理不一致问题。
  • 在多个复杂场景下准确率超越现有自回归模型,仅需3步去噪。
  • 适合追求高速高精度文本识别的工业应用和多语言场景。

掩码扩散模型(MDM)因其在效率与精度间的灵活平衡,成为视觉-语言任务中自回归模型(ARM)的有前途替代方案。本文首次将MDM引入场景文本识别(STR)任务。我们发现,原始MDM虽提升识别效率,但准确率仍落后于ARM。为此,提出MDiff4STR,通过两项专为STR优化的改进策略弥补差距。首先,识别出两个关键挑战:训练与推理阶段的噪声差异,以及推理时过度自信预测。针对前者,设计六种噪声策略以更好对齐训练与推理行为;针对后者,提出一种令牌替换噪声机制,引入非掩码噪声类型,促使模型重新审视并修正错误的高置信度预测。在标准与挑战性STR基准上进行广泛评估,涵盖不规则、艺术化、遮挡及中文文本等多种场景,并考察预训练使用情况。结果表明,MDiff4STR在所有设置中持续优于主流STR模型,准确率超越最先进自回归模型,同时保持仅需三步去噪的快速推理速度。

原文摘要 · Abstract (English)

Mask Diffusion Models (MDMs) have recently emerged as a promising alternative to auto-regressive models (ARMs) for vision-language tasks, owing to their flexible balance of efficiency and accuracy. In this paper, for the first time, we introduce MDMs into the Scene Text Recognition (STR) task. We show that vanilla MDM lags behind ARMs in terms of accuracy, although it improves recognition efficiency. To bridge this gap, we propose MDiff4STR, a Mask Diffusion model enhanced with two key improvement strategies tailored for STR. Specifically, we identify two key challenges in applying MDMs to STR: noising gap between training and inference, and overconfident predictions during inference. Both significantly hinder the performance of MDMs. To mitigate the first issue, we develop six noising strategies that better align training with inference behavior. For the second, we propose a token-replacement noise mechanism that provides a non-mask noise type, encouraging the model to reconsider and revise overly confident but incorrect predictions. We conduct extensive evaluations of MDiff4STR on both standard and challenging STR benchmarks, covering diverse scenarios including irregular, artistic, occluded, and Chinese text, as well as whether the use of pretraining. Across these settings, MDiff4STR consistently outperforms popular STR models, surpassing state-of-the-art ARMs in accuracy, while maintaining fast inference with only three denoising steps. Code: https://github.com/Topdu/OpenOCR.

文本识别扩散模型高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。