arXiv:2603.28028cs.CVcs.LG2026-03中稿 · the International …

用解耦语言模型实现低算力文本行识别域适应,效果接近顶尖水平。

Efficient Domain Adaptation for Text Line Recognition via Decoupled Language Models

  • 将视觉检测与语言修正分离,用预训练模型做无标注目标域纠错
  • 仅需单卡训练,算力需求降低约95%,准确率接近端到端模型
  • T5适合现代文本,ByT5能修复古籍异体字,适配不同历史文档

光学字符识别是文档数字化的关键技术,但当前先进方法受限于高昂计算成本,仅少数资源丰富机构可使用。端到端Transformer架构虽准确率高,但域适应需数百GPU小时,限制了实践者与数字人文学者的使用。本文提出一种模块化检测-纠正框架,仅用单卡训练即可达到近顶尖准确率。该方法将轻量级视觉字符检测(与领域无关)与基于T5、ByT5、BART等预训练序列模型的领域特定语言修正解耦。通过在合成噪声数据上训练纠正器,实现无需目标图像标注的域适应。在现代手写体、连笔文字和历史文献上评估发现:架构选择存在关键“帕累托前沿”——T5-Base在现代文本标准词汇上表现最佳,而ByT5-Base通过字节级重构古体拼写,在历史文档上占优。结果表明,该解耦范式在保持端到端模型准确率的同时,算力减少约95%,为复杂OCR提供了可行且高效的替代方案。

原文摘要 · Abstract (English)

Optical character recognition remains critical infrastructure for document digitization, yet state-of-the-art performance is often restricted to well-resourced institutions by prohibitive computational barriers. End-to-end transformer architectures achieve strong accuracy but demand hundreds of GPU hours for domain adaptation, limiting accessibility for practitioners and digital humanities scholars. We present a modular detection-and-correction framework that achieves near-SOTA accuracy with single-GPU training. Our approach decouples lightweight visual character detection (domain-agnostic) from domain-specific linguistic correction using pretrained sequence models including T5, ByT5, and BART. By training the correctors entirely on synthetic noise, we enable annotation-free domain adaptation without requiring labeled target images. Evaluating across modern clean handwriting, cursive script, and historical documents, we identify a critical "Pareto frontier" in architecture selection: T5-Base excels on modern text with standard vocabulary, whereas ByT5-Base dominates on historical documents by reconstructing archaic spellings at the byte level. Our results demonstrate that this decoupled paradigm matches end-to-end transformer accuracy while reducing compute by approximately 95%, establishing a viable, resource-efficient alternative to monolithic OCR architectures.

OCR域适应语言模型低资源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。