arXiv:2604.06160cs.CVcs.LG2026-04被引 1

提出可分解的字符错误向量,精准定位页面OCR中的解析与识别错误。

The Character Error Vector: Decomposable errors for page-level OCR evaluation

论文配图:The Character Error Vector: Decomposable errors for page-level OCR evaluation
图 1 · 摘自论文原文
  • 将字符错误分解为解析、识别和交互三部分,定位问题根源。
  • 在古籍报纸数据集上,传统流水线方法优于端到端模型。
  • 只需简单阈值即可预测主要错误类型,F1达0.91,适合工程优化。

字符错误率(CER)是评估光学字符识别(OCR)质量的关键指标,但其假设文本已完美解析,这在实际中常不成立。当存在页面解析错误时,CER会失效,限制了其在页面级OCR评估中的应用,尤其在标签格式不统一的数据上。本文提出字符错误向量(CEV),一种基于字符袋的OCR评估方法。CEV可分解为解析错误、OCR错误和交互错误三部分,帮助研究者聚焦影响文本提取质量的关键环节。我们展示了两种实现方式:空间感知字符错误率(SpACER)和基于杰恩-申索距离的字符分布法。验证表明,CEV能有效衔接解析度量与局部度量如CER。在包含退化图像和复杂版式的档案报纸数据集上,当前先进端到端模型表现不及传统流水线方法。尽管最优使用需字符级定位信息,仅用易获取的阈值即可以F1=0.91准确预测主要错误来源。我们已将CEV开源为Python库,支持文档理解研究。

原文摘要 · Abstract (English)

The Character Error Rate (CER) is a key metric for evaluating the quality of Optical Character Recognition (OCR). However, this metric assumes that text has been perfectly parsed, which is often not the case. Under page-parsing errors, CER becomes undefined, limiting its use as a metric and making evaluating page-level OCR challenging, particularly when using data that do not share a labelling schema. We introduce the Character Error Vector (CEV), a bag-of-characters evaluator for OCR. The CEV can be decomposed into parsing and OCR, and interaction error components. This decomposability allows practitioners to focus on the part of the Document Understanding pipeline that will have the greatest impact on overall text extraction quality. The CEV can be implemented using a variety of methods, of which we demonstrate SpACER (Spatially Aware Character Error Rate) and a Character distribution method using the Jensen-Shannon Distance. We validate the CEV's performance against other metrics: first, the relationship with CER; then, parse quality; and finally, as a direct measure of page-level OCR quality. The validation process shows that the CEV is a valuable bridge between parsing metrics and local metrics like CER. We analyse a dataset of archival newspapers made of degraded images with complex layouts and find that state-of-the-art end-to-end models are outperformed by more traditional pipeline approaches. Whilst the CEV requires character-level positioning for optimal triage, thresholding on easily available values can predict the main error source with an F1 of 0.91. We provide the CEV as part of a Python library to support Document understanding research.

OCR文档理解错误分析评估指标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。