轻量级框架实现手写成绩单高效准确数字化,适合边缘设备部署。
Edge-Native Digitization of Handwritten Marksheets: A Hybrid Heuristic-Deep Learning Framework
- 结合OpenCV规则与改进YOLOv8,先检表结构后识字迹。
- 在EMNIST上达97.5%识别准确率,推理速度比传统OCR快95倍。
- 可在普通CPU上实时运行(29 FPS),适合真实场景文档自动化。
手写成绩单等结构化文档的数字化仍面临表结构不规则与笔迹多样性的双重挑战。尽管基于Transformer的方法如TableNet和TrOCR达到顶尖准确率,但其高计算开销使其难以在资源受限的边缘设备上部署。本文提出一种轻量级混合框架,采用OpenCV启发式流程快速检测表格结构,并使用改进的轻量级YOLOv8模型进行手写字符识别。通过移除标准YOLOv8主干中的SPPF和深层C2f模块,显著降低计算开销,同时保持高识别保真度。在EMNIST数字基准测试中,改进后的YOLOv8模型达到97.5%准确率。全面效率分析表明,本框架相比标准OCR管道实现95倍推理加速,远超新兴的大规模多模态模型(如Qwen2.5-VL)。在具有挑战性的真实成绩单数据集AMES上的定性与定量评估显示,系统能有效处理混合文本内容,弥合高性能深度学习与可扩展文档自动化之间的差距。
原文摘要 · Abstract (English)
The digitization of structured handwritten documents, such as academic marksheets, remains a significant challenge due to the dual complexity of irregular table structures and diverse handwriting styles. While recent Transformer-based approaches like TableNet and TrOCR achieve state-of-the-art accuracy, their high computational cost renders them unsuitable for resource-constrained edge deployments. This paper introduces a resource-efficient hybrid framework that integrates a heuristic OpenCV-based pipeline for rapid table structure detection with a modified lightweight YOLOv8 architecture for handwritten character recognition. By strategically removing the SPPF and deep C2f layers from the standard YOLOv8 backbone, we reduce computational overhead while maintaining high recognition fidelity. Experimental results on the EMNIST digit benchmark demonstrate that our Modified YOLOv8 model achieves 97.5% accuracy. Furthermore, we provide a comprehensive efficiency analysis showing that our framework offers a 95 times inference speedup over standard OCR pipelines and massive efficiency gains over emerging Large Multimodal Models (LMMs) like Qwen2.5-VL, achieving real-time performance 29 FPS on standard CPU hardware. A qualitative and quantitative evaluation on the AMES dataset, a challenging subset of real-world marksheets, confirms the system's robustness in handling mixed alphanumeric content, bridging the gap between high-performance deep learning and practical, scalable document automation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。