用深度学习同时检测书写障碍并识别困难字迹,助力早期干预。
Towards Accessible Learning: Deep Learning-Based Potential Dysgraphia Detection and OCR for Potentially Dysgraphic Handwriting
- 自研CNN模型结合预训练模型,分类准确率达91.8%。
- 对困难手写体的字符识别准确率为43.5%。
- 为教育和临床提供可落地的书写障碍辅助诊断工具。
书写障碍是一种影响书写的学龄障碍,使儿童难以写出清晰、一致的字迹。早期检测与监测对及时支持至关重要。本研究应用深度学习技术,同时解决书写障碍检测与儿童疑似书写障碍手写样本的光学字符识别(OCR)问题。基于马来西亚中小学生手写样本数据集,开发了自研卷积神经网络(CNN)模型,对比VGG16与ResNet50,自研模型在测试中达到91.8%的准确率,且精确率、召回率与AUC均表现优异,展现出识别书写障碍特征的鲁棒性。此外,构建了用于分割与识别困难手写字符的OCR流水线,字符识别准确率约为43.5%。研究证明深度学习在书写障碍评估中的潜力,为教育与临床场景中辅助工具的开发奠定基础,推动学习障碍辅助技术进步。
原文摘要 · Abstract (English)
Dysgraphia is a learning disorder that affects handwriting abilities, making it challenging for children to write legibly and consistently. Early detection and monitoring are crucial for providing timely support and interventions. This study applies deep learning techniques to address the dual tasks of dysgraphia detection and optical character recognition (OCR) on handwriting samples from children with potential dysgraphic symptoms. Using a dataset of handwritten samples from Malaysian schoolchildren, we developed a custom Convolutional Neural Network (CNN) model, alongside VGG16 and ResNet50, to classify handwriting as dysgraphic or non-dysgraphic. The custom CNN model outperformed the pre-trained models, achieving a test accuracy of 91.8% with high precision, recall, and AUC, demonstrating its robustness in identifying dysgraphic handwriting features. Additionally, an OCR pipeline was created to segment and recognize individual characters in dysgraphic handwriting, achieving a character recognition accuracy of approximately 43.5%. This research highlights the potential of deep learning in supporting dysgraphia assessment, laying a foundation for tools that could assist educators and clinicians in identifying dysgraphia and tracking handwriting progress over time. The findings contribute to advancements in assistive technologies for learning disabilities, offering hope for more accessible and accurate diagnostic tools in educational and clinical settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。