用YOLO检测合成手写稿中的阅读障碍特征,准确率超99.9%。
Explainable YOLO-Based Dyslexia Detection in Synthetic Handwriting Data
- 基于YOLOv11同时定位与分类字母,识别正常、颠倒、修正三类书写模式。
- 在合成数据上精度、召回率和F1值均超过0.999,优于传统单字识别方法。
- 适合教育者和临床医生使用,可快速筛查阅读障碍,结果易于解释。
阅读障碍影响多种语言的读写能力。本文提出一种基于YOLO的新型应用,用于在模拟真实单词的合成图像中分离并标注手写模式(正常、颠倒、修正)。首先收集个体字母,预处理为32x32样本,再组合成更大的合成‘单词’以模拟真实手写。我们的YOLOv11框架可同步定位每个字母并将其分类为三类之一,反映关键阅读障碍特征。实验显示,精度、召回率和F1值通常超过0.999,显著优于此前依赖传统CNN或迁移学习分类器(如Robaa等人的MobileNet方法)的单字识别方案。与仅孤立分析单个字母的简单流程不同,本方法处理完整单词图像,生成更真实的书写表征。尽管依赖合成数据可能带来领域差异问题,但这些实验凸显了基于YOLO的检测在快速、可解释性阅读障碍筛查中的潜力。未来工作将扩展至真实手写数据、其他语言,并引入更深入的可解释性方法,以增强教育者、临床医生和家庭的信任。
原文摘要 · Abstract (English)
Dyslexia affects reading and writing skills across many languages. This work describes a new application of YOLO-based object detection to isolate and label handwriting patterns (Normal, Reversal, Corrected) within synthetic images that resemble real words. Individual letters are first collected, preprocessed into 32x32 samples, then assembled into larger synthetic 'words' to simulate realistic handwriting. Our YOLOv11 framework simultaneously localizes each letter and classifies it into one of three categories, reflecting key dyslexia traits. Empirically, we achieve near-perfect performance, with precision, recall, and F1 metrics typically exceeding 0.999. This surpasses earlier single-letter approaches that rely on conventional CNNs or transfer-learning classifiers (for example, MobileNet-based methods in Robaa et al. arXiv:2410.19821). Unlike simpler pipelines that consider each letter in isolation, our solution processes complete word images, resulting in more authentic representations of handwriting. Although relying on synthetic data raises concerns about domain gaps, these experiments highlight the promise of YOLO-based detection for faster and more interpretable dyslexia screening. Future work will expand to real-world handwriting, other languages, and deeper explainability methods to build confidence among educators, clinicians, and families.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。