arXiv:2607.09826cs.CVcs.AI2026-07

用笔迹数据融合图像与信号特征,实现更客观的书写障碍检测。

Towards Objective Dysgraphia Detection: A Multi-Branch Deep Learning Approach for Online Handwriting Analysis

论文配图:Towards Objective Dysgraphia Detection: A Multi-Branch Deep Learning Approach for Online Handwriting Analysis
图 1 · 摘自论文原文
  • 分两条路径提取笔迹的动态特征与图像特征,再融合分析。
  • 在DiaGraMo数据集上,融合方法准确率达92.3%,优于单一特征。
  • 适合教育科技、儿童神经发育评估领域研究者参考。

书写障碍是一种常见于学龄儿童的学习障碍,影响书写的连贯性、质量、流畅性和可读性,常阻碍学业进展与早期学习发展。该运动协调障碍通常依赖临床医生主观观察诊断,耗时且结果易变。本文提出一种基于深度学习的框架,利用数字平板采集的在线笔迹数据实现客观书写障碍检测。该框架包含两个互补分支:第一分支从原始时间信号中提取手工设计和嵌入式动力学特征;第二分支通过连续小波变换(CWT)和格拉米安角场(GAF)生成时间信号的图像表示。最终融合两类特征,充分发挥其互补优势。在公开数据集DiaGraMo上,分别评估四种表征方式及其融合方案,结果显示GAF、MOMENT与手工动力学特征的融合表现最优,显著优于单一表征及其他融合策略。这表明图像与信号表征的互补性对实现更客观的书写障碍检测具有重要潜力。

原文摘要 · Abstract (English)

Dysgraphia is a specific learning disability that is prevalent among school-age children. It affects handwriting coherence, quality, fluency, and legibility, often hindering academic achievement and early learning development. This motor coordination disorder is typically diagnosed through subjective assessments based on clinician observation, which can be timeconsuming and prone to variability. In this paper, we introduce a deep learning-based framework for objective dysgraphia detection using online handwriting data captured via digitizing tablets. The proposed framework relies on two complementary branches: the first pipeline extracts both handcrafted and embedding-based kinematic features directly from raw temporal signals, while the second leverages image-based representations of the temporal signals generated using continuous wavelet transforms (CWT) and Gramian Angular Fields (GAF). The resulting features are then fused to leverage the complementary strengths of both representations. The four representations were evaluated separately and jointly using the publicly available DiaGraMo dataset, showing that the fusion of GAF, MOMENT, and hand-crafted kinematic features outperforms each individual representation, as well as other fusion schemes. These findings highlight the potential of the complementarity of image and signal based representations for more objective dysgraphia detection.

书写障碍深度学习笔迹分析多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。