用视频检测写字时笔是否离纸,补充触屏笔的局限。
Detecting Pen-In-Air States from Video: A Proof-of-Concept Toward Complementary Handwriting Analysis

- 用YOLO追踪笔尖+运动特征分类,实现可解释的笔接触状态识别。
- 在自建数据集上达到0.805的F2分数,召回率表现优异。
- 适合需要无感采集笔离纸动作的研究与临床筛查场景。
手写动态对评估阅读障碍等发育障碍至关重要,传统方法依赖数字板捕捉信息,但仅能检测靠近书写表面的笔离纸行为,可能遗漏高抬笔动作。本文以验证可行性为目标,研究顶部视角视频能否作为不依赖板面传感的互补手段,推断笔接触状态。提出一种可解释的混合流程:基于YOLO的笔尖跟踪结合运动学特征提取与机器学习分类。构建了多样化的手写视频小规模数据集,逐帧人工标注,并采用留一视频外(LOVO)评估协议。结果表明,该方法能可靠检测笔离纸事件,最高F_2分数达0.805,在以召回率为导向的筛查场景中表现一致。研究支持视频驱动笔离纸检测的可行性,具备低成本、非侵入性优势,为未来大规模研究奠定基础。
原文摘要 · Abstract (English)
Dynamic aspects of handwriting are critical for assessing developmental disorders such as dysgraphia and are typically captured using digitizing tablets. However, tablet-based sensing restricts analysis of Pen-Up behavior to a short proximity range above the writing surface, potentially missing high-lift in-air movements. As a proof of concept, we investigate whether top-view video can provide a complementary source of information for inferring pen-contact states without relying on tablet proximity sensing. We propose an interpretable hybrid pipeline combining pen-tip tracking using a YOLO-based detector with kinematic feature extraction and machine learning classification. A pilot dataset of diverse handwriting videos was manually annotated at the frame level and evaluation used a Leave-One-Video-Out (LOVO) protocol. The method achieved reliable event-level detection of Pen-Up segments, with an F_2 score up to 0.805, consistent with the emphasis on recall in a screening-oriented setting. These results support the feasibility of video-based Pen-Up detection as a low-cost and non-intrusive complement to digitizing tablets, and provide a foundation for future large-scale studies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。