区分作者间与作者内差异,用分词和拼接增强分别提升手写识别效果。
Tokenization vs. Augmentation: A Systematic Study of Writer Variance in IMU-Based Online Handwriting Recognition
- 用双字词分词抽象书写风格,提升跨作者泛化能力。
- 拼接增强使字符错误率降34.5%,词错误率降25.4%。
- 适合处理书写风格差异大或数据稀疏的在线手写识别任务。
基于惯性测量单元的在线手写识别可在不同书写表面上捕获输入信号,但仍受不均衡字符分布和作者间差异的挑战。本文系统研究了两种策略:子词分词与基于拼接的数据增强。在OnHW-Words500数据集上的实验揭示了应对作者间与作者内变异的明显差异。在独立于作者的划分下,通过双字词分词实现结构抽象显著提升了对未见书写风格的泛化能力,将词错误率(WER)从15.40%降至12.99%。而在依赖作者的划分下,分词因训练与验证集词汇分布偏移导致性能下降。相反,提出的拼接式数据增强作为强正则化手段,使字符错误率降低34.5%,词错误率降低25.4%。进一步分析表明,短而低层次的分词更利于模型表现,且拼接增强带来的性能提升超过等量扩展训练。结果表明:子词分词主要缓解作者间风格差异,而拼接增强有效弥补作者内分布稀疏问题。
原文摘要 · Abstract (English)
Inertial measurement unit-based online handwriting recognition enables the recognition of input signals collected across different writing surfaces but remains challenged by uneven character distributions and inter-writer variability. In this work, we systematically investigate two strategies to address these issues: subword tokenization and concatenation-based data augmentation. Our experiments on the OnHW-Words500 dataset reveal a clear dichotomy between handling inter-writer and intra-writer variance. On the writer-independent split, structural abstraction via Bigram tokenization significantly improves generalization to unseen writing styles, reducing the word error rate (WER) from 15.40% to 12.99%. In contrast, on the writer-dependent split, tokenization degrades performance due to vocabulary distribution shifts between the training and validation sets. Instead, our proposed concatenation-based data augmentation acts as a powerful regularizer, reducing the character error rate by 34.5% and the WER by 25.4%. Further analysis shows that short, low-level tokens benefit model performance and that the performance gains from concatenation-based data augmentation surpass those achieved by proportionally extended training. These findings reveal a clear variance-dependent effect: subword tokenization primarily mitigates inter-writer stylistic variability, whereas concatenation-based data augmentation effectively compensates for intra-writer distributional sparsity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。