arXiv:2602.07049cs.CVcs.LG2026-02中稿 · ICDAR 2026被引 1

用对比学习提升手写识别精度,不增加推理开销。

Enhancing IMU-Based Online Handwriting Recognition via Contrastive Learning with Zero Inference Overhead

  • 训练时引入辅助分支对齐传感器信号与文本语义
  • 在无名笔迹数据上字符错误率降低10.4%
  • 适合边缘设备部署,特别适用于未见过的书写风格

基于惯性测量单元(IMU)的在线手写识别为数字设备提供了纸面输入新方式。在边缘硬件上实现可提升隐私保护并降低延迟,但受限于内存。为此,我们提出误差增强对比手写识别(ECHWR)训练框架,旨在提升特征表示和识别准确率,且不增加推理成本。ECHWR在训练阶段使用临时辅助分支,将传感器信号与语义文本嵌入对齐,通过双重对比损失实现:批次内对比损失用于通用模态对齐,以及一种新颖的基于错误的对比损失,以区分正确信号与合成困难负样本。训练完成后丢弃辅助分支,使部署模型保持原有高效架构。在OnHW-Words500数据集上的评估显示,ECHWR显著优于现有基线,作者独立划分下字符错误率降低7.4%,作者依赖划分下降低10.4%。尽管消融实验表明特定挑战需特定结构与目标配置,但基于错误的对比损失在处理未见书写风格方面表现有效。

原文摘要 · Abstract (English)

Online handwriting recognition using inertial measurement units opens up handwriting on paper as input for digital devices. Doing it on edge hardware improves privacy and lowers latency, but entails memory constraints. To address this, we propose Error-enhanced Contrastive Handwriting Recognition (ECHWR), a training framework designed to improve feature representation and recognition accuracy without increasing inference costs. ECHWR utilizes a temporary auxiliary branch that aligns sensor signals with semantic text embeddings during the training phase. This alignment is maintained through a dual contrastive objective: an in-batch contrastive loss for general modality alignment and a novel error-based contrastive loss that distinguishes between correct signals and synthetic hard negatives. The auxiliary branch is discarded after training, which allows the deployed model to keep its original, efficient architecture. Evaluations on the OnHW-Words500 dataset show that ECHWR significantly outperforms state-of-the-art baselines, reducing character error rates by up to 7.4% on the writer-independent split and 10.4% on the writer-dependent split. Finally, although our ablation studies indicate that solving specific challenges require specific architectural and objective configurations, error-based contrastive loss shows its effectiveness for handling unseen writing styles.

手写识别对比学习边缘计算IMU

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。