通过参考点对齐笔画,精准捕捉手写笔画间的细微交互关系。
StrokeNet: Unveiling How to Learn Fine-Grained Interactions in Online Handwritten Stroke Classification
- 用参考点序列表示笔画,实现细粒度空间关系建模。
- 在CASIA-onDo数据集上准确率提升至95.54%,优于现有方法。
- 适合研究手写识别、笔画语义建模的开发者和研究人员。
笔画分类因书写风格差异、内容模糊及动态书写位置而具挑战性,核心难点在于建模笔画间的语义关系。观察发现,笔画交互通常局部集中,现有深度学习方法难以捕捉此类细粒度关系。虽点级视角可缓解此问题,但引入冗余信息。本文提出通过选择参考点并按顺序编码笔画,有效解决该问题。基于此,设计StrokeNet:将笔画表示为参考点对(点+特征向量),参考点支持空间查询,特征用于交互建模。动态为每笔画选择参考点并排序,采用内联序列注意力(ISA)模块构建上下文特征;设计跨椭圆查询(CEQ)机制,聚类参考点并在多尺度空间提取特征。最后,通过联合优化框架,利用参考点回归预测笔画类别,并通过辅助分支建模相邻笔画语义转换。实验表明,该方法在多个公开在线手写数据集上达到领先性能。尤其在CASIA-onDo数据集上,准确率从93.81%提升至95.54%,验证了方法的有效性与鲁棒性。
原文摘要 · Abstract (English)
Stroke classification remains challenging due to variations in writing style, ambiguous content, and dynamic writing positions. The core challenge in stroke classification is modeling the semantic relationships between strokes. Our observations indicate that stroke interactions are typically localized, making it difficult for existing deep learning methods to capture such fine-grained relationships. Although viewing strokes from a point-level perspective can address this issue, it introduces redundancy. However, by selecting reference points and using their sequential order to represent strokes in a fine-grained manner, this problem can be effectively solved. This insight inspired StrokeNet, a novel network architecture encoding strokes as reference pair representations (points + feature vectors), where reference points enable spatial queries and features mediate interaction modeling. Specifically, we dynamically select reference points for each stroke and sequence them, employing an Inline Sequence Attention (ISA) module to construct contextual features. To capture spatial feature interactions, we devised a Cross-Ellipse Query (CEQ) mechanism that clusters reference points and extracts features across varying spatial scales. Finally, a joint optimization framework simultaneously predicts stroke categories via reference points regression and adjacent stroke semantic transition modeling through an Auxiliary Branch (Aux-Branch). Experimental results show that our method achieves state-of-the-art performance on multiple public online handwritten datasets. Notably, on the CASIA-onDo dataset, the accuracy improves from 93.81$\%$ to 95.54$\%$, demonstrating the effectiveness and robustness of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。