通过时频联合建模,提升手写验证的鲁棒性。
Capturing More: Learning Multi-Domain Representations for Robust Online Handwriting Verification
- 设计时频协同模块,融合多尺度时序与频域特征。
- 在多个数据集上显著超越传统仅用时序的方法。
- 适合需要高精度手写认证的场景,如金融、政务安全。
本文提出SPECTRUM,一种时频协同模型,旨在挖掘在线手写验证(OHV)中多域表示学习的潜力。该模型包含三个核心组件:(1) 多尺度交互器,通过双模态序列交互与多尺度聚合,精细融合时序与频域特征;(2) 自门控融合模块,基于自驱动平衡动态整合全局时序与频域特征,实现微观到宏观的时频融合;(3) 多域距离验证器,利用时序与频域表示增强真伪手写样本的判别能力,优于传统仅依赖时序的方法。大量实验表明,SPECTRUM在多个基准数据集上性能领先,验证了时频多域学习的有效性。研究还发现,融合多种手写生物特征能显著提升表征判别力,为未来跨特征与生物特征域的多域方法研究提供新路径。代码已公开于https://github.com/NiceRingNode/SPECTRUM。
原文摘要 · Abstract (English)
In this paper, we propose SPECTRUM, a temporal-frequency synergistic model that unlocks the untapped potential of multi-domain representation learning for online handwriting verification (OHV). SPECTRUM comprises three core components: (1) a multi-scale interactor that finely combines temporal and frequency features through dual-modal sequence interaction and multi-scale aggregation, (2) a self-gated fusion module that dynamically integrates global temporal and frequency features via self-driven balancing. These two components work synergistically to achieve micro-to-macro spectral-temporal integration. (3) A multi-domain distance-based verifier then utilizes both temporal and frequency representations to improve discrimination between genuine and forged handwriting, surpassing conventional temporal-only approaches. Extensive experiments demonstrate SPECTRUM's superior performance over existing OHV methods, underscoring the effectiveness of temporal-frequency multi-domain learning. Furthermore, we reveal that incorporating multiple handwritten biometrics fundamentally enhances the discriminative power of handwriting representations and facilitates verification. These findings not only validate the efficacy of multi-domain learning in OHV but also pave the way for future research in multi-domain approaches across both feature and biometric domains. Code is publicly available at https://github.com/NiceRingNode/SPECTRUM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。