arXiv:2505.20513cs.CV2025-05CVPR被引 5

用少量无标注样本高效识别个性化手写文字,不依赖繁琐标注。

MetaWriter: Personalized Handwritten Text Recognition Using Meta-Learned Prompt Tuning

  • 通过元学习初始化提示词,实现仅更新1%参数的快速个性化。
  • 在RIMES和IAM数据集上超越现有方法,参数量减少20倍。
  • 适合需要低资源、快速适配的手写识别场景,如移动端应用。

手写文字识别(HTR)虽已取得进展,但跨书写风格的鲁棒性仍存挑战。传统方法缺乏测试时的作者个性化能力,现有基于梯度的元学习方法需标注样本且参数效率低,导致计算与内存开销大。为此,我们提出一种高效框架,将个性化建模为提示调优,并引入辅助图像重建任务与自监督损失,指导使用无标注测试样本进行提示适应。通过元学习优化提示初始值,确保自监督损失能有效降低识别误差。该方法仅更新模型不到1%的参数,无需耗时标注。在RIMES和IAM手写数据库上验证,性能持续优于当前最优方法,参数量减少20倍。这标志着个性化手写识别的重要进步,为资源受限场景下的可靠部署铺平道路。

原文摘要 · Abstract (English)

Recent advancements in handwritten text recognition (HTR) have enabled the effective conversion of handwritten text to digital formats. However, achieving robust recognition across diverse writing styles remains challenging. Traditional HTR methods lack writer-specific personalization at test time due to limitations in model architecture and training strategies. Existing attempts to bridge this gap, through gradient-based meta-learning, still require labeled examples and suffer from parameter-inefficient fine-tuning, leading to substantial computational and memory overhead. To overcome these challenges, we propose an efficient framework that formulates personalization as prompt tuning, incorporating an auxiliary image reconstruction task with a self-supervised loss to guide prompt adaptation with unlabeled test-time examples. To ensure self-supervised loss effectively minimizes text recognition error, we leverage meta-learning to learn the optimal initialization of the prompts. As a result, our method allows the model to efficiently capture unique writing styles by updating less than 1% of its parameters and eliminating the need for time-intensive annotation processes. We validate our approach on the RIMES and IAM Handwriting Database benchmarks, where it consistently outperforms previous state-of-the-art methods while using 20x fewer parameters. We believe this represents a significant advancement in personalized handwritten text recognition, paving the way for more reliable and practical deployment in resource-constrained scenarios.

手写识别提示调优元学习低资源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。