构建真实手写多位数识别数据集，揭示现有方法在实际场景中的局限。
Realistic Handwritten Multi-Digit Writer (MDW) Number Recognition Challenges
- 基于NIST手写数据构建同作者多位数数字数据集
- 单一数字分类器在多位数识别上性能显著下降
- 引入任务定制评估指标，推动真实场景下的模型优化
孤立数字分类是机器学习研究几十年来的核心问题。但在真实场景中，数字常以多位数形式出现，且由同一人书写，如邮政编码、手写支票金额和预约时间。本文利用NIST数字图像中的书写者信息，构建更贴近现实的多数字书写者（MDW）基准数据集。实验表明，尽管分类器在孤立数字上表现良好，但在多位数识别任务中性能明显下降。若要解决真实世界中的数字识别问题，仍需进一步技术突破。这些MDW基准包含任务特定的评估指标，超越传统错误率计算，更贴近实际应用影响，并为开发可利用任务知识提升性能的方法提供契机。
原文摘要 · Abstract (English)
Isolated digit classification has served as a motivating problem for decades of machine learning research. In real settings, numbers often occur as multiple digits, all written by the same person. Examples include ZIP Codes, handwritten check amounts, and appointment times. In this work, we leverage knowledge about the writers of NIST digit images to create more realistic benchmark multi-digit writer (MDW) data sets. As expected, we find that classifiers may perform well on isolated digits yet do poorly on multi-digit number recognition. If we want to solve real number recognition problems, additional advances are needed. The MDW benchmarks come with task-specific performance metrics that go beyond typical error calculations to more closely align with real-world impact. They also create opportunities to develop methods that can leverage task-specific knowledge to improve performance well beyond that of individual digit classification methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。