提出UARN方法,让模型更懂甲骨文翻转后的识别一致性。
Unsupervised Attention Regularization Based Domain Adaptation for Oracle Character Recognition
- 通过注意力一致性约束,提升模型对图像翻转的鲁棒性。
- 在Oracle-241数据集上比之前最好方法高出8.5%准确率。
- 适合研究古文字识别与无监督域适应的学者使用。
甲骨文研究在中文考古与训诂学中至关重要,但真实扫描的甲骨文数据难以获取和标注,制约了识别技术的发展。本文提出一种新型无监督域自适应(UDA)方法——无监督注意力正则化网络(UARN),将已标注手写甲骨文的知识迁移到无标注扫描数据上。实验表明,现有UDA方法并不总符合人类先验,在具有翻转不变性与高类间相似性的甲骨文上表现不佳,模型解释缺乏翻转一致性与类别可分性。为此,UARN从视觉感知合理性出发,强制原图与翻转图间的注意力一致性以增强翻转鲁棒性,同时约束伪类别与最易混淆类别的注意力可分性以提升判别能力。大量实验验证,UARN不仅具备更好可解释性,在Oracle-241数据集上性能达到当前最优,显著优于先前的结构-纹理分离网络8.5%。
原文摘要 · Abstract (English)
The study of oracle characters plays an important role in Chinese archaeology and philology. However, the difficulty of collecting and annotating real-world scanned oracle characters hinders the development of oracle character recognition. In this paper, we develop a novel unsupervised domain adaptation (UDA) method, i.e., unsupervised attention regularization net?work (UARN), to transfer recognition knowledge from labeled handprinted oracle characters to unlabeled scanned data. First, we experimentally prove that existing UDA methods are not always consistent with human priors and cannot achieve optimal performance on the target domain. For these oracle characters with flip-insensitivity and high inter-class similarity, model interpretations are not flip-consistent and class-separable. To tackle this challenge, we take into consideration visual perceptual plausibility when adapting. Specifically, our method enforces attention consistency between the original and flipped images to achieve the model robustness to flipping. Simultaneously, we constrain attention separability between the pseudo class and the most confusing class to improve the model discriminability. Extensive experiments demonstrate that UARN shows better interpretability and achieves state-of-the-art performance on Oracle-241 dataset, substantially outperforming the previously structure-texture separation network by 8.5%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。