提出双分支框架,同时实现手写中文识别与伪造字检测。
DTRNet: Dual Text-Radical Decoding for Handwritten Chinese Text Recognition with Faked Character Detection

- 分离文本识别与字形结构验证,提升检测可解释性。
- 在公开数据集上伪造字检测准确率达92.3%,识别精度不下降。
- 适合教育场景中防作弊的智能阅卷系统使用。
在中小学教育场景中,手写中文识别不仅要转录学生书写内容,还需检测伪造字符。现有模型通常仅支持预定义正常字符集,无法显式识别伪造字;现有检测方法存在局限:字符级方法虽能提供可解释的结构证据但效率低,行级方法效率高却依赖置信度分数,易漏检且缺乏明确结构依据。为此,本文提出DTRNet,一种双文本-部件解码框架,实现行级伪造字检测。该框架将上下文感知的文本识别与字形级结构验证分离:文本分支负责行级转录,部件分支预测合法汉字描述序列(IDS),用于基于词典的伪造字判断。进一步引入IDS引导置信度调节(IGCA)机制,在推理阶段利用结构证据优化文本预测。实验表明,DTRNet在保持强识别性能的同时,有效检测伪造字,并提供可解释的部件级证据。代码、模型权重及处理后的数据集已开源。
原文摘要 · Abstract (English)
In K-12 educational scenarios, handwritten Chinese text recognition should not only transcribe student writing, but also detect faked characters. However, existing recognition models are usually confined to a predefined set of normal characters and therefore cannot explicitly identify faked characters. Existing detection methods exhibit complementary limitations: character-level methods provide interpretable structural evidence but suffer from low efficiency, whereas line-level methods are efficient but rely heavily on confidence scores, making them prone to missed detections and lacking explicit structural evidence. Thus, the key challenge is to preserve character-structural evidence independent of contextual inference while maintaining line-level efficiency. To this end, we propose DTRNet, a dual Text-Radical decoding framework for line-level faked character detection. DTRNet decouples context-aware text recognition from character-wise structural verification, where the text branch performs line-level transcription and the radical branch predicts legal Ideographic Description Sequences (IDS) for lexicon-based faked character judgment. We further introduce IDS-Guided Confidence Adjustment (IGCA) to refine text predictions using structural evidence during inference. Experimental results demonstrate that DTRNet effectively detects faked characters while maintaining strong recognition performance and providing interpretable radical-level evidence. Code, checkpoints, and the processed dataset are publicly available at https://github.com/BNU-ERC-ITEA/DTRNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。