用对比学习生成更逼真伪造文档图像,提升检测模型泛化能力。
Leveraging Contrastive Learning for a Similarity-Guided Tampered Document Data Generation Pipeline
- 通过对比学习构建文本块相似性判断网络,生成高质量伪造样本。
- 在多个数据集上训练的模型性能均显著优于基线方法。
- 适合从事文档篡改检测、数据增强的研究者使用。
由于数据稀缺,文档图像中的篡改文本检测极具挑战性。以往工作采用基于规则的方法生成伪造文档,但结果往往种类有限、视觉质量差,常留下明显痕迹,与真实场景中的篡改不符,导致模型难以学习鲁棒特征。为此,本文提出一种新方法:首先训练辅助网络,利用对比学习和创新的正负样本定义策略,比较文本块相似性;同时训练第二个辅助网络,评估文本块是否精确包围目标字符,避免截断或包含邻近字符。基于这两个网络设计生成流程,构建了一个能生成多样化、高质量伪造文档图像的框架。在相同训练协议下,使用本方法生成的数据集训练多个模型,并在多个开源数据集上评估,结果显示本方法在不同架构和数据集上均实现一致性能提升。
原文摘要 · Abstract (English)
Detecting tampered text in document images is a challenging task due to data scarcity. To address this, previous work has attempted to generate tampered documents using rule-based methods. However, the resulting documents often suffer from limited variety and poor visual quality, typically leaving highly visible artifacts that are rarely observed in real-world manipulations. This undermines the model's ability to learn robust, generalizable features and results in poor performance on real-world data. Motivated by this discrepancy, we propose a novel method for generating high-quality tampered document images. We first train an auxiliary network to compare text crops, leveraging contrastive learning with a novel strategy for defining positive pairs and their corresponding negatives. We also train a second auxiliary network to evaluate whether a crop tightly encloses the intended characters, without cutting off parts of characters or including parts of adjacent ones. Using a carefully designed generation pipeline that leverages both networks, we introduce a framework capable of producing diverse, high-quality tampered document images. We assess the effectiveness of our data generation pipeline by training multiple models on datasets derived from the same source images, generated using our method and existing approaches, under identical training protocols. Evaluating these models on various open-source datasets shows that our pipeline yields consistent performance improvements across architectures and datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。