用拓扑结构净化文本图像,抵御对抗攻击
TopoReformer: Mitigating Adversarial Attacks Using Topological Purification in OCR Models
- 通过拓扑自动编码器保留文本图像全局结构
- 在EMNIST和MNIST上对多种攻击有效防御
- 无需梯度正则,适合各类OCR模型部署
文本图像经对抗扰动后,即使人类难以察觉,也可能导致高精度OCR系统输出错误结果。部分扰动甚至能在物理拍摄中存活,威胁文档处理、车牌识别等关键应用的安全性。现有防御方法如对抗训练、输入预处理或事后校正,通常依赖特定模型、计算成本高,且影响正常输入性能,仍易受未知或自适应攻击。为此提出TopoReformer,一种模型无关的重构流程,在保持文本图像结构完整性的前提下,缓解对抗扰动。该方法基于拓扑学原理,关注形状在连续变形下不变的全局特征(如连通性、孔洞、环路),而非精确距离。利用拓扑自动编码器在隐空间强制流形一致性,提升鲁棒性,无需显式梯度正则化。在EMNIST、MNIST数据集上评估了标准攻击(FGSM、PGD、Carlini-Wagner)、自适应攻击(EOT、BDPA)及专用于OCR的水印攻击(FAWA),均表现出优异防御能力。
原文摘要 · Abstract (English)
Adversarially perturbed images of text can cause sophisticated OCR systems to produce misleading or incorrect transcriptions from seemingly invisible changes to humans. Some of these perturbations even survive physical capture, posing security risks to high-stakes applications such as document processing, license plate recognition, and automated compliance systems. Existing defenses, such as adversarial training, input preprocessing, or post-recognition correction, are often model-specific, computationally expensive, and affect performance on unperturbed inputs while remaining vulnerable to unseen or adaptive attacks. To address these challenges, TopoReformer is introduced, a model-agnostic reformation pipeline that mitigates adversarial perturbations while preserving the structural integrity of text images. Topology studies properties of shapes and spaces that remain unchanged under continuous deformations, focusing on global structures such as connectivity, holes, and loops rather than exact distance. Leveraging these topological features, TopoReformer employs a topological autoencoder to enforce manifold-level consistency in latent space and improve robustness without explicit gradient regularization. The proposed method is benchmarked on EMNIST, MNIST, against standard adversarial attacks (FGSM, PGD, Carlini-Wagner), adaptive attacks (EOT, BDPA), and an OCR-specific watermark attack (FAWA).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。