arXiv:2602.19828cs.CV2026-02AAAI被引 7

用强化学习提升文本篡改检测与推理能力,减少人工标注依赖。

TextShield-R1: Reinforced Reasoning for Tampered Text Detection

  • 基于强化学习构建文本篡改检测模型,通过持续预训练增强识别微小痕迹能力。
  • 在16种语言、10类篡改手法上实现超过92%的检测准确率。
  • 引入新基准TFR,支持跨语言、跨方法的全面评估,适合安全与内容审核场景。

伪造图像的泛滥带来严重安全威胁,亟需可靠的检测方法。多模态大语言模型(MLLM)在分析伪造图像和生成解释方面展现出强大潜力,但仍难以识别微小痕迹,定位篡改文本区域的准确率低,且严重依赖昂贵的人工标注。为此,我们提出TextShield-R1,首个基于强化学习的MLLM解决方案,用于篡改文本检测与推理。该方法引入取证持续预训练,通过自然图像取证和OCR任务的大规模低成本数据,实现由易到难的渐进式训练。微调阶段采用新型奖励函数的组相对策略优化,降低标注依赖并提升推理能力。推理时利用基于MLLM强文本识别能力的OCR修正方法,显著提升定位精度。此外,我们构建了文本取证推理(TFR)基准,包含超过4.5万张真实与伪造图像,覆盖16种语言、10类篡改技术及多样化领域,并附有丰富的推理型标注,可支持全面评估。TFR基准同时解决现有基准七大主要缺陷,实现跨风格、跨方法、跨语言条件下的稳健评估。大量实验表明,TextShield-R1在可解释的篡改文本检测上显著超越现有水平。

原文摘要 · Abstract (English)

The growing prevalence of tampered images poses serious security threats, highlighting the urgent need for reliable detection methods. Multimodal large language models (MLLMs) demonstrate strong potential in analyzing tampered images and generating interpretations. However, they still struggle with identifying micro-level artifacts, exhibit low accuracy in localizing tampered text regions, and heavily rely on expensive annotations for forgery interpretation. To this end, we introduce TextShield-R1, the first reinforcement learning based MLLM solution for tampered text detection and reasoning. Specifically, our approach introduces Forensic Continual Pre-training, an easy-to-hard curriculum that well prepares the MLLM for tampered text detection by harnessing the large-scale cheap data from natural image forensic and OCR tasks. During fine-tuning, we perform Group Relative Policy Optimization with novel reward functions to reduce annotation dependency and improve reasoning capabilities. At inference time, we enhance localization accuracy via OCR Rectification, a method that leverages the MLLM's strong text recognition abilities to refine its predictions. Furthermore, to support rigorous evaluation, we introduce the Text Forensics Reasoning (TFR) benchmark, comprising over 45k real and tampered images across 16 languages, 10 tampering techniques, and diverse domains. Rich reasoning-style annotations are included, allowing for comprehensive assessment. Our TFR benchmark simultaneously addresses seven major limitations of existing benchmarks and enables robust evaluation under cross-style, cross-method, and cross-language conditions. Extensive experiments demonstrate that TextShield-R1 significantly advances the state of the art in interpretable tampered text detection.

文本检测强化学习多模态伪造识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。