arXiv:2412.14816cs.CV2024-12被引 7

用自然语言解释文本篡改检测结果,提升可信赖度。

TextSleuth: Towards Explainable Tampered Text Detection

  • 用大模型生成篡改文本的自然语言解释,结合像素标注。
  • 新数据集ETTD含精细标注,支持细粒度分析与跨域泛化。
  • 适合关注AI可信性、内容安全的研究者与工程师。

近年来,篡改文本检测因在信息安全中的关键作用受到越来越多关注。尽管现有方法能定位篡改区域,但其判断依据不清晰,导致结果不可靠。为此,本文提出利用大得多模态模型,通过自然语言解释篡改检测的依据。为填补该任务的数据空白,构建了大规模、多维度数据集ETTD,包含篡改区域的像素级标注和描述异常的自然语言标注。通过精心设计的查询提示(如融合掩码提示)提升生成质量,并引入OCR准确率过滤机制自动剔除低质标注。进一步提出TextSleuth模型,采用两阶段分析框架与辅助对齐提示,聚焦可疑区域,增强细粒度感知与跨域泛化能力。在ETTD及公开数据集上的实验验证了方法有效性,深入分析为后续研究提供启示。数据集与代码将开源。

原文摘要 · Abstract (English)

Recently, tampered text detection has attracted increasing attention due to its essential role in information security. Although existing methods can detect the tampered text region, the interpretation of such detection remains unclear, making the prediction unreliable. To address this problem, we propose to explain the basis of tampered text detection with natural language via large multimodal models. To fill the data gap for this task, we propose a large-scale, comprehensive dataset, ETTD, which contains both pixel-level annotations for tampered text region and natural language annotations describing the anomaly of the tampered text. Multiple methods are employed to improve the quality of the proposed data. For example, elaborate queries are introduced to generate high-quality anomaly descriptions with GPT4o. A fused mask prompt is proposed to reduce confusion when querying GPT4o to generate anomaly descriptions. To automatically filter out low-quality annotations, we also propose to prompt GPT4o to recognize tampered texts before describing the anomaly, and to filter out the responses with low OCR accuracy. To further improve explainable tampered text detection, we propose a simple yet effective model called TextSleuth, which achieves improved fine-grained perception and cross-domain generalization by focusing on the suspected region, with a two-stage analysis paradigm and an auxiliary grounding prompt. Extensive experiments on both the ETTD dataset and the public dataset have verified the effectiveness of the proposed methods. In-depth analysis is also provided to inspire further research. Our dataset and code will be open-source.

文本检测可解释性大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。