首个关注图文篡改严重程度的基准,评估修改对信息含义的影响。
T-IMPACT: A Severity-Aware Benchmark for Contextual Image-Text Manipulation

- 基于语义锚点定位编辑区域,生成带严重度评分的篡改图文对。
- 包含98,786个样本,支持连续严重度评分与高低中分级标签。
- 适合研究虚假信息影响、模型对篡改严重性的感知能力。
视觉语言模型与生成编辑系统的发展使得联合篡改图像、文本或二者生成有说服力的多模态假信息变得越来越容易。然而,现有数据集主要关注真实性、上下文错位或篡改类型,很少捕捉篡改对内容解读强度的影响。我们提出T-IMPACT,首个面向图文篡改严重度的基准数据集。该数据集包含98,786个样本,涵盖原始、仅图像、仅文本及联合篡改情况,提供校准后的连续严重度信号、粗粒度低/中/高标签及支撑性标注元数据。通过提取语义锚点并空间定位,进行局部图像编辑与受控文本重写,并利用有限人工标注校准上下文影响得分。本版本以连续严重度为首要目标,高低中分组作为粗略操作区间而非平衡类别。实验表明,当前模型可恢复部分真实性信号,但严重度预测仍显著困难,且与人类判断弱相关。T-IMPACT为超越二元真假分类、研究多模态篡改的渐进式影响提供了初步基准。
原文摘要 · Abstract (English)
Recent advances in vision-language models and generative editing systems have made it increasingly easy to produce persuasive multimodal misinformation by altering images, text, or both jointly. However, existing datasets focus mainly on authenticity, out-of-context mismatch, or manipulation type, and rarely capture how strongly an edit changes the likely interpretation of a post. We introduce T-IMPACT, a first-release severity-aware benchmark for manipulated news-style image-text pairs. T-IMPACT contains 98,786 examples spanning pristine, image-only, text-only, and joint manipulations, with a calibrated continuous severity signal, coarse low/medium/high labels, and supporting grounding metadata. Starting from a news image-text pair, the pipeline extracts semantic anchors, grounds them spatially, performs localized image edits and constrained caption rewrites, and calibrates contextual-impact scores using limited human ratings. In this release, the calibrated continuous score is the primary severity target, while the low/medium/high bands should be interpreted as coarse operating buckets rather than balanced classes. Experiments show that current models recover some authenticity signal, but severity prediction remains substantially harder and only weakly aligned with human judgment. T-IMPACT provides an initial benchmark for studying multimodal manipulation beyond binary real/fake classification toward graded contextual impact.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。