arXiv:2603.22453cs.CLcs.SI2026-03

构建首个图像误导信息社区注释数据集,评测大模型自动生成澄清注释能力。

XNote: Benchmarking Automated Community Notes Generation for Image-based Contextual Deception

  • 基于真实社交内容构建图像误导注释数据集XNote
  • 多模型在生成准确澄清信息上表现有限,尤其对上下文细节捕捉不足
  • 适合研究内容安全、可信AI与多模态生成的学者和工程师

社区注释已成为应对社交媒体中在线欺骗的有效众包机制。然而,其依赖人工贡献者,限制了时效性和可扩展性。本文研究图像式上下文欺骗的自动化社区注释生成任务,即一张真实图片搭配误导性上下文(如时间、主体、事件)。与以往主要关注欺骗检测(二元判断真伪)的研究不同,自动化注释需生成简洁且有据可依的说明,帮助用户恢复缺失或修正的上下文。该问题因缺乏支持此任务的数据集而长期未受重视。为此,我们构建了真实世界数据集XNote,包含X条帖子及其关联的社区注释和外部上下文,并标注了主题与欺骗因素。我们进一步对一系列前沿大视觉语言模型(LVLMs)在XNote上进行基准测试,评估其在欺骗检测与注释生成任务中的表现,并与端到端方法SNIFFER及商用工具GPT-5对比。结果揭示了自动化注释生成的挑战,强调亟需改进的方法与针对该任务定制的评估指标。

原文摘要 · Abstract (English)

Community Notes have emerged as an effective crowd-sourced mechanism for combating online deception on social media platforms. However, its reliance on human contributors limits both the timeliness and scalability. In this work, we study the automated Community Notes generation task for image-based contextual deception, where an authentic image is paired with misleading context (e.g., time, entity, and event). Unlike prior work that primarily focuses on deception detection (i.e., judging whether a post is true or false in a binary manner), automated Community Notes generation requires producing concise and grounded notes that help users recover the missing or corrected context. This problem remains underexplored due to the scarcity of datasets that support this task. To address this gap, we curate a real-world dataset, XNote, comprising X posts with associated Community Notes and external contexts, along with annotations of topics and deceptive factors. We further benchmark a range of frontier large vision language models (LVLMs) on XNote, evaluating their performance on both deception detection and note generation tasks. We also compare against an end-to-end approach, SNIFFER, and a commercial tool, GPT-5. Our results highlight the challenges in automated Community Notes generation, underscoring the need for improved methods and metrics tailored for this task.

社区注释图像欺骗多模态生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。